Obviously he did know because he said you'd be like Newman because no one likes you. Only person who liked Newman was Kramer. Everyone pretty much loathed him otherwise.