Because it was an all white Congress, and they were racist . They looked down on all other races, but especially black.