He may have been a recovering racist, though. There are quite a few people who were like that. Grow up into generational racism and have internalized actual phobia of black people. Many politicians landed into this, as well as quite a few authors.