Given the country's historical treatment of its black residents, it's not surprising that white immigrants were more common throughout most of its history.