I don't know as much about the North as I do the South. In the South, the militia was a permanent entity. Many times, the men in a militia district would vote for their officers. It's true that you had to be a land owner. But you didn't need to be a slave owner. Less than a quarter owned even 1.