You can block them. It doesn't remove them from your followers list but at least you won't see anything they have to post.