It implies a really dumb analogy, because while the point may well apply to the social structures Lorde was talking about, it does not at all apply to buildings. And if you get rid of the master then you should keep the house. It’s rightfully yours!