I remember in some versions they were aliens who were mistaken for gods when they visited and just went with it.