Remember Bruce was the first PM to lose his seat at an election while being PM. [Howard was the only other PM to lose so far]

Perhaps it was his own right wing tendencies that caused that!