It’s more likely, being uncharitable, that Bilbo goes on another adventure and then we discover that Istari are capable of memory wipes.