You don't have to double down. You can just say you're sorry, or you goofed. Doing so doesn't make you any less of a person.