Ah yes, fish. I think the closest thing taxonomy has to a definition is "a vertebrate that isn't a tetrapod". Fish are like oblongs or irrational numbers in that regard. :)