IMO part of the problem was, there was still a strong norm around "you can only block justices for being unqualified". So the Senate couldn't just say "We're blocking Bork because we don't like his philosophy" (and for that matter, because of firing Cox). They had to portray him as personally unfit.