There would have been travel in this general direction, that would have been inevitable, but it would be slower. By taking on UKIP the way he did, after losing a couple of crank MPs, he legitimised them (and Farage) in a way they hadn't been before. Cameron feared the cranks within, and without.