I've definitely found you have to be in the right mood to read them. The same as the Gormenghast books or even something like Gene Wolfe’s Book of the New Sun or Iain M Banks' Culture stories for me. I had to go back to the 2nd Vorrh book a few times before it clicked.