I had this problem with House of Leaves. The narrator components felt unnecessary, but I didn’t want to read only part of a book. The Navidson Record parts were fortunately compelling enough to pull me through the rest kicking and screaming. I ended up loving it and the narrator sections finally started to pay off to an extent.