The first three books are fantastic ideas but, honestly, the format of small vignettes spanning centuries with no recurring characters works in a novel but is terrible to adapt to the screen.
When I first heard of this adaptation, my reaction was "How are they going to make an engaging story for a TV audience out of them?"
While not perfect, after the first series I am impressed with what they have done.
The inclusion of following the emperors was a good idea that fleshes out the story, universe and gives a good counterpoint to the foundation.
A page perfect adaptation of the books would be visually boring to most people.
Avid fans of the novels must also realise that the show was made to draw in people who have never read the books. If they were to only attract people who have read the books, the show would be a failure as they would never have been able to justify the budget.