I've actually been wondering how the hell non book readers actually follow this show.
It's very complex and in depth, and tbh you're only getting about 30% compared to the books, they simply cannot fit enough into a 10 hour season to give you the full story and character development.
Give the books a go man, if you don't enjoy the show more having read them I'll be stupidly surprised.
I'm definately gonna read the books (at least the first one) and then rewatch the whole 2 series. I know for a fact Ive missed out on loads of back story that would make it so much better.