I think it really boils down to the fact that Rory gives off an awkward vibe. That awkwardness will put a lot of people off whether its in the lead up to the fight or right after.
Likely fans will come around to like Rory but he has to cut the crap with the taunting, shuffling and all that disrespectful behaviour. He was an absolute beast in that fight and likely will be for quite some time. He should take a page out of GSP's books and eat some humble pie and his image will benefit greatly.
Check out the new MMA Forum app for the Android