Sony has always had the best controllers IMO.
I have always thought the xbox and ps controllers were pretty easy to go back and forth with. Buttons pretty much in the same positions. PS controller is smaller but it's not like the xbox controller feels too big or anything. I don't have an issue with either. Both very easy to use.