Time to go IMO. You have set goals for yourself and the current place is not helping you meet them. Its their problem if they don't understand why you need to leave.
Fighters switch up their trainers all the time in order to continue modifying their game. You want to spend more time on your ground game which they can't help you with. There is no reason you can't change gyms and drop by every now and again to maintain relations.
Stick with your goals. Good luck.