Yeah. That sounds great. Get in close and give him some hard knees. Just do it quick before he can react.
The most important thing though is that you don't do it unless you have to. Fights can be serious shit. You can get hurt. Only fight this guy if there is absolutely no other option.
P.S. I would really like to hear how it turns out. I hope you don't get hurt whatever happens.
Remember, egos heal better than boddies. Your not being a whimp if you don't want to fight.