Sounds like me... I started with a guy who'd been boxing for a year, and I was 300lbs and never did a serious day of training in my life, but within a couple months we were evenly sparring because I didn't know jack t ostart with and he had to relearn a ton of things because he was self trained. I don't believe in natural ability, I think anyone could be great with the right motivation.
Hell, what you're doing with your buddy to start with was a lot more than I could start with. ten pushups would have been impossible for me.