I'd be more concious about the foods you are actually eating then thier caloric content.
Cut back on empty, shitty carbs and fried and processed food.
Get a lot or protein in your diet. A common misconception is that protein is going to make you "bulk" up, but the truth is protein taken daily with every meal helps boost metabolism and repair damaged muscle tissue after exercise.
Also the more muscle you have, the more efficiently you burn fat.
Keep away from excessive fats, especially saturated.
Try to keep calories around 2500-3000 per day with lots of protein and vegetables.