When it comes to your long-term health, calories ultimately take a back seat to the quality of foods you consume. While it’s true that you’ll lose weight if you eat less than you need, that doesn’t automatically mean your health will improve if your calories are of poor nutritional quality.