Cheese forms part of a balanced diet for babies and is rich in calcium, protein, fat and phosphorus and vitamins. But babies should not eat goat cheese, blue cheese, cheese made from unpasteurized milk because of the risk of listeria infection.