It is normal for a 4-month-old baby to have mucus and foam in their stools. As long as the baby is in good health, eating well, wetting diapers, soiling diapers, and gaining weight, there is usually no cause for concern. The appearance of stools can vary greatly in babies and does not necessarily indicate a problem.