If your 4-month-old baby has been coughing for 3 weeks, it would be a good idea to consult with a doctor. It is important to monitor their eating habits, behavior, sleep, and diaper output. If there are any signs of fever or a change in behavior, it is recommended to seek medical attention to rule out any serious infections like pneumonia. It's always better to be cautious when it comes to a baby's health.