Based on the symptoms described, it is not necessary to bring the baby to the emergency room. If the baby's breathing suddenly worsens or if the fever persists continuously for more than 3 days, then it would be advisable to consult a doctor. In this case, since the fever is mild and the baby's general condition is good, you can wait until Monday to visit the pediatrician without any issue.
