Yes, it is possible to give Tylenol and Advil at the same time for a baby with a fever. However, it is important to be cautious and avoid giving too much of either medication. It is recommended to stagger the doses and keep track of when each medication was given to avoid any mistakes. If the fever persists for more than 3 days, it is important to consult a doctor.