It is important to seek medical evaluation when a child has both a fever and a rash, as it could indicate a more serious issue that needs to be addressed promptly. It is best not to delay in getting the appropriate treatment for your baby's condition.