If your newborn's belly button is red and bleeding, it is important to continue practicing basic hygiene measures like cleaning it with water and mild soap. Keep an eye on the redness, and if it worsens, it is advisable to consult a doctor.