Yes, it is possible for a baby of 10 weeks to start teething. You can provide teething toys or a cold damp cloth for them to chew on to help alleviate discomfort.