Thrush is most common in babies that are 2 months old or younger. Also known as a yeast infection, thrush often presents itself as a white fungus inside a baby's mouth or on her tongue. In many instances, no treatment is necessary - the symptoms disappear over time on their own. But if your baby seems uncomfortable, your doctor may be able to prescribe an antibiotic.