Yeast infections are bad enough when they are in the genital or folded skin areas but when it is a yeast infection of the tounge then it is quite an uncomfortable mess. When a yeast infection presents itself in the oral cavity, it is also called oral thrush and can manifest itself on the gums, palate, tongue and more.