I agree with Eric: the soil is not drying out enough between waterings. You need to let the surface of the soil dry completely, then water slowly and thoroughly. Let the surface dry again, water slowly and thoroughly, and so on.
If the tree is still struggling or if what you call mildew is...