Just picked up this crab apple, still full of fruit. Is there a best time to remove the fruit? Can’t imagine it’s pulling energy from the tree to have it on there, but the weight of the fruit may not be ideal once the temperatures get colder and colder?