The "folk tale" about removing flowers is overwrought perfectionism foisted upon us by neurotic azalea growers. I know, I am an azalea grower LOL.
Unless you are in a race, trying to pay a mortgage with the proceeds of the sale of your azalea bonsai, the energy lost by allowing the tree to bloom is insignificant. The minor difference in growth rates won't make a damn bit of difference at the hobby level. And, loropetalum are not azaleas. By the time you can see and remove flower buds, the bulk of the energy that would go into the flowers has already been spent on the buds.
So relax, enjoy the flowers. Flowers are your reward for taking the trouble to water the tree. They are the reason you bought the Loropetalum rather than a boxwood or a juniper. So enjoy the flowers.