Fungus gnats? If so, conditions might be too wet encouraging rot. I use Bacillus thuringiensis (var. israelensis) granules in the garden during the 'rainy' season.
I had my ficus out all summer but its now in the grow room. My substrate is inorganic but I believe its green dream organic fertiliser they are attracted too.