I have found that a daily hunt can cut down the numbers very quickly. Tap each pot and squish any small fly that appears, making sure that you get the ones crawling up the sides of the pot as well as those that have taken flight.
If you haven't the time for hand to wing combat then yellow sticky traps are the answer.
Yellow sticky glue traps work for me. You can buy them on holders, but I just buy a package of large sheet, cut them up, and clip them in a clothes peg hot glued to a chopstick. Some times I cut them into strips and lay them across the rim of the pot so the freshly winged ones fly directly up into it. It clears them up within a week if you have a number of traps around.
Posts