I am using organic soil so gnats have been an on and off issue for me but not since I got a bottle of azamax I would recommend it to any one with a pest problem.
You are getting fungus gnats. They tend to "appear" when the soil is allowed to stay too wet. Let the soil dry out another day or so between waterings. Once things dry out, they will go away. A Hotshot pest strip will help too.