i got ants its a outdoor plant in my veggie garden idk if there living in the stem but they dug a tiny hole in the stem and everyday there seems to be like little sand grains by the hole and i keep killing a bunch of ants tha climb up and down the stem should i be worried and how do i get rid of them