You think I can start smoking again???

So here's the deal. Sorry if it's a little long...

I've been smoking for a few years, and the past year and a half smoking everyday, pretty much all day. I have always have anxiety with panic disorder but it has always been manageable and mild, the pot actually helped me a lot. I started this new birthcontrol last november and within a week I began having panic attacks that lasted 2-4 hours with severe shaking. I learned that people have reported the BC caused a severe chemical sensitivity. Basically really fucks you up.
Anyway I quit the BC because it made my anxiety unbearable and I could barely function and couldn't even go to the store. During this time I also quit smoking because all it did was make it worse and prolong the panick, or induced it.
I tried smoking again in April and out of 10 times I only panicked once for 30 minutes. I haven't smoked since but I did eat a pot cookie on 420 and had a panick attack so bad I was incoherent and a friend had to take care of me, the xanax I'm perscribed didn't even help (it usually does, and if I take one before smoking i'm fine) I basically couldn't talk much, couldn't process anything anyone was saying to me, and was trembliing from head to toe and I blacked out the last hour. I just remember waking up on the couch alone.
Things have gotten worse and my doctor started me on Zoloft and I'm now up to 50 mg. I feel great, and have nearly zero anxiety. I don't even have to take my xanax anymore.

I really want to smoke again. I can't even be around other people smoking with out getting pissed or sad that I can't participate. My boyfriend smokes constantly and he's probably more sad then I am that I can't join him anymore.
I don't know how the weed will react to the zoloft. I don't know if the zoloft will act as a preventative like the xanax did.

I guess I should also mention that the Panick attacks I have are almost 100% physical. I know the fear is irrational, and Im not paranoid ever. I just get the intense physical aspects with the "feeling of doom" and most of the time I just sit there and think "this f'n sucks, theres no reason for this to be happening!"

any suggestions or feedback would be great, thanks!

 

I asked my mom about talking to my doctor about it(she's a drug counselor) and she said to never ever mention it. I'm in Florida right now finishing school and theres a no tollerance for marijuana down here. I'm not really sure where the doctors stand