Anxiety Attacks

Hey guys so recently I've been getting some pretty alarming anxiety/panic attacks when I vape. My body feels like it's shivering from cold and when I try to control it I realize I can move the trembles all over my body. My friends say my heart beats like crazy and then of course I start getting worried which gives me that horrible pit in the stomach feeling you get when you have to go perform onstage or something. Anyway I usually start drinking beers and that calms me a little but it ruins my high, plus I have a nasty headache the next day. I'm in school and would say I'm pretty stressed out with grades and whatnot (I'm a high standard student), which of course is attributing to my anxiety when I get high. However PART of the reason I get high is so that I can relax (the other part being that it's just fucking great), and it has been relaxing up until the last couple times. I've looked all over the place for remedies people have come up with but I just want it straight. Will this anxiety subside? How can I help it go away? Or, is it here to stay and I need to just give up with weed? I really like weed and the times it hasn't given me anxiety It's been a great time and I don't want to just have to keep it on my "no go" list. If it's important I might add that I have a pretty low tolerance, I used to only smoke like once a month but now that I have a vape I've been getting high around once a week on the weekend.
 
I'd be so grateful for y'alls input.
 
Edit: It might be good to include that out of the last two times that yielded a panic attack, one was at a big rowdy party setting. Music was loud and techno-y which makes me understand why I might've been reacting so horribly to the myriad of stimuli around me, however it still doesn't explain the first time because I was just chilling with a couple friends.