Is it necessary to have air from the outside blowing into a closet with a 4 exhaust fan?

I wanna grow in my closet with a 4" carbon filter fan but do i need fresh air blowing in? i will be having the air that is being sucked in from the fan will be going outside the closet, is that god enough or should i have air being pumped in??