All fans push out, it has to be that way. You're essentially using four fans to do the job of two... Also, if you can manage to get the intake hole to be situated such that it pulls air across the CFL's while making its way to a fan will mitigate the heat the fastest.
Actually - This is a great idea. Make a custom duct. from front intake fan - up to cfls. It will take a little room - but what's nice is it should be far enough away / a couple 90 degree angles - that light won't be coming out of the fan hole at the bottom. Then Rear exhaust - and good.
Careful though, ducting takes away CFM and pressure when it has to go through angles. Just switch all the fans to outward facing and see how that goes.