I took the gas off one keg and could hear the gas coming out of the gas in post when that little popet thing is in the middle. So how would I fix that? do I need to buy a whole new post?
It depends. Once you've been kegging for a while, you'll realize that this type of leak is very common. If you're lucky, the gas in poppet does it. If you're unlucky, the liquid out poppet does it. When your face is directly over it.
I usually give it a quick push with my finger, then release. This works as well as any other method I've tried. If the liquid poppet is leaking, cover it with rag or towel, then give it a quick push.
I only replace the poppet when the poppet's o-ring starts coming apart, but I've recently learned that you can actually replace that o-ring.
As far as leaving the gas on vs turning it off is concerned, I leave mine on. When you plumb your system, check all the fittings/connections with soapy water to ensure there are no leaks. Use tight fitting connections, and use teflon tape on all threads. I bought my last CO2 cylinder in October 2007, and it still has liquid CO2 in it (it's a 20lb cylinder). As long as you take care when you install your system, leaks shouldn't be an issue.
Before I bought the commercial fridge I now use, I had a freezer with a temperature controller. To pour a beer, I'd vent the excess pressure on the keg, hook up the gas (at a low dispense pressure), and pour the beer. When done for the evening, I'd top up the keg with 15-20 psi to seat the poppets to prevent leaks. Back in those days I'd go through a 20lb cylinder every 6-8 months. For me, leaving it hooked up 24/7 actually saves on gas.