Sounds like you want to do what I've done then.

Your biggest issue will be email as I'm assuming you don't have a static public IP.

I thought about doing what you're talking about - using gmail. I'd not recommend it .. I've got a gmail account that I've only ever used to send email once - a test account I set up to test the send/receive on my own set up .. and it still gets inundated with spam, so unless you want to have spam filling your inbox, I'd not recommend it.

I originally used DYN.COM for my email as it was part of the registration package, but the email aspect got taken over by DuoCircle, and I have to say I'm extremely pleased with it .. I have the email gateway with them, and the SMTP service, paying for 150 emails per day which I find is more than sufficient. Once the single MX record and SPF and DKIM are defined it just sits there working. Costs me a total of $140 pa - not expensive for email peace of mind.

The email gateway is brilliant; I don't see any spam; it all gets blocked before it gets anywhere near my server, and using SSL between the two only allowing an authenticated connection (using a long, random password), anyone trying to hack their way in to my server directly (bypassing the DuoCircle gateway) fails authentication. So no spam, and no successful hacks for the past 5 years.