Well, the Virtual IP address and manual iptable rule did the trick! Thanks Nick.
The only problem now is, the FTP is not sending me to the flexshare ftp folder it should be sending me to.
I get to the flexshare folder if i FTP to my Public Address #1, just doesn't work for Public Address #2
Any ideas whats up with that?