portsentry was specifically designed for this purpose. Beware though, dynamic port locking is a two edge sword. It can be used for a dos, as someone at evil.com can masquerade as one of your legitimate users, etc.