PredatorCMS is the CMS which powers most of the bigger tube sites, it's a bit expensive but it's very functional.
As for servers, if you're going to host the videos yourself, you can't just get one server, you will need a few. You can use one for the webserver+DB, one as an encoding server and...