This tool properly renames a Visual Studio Project and corrects all the references thoughout a solution. To use, simply compile the project and run the VSPRGui.exe file.
This project was "forked" from a codeplex project and the credit goes to Norman Koswell. I just took the project and made it work within a solution and did a bit of refactoring.