Clean install of Unity?

If I want to do a clean re-install of Unity,
I should uninstall Unity and remove any in the C:\Program Files\Unity* directory.

Are there any other directories or files I should delete or remove?

If you like to clean everything up you should take a look at this folder : %appdata%\Unity (C:\Users\Username\AppData\Roaming\Unity)