The simple solution to this is to delete the Value "UILanguage" under "HKEY_CURRENT_USER\Software\Microsoft\VisualStudio\10.0\General" or to change its value to "0x409", which is english i think.
http://www.cnblogs.com/mikechang/archive/2010/01/21/1653486.html