If you are missing the pictures of the icons in Remote Desktop Services Web Access, but you can still see the icon text, then it is a compatibility issue with Internet Explorer 10.
While there appears to be no actual fix there is a very easy workaround. Simply switch your RDS Web Access portal page into compatibility mode.
You can do this by clicking the icon of the torn page in Internet Explorer’s Address Bar. The page will reload in compatibility mode and you should now have matching pictures to go with the text descriptions. As long as you don’t clear your browser cache, Internet Explorer will remember the compatibility mode setting.