Adding the following code to the bottom of the theme's style.css file will hide the Desktop Version button:
#s5_responsive_switch_mobile {
display: none;
}
On responsive sites, the mobile version and the desktop version are the same thing; the site just re-sizes and re-flows the content to fit the smaller screen. You can see this in action on your desktop by resizing the browser window to be smaller.