How to debug Windows Store applications on Windows RT tablets

After receiving my Asus VivoTab RT tablet in the mail I’ve been enjoying it quite a bit these past days. Today, I wanted to try developing some small applications and running it on the tablet which proved to be a bit more difficult than on a Windows Phone. You can’t just plug it in the USB and click run, we have to set up Remote Debugging!