How to start mining bitcoins

Don't bother using a VPS, get a baremetal server if you want to mine bitcoins.

you can stark either collecting bitcoin, like in sites like freebitcoin, or you can use your processor to mine (the last one is the most efficient) for the processor i recommend nicehashminerz