Gmod messes up my internet - anyone else?

The problem is probably your internet download speed. Once you login into a server, your client starts downloading every data file it needs which will reduce the internet speed for other users obviously.