Is stealing Bitcoin illegal?

This is actually a very interesting question and I think it comes down to the way it is stolen and where you are. The crime you get punished for could very well be related to your means of stealing rather than the theft itself.