Do People's opinions matter to you?

Absolutely. Everyone has a valid opinion and everyone has a reason for thinking the way that they do. You should always listen to what someone else has to say, you just might learn something.
Without the opinions of others it is much harder to improve yourself and experience the things around you to their fullest extent. People are your greatest resource.