I think people tend to do this because they don't have to put as much effort into making their snap judgement than actually getting to know someone. What I think is worse than judging by looks, is not admitting when you've made a mistake and not taking a second look at your faulty opinion.