Full Transgender

Difficult topic. I sometimes wonder what would happen if people who are transgender were raised in an entirely male society without knowing females exist. Would they still get that feeling, but just not understand it? Or is it society having two genders that causes it?