Is it legal to break a fence?

Technically yes, if whatever you were on was not your property it can be seen as vandalism in some cases, especially if it was private property the you can get in trouble for even going in there