Buffaloes aren't exactly Main Battle Tanks you know: it's not that difficult to build fences that are able to stop them (it just won't be the light fences you have in mind).

Also, not voluntarily pushing the beasts to your fences is going to help a bit, since buffaloes don't run to cliff on their own…