Not technically legal to harass wildlife, and this is a threatened species so there is that. Nuisance bears are shot with buckshot to 'haze' them so they know not to come around. When they are released from the cage they get shot in the azz.
They are hardly ever aggressive, I wouldn't worry about them. Just think about why they are there - there is food. Discontinue feeding them and they have no reason to be where you are. That is the politically correct answer
Now that being said, if one was trying to climb a tree I am in and/or threatening me I would have not one iota of care to shoot him with some rubber buckshot Sometimes its easier to ask for foregiveness than permission
So say for instance I don't have rubber bullets, And one climbs up my tree? Do I just try to wound him? We have a few where I deer hunt also. Never seen one myself but the landowner has and my buddy that hunts down the road said he seen one cross a pipeline a couple years ago along with catching them on camera.