I'd be inclined to avoid the area, just to avoid unpleasantness, if nothing else. As some others have noted, I'd probably also chat with some neighbors to get their read on him and his general social stability.

I think of the small town I grew up in. It was known by all the kids (and the adults) that there were some houses that you just avoided.... Crossed the street and rode your bike along the other sidewalk past that yard, then back across the street again if you wanted (yes, we did ride bikes zig-zaggy across the streets, but that didn't mean we were unsafe enough to go anywhere near XXXXX's house.)