I know some amazing spots to hit down there, but you'll need permission from the head of the parks department to do so. I haven't asked, but I suspect that this is a polite way of saying, "No." Maybe I'll shoot them an email one of these days. I know that there's no way in hell that they'd let me hit Yama (and this is unfortunate, because the only thing that I'd rather hit than an American ghost town is a Japanese ghost town), but I'd be happy just for Battle Point or Blakely Harbor.
Admittedly I haven't researched the island much.
Which part of the island did the Barber come out of? I'd start there.