Looks like a hand pump. I am betting there was an old structure there of some sorts. I would check the fields and around all the brick pieces. Good Luck and HH
I would guess 1920's or 1930's with that style of pump, but any structure on the property could very well predate that since the pump might have had to be replaced at some point. Probably an old homesite. Don't know how many churches had wells like that. Sounds good with all those surface finds, though. Good luck with it, and let us know how it turns out!