I guess it was just the general shape of it. After reading your reply, I looked at it again. You are correct, it isn't a tooth, it's some kind of shell. Thanks!
What could be attached to the shell is what is left over from a burrowing organisms hole. The hole fills with sediment that cements together. When surrounding mud that turns into rock erodes, it leaves behind the cemented burrow mold. I have collected these when hunting shark teeth in Bakersfield, California at Shark tooth Hill.