Yes, that would be an obstacle.

( stone isn't usually much of a deterrent for him but he's beginning to wonder if this place might be different. so, he doesn't make the offer to find this door and try and brute force his way through it. )

I suppose that it's too much to ask of this town to be able to find pickaxes and the like somewhere convenient, hm?