It's a title of respect, not age or even status.
They're just being polite and acknowledging that you're not a child, but an adult, like they are.
You are a man aren't you?
