I think you handled it like 90% of us would have but you were lucky that this older gent wasn't a younger red neck with a buck knife, bat or something worse. Although, that may have changed your approach
But I agree with your thought of approaching it in a more level-headed way. But then again, it's tough because some guys are real douche bags.