Decline the meal but offer to catch up for a quick beer and exchange a couple of travel stories. A bar is always less awkward than a restaurant/cafe. If things go well and you're enjoying yourselves he can always shout you a countery.
I declined all the same - to much awks!
I don't even get time to see my real mates





