I talked the issue over (one more time) with the person who thinks I am "putting on" the fact that I don't have any sense of direction.  I think I may have finally gotten through to him so he understands my flaw.. that, or it might have been the part where I said the next time he could walk home.. ??  Peace reigns.