"Lost" is right. They didn't lose it, they just saw how you and Gladys didn't fit it with the people who go to ultra-popular, new Asian fusion restaurants. I mean, if I saw someone heading into my restaurant looking like this
I'd turn off the light and tell everyone to be quiet until you went away.