Explain!

"Can you explain to me how this lipstick got on your collar?" my suspicious wife demanded.

"No, I can't," I replied.

Spoiler:

"I distinctly remember taking off my shirt."