Revenge of the Ronin

"This is none of your concern, peasant. Go away," You tell him calmly. Afronted, the man scowls and walks away. However, someone else, having seen someone speak up, calls to you.

"Ronin, you don't have the right to talk to him like that. Get out of our tavern!"

This is a second insult, and the honour you haveleft dictates that this man should be punished for it. Will you? Or lose more honour?