Not rising to the bait of someones taunts or accusations is the best response you can give. Not just for defusing a situation, but also for your own peace of mind. If you don't give them the reaction they want, you want be bothered by them anymore.

"Always forgive your enemies - nothing annoys them so much." - Oscar Wilde