The "mistake" part is being caught.
It was a terrible mistake, as I didn't think you would find out.
Had I had known that it would become public knowledge, I would not have done it. It was a terrible mistake.
Whether you forgive is another matter, but as pisean282311 and Georgiana85 both say, there no mistake in infidelity.