Depends.

Do you _know_ you're wrong in the first place? Does anyone else _know_ you are?

What's the scope/impact of the issue?

Independent from these, staying silent means you resolve to manage on your own your guilt. And this can, no, it will be its own burden. Admitting somehow resets the relation on a shared understanding, and a shared burden: the problem is not so much the wrong done/thought anymore (what is done is done), but how you are going to fix/build back from there (which will involve an effort on everyone).

Not admitting mostly delays admission to happen, or increases the burden of keeping it concealed.

"He who asks a question is a fool for a minute; he who does not ask is a fool for life."

If you have the ability to admit when you're wrong, you look like a fool; but you dont remain that way.

Short term, admitting you're wrong. Long term, staying silent.