You have confessed to the Lord. He has done this:
Micah 7:19
New International Version
19 You will again have compassion on us;
you will tread our sins underfoot
and hurl all our iniquities into the depths of the sea.
So I think it's appropriate for you to Cast it into the sea of forgetfulness.
You shouldn't be feeling guilt about this sin. If you want to tell your wife about your past struggles, fine. But the Lord has forgiven, and freed you. It's possible it's our adversary trying to make you feel guilty.
Didn't the adversary create guilt in Adam and Eve who stayed unclothed in God's most holy presence by urging them to choose the forbidden knowledge of good & evil? Don't we also need to confess this sin of choosing the forbidden knowledge of good & evil?