Some things to consider:
We have instruction to avoid immoral people. This can motivate them to repent.
1 Corinthians 5:11 But now I am writing to you that you must not associate with anyone who claims to be a brother or sister but is sexually immoral or greedy, an idolater or slanderer, a drunkard or swindler. Do not even eat with such people.
2 Thessalonians 3:14 Take special note of anyone who does not obey our instruction in this letter. Do not associate with them, in order that they may feel ashamed. 15 Yet do not regard them as an enemy, but warn them as you would a fellow believer.
2 Corinthians 7:9-11 9 Now I rejoice, not that you were made sorry, but that your sorrow led to repentance. For you were made sorry in a godly manner, that you might suffer loss from us in nothing. 10 For godly sorrow produces repentance leading to salvation, not to be regretted; but the sorrow of the world produces death. 11 For observe this very thing, that you sorrowed in a godly manner: What diligence it produced in you, what clearing of yourselves, what indignation, what fear, what vehement desire, what zeal, what vindication! In all things you proved yourselves to be clear in this matter.
On the ground of sexual immorality is the one reason God will allow a divorce.
Matthew 5:32 But I say to you that everyone who divorces his wife, except on the ground of sexual immorality, makes her commit adultery, and whoever marries a divorced woman commits adultery.
These ideas come from God's word. You already spoke to your husband about these things. What else are you gonna do? God knows all the hidden details. You've been struggling with this for some time. I hope you come up with some kind of solution.