Hebrews 10:26 is a verse that requires it full context.
Now you see Grace gives us the remedy for sin so it really has nothing to do with wanting to feel better about one's in.
There is truth that grace, the cross, repentance, sorrow, desiring to walk in righteousness, to flee
evil and do good, is the remedy. And the reason we want to repent and be forgiven is because
of guilt, the conviction of sin, which is Gods work in our hearts.
And if we continued to feel guilt and condemnation, yes we would desire to do works salvation, to
try and balance the evil deeds with good deeds as many have fallen into. But it takes faith and
the Holy Spirit to take away our burden so we can walk free.
So I am confused with your response UnderGrace. Paul says this about sin and its conviction
8 Even if I caused you sorrow by my letter, I do not regret it. Though I did regret it--I see that my letter hurt you, but only for a little while--
9 yet now I am happy, not because you were made sorry, but because your sorrow led you to repentance. For you became sorrowful as God intended and so were not harmed in any way by us.
10
Godly sorrow brings repentance that leads to salvation and leaves no regret, but worldly sorrow brings death.
11 See what this godly sorrow has produced in you: what earnestness, what eagerness to clear yourselves, what indignation, what alarm, what longing, what concern, what readiness to see justice done. At every point you have proved yourselves to be innocent in this matter.
2 Cor 7
Godly sorrow brings repentance that leads to salvation.
The blood of christ cleanses our consciences
22 let us draw near to God with a sincere heart in full assurance of faith, having our hearts sprinkled
to cleanse us from a guilty conscience and having our bodies washed with pure water.
23 Let us hold unswervingly to the hope we profess, for he who promised is faithful.
24 And let us consider how we may spur one another on toward love and good deeds.
Heb 10
Amen