Honestly, it isn't people who have done what you did that worry me. It's those that constantly, constantly, CONSTANTLY sleep around with different people and then want to marry. Those ones worry me. I'm not saying anything negative about them, but those that treat sex so casually are a major red flag.
I think that those of us that have been protected and able to still say that we're virgins can forget the pain that those that aren't can feel. I have tried to be sensitive to the feelings of others, even though I can't truly fathom the depths of their pain. God has called me to radical purity and He has told me that I need to joyfully encourage others at whatever level of purity they strive for, starting at saving themselves for their spouse, even if they've already had sex in their life and are just making a new commitment to chastity and purity.
God has plans for all of us, beautiful plans, and though we've made choices in our pasts that weren't part of those plans, God knows what we've done and He still has plans for us, still values us, and still desires to bless us.
Be encouraged. Sometimes we sound a great deal harsher than we realize because we forget that others are carrying burdens in areas we ourselves do not have any weight.