I already addressed this issue when I posted about Sections 6 , 7, 8, 9, and 10 of the following article (starting with the Section named
"The Two Goats of Leviticus 16"). I'm afraid it is you who is not harmonizing Scripture...
http://biblecentre.org/content.php?mode=7&item=892
Note also
2Cor5:14-15 -
"...
that if one died for all, then were all dead:
15 And
that he died for all,
that they which live should not henceforth live unto themselves, but unto him which died for them, and rose again."
"He died for all" but "they which live" are not "all"