Yes, you are right there; also it was the Samarians who initially hindered the rebuilding of the temple.
But according to Jeremiah (50)...
17 Israel is a scattered sheep; the lions have driven him away: first the king of Assyria hath devoured him; and last this Nebuchadrezzar king of Babylon hath broken his bones.18 Therefore thus saith the Lord of hosts, the God of Israel; Behold, I will punish the king of Babylon and his land, as I have punished the king of Assyria.19 And I will bring Israel again to his habitation, and he shall feed on Carmel and Bashan, and his soul shall be satisfied upon mount Ephraim and Gilead.20 In those days, and in that time, saith the Lord, the iniquity of Israel shall be sought for, and there shall be none; and the sins of Judah, and they shall not be found: for I will pardon them whom I reserve.
And Gabriel seems to conjoin the the Houses in the return
Daniel 9 :7 O Lord, righteousness belongeth unto thee, but unto us confusion of faces, as at this day; to the men of Judah, and to the inhabitants of Jerusalem, and unto all Israel, that are near, and that are far off, through all the countries whither thou hast driven them, because of their trespass that they have trespassed against thee.8 O Lord, to us belongeth confusion of face, to our kings, to our princes, and to our fathers, because we have sinned against thee.9 To the Lord our God belong mercies and forgivenesses, though we have rebelled against him;10 Neither have we obeyed the voice of the Lord our God, to walk in his laws, which he set before us by his servants the prophets.11 Yea, all Israel have transgressed thy law,