"wilt thou at this time restore again the kingdom to Israel?"
This question is directed at bringing back the northern tribes that were scattered being restored to the kingdom of God which is what Christ said had come upon the Jews.
We see here that the scattered tribes were being restored to the kingdom:
James 1:1 James, a servant of God and of the Lord Jesus Christ, to the twelve tribes which are scattered abroad, greeting.
Peter writes to the diaspora saying they were restored to the kingdom as a generation of Priests:
1 Pet 1:1 Peter, an apostle of Jesus Christ, to the strangers scattered throughout Pontus, Galatia, Cappadocia, Asia, and Bithynia,
1 Pet 2:9 But ye are a chosen generation, a royal priesthood, an holy nation, a peculiar people; that ye should show forth the praises of him who hath called you out of darkness into his marvellous light:
1 Pet 2:10 Which in time past were not a people, but are now the people of God: which had not obtained mercy, but now have obtained mercy.
In the above Peter is referring to the Hosea:
Hosea 1:10 Yet the number of the children of Israel shall be as the sand of the sea, which cannot be measured nor numbered; and it shall come to pass, that in the place where it was said unto them, Ye are not my people, there it shall be said unto them, Ye are the sons of the living God.
Hosea 1:11 Then shall the children of Judah and the children of Israel be gathered together, and appoint themselves one head, and they shall come up out of the land: for great shall be the day of Jezreel.
So we see in both Peter's and Jame's letter the children of Israel being gathered together with children of Judah.