Wrong.
The people being spoken of are not physical but spiritual. This is the account of Aaron's death:
Num 20:
22 The whole Israelite community set out from Kadesh and came to Mount Hor.
23At Mount Hor, near the border of Edom, the Lord said to Moses and Aaron,
24“Aaron will be gathered to his people. He will not enter the land I give the Israelites, because both of you rebelled against my command at the waters of Meribah.
25Get Aaron and his son Eleazar and take them up Mount Hor.
26Remove Aaron’s garments and put them on his son Eleazar,
for Aaron will be gathered to his people; he will die there.”
27Moses did as the Lord commanded: They went up Mount Hor in the sight of the whole community.
28Moses removed Aaron’s garments and put them on his son Eleazar. And Aaron died there on top of the mountain. Then Moses and Eleazar came down from the mountain,
29and when the whole community learned that Aaron had died, all the Israelites mourned for him thirty days.
So when God told Moses that he will die and be gathered to his people just like Aaron died and was gathered to his people, He actually means two different groups spiritually and not physical because Moses died and was buried by God and the angels and not people.
This is Moses' death:
Deut 34:5
So Moses the servant of the LORD died there in the land of Moab, as the LORD had said.6And He buried him in a valley in the land of Moab facing Beth-peor, and no one to this day knows the location of his grave.
Jude 1:9
But even the archangel Michael, when he disputed with the devil over the body of Moses, did not presume to bring a slanderous judgment against him, but said, “The Lord rebuke you!”
I can't see anything to suggest that Moses was gathered to the same people as Aaron.