The act of standing in the temple proclaiming to be God is for the Jews. So it's a must to have a physical temple.
Not sure how you can read the MAN of SIN offers a false sacrifice and relate that to all believers when it would only matter to the Jews?