Not at all, God is the judge and His methods are what they are. But there is no justice if there are no criteria, if there's no standard. Then it's just capriciousness and justice means absolutely nothing.
The issue is you've mistaken your soteriology which is based on human systematic theologies for God's actual methods. You've mistaken the philosophizing on Biblical texts by men like Augustine and Calvin as actual Biblical truth whether you've read them or not because it is what you have heard preached.
You ignore God calling numerous men righteous in favor of a quotation of a poem and other proof texts. You ignore God calling men to choose in favor of that same philosophizing.
God's justice is real justice, the righteous are saved and the wicked damned. Even if we can't see immediately who is and isn't wicked.