Yes, but the Elect were chosen way back when, right?
The elect were chosen according to the foreknowledge of God, unless I'm mistaken. So I guess maybe it's like, God knew how things were going to turn out and these people were definitely going to be who he would draw to his Son and they were chosen in that sense. I'm sort of just speculating here though.