From what I can gather, it appears that Domitian himself had John banished to Patmos. Here's a little information on it:
Late in the first century, the Apostle John was living in Ephesus preaching the Gospel, teaching the Scriptures, and helping lead the church. Historians also maintain that...