Limited atonement and irresistible grace are not deal breakers, where idolatry is. So I can see being married to a Calvinists where I can't a Buddhist or Catholic.
My biggest sticking point for a Calvinists is sacramentarianism, which is also something that can be over come. I take the Lord's supper with Baptists regularly, even though they are also sacramentarian.