It seems to me that you're hanging onto him soley because (as you stated), "You don't want to be alone".
While you listed a few "good points" it seems that the things that concern you far outweigh them.
In a situation like this its hard to let go because you are fearful of what the future...