Do i hold on or let go?

Let it go. Gay relationships are just as complicated as straight ones if not more and this one sounds like a dead end. If you keep messing around with this guy you are just wasting time.