I heard, rightly or wrongly, that the "sons of God" were human males from the "righteous line" and the "sons on man" were human males from the "unrighteous line". This see⅞ms to make far more sense than the idea of heavenly-dwelling beings being attractive to and having sex with humans.