A couple of these lines branched off into different human species. What happened to neanderthal and the others we are beginning to learn of? Is it possible that they were killed off?
If the neaderthals and modern humans had sterile offspring and there was a greater tendancy for a neanderthal to want to breed with a M. human than a M. human to want to breed with a neandethal, wouldn't that result in a decrease in the population of neanderthals?...until it reached zero?
Or were you also including sexual selection in the phrase "killed off"?