Just to remind you, while the Toba explosion destroyed many, it did not have a major long-term effect to the surrounding environment (apart from carving out a huge lake). The environment rebounded until people came back and repopulate the region.
Of course, maybe the human victims were some hunter-gatherers who lived without technology. Don't know what happened if tech-pampered Americans would fare the same in case of Yellowstone erupting.