I don't see the point made that it doesn't matter at all if IR vision would be very useful to humans. There are lots of things that would clearer be more useful.
It doesn't matter how useful something is if it simply never happens to arise through mutation. Natural selection works with what comes up.
We do row with the oars we have as noted above.
Maybe there happens to be no path from what we have to IR vision.