Evolution is a two step process. You're forgetting the second step: -1.Chance -2.Selection
The probabilities change radically if someone (artificial selection) or something (natural selection), intervenes discarding certain elements and choosing others.
The only necessity for selection to act is the existence of a self-replicant. Surely there were replicons many many years before the cell appeared, subjects to improvement in its capacity of doing a exact copy of themselves, by NS.
Probably, even before, it existed chemical evolution, also mediated by selection.