The one theory we have that teaches us the nature of "time" has no concept whatsoever of "passage of time" - we have time as a dimension and proper time as a distance measure.
To throw in a Penrose-ism - What about entropy as pertaining to the arrow of time?