We never really see time. We see only clocks. If you say this object moves, what you really mean is that this object is here when the hand of your clock is here, and so on. We say we measure time with clocks, but we see only the hands of the clocks, not time itself. And the hands of a clock are a physical variable like any other. So in a sense we cheat because what we really observe are physical variables as a function of other physical variables, but we represent that as if everything is evolving in time.
