Anticipatory acts or predictive behavior are prerequisites for living organisms to sustain their survival when escaping from a predator, catching prey, or schooling. For example, catching prey requires that the predator perform some procedures that are equivalent to estimating the directional movement of the prey, its speed and its distance relative to the predator. Underlying these procedures is time experience, which does not adhere to man-made mechanical clocks. Living organisms keep time based on the local activities of each participant and form ecological clocks together. The timekeeping of ecological clocks has been called E-series time, which is interactive in character and consists of mutual alignment of timing that is co-adjusted to each other's movements and rhythms. A main objective of our current work is to illustrate how E-series time is used for flows of anticipatory acts. To explain such predictive moves and their efforts based on how the perspective of the immediate future affects the present, we resort to the organismic activity of revising the preceding acts in retrospect and semiotic scaffolding that extends beyond simple linear causality. Special attention is paid to the construction of the notion of retrocausal scaffolding, which is a series of dialogical punctuations or mutual coordination of rhythms for the joint production of the present moment of now. Retrocausal scaffolding is synonymous with negotiated anticipation, which is a semiotic/communicative account of revising the preceding acts in the present moment.