Execution of cognitive functions is orchestrated by a brain-wide network comprising multiple regions. However, it remains elusive whether the cortical laminar pattern of inter-areal interactions exhibits dynamic routings, depending on cognitive operations. We address this issue by simultaneously recording neuronal activities from area 36 and area TE of the temporal cortex while monkeys performed a visual cued-recall task. We identify dynamic laminar routing of the inter-areal interaction: during visual processing of a presented cue, spiking activities of area 36 neurons are preferentially coherent with local field potentials at the supragranular layer of area TE, while the signal from the same neurons switches to target the infragranular layer of area TE during memory retrieval. This layer-dependent signal represents the to-be-recalled object, and has an impact on the local processing at the supragranular layer in both cognitive operations. Thus, cortical layers form a key structural basis for dynamic switching of cognitive operations.