Scanning a compressed ordered representation of the future

Zoran Tiganj, Inder Singh, Zahra G. Esfahani, Marc W. HowardbioRxiv 2017 · DOI

TL;DR

This paper introduces a new task (JOI) to study how we predict future events, finding a striking symmetry with how we remember past events. Both memory and future prediction seem to rely on scanning a compressed, ordered representation of time, suggesting a fundamental link between recalling the past and anticipating the future.

What Problem Does This Paper Address?

While many theories suggest a deep connection between remembering the past and imagining the future, there's a lack of experimental paradigms that directly compare these cognitive processes under controlled conditions. Specifically, how the brain organizes and accesses temporal information for past events versus future events remains an open question. Existing research on memory for the past often uses tasks like the "Judgment of Recency" (JOR), which reveals how we judge the order of past events. This paper aims to bridge this gap by developing a parallel task for future events and comparing the underlying cognitive mechanisms.

Methods

The core of this research lies in two experimental tasks:

  • Judgment of Recency (JOR): This is a standard task where participants are shown a sequence of stimuli and then asked to identify which of two probe stimuli appeared more recently. The authors used a short-term relative JOR task.
  • Judgment of Imminence (JOI): This is a novel task introduced by the authors. Participants first learn a probabilistic sequence of stimuli. Then, during an interrupted sequence, they are presented with two probe stimuli and asked to predict which one is expected to appear sooner in the future.

The researchers analyzed response times (RTs) and RT distributions, looking for patterns consistent with a "self-terminating search" model. This model posits that the brain scans through a representation of time (either past or future) until it finds the relevant item, and the time taken for this scan provides insights into the structure of that representation.

Datasets

Not discussed in the paper. The experiments involved participants learning and responding to sequences of letters.

Key Insights and Ideas

  • Symmetry Between Past and Future: The most striking finding is the mirror-symmetric results between judging past events (JOR) and predicting future events (JOI). This strongly suggests that the underlying cognitive mechanisms for memory and prediction are remarkably similar.
  • Compressed Temporal Representation: Both memory for the past and prediction of the future appear to be based on a "compressed" representation of time. This means that events closer in time are represented with more detail or resolution, and the representation becomes less detailed (more compressed) for events further away.
  • Scanning Models: The data strongly support models where the brain "scans" through a temporal representation. For the past, this is a backward scan; for the future, it's a forward scan. This scanning process is self-terminating, meaning it stops once the target item is found.
  • Time as a Dimension: The findings imply that time is not just a passive backdrop but an actively organized dimension that the brain uses for both recalling and anticipating events.

Key Results

  • Response Times (RTs): In the JOR task, correct RTs depended on the lag of the more recent probe but not the less recent one, consistent with a backward scanning model. In the JOI task, correct RTs depended on the lag of the more imminent probe but not the less imminent one, suggesting a forward scanning model.
  • Sublinear RT Increase: RTs increased sub-linearly with the temporal distance (lag) of the probe, both for past and future events. This sub-linearity is a hallmark of a compressed temporal representation.
  • RT Distributions: Analysis of RT distributions further supported the scanning models, showing that the "non-decision time" (the time before information processing begins) was affected by temporal proximity.
  • Accuracy: While RTs were the primary focus, accuracy also showed patterns related to temporal proximity, though the distance effect was more pronounced in JOR than JOI.

Limitations and Future Work

  • Temporal vs. Ordinal Representation: The study did not explicitly distinguish between temporal and ordinal representations. Future work could investigate whether the organization is strictly temporal or if it also encodes the order of events.
  • Procedural Differences: The JOR and JOI tasks had some procedural differences (e.g., presentation rate, number of lists). While the core findings were similar, future studies could aim for even closer methodological alignment.
  • Neuroimaging: The authors suggest that future research could explore the neural correlates of this temporal organization and compression using neuroimaging methods.
  • Instructions in JOI: The JOI task's continuous sequence learning might differ from how we naturally anticipate future events, which can sometimes involve discrete "landmarks." Future studies could explore how different experimental designs (e.g., lists with distinct items) might influence JOI performance.

Summary updated

Abstract

Abstract Several authors have suggested a deep symmetry between the psychological processes that underlie our ability to remember the past and make predictions about the future. The judgment of recency (JOR) task measures temporal order judgments for the past by presenting pairs of probe stimuli; participants choose the probe that was presented more recently. We performed a short-term relative JOR task and introduced a novel judgment of imminence (JOI) task to study temporal order judgments for the future. In the JOR task, participants were presented with a sequence of stimuli and asked to choose which of two probe stimuli was presented closer to the present. In the JOI task, participants were trained on a probabilistic sequence. After training, the sequence was interrupted with probe stimuli. Participants were asked to choose which of two probe stimuli was expected to be presented closer to the present. Replicating prior work on JOR, we found that RT results supported a backward self-terminating search model operating on a temporally-organized representation of the past. We also showed that RT distributions are consistent with this model and that the temporally-organized representation is compressed. Critically, results for the JOI task probing expectations of the future were mirror-symmetric to results from memory, suggesting a forward self-terminating search model operating on a temporally-organized representation of the future.
BibTeX
@misc{tiganj2017scanning,
  author = {Zoran Tiganj and Inder Singh and Zahra G. Esfahani and Marc W. Howard},
  title = {{Scanning a compressed ordered representation of the future}},
  year = {2017},
  doi = {10.1101/229617},
  howpublished = {bioRxiv},
}

Loading related content...

Figure