Report

Motion Integration and Postdiction in Visual Awareness

See allHide authors and affiliations

Science  17 Mar 2000:
Vol. 287, Issue 5460, pp. 2036-2038
DOI: 10.1126/science.287.5460.2036

Abstract

In the flash-lag illusion, a flash and a moving object in the same location appear to be offset. A series of psychophysical experiments yields data inconsistent with two previously proposed explanations: motion extrapolation (a predictive model) and latency difference (an online model). We propose an alternative in which visual awareness is neither predictive nor online but is postdictive, so that the percept attributed to the time of the flash is a function of events that happen in the ∼80 milliseconds after the flash. The results here show how interpolation of the past is the only framework of the three models that provides a unified explanation for the flash-lag phenomenon.

The flash-lag effect is a robust visual illusion wherein a flash and a moving object that appear in the same location are perceived to be displaced from one another (1, 2). Two explanations have been suggested in recent years: The first proposal is that the visual system is predictive, accounting for neural delays by extrapolating the trajectory of a moving stimulus into the future (2). The second is that the visual system processes moving objects more quickly than flashed objects. This “latency difference” hypothesis asserts that by the time the flashed object is processed, the moving object has already moved to a new position (3, 4). The latter proposal tacitly rests on the assumption that awareness (what the participant reports) is an online, or real-time, phenomenon, coming about as soon as a stimulus reaches its “perceptual end point” (5). We have designed a series of psychophysical experiments to directly test these two frameworks. Our results are inconsistent with both models. Here we propose that visual awareness is postdictive, so that the percept attributed to the time of an event is a function of what happens in the ∼80 ms following the event.

To directly test extrapolation into the future against interpolation of the past, we designed a series of psychophysical experiments. Five participants sat in front of a computer screen and were instructed to indicate whether a flashed white disk occurred above or below the center of a moving ring (Fig. 1A) (6). Beginning with the frame following the flash, the ring took one of three randomly interleaved trajectories: continuing, stopping, or reversing direction (Fig. 1A). The initial trajectory of the ring (up to and including the frame with the flash) was identical in all three conditions; thus, if motion extrapolation were occurring, the predicted trajectory should be the same. Contrary to that hypothesis, the perceived position of the flash relative to the ring was independent of the initial trajectory. In the case of the uninterrupted trajectory, participants perceived the flash to be in the middle of the ring when the flash was physically displaced 5.39° ± 0.9° in front of the moving ring, as expected from previous studies of the flash-lag effect. However, in the presentations wherein the moving ring stopped, participants reported the ring and flash co-localized when there was no displacement (−0.36° ± 0.27°), indicating that movement preceding the flash does not by itself engender the flash-lag illusion. When the ring reversed direction immediately after the flash, participants reported colocalization of the ring and the flash only when the flash was physically displaced by an average of −6.47° ± 0.8°. The direction of the flash-lag effect is opposite in the continuous and reversing conditions, but the magnitude of the effect is the same (t test, P > 0.398, t = −0.89). On the other hand, those two conditions are significantly different from the stopping condition (P < 0.0017,t = 6.11), wherein no illusion is seen (7).

Figure 1

The flash-lag illusion with variable outcomes after the flash. (A) Participants reported whether they perceived a flash above or below the center of a moving ring (forced choice). The ring moved in a circular trajectory at a speed of 360° s–1. When the ring reached the opposite side, a flash (bright white disk) appeared in a range that extended above and below the ring on its trajectory, in 7° each direction. After the flash, one of three conditions followed: The ring continued, stopped, or reversed. Participants were instructed to fixate on a small square 1° to the right of the flash location; however, eye fixation was not monitored, as the three conditions were randomly interleaved to obviate any predictive effects. The initial trajectory of the ring was mirrored in half the trials. The same results were found with repeated presentations of the same trajectory (18), indicating that prediction does not appear to enhance or diminish the perceptual effect. Symbols represent the average displacement at which participants' psychometric curves crossed 50% (the point of perceived alignment of flash and ring). The thick line marks the average for five participants ± SE (19). (B) Same paradigm as in (A), but here the ring and flash appear simultaneously on a blank screen. Results are not significantly different from (A). The illusion is unchanged even if the ring is initially present and set in motion after the flash, as opposed to simultaneous onset here.

These results indicate that the perceived position of the flash relative to the ring is not dictated by the initial trajectory because if visual awareness were predictive, the same initial trajectory would lead to the same extrapolation. Our results are consistent with a recent demonstration by Whitney and Murakami in which the perceived displacement of a flash was influenced by a motion change that occurred after the flash (4). In our experiment, by directly comparing stimuli with an identical pre-flash trajectory to three different post-flash trajectories, we demonstrated that the perceived displacement of the flashed and moving stimuli is a function of the movement after the flash. (In the stopped case there is no flash-lag effect at all.) Thus, we suggest that the perception attributed to an event at time t 0 depends on what happens int 0 < t < t 0 + h, where h is a window of time whose magnitude serves as a lower bound on the length of the delay before visual awareness.

To verify that the pre-flash trajectory plays no role in the flash-lag effect, we made another test in which the flash and ring appeared on the screen at the same time and the ring's movement began in the next video frame (8). Thus, there is no trajectory (no previous motion) from which to extrapolate. The results (Fig. 1B) are essentially unchanged from Fig. 1A (P > 0.75,P > 0.35, P > 0.55, for the continuous, stopped, and reversed cases, respectively), supporting the conclusion that motion extrapolation is untenable and that only events after the flash determine the perception. The similarity of results inFig. 1, A and B, suggests that the flash resets motion integration in the visual system, making motion after the flash effectively like motion that starts de novo (Fig. 1B). One explanation may be that the flash temporarily redirects attention (9).

To determine how much information the brain integrates after the flash for its decision, we designed stimuli analogous to those in Fig. 1B but included a direction reversal. Immediately after the flash, the ring moves in one direction and then it reverses direction after a variable number of video frames (Fig. 2). If the visual system only uses information from the 10 to 20 ms after the flash (as might be predicted from Fig. 1, and from the latency difference hypothesis), then the trajectory of the ring after that time window should not affect the percept. Contrary to that hypothesis, movement up to 80 ms after the flash influences the percept. We find that 67 to 80 ms of unidirectional movement is necessary to approach the illusory displacement measured in Fig. 1. As the amount of time before the reversal is reduced, the illusory displacement is lessened, and with only 26 ms before reversal, the flash-lag effect is effectively canceled out (as though the ring were stopped). With only one video frame remaining before reversal, the perceived displacement changes direction (10). These data are consistent with a temporally weighted spatial averaging that takes place during the ∼80 ms after the flash. Physiological mechanisms for the spatiotemporal filtering may involve a form of temporal recruitment, the process by which motion signals in the neural tissue are combined over time (11). However, most of the available literature implicitly assumes that motion integration would occur over the time before the flash, i.e., the visual system would collect information until the time of the stimulus, with perceptual processing following online. Our data indicate instead that the visual system integrates information after the flash, which necessitates that perception be delayed. The direction reversal experiment indicates that the position of the moving object is interpolated as a point within the integrated path, and given the results of Fig. 1, A and B, our interpretation is that the flash serves to reset the motion integration.

Figure 2

Determining the time window of influence by means of direction reversals. The paradigm is identical toFig. 1B, except that after the flash the ring reverses direction after a variable time, t rev (13 to 80 ms) (n = 6). The data point att rev = 0 is taken from Fig. 1B and represents the perceived displacement when the ring makes no reversal, e.g., it simply moves counterclockwise instead of starting clockwise and then reversing.

To further examine our interpretation, we next separated the temporal coincidence of the flash and the moving object. A latency difference model assumes a “race” between a flash and a moving object to a perceptual end point; thus, we reasoned that giving the flash a temporal advance should change the outcome of such a race. Participants were instructed to adjust the angle of a “pointer” line (flashed for 13 ms) to point to the beginning of the trajectory of the moving ring (Fig. 3). The pointer was flashed and then the moving ring appeared. These two stimuli were separated by a stimulus onset asynchrony Δt ranging from 0 to 53 ms. Thus, in one condition, the flash and ring appeared on the same frame (Δt = 0), but in the remaining four conditions, a variable delay after the single frame with the flash (13 ms < Δt < 53 ms) preceded the appearance of the ring. The sequence was repeated after a 1 s delay and participants were allowed to see a condition as many times as they wished before committing to an answer. Regardless of the length of the delay, participants adjusted the pointer to indicate a position an average of ∼6° ahead of the actual starting position of the ring (this is the same magnitude as the displacements in Figs. 1 and 2). These results do not support the latency difference model because giving the flash a head start does not change the perceptual outcome. Instead, this demonstrates that participants do not correctly perceive the starting position of a newly moving object—a long-known observation called the Frohlich effect (12)—but instead perceive an interpolation of its past positions. Thus, the entirety of the flash-lag effect in Fig. 1B can be explained by the fact that the starting point of a newly moving object is interpolated (misperceived). Further, it seems the traditional flash-lag effect (Fig. 1A) is well explained by our suggestion that a flash resets motion integration.

Figure 3

Separating the flash and moving object in time. Participants were instructed to adjust the radial angle (θ) of a flashed pointer to indicate the starting position of a sudden-onset moving ring. The available range of adjustment was between –18° and 18°, where 0° on the ordinate marks the actual starting position of the ring. At Δt = 0, the flash and ring appeared in the same frame; in the remaining four conditions, the ring did not appear until some delay after the 13 ms with the flash (Δt = 13, 26, 40, or 53 ms). Bars represent averages from 10 participants ± SEM.

The evidence presented here does not support the two frameworks previously proposed to explain the flash-lag illusion. First, we demonstrated that the illusory displacement between moving and flashed stimuli is independent of the pre-flash trajectory of the moving object and depends entirely on movement after the flash. Many previous experiments appeared to be consistent with motion extrapolation (2, 13) only because the movement after the flash happened to be continuous with the movement before. For an action such as catching a ball, it is unnecessary for extrapolation to take place in visual perception because neural delays can be compensated for in the training of the motor systems. Second, we demonstrated that even when the flash occurs at various times before the moving object appears, the degree of misperception of the moving object is the same. The latency difference model is unsupported by the result in Fig. 3 and cannot explain the results in Fig. 1B, wherein the “moving” object does not begin to move until after the flash. In this case, the newly appearing moving object should initially suffer the same processing delays as the flashed stimulus. We suggest that although latency differences may apply to other phenomena (for example, the Pulfrich effect wherein one retina is dark-adapted), they are not relevant to the flash-lag effect.

We have proposed an alternative hypothesis: The flash resets motion integration, and motion is newly calculated and postdicted to the time of the flash. This hypothesis requires visual awareness to be postdictive, a conclusion already supported elsewhere (14). For example, in backward masking (15) the perception of a stimulus can be blocked or modified if it is followed in rapid succession by a second stimulus. Another example is the color phi phenomenon (16), wherein two colored dots, presented sequentially within small amounts of time and distance, will appear to have changed color in the middle of their apparent trajectory. Because the viewer cannot know the color of the second dot until having seen the second dot, the conscious percept attributed to the time of the trajectory must be formed in retrospect. Overall, these experiments indicate that the visual system consults the ongoing input of information from the near future of an event before committing to a percept (17). This postdictive framework has implications for interpreting physiological data related to visual perception.

  • * To whom correspondence should be addressed. E-mail: eagleman{at}salk.edu

REFERENCES AND NOTES

View Abstract

Navigate This Article