2020.11.01;天Nov1st(306):Memory failure predicted by attention lapsing and media multitasking | Nature

               

Abstract

With the explosion of digital media and technologies, scholars, educators and the public have become increasingly vocal about the role that an ‘attention economy’ has in our lives1. The rise of the current digital culture coincides with longstanding scientific questions about why humans sometimes remember and sometimes forget, and why some individuals remember better than others2,3,4,5,6. Here we examine whether spontaneous attention lapses—in the moment7,8,9,10,11,12, across individuals13,14,15 and as a function of everyday media multitasking16,17,18,19—negatively correlate with remembering. Electroencephalography and pupillometry measures of attention20,21 were recorded as eighty young adults (mean age, 21.7 years) performed a goal-directed episodic encoding and retrieval task22. Trait-level sustained attention was further quantified using task-based23 and questionnaire measures24,25. Using trial-to-trial retrieval data, we show that tonic lapses in attention in the moment before remembering, assayed by posterior alpha power and pupil diameter, were correlated with reductions in neural signals of goal coding and memory, along with behavioural forgetting. Independent measures of trait-level attention lapsing mediated the relationship between neural assays of lapsing and memory performance, and between media multitasking and memory. Attention lapses partially account for why we remember or forget in the moment, and why some individuals remember better than others. Heavier media multitasking is associated with a propensity to have attention lapses and forget.

                                                   
                                       
                                                                       
                           

Access options

       

Subscribe to Journal

Get full journal access for 1 year

$199.00

only $3.90 per issue

All prices are NET prices.
VAT will be added later in the checkout.

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

 
   

Additional access options:

   
           
  •             Log in       
  •        
  •             Access through your institution       
  •        
  •             Learn about institutional subscriptions       
  •                                                                            

    Data availability

                           

    Data that support the findings of this study are publicly available via the Open Science Framework47 with identifier zj7tb (https://osf.io/zj7tb). Data used in the preparation of this manuscript are also publicly available from the National Institute of Mental Health (NIMH) Data Archive (NDA) (https://doi.org/10.15154/1519022)48. The source data underlying all figures are provided as a Source Data file. Source data are provided with this paper.

             

    Code availability

                           

    Analytic code that support the findings of this study are publicly available via Open Science Framework47 with identifier zj7tb (https://osf.io/zj7tb).

             

    References

    1. 1.

      Harris, T. Optimizing for Engagement: Understanding the Use of Persuasive Technology on Internet Platforms. Testimony on behalf of Center for Humane Technology. https://www.commerce.senate.gov/2019/6/optimizing-for-engagement-understanding-the-use-of-persuasive- technology-on-internet-platforms (US Senate Committee on Commerce, Science & Transportation; 25 June 2019).

    2. 2.

      Baddeley, A., Lewis, V., Eldridge, M. & Thomson, N. Attention and retrieval from long-term memory. J. Exp. Psychol. Gen. 113, 518–540 (1984).

      Article                         Google Scholar                

    3. 3.

      Craik, F. I., Govoni, R., Naveh-Benjamin, M. & Anderson, N. D. The effects of divided attention on encoding and retrieval processes in human memory. J. Exp. Psychol. Gen. 125, 159–180 (1996).

      CAS     Article                         Google Scholar                

    4. 4.

      Anderson, M. C. & Spellman, B. A. On the status of inhibitory mechanisms in cognition: memory retrieval as a model case. Psychol. Rev. 102, 68–100 (1995).

      CAS     Article                         Google Scholar                

    5. 5.

      Evans, L. H. & Herron, J. E. Pre-retrieval event-related potentials predict source memory during task switching. Neuroimage 194, 174–181 (2019).

      Article     PubMed Central                         Google Scholar                

    6. 6.

      Curran, T. Effects of attention and confidence on the hypothesized ERP correlates of recollection and familiarity. Neuropsychologia 42, 1088–1106 (2004).

      Article                         Google Scholar                

    7. 7.

      Klimesch, W. α-Band oscillations, attention, and controlled access to stored information. Trends Cogn. Sci. 16, 606–617 (2012).

      Article     PubMed Central                         Google Scholar                

    8. 8.

      Hanslmayr, S., Staudigl, T. & Fellner, M. C. Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis. Front. Hum. Neurosci. 6, 74 (2012).

      Article     PubMed Central                         Google Scholar                

    9. 9.

      Jin, C. Y., Borst, J. P. & van Vugt, M. K. Predicting task-general mind-wandering with EEG. Cogn. Affect. Behav. Neurosci. 19, 1059–1073 (2019).

      Article     PubMed Central                         Google Scholar                

    10. 10.

      Unsworth, N. & Robison, M. K. The importance of arousal for variation in working memory capacity and attention control: a latent variable pupillometry study. J. Exp. Psychol. Learn. Mem. Cogn. 43, 1962–1987 (2017).

      Article                         Google Scholar                

    11. 11.

      Unsworth, N. & Robison, M. K. Pupillary correlates of lapses of sustained attention. Cogn. Affect. Behav. Neurosci. 16, 601–615 (2016).

      Article                         Google Scholar                

    12. 12.

      Konishi, M., Brown, K., Battaglini, L. & Smallwood, J. When attention wanders: pupillometric signatures of fluctuations in external attention. Cognition 168, 16–26 (2017).

      Article                         Google Scholar                

    13. 13.

      Fortenbaugh, F. C., DeGutis, J. & Esterman, M. Recent theoretical, neural, and clinical advances in sustained attention research. Ann. NY Acad. Sci. 1396, 70–91 (2017).

      ADS     Article                         Google Scholar                

    14. 14.

      Unsworth, N. Individual differences in long-term memory. Psychol. Bull. 145, 79–139 (2019).

      Article                         Google Scholar                

    15. 15.

      Kahana, M. J., Aggarwal, E. V. & Phan, T. D. The variability puzzle in human memory. J. Exp. Psychol. Learn. Mem. Cogn. 44, 1857–1863 (2018).

      Article     PubMed Central                         Google Scholar                

    16. 16.

      Uncapher, M. R. & Wagner, A. D. Minds and brains of media multitaskers: current findings and future directions. Proc. Natl Acad. Sci. USA 115, 9889–9896 (2018).

      CAS     Article                         Google Scholar                

    17. 17.

      Ralph, B. C. W., Thomson, D. R., Seli, P., Carriere, J. S. & Smilek, D. Media multitasking and behavioral measures of sustained attention. Atten. Percept. Psychophys. 77, 390–401 (2015).

      Article                         Google Scholar                

    18. 18.

      Uncapher, M. R., K Thieu, M. & Wagner, A. D. Media multitasking and memory: differences in working memory and long-term memory. Psychon. Bull. Rev. 23, 483–490 (2016).

      Article     PubMed Central                         Google Scholar                

    19. 19.

      Baumgartner, S. E., van der Schuur, W. A., Lemmens, J. S. & te Poel, F. The relationship between media multitasking and attention problems in adolescents: results of two longitudinal studies. Hum. Commun. Res. 44, 3–30 (2018).

      Article                         Google Scholar                

    20. 20.

      Macdonald, J. S. P., Mathan, S. & Yeung, N. Trial-by-trial variations in subjective attentional state are reflected in ongoing prestimulus EEG alpha oscillations. Front. Psychol. 2, 82 (2011).

      Article     PubMed Central                         Google Scholar                

    21. 21.

      Unsworth, N. & Robison, M. K. Tracking arousal state and mind wandering with pupillometry. Cogn. Affect. Behav. Neurosci. 18, 638–664 (2018).

      Article                         Google Scholar                

    22. 22.

      Dobbins, I. G. & Wagner, A. D. Domain-general and domain-specific prefrontal mechanisms for recollecting events and detecting novelty. Cereb. Cortex 29, 150–166 (2005).

                          Google Scholar                

    23. 23.

      Esterman, M., Noonan, S. K., Rosenberg, M. & Degutis, J. In the zone or zoning out? Tracking behavioral and neural fluctuations during sustained attention. Cereb. Cortex 23, 2712–2723 (2013).

      Article                         Google Scholar                

    24. 24.

      Ophir, E., Nass, C. & Wagner, A. D. Cognitive control in media multitaskers. Proc. Natl Acad. Sci. USA 106, 15583–15587 (2009).

      ADS     CAS     Article                         Google Scholar                

    25. 25.

      Ralph, B. C. W., Thomson, D. R., Cheyne, J. A. & Smilek, D. Media multitasking and failures of attention in everyday life. Psychol. Res. 78, 661–669 (2014).

      Article                         Google Scholar                

    26. 26.

      Herron, J. E. & Evans, L. H. Preparation breeds success: brain activity predicts remembering. Cortex 106, 1–11 (2018).

      Article     PubMed Central                         Google Scholar                

    27. 27.

      Forstmann, B. U., Ridderinkhof, K. R., Kaiser, J. & Bledowski, C. At your own peril: an ERP study of voluntary task set selection processes in the medial frontal cortex. Cogn. Affect. Behav. Neurosci. 7, 286–296 (2007).

      Article                         Google Scholar                

    28. 28.

      Rugg, M. D. & Curran, T. Event-related potentials and recognition memory. Trends Cogn. Sci. 11, 251–257 (2007).

      Article                         Google Scholar                

    29. 29.

      Ra, C. K. et al. Association of digital media use with subsequent symptoms of attention-deficit/hyperactivity disorder among adolescents. J. Am. Med. Assoc. 320, 255–263 (2018).

      Article                         Google Scholar                

    30. 30.

      Hanslmayr, S. et al. The relationship between brain oscillations and BOLD signal during memory formation: a combined EEG-fMRI study. J. Neurosci. 31, 15674–15680 (2011).

      CAS     Article     PubMed Central                         Google Scholar                

    31. 31.

      Kessler, R. C. et al. The World Health Organization Adult ADHD Self-Report Scale (ASRS): a short screening scale for use in the general population. Psychol. Med. 35, 245–256 (2005).

      Article                         Google Scholar                

    32. 32.

      Patton, J. H., Stanford, M. S. & Barratt, E. S. Factor structure of the Barratt impulsiveness scale. J. Clin. Psychol. 51, 768–774 (1995).

      CAS     Article                         Google Scholar                

    33. 33.

      Green, C. S. & Bavelier, D. Action-video-game experience alters the spatial resolution of vision. Psychol. Sci. 18, 88–94 (2007).

      CAS     Article     PubMed Central                         Google Scholar                

    34. 34.

      Carriere, J. S. A., Seli, P. & Smilek, D. Wandering in both mind and body: individual differences in mind wandering and inattention predict fidgeting. Can. J. Exp. Psychol. 67, 19–31 (2013).

      Article                         Google Scholar                

    35. 35.

      Carriere, J. S. A., Cheyne, J. A. & Smilek, D. Everyday attention lapses and memory failures: the affective consequences of mindlessness. Conscious. Cogn. 17, 835–847 (2008).

      Article                         Google Scholar                

    36. 36.

      Brainard, D. H. The psychophysics toolbox. Spat. Vis. 10, 433–436 (1997).

      CAS     Article                         Google Scholar                

    37. 37.

      Willenbockel, V. et al. Controlling low-level image properties: the SHINE toolbox. Behav. Res. Methods 42, 671–684 (2010).

      Article                         Google Scholar                

    38. 38.

      Unsworth, N., Robison, M. K. & Miller, A. L. Pupillary correlates of fluctuations in sustained attention. J. Cogn. Neurosci. 30, 1241–1253 (2018).

      Article                         Google Scholar                

    39. 39.

      Delorme, A. & Makeig, S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).

      Article                         Google Scholar                

    40. 40.

      Green, D. M. & Swets, J. A. Signal Detection Theory and Psychophysics (Wiley, 1966).

    41. 41.

      Kleifges, K., Bigdely-Shamlo, N., Kerick, S. E. & Robbins, K. A. BLINKER: automated extraction of ocular indices from EEG enabling large-scale analysis. Front. Neurosci. 11, 12 (2017).

      Article     PubMed Central                         Google Scholar                

    42. 42.

      Goldinger, S. D. & Papesh, M. H. Pupil dilation reflects the creation and retrieval of memories. Curr. Dir. Psychol. Sci. 21, 90–95 (2012).

      Article     PubMed Central                         Google Scholar                

    43. 43.

      Otero, S. C., Weekes, B. S. & Hutton, S. B. Pupil size changes during recognition memory. Psychophysiology 48, 1346–1353 (2011).

      Article                         Google Scholar                

    44. 44.

      Võ, M. L.-H. et al. The coupling of emotion and cognition in the eye: introducing the pupil old/new effect. Psychophysiology 45, 130–140 (2008).

      Article                         Google Scholar                

    45. 45.

      Hong, L., Walz, J. M. & Sajda, P. Your eyes give you away: prestimulus changes in pupil diameter correlate with poststimulus task-related EEG dynamics. PLoS ONE 9, e91321 (2014).

      ADS     Article     CAS     PubMed Central                         Google Scholar                

    46. 46.

      Rosenberg, M., Noonan, S., DeGutis, J. & Esterman, M. Sustaining visual attention in the face of distraction: a novel gradual-onset continuous performance task. Atten. Percept. Psychophys. 75, 426–439 (2013).

      Article                         Google Scholar                

    47. 47.

      Madore, K. P. Memory failure predicted by attention lapsing and media multitasking (dataset and analytic code). https://osf.io/zj7tb (Open Science Framework, 2020).

    48. 48.

      Madore, K. P. Memory failure predicted by attention lapsing and media multitasking (dataset). https://doi.org/10.15154/1519022 (National Institute of Mental Health Data Archive, 2020).

    49. Download references

      Acknowledgements

      We thank A. Gonzalez and J. Qi for assistance with various aspects of the study. This research was supported by the National Institute of Mental Health (R56MH111672 to A.D.W.) and the National Institute on Aging (R01AG065255 to A.D.W.; F32AG059341 to K.P.M.). The content is solely the views of the authors and does not necessarily represent the official views of the National Institutes of Health.

      Author information

      Affiliations

      1. Department of Psychology, Stanford University, Stanford, CA, USA

        Kevin P. Madore, Anna M. Khazenzon, Jiefeng Jiang, Anthony M. Norcia & Anthony D. Wagner

      2. Symbolic Systems Program, Stanford University, Stanford, CA, USA

        Cameron W. Backes

      3. Department of Neurology, University of California, San Francisco, San Francisco, CA, USA

        Melina R. Uncapher

      4. Neuroscape, University of California, San Francisco, San Francisco, CA, USA

        Melina R. Uncapher

      5. Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA

        Anthony M. Norcia & Anthony D. Wagner

      6. Contributions

        K.P.M., A.M.K., M.R.U., A.M.N. and A.D.W. developed the study concept and contributed to study design; K.P.M. and C.W.B. collected data under supervision of A.M.N. and A.D.W.; K.P.M., A.M.K., C.W.B. and J.J. analysed data under supervision of A.M.N. and A.D.W.; K.P.M. and A.D.W. wrote the manuscript, and all authors provided critical revisions.

        Corresponding authors

        Correspondence to                Kevin P. Madore or Anthony D. Wagner.

        Ethics declarations

                                 

        Competing interests

                     

        The authors declare no competing interests.

                             

        Additional information

        Peer review information Nature thanks Edward K. Vogel and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

        Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

        Extended data figures and tables

        Extended Data Fig. 1 Experimental design.

        a, Schematic of the goal-directed memory task with EEG and pupillometry measurements. b, Schematic of electrode clusters from which alpha or ERP signals were extracted for the respective analyses; electrode clusters are illustrated on a 128-channel net. Pupil diameter from the right eye (top right) was recorded concurrently using an eye-tracking system. L, left; R, right.

        Extended Data Fig. 2 Pre-goal attention lapses relate to canonical neural signals of recollection- and familiarity-based memory as assayed by grand-average left-lateralized Parietal Old/New and FN400 ERP effects, respectively.

        a, Evidence of a peak Parietal Old/New signal (indicated by the black arrow) in the 500–600-ms post-probe window as a function of memory outcome in conceptual and perceptual source-retrieval trials. b, Trial-level interaction between pre-goal attention lapses and the Parietal Old/New signal during remembered (source hit) and forgotten (miss) trials. c, Evidence of a peak FN400 signal (indicated by the black arrow) in the 400–500-ms post-probe window as a function of memory outcome in novelty-detection trials. d, Trial-level interaction between pre-goal attention lapses and FN400 signal on correctly endorsed new items (hits) compared with misses. For visualization, quintiles are shown for the relationship between pre-goal lapsing and ERP signal; statistics included an interaction term for retrieval goal state (for Parietal Old/New) and treated pre-goal lapsing and the ERP signals continuously in trial-level mixed models. y-axis units are z-scores. Data are mean ± s.e.m. Note that z-scoring within run and time-binning in 0.1-s (100-ms) intervals reduces smaller temporal effects that are sometimes exhibited in grand-average ERP plots (for visualization of grand-average ERP plots downsampled to 0.01-s intervals (10-ms), see Extended Data Fig. 4). CRold, correct rejection of old item; CRnew, correct rejection of new item; FAold, false alarm to old item; FAnew, false alarm to new item. n = 75 participants from a single independent experiment.                        Source data                     

        Extended Data Fig. 3 Evidence of mean peak Parietal Old/New signal in the 500–600-ms post-probe window as a function of memory outcome in source retrieval trials.

        The mean peak Parietal Old/New signal is indicated by the black arrow. a, b, Data are split by conceptual (a) and perceptual (b) source trials. CRold, correct rejection of old item; FAold, false alarm to old item. For conceptual cuing, hits and misses are for conceptually studied items, and correct rejections and false alarms are for perceptually studied items. For perceptual cuing, hits and misses are for perceptually studied items, and correct rejections and false alarms are for conceptually studied items. n = 75 participants from a single independent experiment.                        Source data                     

        Extended Data Fig. 4 Grand-average left-lateralized ERPs revealing recollection-based Parietal Old/New and familiarity-based FN400 memory effects.

        Data were down-sampled to 10-ms time-bin intervals. a, b, The same profile of findings is observed as with the 100-ms time-bins (see main text), such that evidence of a peak Parietal Old/New signal (indicated by the black arrow) is exhibited 500–600-ms post-probe onset as a function of memory outcome in conceptual and perceptual source-retrieval trials (a) and evidence of a peak FN400 signal (indicated by the black arrow) is exhibited 400–500-ms post-probe onset as a function of memory outcome in novelty-detection trials (b). y-axis units are within-run z-scores. n = 75 participants from a single independent experiment.                        Source data                     

        Extended Data Fig. 5 Trait-level differences in sustained attention at encoding help to explain why individuals are more prone to remembering or forgetting.

        a, b, Greater pre-goal attention lapsing at encoding is correlated with greater pre-goal attention lapsing at retrieval (a) and lower d′ on the memory task (b). For visualization, raw scores are plotted; statistics included z-scored assays with Pearson correlations. n = 75 participants for alpha retrieval data and n = 80 participants for all other data from a single independent experiment. These trait differences in attention at encoding do not fully explain the relationship between the trait differences in attention at retrieval and memory ability (Supplementary Information).                        Source data                     

        Extended Data Fig. 6 Phasic pupil and memory effects.

        Evidence of a phasic pupil old/new effect in novelty-detection trials 300–500 ms post-probe, particularly between correctly rejected old objects versus hits to new objects. The mean peak difference is at 400 ms post-probe (indicated by the black arrow). x-axis units are 100-ms time-bin intervals; y-axis units are within-run z-scores. n = 75 participants from a single independent experiment.                        Source data                     

        Extended Data Fig. 7 Key results from extreme group analyses of multitasking, memory and sustained attention for light and heavy media multitaskers.

        ac, Heavy media multitaskers exhibited lower d′ on the memory tasks (a), more attention lapses on the gradCPT (b) and more evidence of attention lapsing (assayed by mean alpha power and pupil variability) on the memory task (c), relative to light media multitaskers. Data are mean ± s.e.m. from a single independent experiment. n = 18 light and n = 18 heavy media multitaskers for alpha data; n = 20 light and n = 20 heavy media multitaskers for all other data. d, Histogram of scores (n = 80) on the MMI, illustrated by the bottom 25% of scores (light media multitaskers), the middle 50% of scores (intermediate media multitaskers) and the top 25% of scores (heavy media multitaskers). LMM, light media multitasker; HMM, heavy media multitasker.                        Source data                     

        Extended Data Table 1 Mnemonic rates as a function of retrieval goal

        Supplementary information

                                                     

        Supplementary Information

        This file contains Supplementary Methods, Supplementary Discussion, Supplementary Notes, and Supplementary References.

        Source data

                                                                                                                                                                     

        Rights and permissions

        About this article

        Verify currency and authenticity via CrossMark

        Cite this article

        Madore, K.P., Khazenzon, A.M., Backes, C.W. et al. Memory failure predicted by attention lapsing and media multitasking.                    Nature  (2020). https://doi.org/10.1038/s41586-020-2870-z

        Download citation

        • Received31 January 2020

        • Accepted03 August 2020

        • Published28 October 2020

        • DOIhttps://doi.org/10.1038/s41586-020-2870-z

        •                    

          Subjects

                     
                           
          • Attention
          • Human behaviour
          • Long-term memory
          •                                                                            

            Comments

            By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.