Skip to main content

BRIEF RESEARCH REPORT article

Front. Psychol., 14 April 2022
Sec. Neuropsychology
This article is part of the Research Topic Virtual, Mixed, and Augmented Reality in Cognitive Neuroscience and Neuropsychology View all 9 articles

Remembering a Virtual Museum Tour: Viewing Time, Memory Reactivation, and Memory Distortion

  • 1Department of Philosophy, Social Sciences & Education, University of Perugia, Perugia, Italy
  • 2Department of Psychology, Sapienza University of Rome, Rome, Italy
  • 3Department of Psychology, University of Alberta, Edmonton, AB, Canada
  • 4Department of Psychology, Harvard University, Cambridge, MA, United States
  • 5Functional Neuroimaging Laboratory, IRCCS Santa Lucia, Rome, Italy

A variety of evidence demonstrates that memory is a reconstructive process prone to errors and distortions. However, the complex relationship between memory encoding, strength of memory reactivation, and the likelihood of reporting true or false memories has yet to be ascertained. We address this issue in a setting that mimics a real-life experience: We asked participants to take a virtual museum tour in which they freely explored artworks included in the exhibit, while we measured the participants’ spontaneous viewing time of each explored artwork. In a following memory reactivation phase, participants were presented again with explored artworks (reactivated targets), followed by novel artworks not belonging to the same exhibit (activated lures). For each of these objects, participants provided a reliving rating that indexed the strength of memory reactivation. In the final memory recognition phase, participants underwent an old/new memory task, involving reactivated vs. baseline (i.e., non-reactivated) targets, and activated and baseline lures. The results showed that those targets that were spontaneously viewed for a longer amount of time were more frequently correctly recognized. This pattern was particularly true for reactivated targets associated with greater memory strength (a higher reliving rating). Paradoxically, however, lures that were presented after targets associated with higher reliving ratings in the reactivation phase were more often erroneously recognized as artworks encountered during the tour. This latter finding indicates that memory intrusions, irrespective of the viewing time, are more likely to take place and be incorporated into true memories when the strength of target memory is higher.

Introduction

It is well established that memory is a reconstructive process (Schacter, 2001; Loftus, 2005), as supported by a number of studies showing that memory recall is prone to errors and distortions (see, for a review, Schacter et al., 2011). Memory reactivation mechanisms have been shown to play a key role in memory consolidation and memory recall: After an experience is encoded into memory, the spontaneous or instructed reactivation of that experience is thought to contribute to long-term memory stabilization and transformation of that trace, mostly by hippocampal–cortical connectivity (Tambini and Davachi, 2019). Memory reactivation can therefore be considered as a process that favors the opportunity for memory traces to be enhanced and updated with new information (Johnson and Chalfonte, 1994). However, memory reactivation also makes memories susceptible to physiological and behavioral interference (Scully et al., 2017). The dual effect of memory reactivation is well exemplified in the context of autobiographical memory by a “museum paradigm” (St. Jacques et al., 2013, 2015; St. Jacques and Schacter, 2013) that used a memory reactivation procedure to measure memory distortions. The participants were asked to take part in a self-guided audio tour of a museum wearing a body camera that automatically took photos every 15 s (encoding phase). After the tour, a memory reactivation phase took place, in which participants were presented with pictures taken from their tour (reactivated targets). Each reactivated target was immediately followed by the presentation of a novel lure photo from an alternative tour version (reactivation plus new information). Results from the subsequent recognition memory phase showed better performance for reactivated vs. non-reactivated targets, but also increased false alarms for lures, which were incorrectly recognized as items encountered during the tour.

These findings highlight that the reactivation procedure can selectively enhance—but also distort—autobiographical memories. However, it is currently unexplored whether reactivation mechanisms depend (and to what extent) on encoding-related features, such as the amount of time spent to view a specific item. In most studies of real-world memory, it is difficult to precisely control the amount of time that people spend viewing events. People may spontaneously spend more time viewing/interacting with stimuli that they find more interesting, and these differences in encoding time are known to improve memory (Li et al., 2020). Here we used virtual reality (VR) to examine how people’s natural viewing time with ecological valid experiences impacts their memories. A growing body of studies used VR to investigate episodic-autobiographical memory (Smith, 2019). Recent findings showed that VR experiences promote better autobiographical retrieval accuracy than conventional laboratory events (Kisker et al., 2021). To date, however, how learning mechanisms operate in VR and whether these processes are comparable to those operating in real life was scarcely investigated (Smith and Mulligan, 2021). Here we contributed to this issue by assessing memory of a virtual museum tour (VMT). This procedure allowed us to measure the spontaneous viewing time of each artwork explored in a setting that mimics real experience, that is, during the VMT. Two hours after, half of the artworks explored during the VMT were presented again to the participants (reactivated targets) and rated on reliving (Rubin et al., 2003). Each reactivated target was followed by novel information consisting of an artwork not belonging to the same exhibit (activated lures). We expected that a longer viewing time would promote higher reliving ratings, indicating greater strength of memory representation.

The day after the reactivation phase, the participants were administered an old/new recognition task, involving the presentation of reactivated/non-reactivated targets, and activated/non-activated lures (i.e., items that were previously presented in the reactivation phase or not, respectively). In agreement with the previous literature, we expected higher recognition accuracy for reactivated vs. non-reactivated targets, but also increased false alarms for activated vs. non-activated lures (St. Jacques et al., 2013). Moreover, we investigated the relationship between viewing time, strength of memory reactivation, and memory distortions (activated lures recognized as items encountered during the tour). If longer viewing time and/or greater memory strength of reactivated targets acts as a protective factor against memory distortions, we should find that correctly rejected lures are associated with those targets with longer viewing time and/or higher reliving rating. Conversely, increased target viewing time and/or reliving rating associated with increased false alarms (i.e., memory distortions) would paradoxically indicate that memory intrusions are more likely to be incorporated into true memories when the target viewing time and/or memory strength is higher.

Materials and Methods

Participants

Thirty-one healthy volunteers participated in this study, which was approved by the independent Ethics Committee of the IRCCS Santa Lucia and conducted in adherence to the tenets of the Declaration of Helsinki. Participants gave written informed consent to the study. Four of them were excluded from the analysis because of technical problems related to the video recording of the VMT, while another additional participant was excluded because he reported having misunderstood the experimental instructions at the end of the task, leaving 26 participants for the analysis (8 males; mean age: 29 years; SD: 9.44; range: 22–54 years). The final sample size was estimated on the basis of the previous literature using the same paradigm (St. Jacques et al., 2013) and on the basis of a power analysis conducted with G*Power 3.1.9.2 that confirmed statistical reliability with a sample size of 26 subjects (statistical power = 80%; medium effect size = 0.5; significance level = 0.05). None of the participants had already visited—in real life or virtually—the museum galleries that were explored during the experiment.

Stimuli

The stimuli consisted of 195 artworks placed in the Egyptian and Historical galleries of the Louvre Museum, explorable through a free and easily accessible virtual tour.1 The participants explored the galleries through a desktop VR system, that is, a virtual environment that uses a standard computer monitor and the keyboard/mouse as tools for interaction (Ausburn and Ausburn, 2004). This user-friendly approach drastically reduced for most people the time required to familiarize with the tool. The tour encompassed 23 rooms (Figure 1A; see Supplementary Methods). Each room could be explored by holding the mouse button and then moving it toward the left or right side of the screen. This procedure allowed a 360° exploration of each room. When the mouse pointer was in proximity of a door or a staircase, a black arrow appeared on the floor, allowing—with a mouse click—participants to move into a different part of the room or to an adjacent room. Alternatively, participants could move from one room to another by clicking on the corresponding location of the map, always available at the bottom-left corner of the display. During rooms/galleries exploration, participants encountered several artworks. Some of these artworks were clickable for a more detailed exploration through a close-up view and a related written description. These items were considered as target objects for the subsequent memory task. Targets were subdivided into several categories, each including a variable number of items (see Supplementary Methods). For each category, we found on the Internet an equal number of artworks (not exposed in the Louvre Museum) that served as lures in the reactivation/recognition phases (Figure 1B).

FIGURE 1
www.frontiersin.org

Figure 1. Virtual tour display and artworks examples. (A) Left panel: map of the explorable rooms of the Egyptian (in green) and Historic (in red) galleries of the Louvre Museum; middle panel: example of the view during the tour, including the display of a museum room, the position of the room in the map (bottom-left corner) and a brief description of the room (bottom-right corner); right panel: example of the close-up view of a clickable artwork—revealed by a circled “i” symbol (i.e., “information”) when moving the mouse—selected by the participant. (B) Targets and lures related to an example category, that is, “statuettes.” (C) Example of a trial of the memory reactivation phase that started 2 h after the end of the encoding phase. Each trial started with the presentation of a target object (i.e., an artwork explored in the encoding phase) for 5 s, and a following reliving rating; then, after a blank display of 0.5 s, a lure object, belonging to the same category of the target, was presented for 5 s, followed by a relatedness rating. (D) Example of a trial of the memory recognition phase that started 24 h after the reactivation phase. Each trial consisted in the presentation of an artwork. The participants judged whether this artwork was encountered during the virtual tour or not and then provided a confidence judgment. For each response, they had a maximum time of 8 s. ITI, inter-trial interval.

Procedure

The procedure was modeled after (St. Jacques et al., 2013) and consisted of three phases:

Encoding

The encoding phase involved virtual exploration of the galleries previously described. Before starting the VMT, the participants were allowed 5 min of exploration—limited to two rooms of the Egyptian section that included 15 clickable artworks—to familiarize themselves with the navigation tools. No other rooms were explored during the training session, and the artworks explored during training were not used in the following phases. The main VMT started from the same predefined point for each participant. The participants were instructed to navigate across the rooms and search for clickable artworks. They were free to observe the artworks for as long as they wanted. For each participant, the exploration continued until 120 out of 195 clickable artworks were found and explored by clicking on them. A researcher (SD) positioned behind the participants observed the monitor and counted the number of explored artworks. For each participant, the entire VMT was video-recorded using Camstudio 2.7.2 for offline identification of the artworks individually explored, which allowed us to select the appropriate lures for the following memory reactivation phase. Lures were randomly extracted from the set of images associated with a given target category (e.g., if a participant explored 4 “statuettes” in the VMT, four lures were randomly selected from the related set and used in the following phases; Figure 1B).

Reactivation

After a 2-h delay from the end of the encoding phase (in which the participants were free to remain in or to leave the laboratory), the memory reactivation phase started (Figure 1C). This consisted of a computer task implemented with Cogent 1.30, running in Matlab 7.1 (duration about 15 min). Each trial started with the presentation of a random target (i.e., an artwork selected and explored by that participant during the VMT) for 5 s, followed by the question: “How much do you vividly remember it?”. Participants were instructed to retrieve their memory in as much detail as possible and then to rate their subjective sense of recollection or re-experience on a four-point scale from low to high, with no time limits. After the presentation of a blank display for 0.5 s, a lure item randomly selected from the same category of the previous target item was presented for 5 s, and participants were asked to make a perceptual decision, operationalized by the question: “Could it be taken from the same exhibit?”, answering again on a four-point scale from low to high, with no time limits. When a given lure was used in one trial it could not be used in a different trial for that participant. After an inter-trial interval (ITI) of 1 s, the following trial began. This task included 60 trials, involving 120 stimuli, 60 targets, and 60 lures.

Recognition

The recognition phase started approximately 24 h (24 h and 9 min ± 30 min) after the conclusion of the reactivation phase (Figure 1D) and consisted of a memory recognition task (again implemented with Cogent/Matlab). On each trial, the participants were presented with an artwork and their task was to judge, within 8 s, whether this item was encountered during the VMT (encoding phase). Then, they provided a confidence rating about their previous response (“Are you sure?” display) on a scale from 1 (“not at all”) to 4 (“completely”), within 8 s. After an ITI of 1 s, the next trial was presented. The recognition phase included 240 stimuli: 60 targets explored during the VMT and then reactivated in the reactivation phase (“reactivated targets”); 60 targets explored during the VMT but not presented in the reactivation phase (“baseline targets”); 60 lures presented during the reactivation phase (“activated lures”); 60 lures never presented to the participants (“baseline lures”). The stimuli were presented in a random order across two blocks of 120 stimuli each. Each block lasted about 12.5 min. Participants were allowed to rest a few minutes between the blocks.

Results

First, we computed the proportion of “yes” responses during the recognition memory phase, that is, the responses in which the participants indicated that the artwork was encountered during the VMT (hit targets). Participants remembered reactivated targets (79%) more frequently than baseline targets (52%) [hits, two-tailed paired t-test: t(25) = 15.4, p < 0.001, Cohen’s d = 3.190], indicating that the reactivation phase increased the number of hits (Figure 2A; see also Supplementary Table 1). However, the reactivation phase also increased the number of lures erroneously recognized as items encountered during the VMT, as evidenced by the significant difference between activated lures (35%) vs. baseline lures (13%) [false alarms: t(25) = 10.4, p < 0.001, d = 2.113]. Second, we examined the relationship between the degree of reliving during the reactivation phase and subsequent recognition memory performance, for reactivated items (both targets and lures) that were recognized as encountered (“yes” responses) or not (“no” responses) in the VMT. Hit targets were associated with greater reliving ratings as compared to not recognized targets [3.4 vs. 2.2; t(25) = 11.1, p < 0.001, d = 2.108] (Figure 2B). Similarly, erroneously recognized lures were associated with greater reliving ratings than correctly rejected lures [1.9 vs. 1.5; t(25) = 6.3, p < 0.001, d = 1.448]. These findings indicate that the quality/strength of reactivation affected the level of true and false memories: The greater the reliving rate, the higher the probability of recognizing that item as encountered during the VMT (a “yes” response at the memory recognition phase).

FIGURE 2
www.frontiersin.org

Figure 2. Memory recognition performance and reliving ratings. (A) Proportion of “yes” responses (± the standard error of the mean) for reactivated and baseline targets. The graph shows that the reactivation procedure increased both hits and false alarms. (B) Mean reliving ratings (± the standard error of the mean) for reactivated items expressed during the memory reactivation phase. The graph shows that higher reliving ratings are associated with an increased probability to recognized the artwork (target or lure) as an item encountered during the museum tour (i.e., a “yes” response). ***p < 0.001.

Next, we evaluated the impact of the viewing time on the strength of memory reactivation (phase 2) for targets that were correctly recognized (hits) or not (missed; phase 3; see Supplementary Results for preliminary analyses of participants’ behavior at encoding). We conducted a two-way repeated-measure ANOVA with the factors of Performance outcome of reactivated targets (hits or misses) and Reliving rating (low, 1–2 scores, vs. high, 3–4 scores) on the viewing time (Figure 3A). This analysis revealed a main effect of the target performance outcome [F(1.25) = 15.4, p < 0.001, ɳ2 = 0.382], indicating that hit targets were encoded for a longer amount of time than missed targets (8.5 and 7.1 s, respectively). The main effect of reliving rating was not significant [F(1.25) = 2.5, p = 0.123, ɳ2 = 0.092]. Importantly, however, the reliving rating interacted with the target performance outcome [F(1.25) = 5.9, p = 0.023, ɳ2 = 0.190], indicating a longer viewing time for those targets that received a higher reliving rating (vs. low reliving rating), but only for hits (9.2 vs. 7.8 s) and not for missed targets (7.2 vs. 7.1 s). Increased viewing time was also found for hits (8.9 s) vs. missed (7.2 s) baseline targets [t(25) = 3.7, p < 0.001, d = 0.694] (Figure 3B). Furthermore, the relationship between the viewing time and target memory performance was also confirmed by an item-specific correlation analysis that crossed the average viewing time with the average recognition accuracy (percentage of hits) for each target object across participants. As illustrated in Figure 3C, we found a significant correlation between the viewing time and the percentage of hits for reactivated targets (r = 0.169, p = 0.023, r2 = 0.029), but not for baseline targets (r = 0.085, p = 0.257, r2 = 0.007; left panel). However, when considering high confidence ratings only (i.e., 3 and 4 scores; right panel), we found a significant correlation for both reactivated (r = 0.188, p = 0.011, r2 = 0.035) and baseline targets (r = 0.153, p = 0.041, r2 = 0.023), confirming that the recognition accuracy of both reactivated and baseline targets benefited from longer viewing time. Conversely, when considering low confidence ratings only (1 and 2 scores; central panel), no relation between recognition accuracy and viewing time was found, neither for reactivated (r = −0.083, p = 0.266, r2 = 0.007), nor for baseline targets (r = −0.135, p = 0.073, r2 = 0.018).

FIGURE 3
www.frontiersin.org

Figure 3. Viewing time. (A) Mean viewing time (± the standard error of the mean) in reactivated targets that were recognized (hits) or not (misses) at the memory recognition task (phase 3) according to the reliving rating reported during the reactivation procedure (phase 2). This shows greater viewing time for hits vs. misses, and also greater viewing time for high reliving rate hit targets. (B) Mean viewing time (± the standard error of the mean) in baseline targets, indicating a greater viewing time spent for non-reactivated targets subsequently recognized (hit) vs. missed in the recognition memory task (phase 3). (C) The relationship between recognition accuracy and viewing time. The graphs show that when higher confidence scores are considered, the recognition accuracy of both reactivated and baseline targets benefited from a longer viewing time. ***p < 0.001; *p < 0.05.

Finally, we assessed whether encoding-related parameters (i.e., viewing time and reliving ratings) affected the fate of lures in terms of false alarms and correct rejections. As illustrated in Figure 4A, we found that the performance outcome of the activated lures in the memory reactivation phase (i.e., false alarms vs. correct rejections) was not affected by the viewing time of the related targets (9.6 vs. 8.6 s, respectively) [t(25) = 1.1, p = 0.281, d = 0.216]. Conversely, the strength of target memory, as indexed by target reliving ratings, significantly affected the fate of lures (Figure 4B). Lures erroneously recognized as artworks encountered during the tour (false alarms) were associated with targets that received a higher reliving rate (3.2) as compared to lures that were correctly rejected (0.7) [t(25) = 4.6, p < 0.001, d = 9.918].

FIGURE 4
www.frontiersin.org

Figure 4. Memory recognition performance for activated lures. Mean viewing time (A) and mean reliving rating (B) (± the standard error of the mean) in reactivated targets associated with activated lures (phase 2) that were erroneously (false alarms) or correctly recognized (correct rejections) in phase 3. Target-related viewing time did not significantly affect lure recognition outcome (A); by contrast, the target reliving rating was significantly higher in those lures that were erroneously recognized as artworks encountered in the tour compared to lures correctly rejected (B). ***p < 0.001.

Discussion

In terms of recognition memory performance, the results were highly consistent with the previous literature (St. Jacques and Schacter, 2013). This finding is interesting because, in contrast to a previous study (Diamond et al., 2020), it indicates that the VMT produces effects similar to the actual experience of a museum tour. Specifically, the reactivation phase produced an increased number of reactivated (vs. baseline) targets correctly recognized as artworks explored during the VMT, possibly acting as a retrieval practice phase (McDermott, 2021). However, the reactivation phase also produced an increased number of false alarms (i.e., artworks erroneously recognized as objects encountered in the tour) for activated vs. baseline lures. This effect might be interpreted as a failure of source monitoring (Johnson et al., 1993; Mitchell and Johnson, 2009), related to the capability of attributing a given artwork to the VMT or to information seen later in the reactivation phase. Alternatively, as suggested by St. Jacques and Schacter (2013), the increase of false alarms might be interpreted on the basis of those models that have linked memory reactivation with updating of existing memories (Johnson and Chalfonte, 1994; Hardt et al., 2010; Sederberg et al., 2011), as memory reactivation also involves the incorporation of new information into existing memories (Hupbach et al., 2007, 2009). The current design does not allow us to disentangle whether the increased number of false alarms was a consequence of memory updating or source confusion. However, our findings are consistent with the notion that memory reactivation—and, in general, memory retrieval—is an active process that can modify existing memories (Schacter, 2012; Scully et al., 2017).

We also found that the likelihood of recognizing an artwork as encountered during the tour was related to the reliving rating, both for reactivated targets and activated lures. This finding indicates that the strength of the (re)activation had a significant impact both on true and false memories (St. Jacques et al., 2013). The present study provides novel evidence about the generalizability of these reactivation-related effects, which were observed here using VR. Moreover, in the current study, we drastically reduced the time intervals among the three phases, from 48 (as in St. Jacques and Schacter, 2013) to 2 h. Also considering the well-known relationship between sleep and memory consolidation (Klinzing et al., 2019), a 48-h delay—involving two nights of sleep—typically allows memory consolidation into stable long-term memories (Lisman and Morris, 2001; Yang et al., 2009). Conversely, the 2-h delay used in the current experiment allowed us to investigate the impact of memory reactivation on much more recently encoded/less consolidated memories. Notwithstanding these temporal differences, we found similar findings compared to the previous studies (St. Jacques et al., 2013, 2015; St. Jacques and Schacter, 2013). This extends the previous literature, showing that memory reactivation enhances both target recognition and false alarms also at shorter delays.

The current findings also revealed a clear link between viewing time, strength of memory reactivation, and recognition accuracy. Correctly recognized targets were encoded for a longer amount of time than missed targets. This pattern was particularly evident for those reactivated targets associated with a higher reliving rating. This effect was also evident when switching to an object-based approach, that is, considering the fate of each single artwork in the tour. The longer a given artwork was encoded (averaging the viewing time across the participants) the higher the probability for that artwork to be correctly recognized, especially when the participants were more confident about the accuracy of their memory. Interestingly, while low confidence ratings are thought to be associated with familiarity-based recognition memory decisions, high confidence ratings are associated with recollection (Yonelinas, 2002; Evans and Wilding, 2012). The impact of viewing time therefore appears to be specifically linked to recollection-based memory judgments.

A number of studies have reported encoding-dependent benefits at retrieval in short-term memory tasks, suggesting that the likelihood to correctly retrieve information at short-term intervals is a function of the attentional resources devoted to that information at encoding (e.g., Fine and Minnery, 2009; Botta et al., 2010; Huebner and Gegenfurtner, 2011; Melcher and Piazza, 2011; Santangelo and Macaluso, 2013; Pedale and Santangelo, 2015; Santangelo et al., 2015; for reviews, see Gazzaley and Nobre, 2012; Santangelo, 2015). A similar link has been documented in long-term memory, showing for instance that the probability of successful retrieval is a function of the number of repetitions of the to-be-remembered material studied at encoding (Koutstaal et al., 1998). Consistently, we showed higher recognition accuracy as a function of spontaneous viewing time, especially for reactivated targets associated with higher reliving ratings. An increased viewing time therefore appears to promote successful recognition, possibly by creating stronger memory representation (Diekelmann et al., 2011). This suggestion is in good agreement with the non-monotonic plasticity hypothesis (Sinclair and Barense, 2019), according to which there is a U-shaped relationship between the strength of the memory reactivation and the degree of memory change. Weakly reactivated memories would not become labile, avoiding to influence synaptic plasticity. Moderate reactivation would instead induce optimal synaptic weakening, eliciting neural plasticity; and strong reactivation would strengthen synaptic connections, making memories resistant to later distortions and preserving accurate recall (Newman and Norman, 2010). Consistently, we showed that targets encoded for a longer time and then rated with higher reliving are more correctly retrieved than targets associated with lower reliving ratings.

One may argue that the viewing time and the related increase in the strength of memory reactivation may also act as a protective factor against memory distortions with respect to lure recognition. For instance, Marche and Howe (1995) reported that the susceptibility to misinformation decreased when the original information was encoded multiple times vs. once. The current findings did not reveal any effect of the viewing time on memory distortions. However, we found that lures were more likely erroneously recognized as artworks explored during the tour when they were presented after targets associated with higher reliving ratings in the reactivation phase. This finding suggests that new information (activated lures) was incorporated more easily into old information (reactivated targets) reactivated with greater memory strength. Incidentally, the specific question used during lure activation (“Could it be taken from the same exhibit?”) might have enhanced this effect by promoting imagination inflation (Garry et al., 1996). This finding can be interpreted in the light of the temporal context model (Sederberg et al., 2011), according to which memory reactivation reinstates the context from the original encoding occurred when the memory traces started to be formed. The reactivation of stronger memories associated with higher reliving ratings could lead to a greater reinstatement of the VMT (also in agreement with the non-monotonic plasticity hypothesis), leading participants to encode the category-matched lures within the same context of the target objects encountered during the tour. The reactivation of those targets associated with greater memory strength might have therefore favored the incorporation of false information (lures) to true information (the reactivated target associated with higher reliving ratings).

Some limitations should be also considered when interpreting the present findings. While the VMT allowed us to accurately measure the spontaneous viewing time of single artworks, there are several obvious differences from real-world experiences. For instance, in the real-world people would probably spend much longer time at each exhibit, and the social interaction among exhibit visitors might also have a deep impact on memory formation. Moreover, in the current study, we did not investigate several individual factors (curiosity and/or personal interest for specific objects/artworks, etc.) that might have contributed to driving some of the reported effects. Notwithstanding these important aspects that should be considered by future studies, we showed in a setting that mimics real experience that those artworks that were spontaneously viewed for a longer amount of time were more frequently correctly recognized as objects seen during the virtual tour. By contrast, the current findings did not reveal any effect of the viewing time on the proportion of memory distortions. We found instead that the proportion of memory distortions increased when novel artworks were associated with those artworks seen in the tour that elicited in the participants a stronger memory reactivation, irrespective of the viewing time. Overall, these findings suggest that longer viewing time promotes better memory recognition, but fails to act as a protective factor against memory distortions.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the IRCCS Santa Lucia Foundation. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SD collected the data. SD and VS analyzed and interpreted the data and wrote the first draft of the manuscript. All authors contributed, conceived, and designed the study to improve the quality of the manuscript with significant feedback.

Funding

This work was supported by the Bial Foundation (Grant No. 75/20, to VS) and by the Italian Ministry of Health (RF-2019-12369567, to VS).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We wish to publicly thank the Louvre museum for providing a freely available virtual tour of some galleries.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.869336/full#supplementary-material

Footnotes

References

Ausburn, L. J., and Ausburn, F. B. (2004). Desktop virtual reality: a powerful new technology for teaching and research in industrial teacher education. J. STEM Teach. Educ. 41, 1–16.

Google Scholar

Botta, F., Santangelo, V., Raffone, A., Lupiáñez, J., and Olivetti Belardinelli, M. (2010). Exogenous and endogenous spatial attention effects on visuospatial working memory. Q. J. Exp. Psychol. 63, 1590–1602. doi: 10.1080/17470210903443836

PubMed Abstract | CrossRef Full Text | Google Scholar

Diamond, N. B., Abdi, H., and Levine, B. (2020). Different patterns of recollection for matched real-world and laboratory-based episodes in younger and older adults. Cognition 202:104309. doi: 10.1016/j.cognition.2020.104309

PubMed Abstract | CrossRef Full Text | Google Scholar

Diekelmann, S., Buchel, C., Born, J., and Rasch, B. (2011). Labile or stable: opposing consequences for memory when reactivated during waking and sleep. Nat. Neurosci. 14, 381–386. doi: 10.1038/nn.2744

CrossRef Full Text | Google Scholar

Evans, L. H., and Wilding, E. L. (2012). Recollection and familiarity make independent contributions to memory judgments. J. Neurosci. 32, 7253–7257. doi: 10.1523/JNEUROSCI.6396-11.2012

PubMed Abstract | CrossRef Full Text | Google Scholar

Fine, M. S., and Minnery, B. S. (2009). Visual salience affects performance in a working memory task. J. Neurosci. 29, 8016–8021. doi: 10.1523/JNEUROSCI.5503-08.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Garry, M., Manning, C. G., Loftus, E. F., and Sherman, S. J. (1996). Imagination inflation: imagining a childhood event inflates confidence that it occurred. Psychon. Bull. Rev. 3, 208–214. doi: 10.3758/BF03212420

PubMed Abstract | CrossRef Full Text | Google Scholar

Gazzaley, A., and Nobre, A. C. (2012). Top-down modulation: bridging selective attention and working memory. Trends Cogn. Sci. 16, 129–135. doi: 10.1016/j.tics.2011.11.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Hardt, O., Einarsson, E. O., and Nader, K. (2010). A bridge over troubled water: reconsolidation as a link between cognitive and neuroscientific memory research traditions. Annu. Rev. Psychol. 61, 141–167. doi: 10.1146/annurev.psych.093008.100455

PubMed Abstract | CrossRef Full Text | Google Scholar

Huebner, G. M., and Gegenfurtner, K. R. (2011). The efficiency of encoding: limits of information transfer into memory. Atten. Percept. Psychophys. 73, 1503–1521. doi: 10.3758/s13414-011-0120-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Hupbach, A., Gomez, R., Hardt, O., and Nadel, L. (2007). Reconsolidation of episodic memories: a subtle reminder triggers integration of new information. Learn. Mem. 14, 47–53. doi: 10.1101/lm.365707

PubMed Abstract | CrossRef Full Text | Google Scholar

Hupbach, A., Gomez, R., and Nadel, L. (2009). Episodic memory reconsolidation: updating or source confusion? Memory 17, 502–510. doi: 10.1080/09658210902882399

CrossRef Full Text | Google Scholar

Johnson, M. K., and Chalfonte, B. L. (1994). “Binding complex memories: the role of reactivation and the hippocampus,” in Memory Systems. eds. D. L. Schacter and E. Tulving (Cambridge, MA: MIT Press), 311–350.

Google Scholar

Johnson, M. K., Hashtroudi, S., and Lindsay, D. S. (1993). Source monitoring. Psychol. Bull. 114, 3–28. doi: 10.1037/0033-2909.114.1.3

CrossRef Full Text | Google Scholar

Kisker, J., Gruber, T., and Schöne, B. (2021). Virtual reality experiences promote autobiographical retrieval mechanisms: electrophysiological correlates of laboratory and virtual experiences. Psychol. Res. 85, 2485–2501. doi: 10.1007/s00426-020-01417-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Klinzing, J. G., Niethard, N., and Born, J. (2019). Mechanisms of systems memory consolidation during sleep. Nat. Neurosci. 22, 1598–1610. doi: 10.1038/s41593-019-0467-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Koutstaal, W., Schacter, D. L., Johnson, M. K., Angell, K. E., and Gross, M. S. (1998). Post-event review in older and younger adults: improving memory accessibility of complex everyday events. Psychol. Aging 13, 277–296. doi: 10.1037/0882-7974.13.2.277

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Xiong, Z., Theeuwes, J., and Wang, B. (2020). Visual memory benefits from prolonged encoding time regardless of stimulus type. J. Exp. Psychol. Learn. Mem. Cogn. 46, 1998–2005. doi: 10.1037/xlm0000847

PubMed Abstract | CrossRef Full Text | Google Scholar

Lisman, J., and Morris, R. G. (2001). Memory. Why is the cortex a slow learner? Nature 411, 248–249. doi: 10.1038/35077185

PubMed Abstract | CrossRef Full Text | Google Scholar

Loftus, E. F. (2005). Planting misinformation in the human mind: a 30-year investigation of the malleability of memory. Learn. Mem. 12, 361–366. doi: 10.1101/lm.94705

PubMed Abstract | CrossRef Full Text | Google Scholar

Marche, T. A., and Howe, M. L. (1995). Preschoolers report misinformation despite accurate memory. Dev. Psychol. 31, 554–567. doi: 10.1037/0012-1649.31.4.554

CrossRef Full Text | Google Scholar

McDermott, K. B. (2021). Practicing retrieval facilitates learning. Annu. Rev. Psychol. 72, 609–633. doi: 10.1146/annurev-psych-010419-051019

PubMed Abstract | CrossRef Full Text | Google Scholar

Melcher, D., and Piazza, M. (2011). The role of attentional priority and saliency in determining capacity limits in enumeration and visual working memory. PLoS One 6:e29296. doi: 10.1371/journal.pone.0029296

PubMed Abstract | CrossRef Full Text | Google Scholar

Mitchell, K. J., and Johnson, M. K. (2009). Source monitoring 15 years later: what have we learned from fMRI about the neural mechanisms of source memory? Psychol. Bull. 135, 638–677. doi: 10.1037/a0015849

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, E. L., and Norman, K. A. (2010). Moderate excitation leads to weakening of perceptual representations. Cereb. Cortex 20, 2760–2770. doi: 10.1093/cercor/bhq021

PubMed Abstract | CrossRef Full Text | Google Scholar

Pedale, T., and Santangelo, V. (2015). Perceptual salience affects the contents of working memory during free-recollection of objects from natural scenes. Front. Hum. Neurosci. 9:60. doi: 10.3389/fnhum.2015.00060

PubMed Abstract | CrossRef Full Text | Google Scholar

Rubin, D. C., Schrauf, R. W., and Greenberg, D. L. (2003). Belief and recollection of autobiographical memories. Mem. Cogn. 31, 887–901. doi: 10.3758/BF03196443

CrossRef Full Text | Google Scholar

Santangelo, V. (2015). Forced to remember: when memory is biased by salient information. Behav. Brain Res. 283, 1–10. doi: 10.1016/j.bbr.2015.01.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Santangelo, V., Di Francesco, S. A., Mastroberardino, S., and Macaluso, E. (2015). Processing of contextual and saliency signals in parietal cortex during the encoding of natural scenes in working memory. Hum. Brain Mapp. 36, 5003–5017. doi: 10.1002/hbm.22984

PubMed Abstract | CrossRef Full Text | Google Scholar

Santangelo, V., and Macaluso, E. (2013). Visual salience improves spatial working memory via enhanced parieto-temporal functional connectivity. J. Neurosci. 33, 4110–4117. doi: 10.1523/JNEUROSCI.4138-12.2013

PubMed Abstract | CrossRef Full Text | Google Scholar

Schacter, D. L. (2001). The Seven Sins of Memory: How the Mind Forgets and Remembers. Houghton Mifflin, Boston, MA.

Google Scholar

Schacter, D. L. (2012). Adaptive constructive processes and the future of memory. Am. Psychol. 67, 603–613. doi: 10.1037/a0029869

PubMed Abstract | CrossRef Full Text | Google Scholar

Schacter, D. L., Guerin, S. A., and St. Jacques, P. L. (2011). Memory distortions: an adaptive perspective. Trends Cogn. Sci. 15, 467–474. doi: 10.1016/j.tics.2011.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Scully, I. D., Napper, L. E., and Hupbach, A. (2017). Does reactivation trigger episodic memory change? A meta-analysis. Neurobiol. Learn. Mem. 142, 99–107. doi: 10.1016/j.nlm.2016.12.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Sederberg, P. B., Gershman, S. J., Polyn, S. M., and Norman, K. A. (2011). Human memory reconsolidation can be explained using the temporal context model. Psychon. Bull. Rev. 18, 455–468. doi: 10.3758/s13423-011-0086-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Sinclair, A. H., and Barense, M. D. (2019). Prediction error and memory reactivation: how incomplete reminders drive reconsolidation. Trends Neurosci. 42, 727–739. doi: 10.1016/j.tins.2019.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, S. A. (2019). Virtual reality in episodic memory research: a review. Psychon. Bull. Rev. 26, 1213–1237. doi: 10.3758/s13423-019-01605-w

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, S. A., and Mulligan, N. W. (2021). Immersion, presence, and episodic memory in virtual reality environments. Memory 29, 983–1005. doi: 10.1080/09658211.2021.1953535

PubMed Abstract | CrossRef Full Text | Google Scholar

St. Jacques, P. L., Montgomery, D., and Schacter, D. L. (2015). Modifying memory for a museum tour in older adults: reactivation-related updating that enhances and distorts memory is reduced in ageing. Memory 23, 876–887. doi: 10.1080/09658211.2014.933241

PubMed Abstract | CrossRef Full Text | Google Scholar

St. Jacques, P. L., Olm, C., and Schacter, D. L. (2013). Neural mechanisms of reactivation-induced updating that enhance and distort memory. Proc. Natl. Acad. Sci. U. S. A. 110, 19671–19678. doi: 10.1073/pnas.1319630110

PubMed Abstract | CrossRef Full Text | Google Scholar

St. Jacques, P. L., and Schacter, D. L. (2013). Modifying memory: selectively enhancing and updating personal memories for a museum tour by reactivating them. Psychol. Sci. 24, 537–543. doi: 10.1177/0956797612457377

PubMed Abstract | CrossRef Full Text | Google Scholar

Tambini, A., and Davachi, L. (2019). Awake reactivation of prior experiences consolidates memories and biases cognition. Trends Cogn. Sci. 23, 876–890. doi: 10.1016/j.tics.2019.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, G., Pan, F., and Gan, W. B. (2009). Stably maintained dendritic spines are associated with lifelong memories. Nature 462, 920–924. doi: 10.1038/nature08577

PubMed Abstract | CrossRef Full Text | Google Scholar

Yonelinas, A. P. (2002). The nature of recollection and familiarity: a review of 30 years of research. J. Mem. Lang. 46, 441–517. doi: 10.1006/jmla.2002.2864

CrossRef Full Text | Google Scholar

Keywords: autobiographical memory, virtual tour, memory encoding, memory reactivation, memory recognition, false memories

Citation: Daviddi S, Mastroberardino S, St. Jacques PL, Schacter DL and Santangelo V (2022) Remembering a Virtual Museum Tour: Viewing Time, Memory Reactivation, and Memory Distortion. Front. Psychol. 13:869336. doi: 10.3389/fpsyg.2022.869336

Received: 04 February 2022; Accepted: 24 March 2022;
Published: 14 April 2022.

Edited by:

Mounia Ziat, Bentley University, United States

Reviewed by:

Teal S. Eich, University of Southern California, United States
Marina Carulli, Politecnico di Milano, Italy

Copyright © 2022 Daviddi, Mastroberardino, St. Jacques, Schacter and Santangelo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Valerio Santangelo, valerio.santangelo@unipg.it

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.