You will be provided with a reference and some statements. Please determine whether each statement is 'supported', 'unsupported', or 'unknown' with respect to the reference. Please note:
First, assess whether the reference contains any valid content. If the reference contains no valid information, such as a 'page not found' message, then all statements should be considered 'unknown'.
If the reference is valid, for a given statement: if the facts or data it contains can be found entirely or partially within the reference, it is considered 'supported' (data accepts rounding); if all facts and data in the statement cannot be found in the reference, it is considered 'unsupported'.

You should return the result in a JSON list format, where each item in the list contains the statement's index and the judgment result, for example:
[
    {
        "idx": 1,
        "result": "supported"
    },
    {
        "idx": 2,
        "result": "unsupported"
    }
]

Below are the reference and statements:
<reference>
Executive function and the continued influence of misinformation: A latent-variable analysis - PMC

Misinformation can continue to influence reasoning after correction; this is known as the continued influence effect (CIE). Theoretical accounts of the CIE suggest failure of two cognitive processes to be causal, namely memory updating and ...

Skip to main content

An official website of the United States government

Here's how you know

Here's how you know

Official websites use .gov

A

.gov
website belongs to an official
government organization in the United States.

Secure .gov websites use HTTPS

A
lock
(

) or
https://
means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.

Search

Log in

Dashboard

Publications

Account settings

Log out

Search…

Search NCBI

Primary site navigation

Search

Logged in as:

Dashboard

Publications

Account settings

Log in

Search PMC Full-Text Archive

Search in PMC

Journal List

User Guide

PERMALINK

Copy

As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with,
the contents by NLM or the National Institutes of Health.

Learn more:

PMC Disclaimer

|

PMC Copyright Notice

PLoS One
. 2023 Apr 5;18(4):e0283951. doi:
10.1371/journal.pone.0283951

Search in PMC

Search in PubMed

View in NLM Catalog

Add to search

Executive function and the continued influence of misinformation: A latent-variable analysis

Paul McIlhiney

Paul McIlhiney

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

Find articles by
Paul McIlhiney

1,
*
,
Gilles E Gignac

Gilles E Gignac

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

Conceptualization, Formal analysis, Methodology, Project administration, Validation, Writing – review & editing

Find articles by
Gilles E Gignac

1
,
Ullrich K H Ecker

Ullrich K H Ecker

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Find articles by
Ullrich K H Ecker

1
,
Briana L Kennedy

Briana L Kennedy

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

Methodology, Writing – review & editing

Find articles by
Briana L Kennedy

1
,
Michael Weinborn

Michael Weinborn

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Find articles by
Michael Weinborn

1

Editor:
Alessandra S Souza
2

Author information

Article notes

Copyright and License information

1
School of Psychological Science, University of Western Australia, Crawley, WA, Australia

2
University of Zurich, SWITZERLAND

Competing Interests:
The authors have declared that no competing interests exist.

✉
* E-mail:
paul.mcilhiney@research.uwa.edu.au

Roles

Paul McIlhiney
:
Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

Gilles E Gignac
:
Conceptualization, Formal analysis, Methodology, Project administration, Validation, Writing – review & editing

Ullrich K H Ecker
:
Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Briana L Kennedy
:
Methodology, Writing – review & editing

Michael Weinborn
:
Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Alessandra S Souza
:
Editor

Received 2022 Jun 22; Accepted 2023 Mar 21; Collection date 2023.

© 2023 McIlhiney et al

This is an open access article distributed under the terms of the
Creative Commons Attribution License
, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

PMC Copyright notice

PMCID: PMC10075451 PMID:
37018324

Abstract

Misinformation can continue to influence reasoning after correction; this is known as the continued influence effect (CIE). Theoretical accounts of the CIE suggest failure of two cognitive processes to be causal, namely memory updating and suppression of misinformation reliance. Both processes can also be conceptualised as subcomponents of contemporary executive function (EF) models; specifically, working-memory updating and prepotent-response inhibition. EF may thus predict susceptibility to the CIE. The current study investigated whether individual differences in EF could predict individual differences in CIE susceptibility. Participants completed several measures of EF subcomponents, including those of updating and inhibition, as well as set shifting, and a standard CIE task. The relationship between EF and CIE was then assessed using a correlation analysis of the EF and CIE measures, as well as structural equation modelling of the EF-subcomponent latent variable and CIE latent variable. Results showed that EF can predict susceptibility to the CIE, especially the factor of working-memory updating. These results further our understanding of the CIE’s cognitive antecedents and provide potential directions for real-world CIE intervention.
Introduction

During the Australian “Black Summer” wildfires in 2019/2020, some groups repeatedly claimed that arson caused the fires; while these claims were later debunked, some continued to falsely believe in arson’s causative role, contributing to further polarisation in the climate-change debate [
1
,
2
]. Such a phenomenon is a real-world example of the
continued influence effect
(CIE) [
3
,
4
]. Specifically, the CIE constitutes the continued use of information in inferential reasoning after said information has been retracted or corrected. Psychological lab studies have demonstrated that the CIE can occur even when materials are fictional, suggesting that cognitive factors play a significant role in the CIE [e.g.,
4
–
8
]. Consequently, there has been two decades worth of research attention on the role that cognitive processes play in the CIE [e.g.,
7
,
9
–
15
; also see
16
]. However, little is known about how individual differences in cognition influence CIE susceptibility. While recent individual differences research has suggested a potential role for working-memory updating [
17
], attempts to replicate these results have failed [
18
] and so require further investigation. One model that may be useful in this regard is Miyake’s model of executive function [
19
], which includes working-memory updating as a subcomponent alongside prepotent-response inhibition and mental-set shifting. Using Miyake’s model, understanding of the relationship between cognitive abilities and the CIE may be improved; that is, results could provide further insight into current cognitive theories of the CIE and aid intervention efforts in the real world.

One of the two theories proposed to explain the role of cognitive processes in the CIE is the mental-model-updating account. This account is derived from mental-model theory, which postulates that people build mental models of events in real time, and update these models when new information (e.g., a correction) is received [
20
]. From this perspective, a CIE may arise from a failure in memory-updating processes [
16
,
21
]. Supporting this theory, Ecker et al. [
11
] demonstrated that retractions reduced the CIE more effectively when original misinformation was repeated (versus not being repeated) at the time of retraction. The authors suggested that repeating misinformation may increase the salience of retractions, thus aiding their integration into the mental model. In a further study, neural pathways associated with memory updating showed greater activation during processing of corrections than during processing of non-corrective information [
22
; however, see
23
]. This account suggests that better updating of working memory may promote better integration of corrections into mental event models. In line with this thinking, working-memory capacity has been shown to be predictive of the CIE [
17
].

An alternative, complementary theory is a retrieval-based account, which postulates that both misinformation and correction are stored concurrently and compete for activation at memory retrieval [e.g.,
12
,
24
]. This account suggests that continued influence can occur if misinformation is selectively retrieved by an automatic familiarity-driven process but fails to be inhibited when responding to event-related test questions [
12
]. In support of this account, Swire et al. [
25
] demonstrated that factors that are theoretically conducive to use of familiarity-based retrieval (as opposed to more strategic, recollection-based retrieval, e.g., longer study-test delays; advanced participant age) were associated with greater reliance on corrected misinformation. This account suggests that greater capacity for inhibition of prepotent responses may translate to an enhanced ability to inhibit responses based on automatically retrieved misinformation. While no previous research has provided empirical evidence for a link between inhibitory processes and the CIE, work in the knowledge-revision literature has shown that better prepotent-response inhibition provides a mechanism to manage interference from misconceptions when reading accurate but counterintuitive statements [
26
].

More recent efforts have been made from an individual-differences perspective to understand the role of cognitive processes in the CIE; however, these efforts have been thus far limited to investigations of the CIE’s relationship with working-memory capacity [
17
] and verbal cognitive ability [
27
]. Brydges et al. [
17
] investigated the relationship between CIE susceptibility and working-memory capacity. Participants were given several measures of working-memory capacity, from which a latent variable was derived and used to try predict performance on a CIE paradigm task [see
14
]. Briefly, the CIE paradigm task involves presenting several news reports containing critical information that is, or is not, subsequently corrected; inferential-reasoning questions are then used to gauge participants’ reliance on the critical (mis-)information. In line with Brydges et al.’s [
17
] predictions, higher working-memory capacity predicted lower CIE susceptibility [however, see
18
]. The authors suggested that their results support the mental-model-updating account of the CIE, as model updating relies on working memory. De keersmaecker and Roets [
27
] investigated whether verbal cognitive ability predicted CIE susceptibility. The authors partly based their investigation on the comprehensive assessment of rational thinking model [
28
], which suggests that cognitive ability is relevant to the inhibition and overriding of previously learned responses. Results showed that higher verbal cognitive ability predicted lower CIE susceptibility.

In sum, then, recent evidence suggests that individual differences in higher-level cognitive abilities—such as working-memory capacity [
17
]—may play a role in determining individual susceptibility to the CIE. However, this line of investigation has yet to assess both theoretically implicated cognitive processes—memory updating and inhibition—directly and concurrently. Thus, an exploratory investigation of the correlations between updating, inhibition, and CIE measures is warranted. Furthermore, both candidate cognitive processes can also be conceptualised as subcomponents of
executive function
(EF), as in Miyake’s model [
19
; for reviews, see
29
–
31
]. Therefore, assessing the relationship between the subcomponents of Miyake’s EF model and CIE susceptibility may allow for a more nuanced understanding of how individual differences in cognitive abilities affect the CIE, as well as how well each CIE theory explains the CIE.
The current study

The current, exploratory, study aimed to investigate whether individual differences in executive function (EF) were predictive of individual differences in CIE susceptibility. To do this, participants were given three measures of each EF subcomponent from Miyake et al.’s [
19
] model (i.e., working-memory updating, prepotent-response inhibition, and mental-set shifting), followed by a CIE-paradigm task [e.g.,
32
]. While we did not expect an effect of shifting, we included it for completeness. We used confirmatory factor analyses (CFA) to fit our data, starting with the model architectures suggested by Miyake and colleagues but also testing alternative models. Subsequently, we ran a correlation analysis between the EF tasks and the CIE task, as well as a structural equation model (SEM) analysis of the CIE-task latent variable regressed onto our EF model. Note that both verbal and non-verbal measures of each EF subcomponent were employed, as Brydges et al. [
17
] found that only verbal working-memory capacity measures correlated with CIE susceptibility; specifically, of the three measures we used for each EF subcomponent, two were verbal and one was non-verbal.

As the current study is exploratory, due to the limited individual-differences evidence for CIE theoretical accounts [
17
,
27
], we simply hypothesised that greater EF ability would predict lower CIE susceptibility. As such, we predicted that there would be: (i) negative observed-score correlations between one or more of the EF measures and CIE measure, and (ii) a significant negative β weight between one or more of the EF-subcomponent latent variables and the CIE latent variable. However, note that finding such relationships for updating and inhibition measures would provide some evidence for the mental-model-updating and selective-retrieval accounts of the CIE, respectively.
Method

This study used a cross-sectional design with one independent variable (executive function; EF) that had three sub-dimensions (updating, inhibition, shifting) and one dependent variable (CIE susceptibility). Each sub-dimension of the independent variable was measured with three standardised tests to allow formation of a latent variable, which was used to predict CIE susceptibility, as measured by a standard CIE paradigm task. Our research was approved by the University of Western Australia’s Human Research Ethics Office. Participants provided written informed consent after reading an information sheet.

Participants

Participants were undergraduate students from the University of Western Australia (UWA), who participated for course credit. As we anticipated exclusions, and a minimum of 200 participants is recommended for SEM [
33
], we recruited 300 participants in total. Participants were excluded if performance on EF and CIE measures was suggestive of poor effort or engagement with the measures (e.g., below chance performance; see
Materials
section for details).

In total, 45 participants were excluded, with 34 exclusions from the EF tasks and eight exclusions from the CIE task due to poor performance; the remaining three exclusions resulted from the Flanker task being accidentally skipped, inattentiveness of one participant as observed by the experimenter, and a mock fire alarm. Thus, the final sample size was
N
= 255, with 55 men, 198 women, and two participants of undisclosed gender (mean age
M
= 20.56,
SD
= 6.22; age range: 18–53).
Materials

Updating tasks

Letter N-Back Task (Verbal)
. To measure verbal updating ability, the
N
-Back task was employed [
34
], using 20 consonants as stimuli, based on Ragland et al. [
35
]. As with all EF tasks used in this study, we used the Inquisit 6 version of the Millisecond test library [
36
]. In each block, participants were presented with a sequence of 15 (white) letters that were shown one-at-a-time on a series of black screens. Each letter appeared in the middle of the screen for 500 ms, with a 2000 ms delay between letters. Participants were instructed to press the ‘A’ key on the keyboard when the current letter matched the letter three screens previous (i.e., a 3-back task), and to do nothing if the letters did not match. Responses were to be given as quickly and accurately as possible. One practice block was given first, wherein nine letters were presented including three targets (i.e., letters matching those three positions back). Subsequently, six main blocks were run with five target letters in each—a total of 30 target letters. Performance was determined by the overall proportion of correct responses. Testing time was approximately seven minutes. One participant was excluded based on their performance in this task, as they had a mean response time equal to 2500 ms, indicating that they did not respond at all.

Keep-Track Task (Verbal)
. The second task used to measure verbal updating ability was the keep-track task [
37
]. The version of the task we used was based on Friedman et al. [
38
] On each trial, participants were given a sequence of 15 words each belonging to one of six categories (i.e., animals, colours, countries, distances, metals, and relatives). Each word was presented in the middle of the screen for 2500 ms, with a 500 ms delay between words. Participants were instructed to remember the last word given from each included category, then report these words in a questionnaire at the end of each trial. A minimum of two words and a maximum of three words were presented from each category per trial. Nine trials were run wherein four category lists had to be updated (36 words in total). The words selected from each category were randomised, with repetitions not allowed. Updating ability was determined by the overall proportion of correct responses. Testing time was approximately seven minutes.

Shape N-Back Task (Non-verbal)
. The Shape
N
-Back task was essentially identical to the Letter
N
-Back task discussed above; however, there were some differences (based on Jaeggi et al. [
39
]). Firstly, the stimuli used in this task were eight irregular yellow shapes; each stimulus was presented for 500 ms with a 2500 ms delay between shapes. Secondly, since the shape task was inherently more difficult than the letter task—due to the shapes being unfamiliar and difficult to label—a 2-back version was utilised. Finally, due to the different number of stimuli used (i.e., 8 shapes versus 20 consonant letters), a different number of blocks was run, namely five blocks with six target shapes in each block—a total of 30 target shapes. Performance was determined by the overall proportion of correct responses. Testing time was approximately seven minutes. Five participants were excluded based on their performance in this task, as they had a mean response time of 3000 ms, indicating a lack of responding.
Inhibition tasks

Stroop Task (Verbal)
. To measure verbal inhibition ability, a Stroop task was utilised [
40
]. In the task, participants were presented with a randomised sequence of colour words written in colour, one at a time, and were required to indicate the written colour with predefined key presses. Each colour word remained in the centre of the screen until the participant responded, allowing for response time to be measured; there was a 200 ms delay between words and a 400 ms error message for incorrect responses. The colours used were red (“D” key), green (“F” key), blue (“J” key), and black (“K” key). There were incongruent trials using colour words written in a different colour (e.g., “red” written in blue) or control trials that used coloured rectangles, with a total of 120 trials given (60 per condition). A practice block was given first that consisted of 18 trials (9 per condition). Inhibition ability was determined by the average difference in response time between correct incongruent and control trials, where a smaller difference indicated better inhibition ability. Testing time was approximately three minutes.

Parametric Go-No-Go Task (Verbal)
. To measure verbal inhibition ability, we also used a Go-No-Go task [
41
] with letters as stimuli [
42
]. Generally, this task involved presenting a stream of letters to participants (for 500 ms each) with instructions to press the space bar for target letters. Target letters were defined differently throughout the task based on three different levels of difficulty: at Level 1, participants were instructed to respond to letters “r”, “s”, or “t”; at Level 2, the instruction was to respond to letters “r” and “s” but only when they were not repeats (i.e., if you respond to the letter “r”, then do not respond to “r” again until after you have responded to the letter “s”); Level 3 was identical to Level 2 but used all three target letters (“r”, “s”, “t”). At each level, a short practice block of 20 (Levels 1 & 2) or 25 trials (Level 3) was given first, showing letters for 1000 ms each and instructing participants on when to respond, with corrective feedback. Only Level 3 data were used to assess inhibition ability due to the high aptitude of our sample. Level 3 had a total of 552 trials including 64 target (“go”) trials (respond to “r”, “s”, or “t”) and 26 lure (“no-go”) trials (repeats of “r”, “s”, or “t”). Inhibition ability was determined by the proportion of correct responses to lure trials. Testing time was approximately seven minutes. Five participants were excluded due to below-chance target-trial performance.

Arrow-Flanker Task (Non-verbal)
. To measure non-verbal inhibition ability, a Flanker task was utilised [
43
] with arrows as stimuli [
44
]. On each trial, a fixation cross appeared centrally for 1750 ms, followed by a row of five arrows. Participants indicated whether the central arrow pointed left (“Q” key) or right (“P” key). The presented arrows could either be congruent (i.e., all arrows pointing the same direction) or incongruent (i.e., central arrow pointing the opposite direction to the four surrounding arrows). If participants did not respond within 1750 ms, the correct answer was indicated on-screen, and the trial marked incorrect. The task started with eight practice trials, followed by a main block of 48 randomised trials, which started with a 3000 ms message that read “get ready”. Inhibition ability was determined by the mean response time difference between correct congruent and incongruent trials, with a smaller difference indicating better ability. Testing took approximately three minutes.
Shifting tasks

Number-Letter Task (Verbal)
. To measure verbal shifting ability, we used a Number-Letter task [
19
]. This task presented participants with a 2 × 2 matrix. In each trial, a number-letter pair (e.g., E8, 7H, etc.) was presented in one of the matrix cells, starting in the top-left cell and then moving in a clockwise fashion across trials. When the pair appeared in one of the top two quadrants, participants were required to indicate whether the letter was a consonant (“E” key) or a vowel (“I” key); when the pair appeared in one of the bottom two quadrants, participants classified the number as odd (“E” key) or even (“I” key). Interstimulus time was 150 ms for correct trials and 1500 ms for incorrect trials (with error feedback). Practice blocks consisting of 32 trials each were first given for the number and letter tasks separately; this was followed by 16 practice trials for the combined task, with eight switch trials (i.e., switching from number to letter task or vice versa) and eight non-switch trials. The main block presented 128 trials, with 64 switch trials and 64 non-switch trials. Shifting ability was determined by the average response time difference between correct switch and non-switch trials, where a smaller difference meant better ability. Testing time was approximately seven minutes.

Category-Switch Task (Verbal)
. To measure verbal shifting ability, we also used the Category-Switch task [
38
,
45
]. In this task, participants were presented with a stream of nouns (from a pool of 16). Each noun was accompanied by a heart or cross symbol that specified the task to be performed; nouns with a heart were classified as living (‘E” key) or non-living (“I” key) things; nouns with a cross were categorized as objects bigger (“E” key) or smaller (“I” key) than a basketball. The intertrial interval was 500 ms for correct responses and 1500 ms for incorrect responses (with corrective feedback). Practice blocks, each consisting of 32 trials, were given first for each individual task; this was followed by 16 combined-task practice trials (8 switch, 8 non-switch). The main block comprised 32 trials (16 switch, 16 non-switch). Shifting ability was determined by the mean response time difference between correct switch and non-switch trials, where a smaller difference indicated better ability. Testing time was approximately six minutes.

Trails Task (Non-verbal)
. To measure non-verbal shifting ability, we used a modified Trails task [
46
,
47
]. This task has two components called Trails A and Trails B. Both tasks involve an array of circles; in Trails A, the circles contain a sequence of numbers (i.e., 1–26), while in Trails B, half the circles contain a sequence of numbers (i.e., 1–13) and the other half a sequence of letters (i.e., A-M). Participants were given Trails A first, where the aim was to draw a line (with the computer mouse) through the numbered circles in the correct sequence (i.e., 1-2-3…26). Subsequently, Trails B was given, where the aim was to draw a line that alternated between numbered and lettered circles in the correct sequence (i.e., 1-A-2-B…13-M). If participants made an error, they were informed and instructed to continue from the last correct circle. Shifting ability was determined by performance on Trails B only, with a shorter completion time indicating greater ability. Testing time was approximately three minutes. Twenty-three participants were excluded based on performance on this task; specifically, participants whose error rates were greater than 2.4 interquartile ranges above the third quartile [
48
] on Trails A or B were excluded.
CIE task

This task was implemented using Qualtrics software [
49
]. Eight event reports and accompanying questionnaires were given in total. Each report contained a description of a different event and had a critical piece of information related to the event’s cause, which subsequently was or was not retracted. There were four retraction-condition reports and four control-condition reports; conditions alternated, with a control report always given first, in order to avoid build-up of retraction expectations. Presentation order of the reports was counterbalanced using a Latin square (see Table S1 in the Online Supplement, available at
https://osf.io/hw47f/
). Questionnaires containing inference questions related to the event reports were subsequently given and followed the same order as the reports. An effort question designed to ascertain participant engagement was given at the end of the task.

CIE Task Event Reports
. Each report consisted of two articles that were each around 100 words—following precedent [e.g.,
11
]. The first article always contained the critical information about the event’s cause. The second article contained either a retraction of the critical information (retraction condition) or additional neutral information about the event (control condition). The no-retraction control condition was used as a baseline of participant’s reliance on the critical information, and neutral information was given in place of the retraction so that report length was closely matched between conditions. For example, one report described an incidence of mass fish deaths in a river and suggested that the cause was chemical waste dumping by a riverside pharmaceutical company; this was subsequently retracted in the second article. Minimum presentation time for the articles within each report was 15 seconds, such that participants could not continue to the next report until that time had elapsed. Once all reports were encoded, participants completed a one-minute distractor task—in line with previous studies [e.g.,
17
]. All reports are provided in the Online Supplement.

CIE Task Questionnaires
. Similar to previous work [e.g.,
18
] questionnaires comprised one memory and four inference questions per report. The multiple-choice memory questions were provided to ensure that participants had adequately encoded the reports and targeted details unrelated to the critical information (e.g., “What contributed to low water storage levels in the affected region?”–a. drought; b. over-usage; c. containment leak; d. pump failure). Participants were excluded if they incorrectly answered more than 5 out of 8 basic memory questions (i.e., performance at chance level;
n
= 5), following previous studies [e.g.,
17
]. The inference questions were designed to measure reliance on the critical information. For each report, three inference questions asked participants to rate their endorsement of a statement using an 11-point Likert scale (e.g., “Chemical contamination contributed to the incident.”–
strongly disagree
{0} to
strongly agree
{10}); one inference question used a multiple-choice format (e.g., “What do you think was the cause of the fish deaths?”–a. chemical spill; b. water temperature; c. virus; d. algal bloom; e. none of the above). All questionnaires are provided in the Online Supplement. Testing time was approximately 15 minutes.

CIE Task Effort Question
. The effort question was a multiple-choice question, and was presented as follows: “
Before you go
,
please truthfully answer the following question
:
In your honest opinion
,
should we use your data
?
This is not related to how well you think you performed but whether you put in a reasonable effort
.
Please be assured that your response to this question will have no effect on your assignment of credit points
.
We just need to know what data to include in our analyses
”. There were three possible responses, namely: (i) yes, I put in a reasonable effort; (ii) maybe, I was a little distracted; and (iii) no, I really was not paying attention. Participants selecting option 3 were excluded (
n
= 3), following precedent [e.g.,
32
].

CIE Score Calculation
. Misinformation reliance was determined by using inference scores derived from responses to the inference questions. The 0–10 Likert-scale responses were divided by 10 to convert them to a 0–1 scale, while multiple-choice responses were coded as either 0 or 1. Responses were then averaged for each report, and four difference scores were calculated by pairing retraction and control report scores by order of magnitude (i.e., subtracting highest-to-lowest ranked control-report inference scores from highest-to-lowest ranked retraction-report scores); note that the specific way in which the retraction and control conditions were paired was inconsequential to results and only influenced internal-consistency reliability estimates. These four difference scores then formed the observed variables that were used as indicators of the CIE latent variable in our SEM analysis. Finally, the four difference scores were used to calculate a single mean score, which served as the observed CIE score; while we acknowledge that this score does not reflect the CIE per se, but rather reflects retraction efficacy, to stay consistent with previous research [e.g.,
17
,
18
] we refer to it as a CIE score.
Procedure

Presentation order for the executive function tasks was: 1
st
, Trails; 2
nd
, Go-No-Go; 3
rd
, Letter
N
-Back; 4
th
, Number Letter; 5
th
, Stroop; 6
th
, Shape
N
-Back; 7
th
, Category Switch; 8
th
, Flanker; 9
th
, Keep Track. This presentation order ensured that tasks of the same type (i.e., updating, inhibition or shifting) were separated, so as to reduce practice effects. Participants then completed the CIE task. Task instructions were given on-screen. In total, the experiment took approximately 60 min to complete.
Data analysis

Model fit of our EF measurement models was evaluated with CFA, while SEM was used to determine the relationship between EF subcomponents and CIE susceptibility. For our CFAs, the analysis plan was to first assess the model fit of Miyake et al.’s [
19
] original correlated three-factor model, wherein updating, inhibition, and shifting each form latent variables that are inter-correlated. Failing acceptable model fit, the plan was to next test Miyake et al.’s [
30
] alternative nested bi-factor model, which has specific updating and shifting factors but no inhibition factor—inhibition is instead subsumed in a general EF factor that loads onto all tasks. In case of unacceptable model fit, we then planned to test alternative models reported in previous literature. For our SEM analysis, we took the EF measurement model found to fit our data, and then regressed our CIE latent variable onto the EF-subcomponent latent variables of said model.

All CFAs and SEMs were run in AMOS 27 [
50
] using maximum-likelihood estimation. We used standardisation as the scaling method for our latent variables. Our point-estimate CIs were estimated using bootstrapping (2,000 samples). Model fit was determined using the following criteria from Schweizer [
51
]: comparative fit index (CFI) ≥ .950; Tucker-Lewis index (TLI) ≥ .950; standardised root mean-square residual (SRMR) < .08; root mean square error of approximation (RMSEA) < .06 (including 90% CIs). We report implied model χ
2
statistics for completeness. Any necessary model comparisons in our CFAs and SEM analysis were based on the following criteria: TLI difference > .010 [
52
]; Bayesian information criterion (BIC) difference > 2.00 ([
53
]; lower BIC values indicate better fit); and Akaike information criterion (AIC) difference > 2.00.([
54
]; lower AIC values indicate better fit) Observed-score correlation effect sizes were based on criteria established by Gignac and Szodorai ([
55
]; small,
r
≥ .10; typical, r ≥ .20; large,
r
≥ .30), as were effect sizes for true-score (latent-variable) correlations (small,
r
≥ .15; typical, r ≥ .25; large,
r
≥ .35). Finally, before conducting our analyses, any extreme values in our response-time data that were indicative of invalid responding (i.e., < 300 ms [< 200 ms for the Flanker task] or > 5 s) were winsorised to the next non-conspicuous value.
Results

Internal-consistency reliability and descriptive statistics

Before running preliminary analyses, we estimated internal-consistency reliability. As can be seen in
Table 1
, most task scores yielded internal reliability greater than .70, with the exception of the Keep-Track, Stroop, Category-Switch, and CIE tasks. Furthermore, skew and kurtosis were within acceptable ranges for all tasks except the Flanker task (skew < |2| & kurtosis < |9|; [
56
,
57
]). The deviant kurtosis of the Flanker task was likely due to an outlier, however, we employed bootstrapping in our analyses for robustness against deviations to normality.

Table 1. Descriptive statistics and internal-consistency reliability for EF tasks and CIE task (N = 255).

Task
(units)

M

SD

Range

Skew

Kurt

Reliability

Letter N-Back
(%)

.83

.08

.63–1.00

.10

-.37

.75
a

Keep-Track
(%)

.69

.12

.08 –.97

-1.11

3.99

.61
a

Shape N-Back
(%)

.81

.10

.40 –.99

-.82

.78

.85
a

Stroop
(ms)
b

-129.7

101.1

-600.6–104.9

-1.06

1.96

.39
a
c

Go-No-Go
(%)

.65

.16

.12 –.96

-.37

.12

.70
a

Arrow Flanker
(ms)
b

-30.1

32.6

-237.1–94.5

-1.48

10.16

.81
a
c

Number-Letter
(ms)
b

-715.2

348.0

-1803.0–72.7

-.77

.35

.95
a
c

Category-Switch
(ms)
b

-290.4

218.6

-1172.9–459.2

-.92

2.52

.36
a
c

Trails
(s)
b

-59.97

19.58

-152.5 –-27.1

-1.41

3.14

N/A

CIE Event Memory

6.15

1.39

3–8

-.45

.57

*

CIE

-.21

.19

-.73 –.41

.03

-.09

.57
a

Open in a new tab

Note
. Kurt, Kurtosis; %, proportion correct;
a
McDonald’s ω.
b
All response-time-based task scores were multiplied by -1 to make correlations between tasks easier to interpret.
c
The difference-score reliability formula was used to correct these estimates. * McDonald’s ω could not be calculated due to negative covariances between items.
Preliminary analyses

Prior to testing the relationship between the EF-subcomponent latent variables and the CIE latent variable, we (i) performed a manipulation check on the CIE task to establish the presence of a CIE by determining if there was a statistically significant difference between the retraction and control conditions, and whether retraction condition scores were statistically different from zero (following precedent; [e.g.,
11
]); (ii) performed a correlation analysis on all tasks; and (iii) performed CFAs to test which model best fitted our EF data.

The manipulation check on the CIE task confirmed that there was a significant difference between retraction (
M
= .31,
SD
= .17) and control (
M
= .51,
SD
= .11) conditions in the appropriate direction,
t
(254) = 17.24,
p
< .001,
d
= 1.08. Furthermore, in checking for the presence of a CIE with one-sample
t
-tests, we found a significant difference between all retraction condition scores and zero,
t
(254) ≥ 15.14,
p
< .001,
d
≥ .95, indicating the presence of a CIE.

As can be seen in
Table 2
, the updating tasks (i.e., Shape
N
-Back, Keep-Track, and Letter
N
-Back tasks) demonstrated large, positive correlations, while the switching tasks (i.e., Number-Letter, Category-Switch, and Trails tasks) demonstrated mostly typical, positive correlations; however, note that the Trails task correlated more highly with the updating tasks than with the other switching tasks. As for the inhibition tasks, the Stroop and Go-No-Go tasks showed a small, positive correlation, while the Flanker and Go-No-Go tasks had a small, negative correlation; the Stroop and Flanker tasks did not correlate significantly. The event-related-memory subtask from the CIE task demonstrated typical, positive correlations with both N-Back tasks and the Go-No-Go task, as well as small, positive correlations with the Keep-Track, Stroop, and Trails tasks. Finally, the CIE task demonstrated mostly typical, negative correlations with the three updating tasks, the Go-No-Go task, and the Trails task, as well as a large, positive correlation with the event-related-memory subtask.

Table 2. Correlations between the Nine EF tasks and CIE task (N = 255).

1)

2)

3)

4)

5)

6)

7)

8)

9)

10)

11)

1) N-Back L

-

2) Keep-Track

.30
**

-

3) N-Back S

.49
**

.39
**

-

4) Stroop

.18
**

.25
**

.20
**

-

5) GnG

.24
**

.23
**

.30
**

.14
*

-

6) Flanker

.02

-.00

.07

.03

-.15
*

-

7) Num-Lett

.01

.05

.10

.01

-.04

-.06

-

8) Cat-Swi

.01

.02

.06

-.01

-.01

-.07

.29
**

-

9) Trails

.33
**

.25
**

.32
**

.14
*

.14
*

-.01

.21
**

.16
*

-

10) Ev-Mem

.24
**

.17
**

.26
**

.18
**

.20
**

.04

.10

.09

.19
**

-

11) CIE

-.28
**

-.19
**

-.24
**

-.05

-.18
**

-.03

-.06

-.07

-.20
**

-.46
**

-

Open in a new tab

Note
. L, Letter; S, Shape; GnG, Go-No-Go; Num-Lett, Number-Letter; Cat-Swi, Category-Switch; Ev-Mem, CIE Event-Memory

*, < .05

**, < .01.

A CFA conducted on Miyake et al.’s [
19
] correlated three-factor model of the EF-subcomponent latent variables yielded unacceptable model fit, based on the incremental close-fit indices, χ
2
(24) = 41.21,
p
= .016,
CFI
= .925,
TLI
= .887,
SRMR
= .055,
RMSEA
= .053 (90%
CI
[.023, .080]).
Fig 1
shows that almost all factor loadings were positive and significant (all
ps
< .008) except for the Flanker-task loading (
p
= .825). There was also a statistically significant, large, positive correlation between the updating and shifting latent variables (
r
= .55, 95% CI [.
25
, .
76
],
p
< .001) and a statistically significant, large, positive correlation between the shifting and inhibition latent variables (
r
= .42, 95% CI [.06, 1.99],
p
= .019). Moreover, and notably, the correlation between the updating and inhibition latent variables was large, positive and statistically significant (
r
= .95, 95% CI [.41, 3.63],
p
< .001). The almost perfect inhibition-updating correlation, with the upper 95% CI exceeding 1—which was also true of the inhibition-shifting correlation—implied a lack of factor distinctness associated with at least one dimension. Furthermore, the stronger loadings on the updating factor, versus the inhibition factor, implied that the construct measured by said factors was updating, suggesting inhibition failed to be measured in a construct-valid manner. Given this, we decided to remove the inhibition tasks from further analyses. Therefore, we did not test Miyake et al.’s [
30
] alternative nested bi-factor model as planned, and instead tested a correlated two-factor model with updating and shifting factors.

Fig 1. Confirmatory factor analysis of EF-subcomponent latent variables in correlated three-factor model.

Open in a new tab

Note. Straight lines with single arrows are regression paths. The curved lines with double arrows are correlations. The observed variables at the bottom represent EF-task scores. Numbers on top-right of observed variables represent proportion of variance accounted for in each variable. Error terms associated with each observed variable are indicated by e1-9. Factor loadings and correlations are fully standardised.
In our CFA of a correlated two-factor model defined by updating and shifting latent variables, model fit was found to be unacceptable, χ
2
(8) = 22.90,
p
= .003,
CFI
= .919,
TLI
= .847,
SRMR
= .060,
RMSEA
= .086 (90%
CI
[.046, .128]); however, when we allowed a cross-loading for the Trails task, model fit was excellent, χ
2
(7) = 4.69,
p
= .698,
CFI
= 1.000,
TLI
= 1.027,
SRMR
= .020,
RMSEA
= .000 (90%
CI
[.000, .059]). Indeed, the Trails task has been found to yield cross-loadings onto updating and shifting factors previously [e.g.,
58
]. As can be seen in
Fig 2
, all factor loadings were positive for both latent variables, and all loadings were significant (
p
< .001). Further, while the latent variable correlation was significant and large in the standard correlated two-factor model (
r
= .55, 95% CI = [.
27
,.
76
],
p
< .001), it was non-significant with the cross-loading included (
r
= .14, 95% CI [-.08, .35],
p
= .208). Note that including the Trails cross-loading in the correlated three-factor model also produced acceptable model fit; however, due to issues highlighted for the inhibition factor in the above paragraph, the correlated two-factor model was preferred. For transparency, results of analyses with the correlated three-factor model have been provided in the Online Supplement.

Fig 2. Confirmatory factor analysis of EF-subcomponent latent variables in correlated two-factor model.

Open in a new tab

Note. Straight lines with single arrows are regression paths. The observed variables at the bottom represent EF-task scores. Numbers on top-right of observed variables represent proportion of variance accounted for in each variable. Error terms associated with each observed variable are indicated by e1-6. Factor loadings and correlations are fully standardised.
Structural Equation Modelling (SEM) of EF and CIE

Following the identification of a well-fitting measurement model for our EF data, and to test the hypothesised relationship between EF and the CIE, we conducted a SEM wherein the CIE latent variable was regressed onto the EF-task latent variables (updating and shifting). The model demonstrated excellent model fit, χ
2
(31) = 38.36,
p
= .170,
CFI
= .975,
TLI
= .964,
SRMR
= .042,
RMSEA
= .031 (90%
CI
= [.000, .059]); further, as shown in
Fig 3
, the beta weight associated with the updating and CIE latent variables was negative (
β
= -.54, 95%
CI
[-.70,-.37]) and statistically significant (
p
< .001), while the regression between the shifting and CIE latent variables was negative and non-significant (
β
= -.16, 95%
CI
[-.36, .08],
p
= .245). A total of 33% (95%
CI
[17, 52%]) of the CIE’s true score variance was accounted for by the model. This supported our hypothesis and suggested that individual differences in EF, particularly working-memory updating, were predictive of individual differences in the CIE (i.e., higher EF ability predicts lower CIE susceptibility). Finally, while a significant negative correlation was found between event-related memory and CIE susceptibility, we were unable to include event-related memory in our SEM analyses due to an unacceptably low KMO value for its measure (
KMO
= .56; [
59
]).

Fig 3. Structural equation model of multiple regression between EF-subcomponent latent variables and CIE latent variable.

Open in a new tab

Note. Straight lines with single arrows are regression paths. The observed variables on the left represent EF-task scores. The observed variables on the right represent CIE scores. Numbers on top-right of observed variables and CIE latent variable represent proportion of variance accounted for in each variable. Error terms associated with each observed variable are indicated by e1-10. Factor loadings and correlations are fully standardised.
Supplementary factor analysis

Given that results of latent variable analyses can be unstable at sample sizes under 400 with the factor-loading magnitudes observed in our model [
60
], we performed a supplementary, unrestricted factor analysis of our two EF factors (i.e., updating and shifting) to help confirm the veracity of findings associated with our latent-variable analyses. Specifically, we factor-analysed the six indicators associated with the updating and shifting dimensions, as well as the CIE observed scores. The supplementary factor analysis was run using the
EFAutilities
package in R. Maximum likelihood estimation was utilised with direct oblimin rotation and Kaiser normalisation, while bootstrapped 95% CIs (2,000 samples) were calculated for factor loadings and the factor correlation; this served as a measure of statistical significance for both.

Firstly, the KMO value suggested that our sample was suitable for factor analysis (
KMO
= .72; [
59
]) as did the result of Bartlett’s test of sphericity, χ
2
= 224.38,
p
< .001. As shown in
Table 3
, the extracted communalities ranged from .14 to .51. As further seen in
Table 3
, the pattern of loadings replicated the findings of our CFAs; that is, the updating tasks (i.e.,
N
-Back and Keep-Track tasks) loaded significantly onto an updating factor, the shifting tasks (i.e., Number-Letter, Category-Switch, and Trails tasks) loaded significantly onto a shifting factor, and the Trails task cross-loaded. Moreover, the CIE task loaded negatively and significantly onto the updating factor, λ = -.37, 95% CI [-.50, -.24], but not the shifting factor, λ = -.03, 95% CI [-.19, .14], thus corroborating the results of our SEM analysis. Finally, the correlation between the updating and shifting factors was
r
= .22, which was significant based on the 95% CIs [.03, .39]; this provides further supporting evidence that a correlated two-factor model was appropriate for our EF data.

Table 3. Extracted communalities and fully standardized factor loadings (with 95% CI) for our two extracted factors that contained the updating tasks, shifting tasks and CIE task.

Updating

Shifting

Task

Extracted
h
2

λ

95% CI

λ

95% CI

N-Back L

.48

.71

.58 –.84

-.13

-.28 –.02

Keep-Track

.25

.50

.38 –.62

-.02

-.17 –.12

N-Back S

.51

.72

.60 –.85

-.02

-.14 –.12

Num-Lett

.39

.00

-.13 –.14

.63

.23–1.02

Cat-Swi

.23

-.01

-.12 –.10

.48

.12 –.83

Trails

.29

.44

.29 –.58

.23

.03 –.43

CIE

.14

-.37

-.50 –-.24

-.03

-.19 –.14

Open in a new tab

Note
.
h
2
, communality; λ, factor loading; CI, confidence interval; L, Letter; S, Shape; lett, Letter; swi, Switch.
Discussion

The aim of the current, exploratory, study was to investigate whether executive function (EF) could predict CIE susceptibility. It was hypothesised that greater EF ability would predict lower CIE susceptibility; we thus predicted that (i) there would be significant negative correlations between one or more EF tasks and the CIE task, and (ii) there would be a significant negative beta weight between one or more EF latent variable(s) and the CIE latent variable. This hypothesis and its related predictions were supported by the present results.

Our CIE task having a negative correlation of typical effect size [
55
] with our updating, Go-No-Go, and Trails tasks provides initial evidence that greater EF ability is associated with lower CIE susceptibility. However, given that the Go-No-Go and Trails tasks also had typical to large-sized positive correlations with all three updating tasks, the correlation analysis suggests that updating ability specifically relates to CIE susceptibility. This suggestion was confirmed by the significant, negative, standardised beta weight found between our updating and CIE latent variables (β = -.54), which demonstrated that updating ability can predict CIE susceptibility. Furthermore, our EF model explained 33% of the variance in the CIE latent variable, a large proportion of which was due to the updating factor. Moreover, an unrestricted factor analysis of our EF model and CIE data—conducted as a supplementary post-hoc analysis—showed that CIE-task scores loaded negatively with the updating-task scores, suggesting that the CIE task was tapping into updating ability. This consequently suggests that updating ability is an intrinsic aspect of CIE susceptibility. Thus, overall, the current results provide preliminary evidence that EF is an important determinant of people’s susceptibility to the CIE, and that working-memory updating may be particularly crucial.

The current results expand upon the findings of Brydges et al. [
17
], who demonstrated a predictive relationship between working-memory capacity and CIE susceptibility. However, it should be noted that Sanderson et al. [
18
] failed to replicate Brydges et al.’s findings; they also conducted a reanalysis of Brydges et al.’s data that yielded a non-significant relationship between the CIE and working-memory-capacity variables. Yet, these contradictory results may have been due to the working-memory capacity measures used by Brydges et al. and Sanderson et al.; that is, these measures may not have tapped into working-memory updating sufficiently to produce a reliable effect with CIE measures. Nonetheless, Brydges and colleagues speculated that their results could be evidence for the mental-model-updating account of the CIE, as the updating mechanism central to this account arguably relies on working memory. This speculation aligns with the present study’s results. Specifically, the present study showed that individual differences in working-memory updating significantly predicted individual differences in the CIE, with better updating predicting lower CIE susceptibility. This predictive relationship was also not limited to the verbal domain, like the working-memory-capacity relationship found in Brydges et al. [
17
] was. Thus, people’s ability to update representations in their working memory appears to be linked to their ability to discount corrected information in reasoning. Consequently, the current study provides individual-differences evidence to support the mental-model-updating account of the CIE [for a recent review,
61
].

However, it should be acknowledged that the updating measures used in the current study may not have been pure measures of updating; that is, other aspects of working memory may have also been measured. Indeed, while the Keep-track and N-Back tasks are commonly used as updating measures [e.g.,
19
,
38
,
62
,
63
], some evidence suggests that these tasks also measure more basic storage and maintenance operations in working memory [e.g.,
64
,
65
]. Therefore, despite our attempts to isolate updating-specific variance with a latent-variable approach, we cannot definitively conclude from our results that updating was the only working-memory process predicting CIE susceptibility.

Of course, the current results do not preclude the possibility that other cognitive factors may determine CIE susceptibility. Most immediately, the current study proposed a potential predictive relationship between prepotent-response inhibition and the CIE based on the selective-retrieval account of the CIE [e.g.,
5
,
12
]. To recap, the selective-retrieval account suggests that a CIE may arise if misinformation is selectively retrieved (e.g., based on automatic familiarity processes) and misinformation-based responses are not inhibited at test, with such inhibition potentially facilitated by strategic recollection of a relevant correction. Thus, better ability to inhibit prepotent responses may reduce CIE occurrence. However, we were unable to assess this proposed relationship, as our inhibition factor did not converge.

While we suggest that future research reattempt a latent-variable analysis of the potential inhibition-CIE relationship, it must be acknowledged that measurement of the inhibition construct has generally proven problematic [e.g.,
66
–
68
]. In fact, it is even debated whether inhibition can be measured as a unitary construct, with some research suggesting that inhibition may be composed of separable but related subfactors [
69
–
72
]. However, attempts to measure these inhibition subfactors have also yielded inconsistent outcomes, as demonstrated with prepotent-response inhibition in the current study and other studies using Miyake’s EF model [see
29
and
31
for reviews]. Friedman and Miyake [
31
] indeed stated that many failures to replicate their EF model have resulted from issues with the (prepotent-response) inhibition factor. Perhaps a potential reason why an inhibition factor was not found in the current study, and previous studies, lies in the measures used; more specifically, evidence suggests that experimental tasks designed to create a between-subjects effect (e.g., the Stroop effect in the Stroop task) can be unreliable at producing individual differences [e.g.,
73
]. Therefore, future studies investigating the relationship between inhibition and CIE susceptibility should carefully consider how inhibition is measured, consult past EF research that used a latent-variable approach, and select appropriate measures for forming an inhibition factor.

Beyond inhibition, verbal intelligence has been shown to influence susceptibility to the CIE [
27
]. Considering this, and evidence that executive function, particularly working-memory updating, correlates with intelligence [e.g.,
38
,
75
–
76
], it may be important to address whether the present results are separable from the intelligence-CIE relationship. More specifically, verbal intelligence may partially or completely mediate the predictive relationship found here between EF and CIE susceptibility, or vice-versa. Therefore, follow-up studies using a latent-variable approach may wish to conduct a mediation analysis with measures of verbal intelligence, EF ability, and CIE susceptibility. Such studies would help to elucidate whether the influence of executive processes on CIE susceptibility is separable from the influence of verbal cognitive ability.

Furthermore, Sanderson et al. [
18
] suggested that greater fidelity of the episodic memory representation of event reports predicted lower susceptibility to the CIE. Similarly, our analyses demonstrated a negative correlation between event-related memory and CIE susceptibility, though poor psychometric properties of our event-related-memory measure prevented further analysis with structural equation modelling. It may be worth further investigating whether episodic-memory ability more generally predicts CIE susceptibility, using more general measures of episodic memory. Moreover, it is possible that episodic-memory abilities could interact with the relationship between EF and the CIE. Indeed, those with better episodic memory may generate higher-fidelity mental models, which may in turn be easier to update. Future investigations could thus seek to assess how the relationship between EF and CIE susceptibility may change across the spectrum of episodic-memory ability, or in other words, determine if episodic memory moderates the EF-CIE relationship.

Regarding the measurement of Miyake’s model more specifically, it is notable that our correlated two-factor (updating and shifting) model, while not replicating Miyake’s original or alternative model, does have precedence [
58
,
77
]. Hull et al. [
77
] found a correlated two-factor model in line with the current study. Van der Sluis et al. [
58
] found a nested two-factor model with updating and shifting factors nested within a “naming” factor that comprised non-EF aspects (i.e., baselines) of each EF measure (e.g., congruent condition in Stroop task, trails A in Trails task, etc.). Interestingly, both studies and the current study tested different age groups, namely primary-school children [
77
], older adults [
58
], and undergraduate students (current study). Thus, results across all three studies could provide tentative evidence that a two-factor updating-and-shifting EF model can manifest across the lifespan. However, we must stress that this goes against the larger evidence [see
29
for a meta-analytic review] and so we cannot provide definitive conclusions regarding EF’s underlying structure.

Also notable was our replication of van der Sluis et al.’s [
58
] finding that Trails B cross-loaded onto updating and shifting factors. The Trails task has traditionally been considered a measure of shifting [
47
]; this makes sense, as participants who complete Trails-B must actively switch between number and letter sequences as quickly as possible to perform well. However, it is conceivable that performance on Trails B is also linked to updating ability. Specifically, one could argue that participants in Trails B must update letter and number sequences as well as switch between them; thus, greater updating ability would reduce time spent updating each sequence between switches, reducing overall completion time and error rates. However, further psychometric investigation will be required to confirm whether such conjecture is supportable.

Regarding measurement of the CIE, the current study provides further psychometric data on the CIE paradigm, which has been hitherto limited.[
78
] In previous individual-differences research using the CIE paradigm [e.g.,
17
,
18
,
32
] the reported estimates of internal-consistency reliability have been problematic. Brydges et al. [
17
] and Sanderson et al. [
18
] reported estimates of α = .65 and α = .46, respectively. Similarly, McIlhiney et al. [
32
], who used two parallel CIE tasks in a test-retest format, reported estimates of ω
time1
= .53 and ω
time2
= .60. While these findings could suggest that the CIE paradigm suffers from similar issues found when using other experimental tasks in individual-differences research [e.g.,
73
], McIlhiney et al.’s [
32
] findings suggested that the CIE paradigm showed acceptable stability in individual-differences variation. Following recommendations cited by McIlhiney et al., we attempted to alleviate reliability issues by incorporating additional retraction and control items; however, our estimated internal consistency of ω = .57 indicated no improvement to reliability. Given this result, we cannot recommend that future studies increase item count in the CIE task. While one could argue that adding further items to retraction and control conditions is needed, we would counterargue that doing so may introduce memory effects that could obscure CIE measurement; that is, a longer task with more reports to remember may overtax people’s memory capacity, making it harder for the researcher to distinguish between forgetting and genuine misinformation reliance. It should be noted, however, that our CIE task correlated well with other tasks, therefore the limited internal consistency did not appear to limit our study excessively. Nevertheless, we do recommend that future research continues to investigate ways of improving the psychometric properties of the CIE paradigm.

In practical terms, the results of the current study could be useful to inform attempts to address the spread of misinformation, such as the intervention strategies summarised in The Debunking Handbook 2020 [
79
]. While information-focused interventions have demonstrated efficacy in the lab, the efficacy of such interventions should be tested on those with lower or compromised cognitive abilities (e.g., those with compromised EF). However, it should be acknowledged that individual differences in executive function will only play a small role in real-world CIE examples. Furthermore, given that cognitive abilities can be difficult to change, intervention strategies focused on inoculating and educating against misinformation influence may help to support information-focused interventions—particularly given their generally demonstrated efficacy [e.g.,
80
–
91
].

Apart from the already-identified issues with CIE task reliability and the potential mediating role of intelligence, one limitation that should be acknowledged is range restriction due to our undergraduate-only sample—especially since age differences in EF ability have been found across the subcomponents we tested [e.g.,
29
,
67
,
92
–
100
]. Due to this range restriction, the effects reported here are likely underestimates, and so future research should seek to replicate our findings in a more heterogenous sample.

Summary and conclusion

To summarise, the current study provides evidence that executive function, particularly working-memory updating, can play a significant role in determining susceptibility to the continued influence of misinformation. Unfortunately, this means that those with lowered executive abilities, particularly in the domain of working-memory updating, are at higher risk of misinformation’s influence. This carries particular implications for those in our society with impaired executive ability.(e.g., older adults; [
93
]) It is hoped, then, that our findings will support further development of real-world intervention strategies designed to combat the effects of misinformation.
Acknowledgments

There are no acknowledgements to be made.
Data Availability

All relevant data and supporting files are available from the OSF database (
https://osf.io/hw47f/
).
Funding Statement

PM’s contribution to this research was supported by an Australian Government Research Training Program (RTP) Scholarship. UKHE was supported by grant FT190100708 from the Australian Research Council. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References

1.
Weber, D., Nasim, M., Falzon, L., & Mitchell, L. (2020). # ArsonEmergency and Australia’s “Black Summer”: Polarisation and Misinformation on Social Media. In
Disinformation in Open Online Media: Second Multidisciplinary International Symposium, MISDOOM 2020, Leiden, The Netherlands, October 26–27, 2020, Proceedings 2
(pp. 159–173). Springer International Publishing. 10.1007/978-3-030-61841-4_11.
[
DOI
]

2.
Mocatta G., & Hawley E. (2020). Uncovering a climate catastrophe? Media coverage of Australia’s Black Summer bushfires and the revelatory extent of the climate blame frame.
M/C Journal
, 23(4). Article 4. 10.5204/mcj.1666.
[
DOI
] [
Google Scholar
]

3.
Wilkes A. L., & Leatherbarrow M. (1988). Editing episodic memory following the identification of error.
Quarterly Journal of Experimental Psychology
, 40(2), 361–387. 10.1080/02724988843000168.
[
DOI
] [
Google Scholar
]

4.
Johnson HM, Seifert CM. Sources of the continued influence effect: When misinformation in memory affects later inferences. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1994.
Nov;20(6):1420–36. 10.1037/0278-7393.20.6.1420.
[
DOI
] [
Google Scholar
]

5.
Ecker UKH, Lewandowsky S, Tang DTW. Explicit warnings reduce but do not eliminate the continued influence of misinformation.
Memory & Cognition.
2010.
Dec;38(8): 1087–1100. 10.3758/MC.38.8.1087.
[
DOI
] [
PubMed
] [
Google Scholar
]

6.
Connor-Desai SC, Reimers S. Comparing the use of open and closed questions for Web-based measures of the continued-influence effect.
Behavior Research Methods.
2019.
Jun;51(3): 1426–40. doi: 10.3758/s13428-018-1066-z

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

7.
Rich PR, Zaragoza MS. The continued influence of implied and explicitly stated misinformation in news reports. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2016.
Jan;42(1): 62–74. doi: 10.1037/xlm0000155

[
DOI
] [
PubMed
] [
Google Scholar
]

8.
Wilkes AL, Leatherbarrow M. Editing episodic memory following the identification of error. Quarterly Journal of Experimental Psychology. 1988.
May
1;40(2): 361–87. 10.1080/02724988843000168.
[
DOI
] [
Google Scholar
]

9.
Chan MPS, Jones CR, Hall Jamieson K, Albarracín D. Debunking: A meta-analysis of the psychological efficacy of messages countering misinformation.
Psychological Science. 2017.
Nov;28(11): 1531–46. doi: 10.1177/0956797617714579

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

10.
Ecker UKH, Lewandowsky S, Chang EP, Pillai R. The effects of subtle misinformation in news headlines. Journal of Experimental Psychology: Applied. 2014.
Dec;20(4): 323–35. doi: 10.1037/xap0000028

[
DOI
] [
PubMed
] [
Google Scholar
]

11.
Ecker UKH, Hogan JL, Lewandowsky S. Reminders and repetition of misinformation: Helping or hindering its retraction?
Journal of Applied Research in Memory and Cognition. 2017.
Jun
1;6(2): 185–92. 10.1016/j.jarmac.2017.01.014.
[
DOI
] [
Google Scholar
]

12.
Ecker UKH, Lewandowsky S, Swire B, Chang D. Correcting false information in memory: Manipulating the strength of misinformation encoding and its retraction.
Psychonomic Bulletin & Review.
2011.
Jun;18(3): 570–78. doi: 10.3758/s13423-011-0065-1

[
DOI
] [
PubMed
] [
Google Scholar
]

13.
Rich PR, Zaragoza MS. Correcting misinformation in news stories: An investigation of correction timing and correction durability. Journal of Applied Research in Memory and Cognition. 2020.
Sep
1;9(3): 310–22. 10.1016/j.jarmac.2020.04.001.
[
DOI
] [
Google Scholar
]

14.
Walter N, Murphy ST. How to unring the bell: A meta-analytic approach to correction of misinformation.
Communication Monographs.
2018.
Jul
3;85(3): 423–41. doi: 10.1080/03637751.2018.1467564
[
DOI
] [
Google Scholar
]

15.
Walter N, Tukachinsky R. A meta-analytic examination of the continued influence of misinformation in the face of correction: How powerful is it, why does it happen, and how to stop it?
Communication Research.
2020.
Mar;47(2): 155–77. 10.1177/0093650219854600.
[
DOI
] [
Google Scholar
]

16.
Rapp DN, Kendeou P. Revising what readers know: Updating text representations during narrative comprehension.
Memory & Cognition.
2007.
Dec;35(8): 2019–32. doi: 10.3758/bf03192934

[
DOI
] [
PubMed
] [
Google Scholar
]

17.
Brydges CR, Gignac GE, Ecker UKH. Working memory capacity, short-term memory capacity, and the continued influence effect: A latent-variable analysis.
Intelligence.
2018.
Jul
1;69, 117–122. 10.1016/j.intell.2018.03.009.
[
DOI
] [
Google Scholar
]

18.
Sanderson JA, Gignac GE, Ecker UK. Working memory capacity, removal efficiency and event specific memory as predictors of misinformation reliance. Journal of Cognitive Psychology. 2021.
Jul
4;1–15. 10.1080/20445911.2021.1931243.
[
DOI
] [
Google Scholar
]

19.
Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis.
Cognitive Psychology.
2000.
Aug
1;41(1): 49–100. doi: 10.1006/cogp.1999.0734

[
DOI
] [
PubMed
] [
Google Scholar
]

20.
Johnson-Laird PN. Mental models: Towards a cognitive science of language, inference, and consciousness. Harvard University Press, 1983.
[
Google Scholar
]

21.
Kendeou P, Walsh EK, Smith ER, O’Brien EJ. Knowledge revision processes in refutation texts.
Discourse Processes.
2014.
Jul
4;51(5–6): 374–97. 10.1080/0163853X.2014.913961.
[
DOI
] [
Google Scholar
]

22.
Gordon A, Brooks JCW, Quadflieg S, Ecker UKH, Lewandowsky S. Exploring the neural substrates of misinformation processing.
Neuropsychologia.
2017.
Nov
1;106, 216–24. doi: 10.1016/j.neuropsychologia.2017.10.003

[
DOI
] [
PubMed
] [
Google Scholar
]

23.
Gordon A, Quadflieg S, Brooks JC, Ecker UKH, Lewandowsky S. Keeping track of ‘alternative facts’: The neural correlates of processing misinformation corrections.
NeuroImage.
2019.
Jun
1;193, 46–56. doi: 10.1016/j.neuroimage.2019.03.014

[
DOI
] [
PubMed
] [
Google Scholar
]

24.
Ayers MS, Reder LM. A theoretical review of the misinformation effect: Predictions from an activation-based memory model.
Psychonomic Bulletin & Review.
1988.
Mar;5(1): 1–21. 10.3758/BF03209454.
[
DOI
] [
Google Scholar
]

25.
Swire B, Ecker UKH, Lewandowsky S. The role of familiarity in correcting inaccurate information. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2017.
Dec;43(12): 1948–61. doi: 10.1037/xlm0000422

[
DOI
] [
PubMed
] [
Google Scholar
]

26.
Butterfuss R, Kendeou P. Reducing interference from misconceptions: The role of inhibition in knowledge revision. Journal of Educational Psychology. 2020.
May;112(4): 782–94. 10.1037/edu0000385.
[
DOI
] [
Google Scholar
]

27.
De keersmaecker J, Roets A. ‘Fake news’: Incorrect, but hard to correct.
The role of cognitive ability on the impact of false information on social impressions. Intelligence. 2017.
Nov
1;65, 107–10. doi: 10.1016/j.intell.2017.10.005
[
DOI
] [
Google Scholar
]

28.
Stanovich KE, West RF, Toplak ME. The rationality quotient: Toward a test of rational thinking. MIT Press, 2016.
[
Google Scholar
]

29.
Karr JE, Areshenkoff CN, Rast P, Hofer SM, Iverson GL, Garcia-Barrera MA. The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies.
Psychological Bulletin.
2018.
Nov;144(11): 1147–85. doi: 10.1037/bul0000160

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

30.
Miyake A, Friedman NP. The nature and organization of individual differences in executive functions: Four general conclusions.
Current Directions in Psychological Science. 2012.
Feb;21(1): 8–14. doi: 10.1177/0963721411429458

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

31.
Friedman NP, Miyake A. Unity and diversity of executive functions: Individual differences as a window on cognitive structure.
Cortex. 2017.
Jan
1;86, 186–204. doi: 10.1016/j.cortex.2016.04.023

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

32.
McIlhiney P, Gignac GE, Weinborn M, Ecker UKH. Sensitivity to misinformation retractions in the continued influence paradigm: Evidence for stability.
Quarterly Journal of Experimental Psychology. 2021.
Oct
5;17470218211048986. doi: 10.1177/17470218211048986

[
DOI
] [
PubMed
] [
Google Scholar
]

33.
Boomsma A, Hoogland JJ. The robustness of LISREL modeling revisited. In Cudeck R., du Toit S.& Sörbom D. (Eds.); Structural equation modeling: Present and future. A Festschrift in honor of Karl Jöreskog (pp.139–68). Scientific Software International, 2001.
http://aboomsma.webhosting.rug.nl/csadata/boomsma_hoogland_2001.pdf
.
[
Google Scholar
]

34.
Kirchner WK. Age differences in short-term retention of rapidly changing information. Journal of Experimental Psychology. 1958.
Apr;55(4): 352–8. doi: 10.1037/h0043688

[
DOI
] [
PubMed
] [
Google Scholar
]

35.
Ragland JD, Turetsky BI, Gur RC, Gunning-Dixon F, Turner T, Schroeder L, et al. Working memory for complex figures: an fMRI comparison of letter and fractal n-back tasks.
Neuropsychology.
2002.
Jul;16(3): 370–9. 10.1037/0894-4105.16.3.370.
[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

36.
Inquisit 6 [Computer program on the Internet] Version 6.4.0. Seattle (WA): Millisecond; 2016 [cited 2022 Mar 10]. Available from:
https://www.millisecond.com
.

37.
Yntema DB. Keeping track of several things at once.
Human Factors.
1963.
Feb;5(1): 7–17. doi: 10.1177/001872086300500102

[
DOI
] [
PubMed
] [
Google Scholar
]

38.
Friedman NP, Miyake A, Young SE, DeFries JC, Corley RP, Hewitt JK. Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology: General. 2008.
May;137(2): 201–25. doi: 10.1037/0096-3445.137.2.201

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

39.
Jaeggi SM, Studer-Luethi B, Buschkuehl M, Su YF, Jonides J, Perrig WJ. The relationship between n-back performance and matrix reasoning—implications for training and transfer. Intelligence. 2010.
Nov
1;38(6): 625–35. 10.1016/j.intell.2010.09.001.
[
DOI
] [
Google Scholar
]

40.
Stroop JR. Studies of interference in serial verbal reactions. Journal of Experimental Psychology. 1935.
Dec;18(6): 643–62. 10.1037/h0054651.
[
DOI
] [
Google Scholar
]

41.
Lappin JS, Eriksen CW. Use of a delayed signal to stop a visual reaction-time response. Journal of Experimental Psychology. 1966.
Dec;72(6): 805–11. 10.1037/h0021266.
[
DOI
] [
Google Scholar
]

42.
Langenecker SA, Zubieta JK, Young EA, Akil H, Nielson KA. A task to manipulate attentional load, set-shifting, and inhibitory control: Convergent validity and test–retest reliability of the Parametric Go/No-Go Test. Journal of Clinical and Experimental Neuropsychology. 2007.
Nov
14;29(8): 842–53. doi: 10.1080/13803390601147611

[
DOI
] [
PubMed
] [
Google Scholar
]

43.
Eriksen BA, Eriksen CW. Effects of noise letters upon the identification of a target letter in a nonsearch task.
Perception & Psychophysics.
1974.
Jan;16(1): 143–9. 10.3758/BF03203267.
[
DOI
] [
Google Scholar
]

44.
Ridderinkhof KR, van der Molen MW, Band GP, Bashore TR. Sources of interference from irrelevant information: A developmental study. Journal of Experimental Child Psychology. 1997.
Jun
1;65(3): 315–41. doi: 10.1006/jecp.1997.2367

[
DOI
] [
PubMed
] [
Google Scholar
]

45.
Mayr U, Kliegl R. Task-set switching and long-term memory retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2000.
Sep;26(5): 1124–40. doi: 10.1037//0278-7393.26.5.1124

[
DOI
] [
PubMed
] [
Google Scholar
]

46.
Army Individual Test Battery. Manual of directions and scoring. Washington, DC: War Department, Adjutant General’s Office, 1944.
[
Google Scholar
]

47.
Reitan RM. Validity of the Trail Making Test as an indicator of organic brain damage. Perceptual and Motor Skills. 1958.
Dec;8(3): 271–6. 10.2466/PMS.8.7.271-276.
[
DOI
] [
Google Scholar
]

48.
Hoaglin DC, Iglewicz B. Fine-tuning some resistant rules for outlier labeling. Journal of the American Statistical Association. 1987.
Dec
1;82(400): 1147–9. 10.2307/2289392.
[
DOI
] [
Google Scholar
]

49.
Qualtrics. Survey Generator [Computer program on the Internet]. Version unknown. Provo (UT): Qualtrics XM;
2020. [cited 2022 Jun 10]. Available from:
http://www.qualtrics.com
.
[
Google Scholar
]

50.
Arbuckle JL. IBM SPSS Amos 27 User’s Guide. New York: IBM, 2020.
[
Google Scholar
]

51.
Schweizer K.
Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment. 2010.
Jan
25;26(1): 1–2. 10.1027/1015-5759/a000001.
[
DOI
] [
Google Scholar
]

52.
Gignac GE. Multi-factor modeling in individual differences research: Some recommendations and suggestions.
Personality and Individual Differences.
2007.
Jan
1;42(1): 37–48. 10.1016/j.paid.2006.06.019.
[
DOI
] [
Google Scholar
]

53.
Raftery AE. Bayesian model selection in social research.
Sociological Methodology.
1995.
Jan
1;25: 111–63. 10.2307/271063.
[
DOI
] [
Google Scholar
]

54.
Burnham KP, Anderson DR. A practical information-theoretic approach.
Model selection and multimodel inference, 2nd ed. Springer, 2002.
[
Google Scholar
]

55.
Gignac GE, Szodorai ET. Effect size guidelines for individual differences researchers.
Personality and Individual Differences.
2016.
Nov
1;102: 74–8. 10.1016/j.paid.2016.06.069.
[
DOI
] [
Google Scholar
]

56.
Schmider E, Ziegler M, Danay E, Beyer L, Bühner M. Is it really robust? Reinvestigating the robustness of ANOVA against violations of the normal distribution assumption.
Methodology: European Journal of Research Methods for the Behavioral and Social Sciences. 2010;6(4): 147–51. doi: 10.1027/1614-2241/a000016
[
DOI
] [
Google Scholar
]

57.
West SG, Finch JF, Curran PJ. Structural equation models with non-normal variables: problems and remedies. In Hoyle R. H. (Ed.): Structural equation modeling: Concepts, issues and applications (pp. 56–75). Newbery Park, CA: Sage, 1995.
[
Google Scholar
]

58.
van der Sluis S, De Jong PF, Van der Leij A. Executive functioning in children, and its relations with reasoning, reading, and arithmetic.
Intelligence. 2007.
Sep
1;35(5): 427–49. 10.1016/j.intell.2006.09.001.
[
DOI
] [
Google Scholar
]

59.
Kaiser HF, Rice J. (1974). Little jiffy, mark IV. Educational and Psychological Measurement. 1974.
Apr;34(1): 111–7. 10.1177/001316447403400115.
[
DOI
] [
Google Scholar
]

60.
Kretzschmar A, Gignac GE. At what sample size do latent variable correlations stabilize?.
Journal of Research in Personality. 2019.
Jun
1;80: 17–22. 10.1016/j.jrp.2019.03.007.
[
DOI
] [
Google Scholar
]

61.
Ecker UKH, Lewandowsky S, Cook J, Schmid P, Fazio LK, Brashier N, et al. The psychological drivers of misinformation belief and its resistance to correction. Nature Reviews Psychology. 2022.
Jan;1(1): 13–29. 10.1038/s44159-021-00006-y.
[
DOI
] [
Google Scholar
]

62.
Colzato LS, Jongkees BJ, Sellaro R, Hommel B. Working memory reloaded: tyrosine repletes updating in the N-back task.
Frontiers in Behavioral Neuroscience. 2013.
Dec
16;7:200. doi: 10.3389/fnbeh.2013.00200

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

63.
Laine M, Fellman D, Waris O, Nyman TJ. The early effects of external and internal strategies on working memory updating training.
Scientific Reports.
2018.
Mar
6;8(1):1–2. 10.1038/s41598-018-22396-5.
[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

64.
Wilhelm O, Hildebrandt A, Oberauer K. What is working memory capacity, and how can we measure it?.
Frontiers in Psychology.
2013.
Jul
24;4:433. doi: 10.3389/fpsyg.2013.00433

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

65.
Frischkorn GT, Von Bastian CC, Souza AS, Oberauer K. Individual differences in updating are not related to reasoning ability and working memory capacity. Journal of Experimental Psychology: General. 2022.
Jun;151(6):1341–1357. doi: 10.1037/xge0001141

[
DOI
] [
PubMed
] [
Google Scholar
]

66.
Gignac GE, Kretzschmar A. Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions.
Intelligence.
2017.
May
1;62: 138–47. 10.1016/j.intell.2017.04.001.
[
DOI
] [
Google Scholar
]

67.
Rey-Mermet A, Gade M, Oberauer K. Should we stop thinking about inhibition? Searching for individual and age differences in inhibition ability. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2018.
Apr;44(4): 501–26. doi: 10.1037/xlm0000450

[
DOI
] [
PubMed
] [
Google Scholar
]

68.
Rey-Mermet A, Singh KA, Gignac GE, Brydges CR, Ecker UKH. Interference control in working memory: Evidence for discriminant validity between removal and inhibition tasks.
PLOS ONE.
2020.
Dec
2;15(12): e0243053. doi: 10.1371/journal.pone.0243053

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

69.
Friedman NP, Miyake A. The relations among inhibition and interference control functions: a latent-variable analysis. Journal of Experimental Psychology: General. 2004.
Mar;133(1): 101–35. doi: 10.1037/0096-3445.133.1.101

[
DOI
] [
PubMed
] [
Google Scholar
]

70.
Nigg JT. On inhibition/disinhibition in developmental psychopathology: Views from cognitive and personality psychology and a working inhibition taxonomy. Psychological Bulletin. 2000.
Mar;126(2): 220–46. doi: 10.1037/0033-2909.126.2.220

[
DOI
] [
PubMed
] [
Google Scholar
]

71.
Pettigrew C, Martin RC. Cognitive declines in healthy aging: Evidence from multiple aspects of interference resolution.
Psychology and Aging.
2014.
Jun;29(2): 187–204. doi: 10.1037/a0036085

[
DOI
] [
PubMed
] [
Google Scholar
]

72.
Stahl C, Voss A, Schmitz F, Nuszbaum M, Tüscher O, Lieb K, et al. Behavioral components of impulsivity. Journal of Experimental Psychology: General. 2014.
Apr;143(2): 850–86. doi: 10.1037/a0033981

[
DOI
] [
PubMed
] [
Google Scholar
]

73.
Hedge C, Powell G, Sumner P. The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences.
Behavior Research Methods.
2018.
Jun;50:1166–86. doi: 10.3758/s13428-017-0935-1

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

74.
Duncan J, Emslie H, Williams P, Johnson R, Freer C. Intelligence and the frontal lobe: The organization of goal-directed behavior.
Cognitive Psychology.
1996.
Jun
1;30(3): 257–303. doi: 10.1006/cogp.1996.0008

[
DOI
] [
PubMed
] [
Google Scholar
]

75.
Friedman NP, Miyake A, Corley RP, Young SE, DeFries JC, Hewitt JK. Not all executive functions are related to intelligence. Psychological Science. 2006.
Feb;17(2): 172–9. doi: 10.1111/j.1467-9280.2006.01681.x

[
DOI
] [
PubMed
] [
Google Scholar
]

76.
Salthouse TA. Relations between cognitive abilities and measures of executive functioning.
Neuropsychology.
2005.
Jul;19(4): 532–45. doi: 10.1037/0894-4105.19.4.532

[
DOI
] [
PubMed
] [
Google Scholar
]

77.
Hull R, Martin RC, Beier ME, Lane D, Hamilton AC. Executive function in older adults: A structural equation modeling approach.
Neuropsychology.
2008.
Jul;22(4): 508–22. doi: 10.1037/0894-4105.22.4.508

[
DOI
] [
PubMed
] [
Google Scholar
]

78.
Swire-Thompson B, DeGutis J, Lazer D. Searching for the backfire effect: Measurement and design considerations. Journal of Applied Research in Memory and Cognition. 2020.
Sep
1;9(3): 286–99. doi: 10.1016/j.jarmac.2020.06.006

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

79.
Lewandowsky S, Cook J, Ecker UKH, Albarracín D, Amazeen MA, Kendeou P, et al. The Debunking Handbook
2020, 2020.
https://sks.to/db2020
. 10.17910/b7.1182.
[
DOI
] [
Google Scholar
]

80.
Basol M, Roozenbeek J, van der Linden S. Good news about bad news: Gamified inoculation boosts confidence and cognitive immunity against fake news. Journal of Cognition. 2020;3(1): 2. doi: 10.5334/joc.91

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

81.
Bonetto E, Troïan J, Varet F, Lo Monaco G, Girandola F. Priming resistance to persuasion decreases adherence to conspiracy theories. Social Influence. 2018.
Jul
3;13(3): 125–36. 10.1080/15534510.2018.1471415.
[
DOI
] [
Google Scholar
]

82.
Cook J.
Understanding and countering climate science denial. Journal & Proceedings of the Royal Society of New South Wales. 2017.
Jan;150(465–6): 207–19. https://search.informit.org/doi/10.3316/informit.388378410941383.
[
Google Scholar
]

83.
Cook J, Bedford D, Mandia S. Raising climate literacy through addressing misinformation: Case studies in agnotology-based learning. Journal of Geoscience Education. 2014.
Sep
2;62(3): 296–306. 10.5408/13-071.1.
[
DOI
] [
Google Scholar
]

84.
Cook J, Lewandowsky S, Ecker, UKH. Neutralizing misinformation through inoculation: Exposing misleading argumentation techniques reduces their influence.
PLOS ONE.
2017.
May
5;12(5): e0175799. doi: 10.1371/journal.pone.0175799

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

85.
Lewandowsky S, Van Der Linden S. Countering misinformation and fake news through inoculation and prebunking.
European Review of Social Psychology.
2021.
Jul
3;1–38. 10.1080/10463283.2021.1876983.
[
DOI
] [
Google Scholar
]

86.
Maertens R, Anseel F, van der Linden S. Combatting climate change misinformation: Evidence for longevity of inoculation and consensus messaging effects. Journal of Environmental Psychology. 2020.
Aug
1;70: 101455. 10.1016/j.jenvp.2020.101455.
[
DOI
] [
Google Scholar
]

87.
Maertens R, Roozenbeek J, Basol M, van der Linden, S. Long-term effectiveness of inoculation against misinformation: Three longitudinal experiments. Journal of Experimental Psychology: Applied. 2021.
Mar;27(1): 1–16. 10.1037/xap0000315.
[
DOI
] [
PubMed
] [
Google Scholar
]

88.
Osborne J.
Arguing to learn in science: The role of collaborative, critical discourse. Science. 2010.
Apr
23;328(5977): 463–6. doi: 10.1126/science.1183944

[
DOI
] [
PubMed
] [
Google Scholar
]

89.
Roozenbeek J, Maertens R, McClanahan W, van der Linden S. Disentangling item and testing effects in inoculation research on online misinformation: Solomon revisited. Educational and Psychological Measurement. 2021.
Apr;81(2): 340–62. 10.1177/0013164420940378.
[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

90.
Roozenbeek J, van der Linden, S. The fake news game: Actively inoculating against the risk of misinformation. Journal of Risk Research. 2019.
May
4;22(5): 570–80. 10.1080/13669877.2018.1443491.
[
DOI
] [
Google Scholar
]

91.
van der Linden S, Leiserowitz A, Rosenthal S, Maibach E. Inoculating the public against misinformation about climate change.
Global Challenges.
2017.
Feb
1;1(2): 1600008. doi: 10.1002/gch2.201600008

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

92.
Bopp KL, Verhaeghen P. Aging and verbal memory span: A meta-analysis.
The Journals of Gerontology Series B: Psychological Sciences and Social Sciences. 2005.
Sep
1;60(5): 223–33. doi: 10.1093/geronb/60.5.p223

[
DOI
] [
PubMed
] [
Google Scholar
]

93.
Maldonado T, Orr JM, Goen JR, Bernard JA. Age differences in the subcomponents of executive functioning. The Journals of Gerontology: Series B. 2020.
Jun
2;75(6): e31–e55. doi: 10.1093/geronb/gbaa005

[
DOI
] [
PubMed
] [
Google Scholar
]

94.
Rhodes MG. Age-related differences in performance on the Wisconsin card sorting test: a meta-analytic review.
Psychology and Aging.
2004.
Sep;19(3): 482–94. doi: 10.1037/0882-7974.19.3.482

[
DOI
] [
PubMed
] [
Google Scholar
]

95.
Salthouse TA. The processing-speed theory of adult age differences in cognition.
Psychological Review.
1996.
Jul;103(3): 403–28. doi: 10.1037/0033-295x.103.3.403

[
DOI
] [
PubMed
] [
Google Scholar
]

96.
Salthouse TA. When does age-related cognitive decline begin?.
Neurobiology of Aging. 2009.
Apr
1;30(4): 507–14. doi: 10.1016/j.neurobiolaging.2008.09.023

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

97.
Verhaeghen P.
Aging and executive control: Reports of a demise greatly exaggerated.
Current Directions in Psychological Science. 2011.
Jun;20(3): 174–80. doi: 10.1177/0963721411408772

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

98.
Verhaeghen P, Cerella J. Aging, executive control, and attention: A review of meta-analyses. Neuroscience & Biobehavioral Reviews. 2002.
Nov
1;26(7): 849–57. doi: 10.1016/s0149-7634(02)00071-4

[
DOI
] [
PubMed
] [
Google Scholar
]

99.
Verhaeghen P, Steitz DW, Sliwinski MJ, Cerella J. Aging and dual-task performance: A meta-analysis.
Psychology and Aging.
2003.
Sep;18(3): 443–60. doi: 10.1037/0882-7974.18.3.443

[
DOI
] [
PubMed
] [
Google Scholar
]

100.
Wasylyshyn C, Verhaeghen P, Sliwinski MJ. Aging and task switching: A meta-analysis.
Psychology and Aging.
2011.
Mar;26(1): 15–20. doi: 10.1037/a0020912

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

PLoS One. doi:
10.1371/journal.pone.0283951.r001

Decision Letter 0

Alessandra S Souza

Alessandra S Souza

Academic Editor

Find articles by
Alessandra S Souza

Author information

Copyright and License information

Roles

Alessandra S Souza
:
Academic Editor

© 2023 Alessandra S. Souza

This is an open access article distributed under the terms of the
Creative Commons Attribution License
, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

PMC Copyright notice

2 Aug 2022

PONE-D-22-17797Executive function and the continued influence of misinformation: A latent-variable analysisPLOS ONE

Dear Dr. McIlhiney,

Thank you for submitting your manuscript to PLOS ONE. I am sorry for the relative delay in processing the article - it has been a it of a challenge to find suitable reviewers, particularly now that it was close to the end of the semester and start of vacation period. I was however lucky to find two excellent expert reviewers that are quite knowledgeable on working memory, lay cognition and misinformation, and confirmatory factor analyses. I want to take this opportunity to thank the reviewers for their valuable input and careful suggestions for improvements. The reviewers see merit in your paper and believe that after careful revision the paper will make a fine contribution to the literature. This agrees with my own reading of the paper. Hence I am inviting a major revision. Please take in consideration of all the reviewer's comments, and respond to all of them to the best of your abilities. They provide complementary suggestions that I believe will improve the reading and robustness of the analyses and discussion points in the paper. In addition to the reviewer's comments, a few remarks arouse on my own reading of the paper that I would like to see addressed as well.First, I was a bit confused about the presentation of the results of Sanderson et al. vs. Brydges et al. It is not really clear what could explain their divergent results, and how the present study can help us further understand the relation between working memory and CIE. Please try to make a more straight point regarding the current state of the literature and what could explain these divergent findings, and how the present study advances the state of this debate.Second, as also noticed by Reviewer 1, there seems to be a conflation between updating and working memory capacity in the paper. Although R1 points it out only as a matter of measurement, I also noticed that the authors use these terms quite interchangeably, creating a bit of confusion, specially in describing their prior work (Sanderson et al. vs. Brydges et al.). Please be consistent in using the term updating when referring to scores derived from updating tasks, and working memory capacity to refer to scores of tasks that do not include updating (or that have a mix of both types of tasks). If the authors do not believe this distinction is relevant, I'd suggest that they are upfront about this in the intro (following the suggestions of R1) and opt for only one term throughout.Third, for the stroop task the authors say at some point that they had a congruent condition. Yet, it seems to me that the implemented condition would be more reasonably classified as a neutral baseline since no semantic information was provided (colored squares?).Fourth, I commend the authors for sharing their data, but as also noticed by R1, only processed data was provided. I wonder if the authors could also provide raw tasks scores. This would allow for more freedom for future studies to explore different task scoring methods. Please also consider adding a codebook (i.e., meta-data file explaining the variables) to the project page.Fifth, I wondered a bit about the choice of building difference scores to create the CIE latent variable, and the rather arbitrary choice of which scores to subtract from which scores. I wonder why the authors did not create a CIE factor from a latent difference score? One could create a latent variable that reflects performance in all eight indicators and then one CIE factor that contains only the additional variance from the four correction conditions. Wouldn't that be less arbitrary? Here also providing the raw CIE task scores would be helpful, since at the moment, only the difference scores selected by the authors are available at the OSF and alternative model implementations are not possible.Sixth, I wondered about the memory measures from the CIE tasks. Could that data also be provided in the OSF? Is there a reason why at least the descriptives are not provided? Could this data provide any additional information?

Please submit your revised manuscript by Sep 16 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at
plosone@plos.org
. When you're ready to submit your revision, log on to
https://www.editorialmanager.com/pone/
and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see:
https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols
. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at
https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols
.

We look forward to receiving your revised manuscript.

Kind regards,

Alessandra S. Souza, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf
and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the Methods section, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

*Please change "female” or "male" to "woman” or "man" as appropriate, when used as a noun (see for instance
https://apastyle.apa.org/style-grammar-guidelines/bias-free-language/gender
).

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript:

"PM’s contribution to this research was supported by an Australian Government Research Training Program (RTP) Scholarship. UKHE was supported by grant FT190100708 from the Australian Research Council."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"PM’s contribution to this research was supported by an Australian Government Research Training Program (RTP) Scholarship.

UKHE was supported by grant FT190100708 from the Australian Research Council.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The
PLOS Data policy
requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The presented manuscript discussed if individual differences in the continued influence effect (CIE) of misinformation can be explained by executive functions. The theoretical introduction is clear, and the tested hypothesis are coherently derived from previous literature. The collected measures are well described and mostly adequate to test the hypothesis (see my comments below for specific critique points). The analysis is also clearly written and fitting for testing the hypothesis, although some more details could have been provided in the manuscript (see my detailed comments). The results are clearly presented and easy to comprehend. Likewise, the discussion summarizes the results well and integrates the presented findings well into the already existing literature. All in all, I think this is an interesting and well written manuscript that will make an important contribution for understanding the continued influence effect and individual differences therein. Yet, there are still some issues that I would like to see addressed prior to publication. These are outlined below.

1. Finding psychometrically good and valid indicators of executive functions is difficult and all in all I think the authors have made a balanced selection for the different executive functions. The only issue I see is that for updating only average performance in working memory tasks involving updating was used. This measure likely conflates individual differences in storage processes of working memory with executive processes like updating. Specifically, previous research has shown that updating tasks are equally good indicators of working memory capacity as simple binding tasks that do not require any updating and removal of outdated information (Wilhelm et al., 2013). This indicates that updating performance likely mainly measures individual differences in more basic WM processes not related to updating. This was further validated in a recent study of my own (Frischkorn et al., 2022). This is not to say, that I want the authors to cite my work, but I rather want to point out that a more nuanced discussion of their updating measurement is required, especially with respect to the discussion and implications of their results. It could be that primarily basic working memory processes such as storage & maintenance are related to individual differences in CIE, because the current measure does not sufficiently separate processes specific to updating from these basic processes.

2. I thank the authors for making their materials and data available. I was able to reproduce all the results and I think this is excellent for the promotion of open science. Yet, in reproducing the results I noted that some data analytical choices were not sufficiently reported in the manuscript.

a. How was the scaling of latent variables achieved? Did the authors fix the loading of one of the indicators to one (i.e., normalization), or did they fix the variance of the latent variables to one (i.e., standardization). This is a minor point, but for a complete description of the analysis please add this information

b. It seems that the authors have standardized the observed variables prior to estimating SEM. I understand this decision given that variances vary considerably between measures. This is not apparent in the current version of the manuscript. Again, I do not think that this is a serious problem, but in the interest of transparency I suggest adding this information and discussing the implications of performing SEM based on correlation matrices instead of covariance matrices

3. When playing around with the data a bit, I noted that the main problem for the correlated EF model causing its bad fit was the cross loading of the Trail-Making Task on the updating factor. This is the same cross-loading later implemented in the model including just shifting and updating. Why did the authors choose to not include this cross loading in the model with all three executive functions given that this would have achieved a good fit? This would then offer the possibility to include inhibition in their analysis as a predictor of individual differences in the CIE. I know that there were additional reasons to drop inhibition, but maybe including the cross-loading can mitigate problems with including inhibition in the SEM analysis.

4. Related to my previous point, the authors could have dropped the flanker task as an indicator of inhibition and constrained the loading of Stroop & go-no-go to be equal for the inhibition factors. That way the inhibition factor would be still locally identified, and the authors could present results with respect to relationship of inhibition with individual differences in the CIE.

5. I was surprised to see that the reliability of the differences scores for inhibition was so good, especially for the Stroop and flanker task. Could the authors share the full data for estimating these reliabilities and provide more information how reliability was estimated. I am familiar with omega in the context of CFA but computing it for item indicators is less common. I assume that the authors followed the method suggested by Hayes & Coutts (2020), but a more explicit description of the procedure would aid the reader in following the reliability estimation. Given the number of trials per condition (48 or 60) and results from previous research (for a summary see von Bastian et al., 2020) I would like to see some more information regarding these estimates to really trust them.

6. I am not entirely convinced that the additional exploratory factor analysis adds to the robustness of the results. I agree that SEM estimates are unstable with smaller sample sizes, especially if factor reliabilities are low. But the same problem applies to estimates for factor analysis that rely on correlation/covariance estimates. These are also not stable in smaller sample sizes and when correlations are low (Schönbrodt & Perugini, 2013). Therefore, the same critique could be used for the results of the exploratory factor analysis. Maybe I am missing a point here, in this case please elaborate why you think that EFA results should be more robust than the SEM results.

References

Frischkorn, G. T., von Bastian, C. C., Souza, A. S., & Oberauer, K. (2022). Individual differences in updating are not related to reasoning ability and working memory capacity. Journal of Experimental Psychology: General.
https://doi.org/10.1037/xge0001141

Hayes, A. F., & Coutts, J. J. (2020). Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…. Communication Methods and Measures, 14(1), 1–24.
https://doi.org/10.1080/19312458.2020.1718629

Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47(5), 609–612.
https://doi.org/10/f496x4

von Bastian, C. C., Blais, C., Brewer, G. A., Gyurkovics, M., Hedge, C., Kałamała, P., Meier, M. E., Oberauer, K., Rey-Mermet, A., Rouder, J. N., Souza, A. S., Bartsch, L. M., Conway, A. R. A., Draheim, C., Engle, R. W., Friedman, N. P., Frischkorn, G. T., Gustavson, D. E., Koch, I., … Wiemers, E. A. (2020). Advancing the understanding of individual differences in attentional control: Theoretical, methodological, and analytical considerations. PsyArXiv, 1–81.

Wilhelm, O., Hildebrandt, A., & Oberauer, K. (2013). What is working memory capacity, and how can we measure it? Frontiers in Psychology, 4, 433.
https://doi.org/10/gd3vs7

Reviewer #2: This is a very interesting paper and I enjoyed reading it. It’s great to see a systematic examination of the relationship between EF/WM and the CIE that draws on contemporary models of WM such as Miyake’s account. The paper is nicely structured and well written, and the study design and analysis are appropriate for addressing the hypothesis/predictions. I don’t think there is a great deal that needs be to done to revise the paper – the comments that follow raise a few issues that I think can be dealt with relatively little effort. I’m cognisant of the fact that there’s not a lot of space available to add more content.

1. The relationship between the overview of the two models and the hypothesis and predictions felt a little loose. The way I read the introduction felt like it was setting up the study to play off the updating and inhibition accounts. Indeed the Discussion suggests that the findings favours the former. Yet the hypothesis and its associated predictions don’t make any mention of a test of the claims of the models. It would be nice to see a stronger link forged.

2. I found it a bit odd that the N-back tasks were described as measures of updating without additional justification. Admittedly there is some face validity for thinking this might be the case but I think it needs to be argued for – especially in light of the debate over what the N-back actually measures and whether it is a WM task at all.

Redick, T. S., & Lindsey, D. R. B. (2013)
https://doi.org/10.3758/s13423-013-0453-9

Frost, A., Moussaoui, S., Kaur, J., Aziz, S., Fukuda, K., & Niemeier, M. (2021).
https://doi.org/10.1016/j.actpsy.2021.103398

Kane, M. J., Conway, A. R. A., Miura, T. K., & Colflesh, G. J. H. (2007).
https://doi.org/10.1037/0278-7393.33.3.615

It would be useful to provide some justification for using the N-back tasks this way. This is especially important given the fact the updating latent variables in the various analyses are strongly (mostly?) ‘driven’ by the N-back measures. If the validity of the N-backs as updating measures is in question then it does raise the questions as to what exactly it is that is explaining variance in the CIE.

3. Although it’s clear that the CIE has been used in individual differences (ID) research before I think there is a question as to whether it is an unproblematic ID measure. The paradigm that is used to generate the CIE measure used in the study is essentially an experimental one (à la (Johnson & Seifert, 1994) where the focus is on creating a task that is best distinguishes different experimental conditions/groups (accentuates between group variation) rather than one that preserves inter-individual variation. Thus, I wonder whether it might suffer from the same kinds of problems other experimental measures (e.g., ‘classic’ task switching and even the Stroop – see Rouder & Haaf, 2019) face when imported into ID research (typically an attenuation of covariance between the ID measures – often to the point where correlations etc are not statistically significant. This in turn can have all sorts of consequences for the likes of CFA, SEM and so on). If this is the case it is unclear to me how it might be influencing the relationships explored in the current study. Might a better ID CIE measure result in a different pattern of results on the SEM? Obviously these questions are beyond the scope of a revision of the paper – but I’d suggest that a brief discussion of the suitability of CIE measure for ID research would be helpful and assure the reader that limitations of the measure don’t mean we might be missing something important.

Hedge, C., Powell, G., & Sumner, P. (2018).
https://doi.org/10.3758/s13428-017-0935-1

Rouder, J., Kumar, A., & Haaf, J. M. (2019).
https://doi.org/10.31234/osf.io/3cjr5

Rouder, J. N., & Haaf, J. M. (2019).
https://doi.org/10.3758/s13423-018-1558-y

4. The same issue could arise for the flanker task (a classic experimental task) and even the Stroop task (although the Stroop is widely used as an ID measure it is does seem to a strongly accentuate between groups variation and attenuate inter-individual variation). I do wonder whether the problem with the inhibition latent variable could possibly be related to the suitability of some of these tasks as ID measures.

5. Finally, a pretty minor but ‘big picture’ comment: it seems to me that it’s a bit of a stretch to argue that longer term, real world CIE effects, like the 5G example given in the introduction, are a ‘simple’ matter of poor WM/EF abilities (whether updating or inhibition issues). Unlike lab-based CIE tasks, in these real world situations it can be some time before disconfirming information comes to light. There seems to be an implication that the ‘action’ occurs at the point at which disconfirming information becomes available. But what if this doesn’t happen for weeks or months? Is the mental model ‘frozen’ until new information arrives? I’d expect not. I don’t think we can simply assume that people’s mental models are stable over longer periods of time – indeed, I think it’s quite possible (via confirmation bias type processes) that people seek out ‘confirming’ information and/or develop model-preserving strategies that can make updating or inhibition decreasingly likely to be effective in changing a person’s mental model (or selecting the better one). So the question is, how big a sway do WM/EF abilities have over belief change in these longer term, real world situations compared to lab-type CIE scenarios? Are they still important or do they become decreasingly important? I suspect WM/EF abilities also play a role in moderating the role of confirmation bias processes and the degree to which people adopt a ‘monological belief system’ about conspiracy theories and other potentially problematic beliefs. Importantly, I don’t think this is a huge problem for the paper – it’s fine to examine a ‘short-term CIE’. What we’ve learnt from the current paper is valuable – I just don’t think it necessarily can explain the kind of example used at the beginning of the paper.

**********

6. PLOS authors have the option to publish the peer review history of their article (
what does this mean?
). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review?
For information about this choice, including consent withdrawal, please see our
Privacy Policy
.

Reviewer #1: No

Reviewer #2:
Yes:
Stephen R. Hill

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool,
https://pacev2.apexcovantage.com/
. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at
figures@plos.org
. Please note that Supporting Information files do not need this step.
PLoS One. 2023 Apr 5;18(4):e0283951. doi:
10.1371/journal.pone.0283951.r002

Author response to Decision Letter 0

Article notes

Copyright and License information

Collection date 2023.

PMC Copyright notice

3 Feb 2023

Please find our responses to reviewers in the "Response to Reviewers" document provided with our resubmission.

Attachment
Submitted filename:
Response to Reviewers.docx

Click here for additional data file.
(42.2KB, docx)

PLoS One. doi:
10.1371/journal.pone.0283951.r003

Decision Letter 1

Alessandra S Souza

Alessandra S Souza

Academic Editor

Find articles by
Alessandra S Souza

Author information

Copyright and License information

Roles

Alessandra S Souza
:
Academic Editor

© 2023 Alessandra S. Souza

This is an open access article distributed under the terms of the
Creative Commons Attribution License
, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

PMC Copyright notice

21 Mar 2023

Executive function and the continued influence of misinformation: A latent-variable analysis

PONE-D-22-17797R1

Dear Dr. McIlhiney,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. There was one minor comment from Reviewer 1, but I believe you can adjust this during the proofreading process. I would like to thank the reviewers for their exceptional work evaluating this manuscript. I hope it makes a fine contribution to the literature on the misinformation effect, which is becoming a topic more and more relevant in our current context.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at
http://www.editorialmanager.com/pone/
, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at
authorbilling@plos.org
.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact
onepress@plos.org
.

Kind regards,

Alessandra S. Souza, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The
PLOS Data policy
requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall, the authors addressed my concerns raised in my first review. The clarifications on the SEM analyses also resolved my question regar

[The evaluation harness truncated this reference: showing the first 120000 of 124844 characters.]
</reference>

<statements>
1. Higher verbal cognitive ability predicted lower susceptibility to the continued influence effect in a cited prior study
2. The executive-function study notes that working-memory updating and intelligence may be difficult to separate and that prior working-memory findings have not consistently replicated
</statements>

Begin the assessment now. Output only the JSON list, without any conversational text or explanations.