The DOI matches its Crossref record; 69 of the 73 references it cites were found in a registry or an index; none of the 39 sources its claims cite is checked for support yet.
Loneliness before and during the COVID-19 pandemic: A systematic review with meta-analysis.
Open accessPublished version of a preprint
Abstract
The COVID-19 pandemic and measures aimed at its mitigation, such as physical distancing, have been discussed as risk factors for loneliness, which increases the risk of premature mortality and mental and physical health conditions. To ascertain whether loneliness has increased since the start of the pandemic, this study aimed to narratively and statistically synthesize relevant high-quality primary studies. This systematic review with meta-analysis was registered at PROSPERO (ID CRD42021246771). Searched databases were PubMed, PsycINFO, Cochrane Library/Central Register of Controlled Trials/EMBASE/CINAHL, Web of Science, the World Health Organization (WHO) COVID-19 database, supplemented by Google Scholar and citation searching (cutoff date of the systematic search December 5, 2021). Summary data from prospective research including loneliness assessments before and during the pandemic were extracted. Of 6,850 retrieved records, 34 studies (23 longitudinal, 9 pseudolongitudinal, 2 reporting both designs) on 215,026 participants were included. Risk of bias (RoB) was estimated using the risk of bias in non-randomised studies-of interventions (ROBINS-I) tool. Standardized mean differences (SMD, Hedges' g) for continuous loneliness values and logOR for loneliness prevalence rates were calculated as pooled effect size estimators in random-effects meta-analyses. Pooling studies with longitudinal designs only (overall N = 45,734), loneliness scores (19 studies, SMD = 0.27 [95% confidence interval = 0.14-0.40], Z = 4.02, p < .001, I 2 = 98%) and prevalence rates (8 studies, logOR = 0.33 [0.04-0.62], Z = 2.25, p = .02, I 2 = 96%) increased relative to prepandemic times with small effect sizes. Results were robust with respect to studies' overall RoB, pseudolongitudinal designs, timing of prepandemic assessments, and clinical populations. The heterogeneity of effects indicates a need to further investigate risk and protective factors as the pandemic progresses to inform targeted interventions. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 39 cited sources checked · 0 supported · 0 flagged
None of the sources cited for this claim have been checked yet.
In the paper
“Women were more likely to report increases in loneliness than men (Entringer & Gosling, 2021; Entringer et al., 2020; Niedzwiedz et al., 2021; Philpot et al., 2021; Wong et al., 2020)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Study Characteristics of Included Studies
What the sources say
- Not checked yetcites Entringer & Gosling, 2021
- Not checked yetcites Entringer et al., 2020
- Not checked yetcites Niedzwiedz et al., 2021
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Those who lived alone (Bartrés-Faz et al., 2021; Heidinger & Richter, 2020; Huxhold & Tesch-Römer, 2021; McGrath et al., 2021; Okely et al., 2020; Stolz et al., 2021; Wong et al., 2020) and/or were single during the pandemic (Huxhold & Tesch-Römer, 2021; Stone, 2020) were particularly at risk for higher levels of loneliness compared to pre-pandemic assessments”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Study Characteristics of Included Studies
What the sources say
- Not checked yetcites Bartrés-Faz et al., 2021
- Not checked yetcites Heidinger & Richter, 2020
- Not checked yetcites Huxhold & Tesch-Römer, 2021
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the overall pooled effect in this study was small and the effect sizes reported by the individual studies were heterogeneous.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the fact that the meta-regression accounted for less than a third of observed variance suggests that other factors may influence the different trajectories of loneliness in the pandemic context.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The main findings of the longitudinal studies were robust against results from 14 studies with serious RoB (SMD = 0.41 [95% CI: 0.11–0.71])”
- Also stated in: § Sensitivity analyses · plain
“two studies with clinical populations (SMD = 0.26 [95% CI: 0.12–0.40]), six studies with pseudo-longitudinal designs (SMD = 0.30 [95% CI: 0.17–0.42]), and two studies whose pre-pandemic assessment period overlapped with the pre-specified date cut-offs (SMD = 0.27 [95% CI: 0.14–0.39])”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Sensitivity analyses
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Sensitivity analyses · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This mirrors findings of the meta-regression, in which studies’ higher RoB was negatively associated with the observed effect sizes.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The during-pandemic assessments yielded higher continuous loneliness scores than the pre-pandemic assessments (SMD = 0.27 [95% CI: 0.14–0.40])”
- Also stated in: § Abstract · plain
“loneliness scores (19 studies, SMD=0.27 [95% confidence interval=0.14–0.40], Z=4.02, p<.001, I2=98%) and prevalence rates (8 studies, logOR=0.33 [0.04–0.62], Z=2.25, p=.02, I2=96%) increased relative to pre-pandemic times with small effect sizes”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Results of Individual Studies and Meta-Analysis
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: Different loneliness measures assess the same underlying construct and can be pooled using standardized mean differences.
- Also stated in: § Abstract · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and prevalence rates (logOR = 0.33 [95% CI: 0.04–0.62])”
- Also stated in: § Abstract · plain
“prevalence rates (8 studies, logOR=0.33 [0.04–0.62], Z=2.25, p=.02, I2=96%) increased relative to pre-pandemic times with small effect sizes”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Results of Individual Studies and Meta-Analysis
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: Different loneliness measures assess the same underlying construct and can be pooled using standardized mean differences.
- Also stated in: § Abstract · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Interestingly, the most rigorous analysis (the sensitivity analyses that included only longitudinal study designs and studies with moderate RoB) showed a larger pooled effect size than the main analyses.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“First, the duration between loneliness assessments was often a range and not a concrete number of days/months.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- It may state two separate claims as one. 23
- Probably not a substantial claim. 18
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In total, 34 articles met the eligibility criteria”
- Also stated in: § Study Characteristics of Included Studies · plain
“Table 1 provides a summary of the main information extracted from the 34 eligible articles, totaling 215,026 participants”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Study Selection
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Study Characteristics of Included Studies · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the studies reporting comparisons of loneliness pre- and during-pandemic, only one reported an overall decrease, 18 reported an overall increase, and eight reported no change”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Study Characteristics of Included Studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Increases in loneliness were found both in younger participant groups, such as students (Beutel et al., 2021; Elmer et al., 2020; Entringer & Gosling, 2021; Rogers et al., 2021) and in older participant groups, such as community cohorts of senior citizens (Heidinger & Richter, 2020; Krendl & Perry, 2021; Wong et al., 2020)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Study Characteristics of Included Studies
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Studies showing decreasing loneliness had overwhelmingly relied on pre-pandemic assessments conducted shortly before the implementation of physical distancing, while those with comparison data from months or years before the pandemic had observed increased loneliness during the pandemic”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The meta-regression identified age, clinical populations, and studies’ overall RoB as predictors of increases in loneliness, but only overall RoB had statistically significant effects.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As some original studies failed to report on previously identified vulnerable groups (e.g., individuals living alone), these could not be tested as predictors.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most studies had a serious overall RoB. For ten studies (seven of which were included in the main analyses), RoB was rated as moderate”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Risk of bias
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In summary, there was a substantial number of studies with high RoB due to confounding, whereas bias due to selective reporting of results (including effect estimates) was rare”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Risk of bias
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As included studies mainly derived from the US and Europe, whereas South America, Asia/Oceania, and Africa were underrepresented, the present findings might not be generalizable to populations not conforming to the WEIRD (Western, educated, industrialized, rich and democratic) stereotype (Henrich et al., 2010).”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the final model (21 studies, R2 = .29), overall RoB rating (B = −0.35 [−0.64, −0.07]) was the only significant predictor, indicating that an overall lower RoB was associated with smaller effect sizes”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Additional Analysis: Meta-Regression
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“This is because loneliness is related to factors other than social isolation, including temporally stable characteristics of the individual (Mund et al., 2020) and their environment such as personality traits, need for contact and expectations of relationships (Qualter et al., 2015), physical and mental health, and cultural norms (Gierveld et al., 2018; Lim et al., 2020)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Mund et al., 2020
- Not checked yetcites Qualter et al., 2015
- Not checked yetcites Gierveld et al., 2018
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Bias domains included in the ROBINS-I tool (Cochrane Handbook for Systematic Reviews of Interventions version 6.2, 2021, Chapter 25, section 4) were used”
- Also stated in: § Methods for Assessing Risk to Internal Validity/Risk of Bias · plain
“For each study and domain, the RoB was independently rated by two authors as “low”, “moderate” or “serious”. Their assessments were merged”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Methods > Methods for Assessing Risk to Internal Validity/Risk of Bias
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Also stated in: § Methods for Assessing Risk to Internal Validity/Risk of Bias · plain
None of the sources cited for this claim have been checked yet.
In the paper
“which increases the risk of premature mortality and mental and physical health conditions”
- Also stated in: § Abstract · plain
“largely due to their serious impact on longevity, mental and physical health, and well-being (Fried et al., 2020; Holt-Lunstad et al., 2015; Leigh-Hunt et al., 2017)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Fried et al., 2020
- Not checked yetcites Holt-Lunstad et al., 2015
- Not checked yetcites Leigh-Hunt et al., 2017
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Abstract · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This step was conducted independently by four members of the research group (postdoctoral/senior researchers with previous experience conducting reviews and/or meta-analyses, three psychologists (two full professors) and one medical doctor (assistant professor))”
- Also stated in: § Study Selection · plain
“Discrepancies were resolved through discussion”
- Also stated in: § Study Selection · plain
“Senior researchers (mathematician and medical doctor/psychologist, full professors) verified the eligibility of included studies”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Methods > Study Selection
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Also stated in: § Study Selection · plain
In the paper
“A more recent systematic review, which included neither a meta-analysis nor a meta-regression (Buecker & Horstmann, 2021), found that longitudinal studies mainly reported increases in loneliness”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Buecker & Horstmann, 2021
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Studies have reported stable (Peng & Roth, 2021; Sibley et al., 2020), as well as increases (Kovacs et al., 2021; Macdonald & Hülür, 2021) and decreases (Bartrés-Faz et al., 2021) in loneliness levels”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Peng & Roth, 2021
- Not checked yetcites Sibley et al., 2020
- Not checked yetcites Kovacs et al., 2021
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“However, it remains unclear whether loneliness has increased overall since the pandemic started (e.g., Killgore et al., 2020; Sutin et al., 2020)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Killgore et al., 2020
- Not checked yetcites Sutin et al., 2020
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This systematic review with meta-analysis was registered at PROSPERO (ID CRD42021246771)”
- Also stated in: § Abstract · plain
“The study protocol was registered before conducting the search”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Abstract · plain
In the paper
“Throughout the systematic review, the latest PRISMA guidelines were followed (Page et al., 2021)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Methods > Search Strategy and Inclusion and Exclusion Criteria
What the sources say
- Not checked yetcites Page et al., 2021
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To ascertain the results’ robustness, a series of sensitivity analyses were performed (1) including only studies with no ‘serious’ or ‘critical’ overall RoB rating, (2) combining longitudinal and pseudo-longitudinal study designs, (3) incorporating pre-pandemic assessments that overlapped with the date cut-offs specified above, and (4) excluding clinical populations”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Methods > Summary Measures/Methods of Synthesis
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A 2021 systematic review and meta-analysis of changes in mental health, focusing on longitudinal studies and natural experiments with pre-pandemic comparisons, found no evidence of increase in loneliness (based on three studies) (Prati & Mancini, 2021)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Abstract
What the sources say
- Not checked yetcites Prati & Mancini, 2021
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For use in sensitivity analyses and meta-regression, an overall RoB rating was constructed (≥1 “serious” rating in any domain resulted in a “serious” overall RoB; overall “low” RoB was only present when all domains were rated “low” risk; otherwise, overall risk was considered “moderate”)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Methods > Methods for Assessing Risk to Internal Validity/Risk of Bias
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“previous research has shown that particularly sustained or chronic loneliness jeopardizes mental and physical health (Cacioppo et al., 2015; National Academies of Science, 2020)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Cacioppo et al., 2015
- Not checked yetcites National Academies of Science, 2020
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The confidence in the finding that there has been an increase in loneliness – albeit small – during the pandemic is strengthened by the results of the sensitivity analyses, the inclusion of only high-quality and longitudinal research in the meta-analyses, the relatively large number of studies with a pooled sample of 45,734 participants, and the lack of any indication of publication bias”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The lack of control samples unaffected by the pandemic weakens possible causal inference, making it more difficult to attribute the increase in loneliness to the pandemic.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the informative value of the meta-regression was still hampered by the limited number of predictors that could be tested on the basis of the available studies (which also necessitated a stepwise procedure).”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“A previous rapid review and meta-analysis (Prati & Mancini, 2021) reported small increases in mental distress (overall g = 0.17) based on longitudinal studies”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Prati & Mancini, 2021
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Their synthesis showed no statistically significant change in loneliness (g = 0.12, p = .34)”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Prati & Mancini, 2021
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“This constitutes a small (Cohen, 1992; Ferguson, 2009) effect, which was also heterogeneous”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Cohen, 1992
- Not checked yetcites Ferguson, 2009
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Based on the examination of the studentized residuals, robustness analyses revealed that there was no indication of outliers and according to the Cook’s distances, none of the studies were overly influential”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Results > Results of Individual Studies and Meta-Analysis
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“The numerical values of effect size indices often provide limited understanding of the real-world significance of those effects, as even statistically small effects can be of high importance (e.g., Meyer et al., 2001).”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Meyer et al., 2001
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Restriction measures were coded based on official mandates, however, this might have been imprecise if measures differed between regions and/or if the assessment spanned a period in which these rules changed.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, as the pandemic progressed differently around the world, we used regional cut-offs to distinguish whether study assessments had taken place before or during the pandemic, but individuals might also have been affected by restrictions outside their place of residence (e.g., travel bans).”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Furthermore, an alternative explanation for increases in loneliness in the population was recently provided by Buecker et al. (2021) who reported linear increases in emerging adults over the last decades.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion > Strengths and Limitations Including Constraints on Generality
What the sources say
- Not checked yetcites Buecker et al., 2021
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Previous research has shown positive effects of interventions enhancing social support (such as buddy-care programs) (Masi et al., 2011).”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Masi et al., 2011
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Prati and Mancini (2021) explored, using meta-regression, predictors of increases in mental health symptoms during the pandemic. They found no effects of mean age, gender, or study design, either.”
§ Loneliness Before and During the COVID-19 Pandemic: A Systematic Review with Meta-Analysis > Discussion
What the sources say
- Not checked yetcites Prati & Mancini, 2021
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
The pandemic and mitigation measures led to fewer social contacts (greater social isolation).
“Since its outbreak, many countries around the world have enacted shelter-in-place and physical distancing orders, travel bans, and switched to remote work and education resulting in fewer social contacts (i.e., greater social isolation), which may in turn have increased loneliness”
The paper relies on this without support.
Different loneliness measures assess the same underlying construct and can be pooled using standardized mean differences.
“For interval- or pseudo-interval-scaled outcomes (continuous loneliness scores), weighted standardized mean differences (Hedges’ g) were used as effect size estimators”
The paper relies on this without support.
Loneliness is a risk factor for premature mortality and for mental and physical health problems.
“However, as loneliness constitutes a risk for premature mortality and mental and physical health, it should be closely monitored, ideally in combination with potential risk and protective factors and health outcomes to derive appropriate interventions.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous literature points out that social distancing and changes to the quantity and frequency of social interactions due to the pandemic sometimes led to a significant disruption of social networks (Lampraki et al., 2022) and loneliness (Ernst et al., 2022).”
From Social connections combat loneliness and promote wellbeing among college students coming out of the COVID-19 pandemic (2025) · cites this paper as Ernst et al., 2022
In the citing paper
“These interventions address structural drivers of loneliness identified in public health research (Ernst et al. 2022;WHO 2023).”
From Not a Silver Bullet for Loneliness: How Attachment and Age Shape Intimacy with AI Companions (2026) · cites this paper as Ernst et al. 2022
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Inconsistent p-value: (Z = 0.205, p = .238
MinorThe paper reports p = .238 here; recomputing from the test statistic and its degrees of freedom gives p = .838 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .238 · recomputed p = .838
“(Z = 0.205, p = .238”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upz = 0.205reported p = .238 · recomputed p = .838
“(Z = 0.205, p = .238”
- Consistentz = 4.02reported p < .001 · recomputed p < .001
“Z=4.02, p < .001”
- Consistentz = 2.25reported p = .02 · recomputed p = .024
“Z=2.25, p = .02”
- Consistentz = 0.236reported p = .813 · recomputed p = .813
“(Z = 0.236, p = .813”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Risk-of-bias effect is interpreted in opposite directions
MinorThe results say lower risk of bias was associated with smaller effects, while the discussion says higher risk of bias was associated with smaller effects. The reported negative coefficient, with moderate risk coded 0 and serious risk coded 1, supports the discussion's direction.
“overall RoB rating (B = −0.35 [−0.64, −0.07]) was the only significant predictor, indicating that an overall lower RoB was associated with smaller effect sizes.”
“studies’ higher RoB was negatively associated with the observed effect sizes.”
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Home visits: a strategy to improve newborn survival - Authors' reply
(2008) · Americanae (AECID Library) · doi:10.1016/s0140 · Cited by 22,524
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Cumpston, M., Li, T., Page, M. J., Chandler, J., Welch, V. A., Higgins, J. P., & Thomas, J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000142 · Cited by 7,218
Loneliness and Social Isolation as Risk Factors for Mortality: A Meta-Analytic Review
Holt-Lunstad, J., Smith, T. B., Baker, M., Harris, T., & Stephenson, D. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614568352 · Cited by 6,043
The Revised UCLA Loneliness Scale: concurrent and discriminant validity evidence
Russell, D., Peplau, L. A., & Cutrona, C. E. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.3.472 · Cited by 5,173
A Short Scale for Measuring Loneliness in Large Surveys: Results From Two Population-Based Studies
Hughes, M. E., Waite, L. J., Hawkley, L. C., & Cacioppo, J. T. (2004) · Research on Aging · doi:10.1177/0164027504268574 · Cited by 4,781
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467
Social isolation, loneliness, and all-cause mortality in older men and women
Steptoe, A., Shankar, A., Demakakos, P., & Wardle, J. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1219686110 · Cited by 2,503
Flagged first, then by citations
4 of the 73 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Cochrane Handbook for Systematic Reviews of Interventions version 6.2. (2021). (Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, & Welch VA, Eds.). Cochrane. www.training.cochrane.org/handbook PMC10284251 31643080
- Gierveld JDJ, & Tilburg TV (2006). A 6-item scale for overall, emotional, and social loneliness: Confirmatory tests on survey data. Research on Aging, 28(5), 582– 598.
- National Academies of Science, Engineering, and Medicine,. (2020). Social Isolation and Loneliness in Older Adults: Opportunities for the Health Care System. National Academies Press. 32510896
- Perlman D, & Peplau LA (1981). Toward a social psychology of loneliness. In Gilmour R & Duck S (Eds.), Personal Relationships (Vol. 3, pp. 31– 56). Academic Press.
Cited by
Sorted by citations
How COVID-19 shaped mental health: from infection to pandemic effects
Penninx, B. W. J. H., Benros, M. E., Klein, R. S., & Vinkers, C. H. (2022) · Nature Medicine · doi:10.1038/s41591-022-02028-2 · Cited by 477
Risk factors for loneliness: A literature review
Barjaková, M., Garnero, A., & d’Hombres, B. (2023) · Social Science & Medicine · doi:10.1016/j.socscimed.2023.116163 · Cited by 296
Gajendran, R. S., Ponnapalli, A. R., Wang, C., & Javalagi, A. A. (2024) · Personnel Psychology · doi:10.1111/peps.12641 · Cited by 225
Farrell, A. H., Vitoroulis, I., Eriksson, M., & Vaillancourt, T. (2023) · Children · doi:10.3390/children10020279 · Cited by 130
“However, only some of these systematic reviews and meta-analyses included the prevalence of child and adolescent loneliness (e.g., [15]) and even fewer have focused on loneliness with the well-being of children and adolescents (e.g., [16]).”
BackgroundEducational Research and Innovation
OECD, & Centre for Educational Research and Innovation (2009) · Educational research and innovation · doi:10.1787/20769679 · Cited by 129
Metadata
- Authors
- Ernst, M., Niederer, D., Werner, A. M., Czaja, S. J., Mikton, C., Ong, A. D., Rosen, T., Brähler, E., & Beutel, M. E.
- Affiliations
- Johannes Gutenberg University Mainz (DE)
- Goethe University Frankfurt (DE)
- Weill Cornell Medicine (US)
- World Health Organization (CH)
- Cornell University (US)
- NewYork–Presbyterian Hospital (US)
- Corresponding author
- Ernst, Mareike
- ORCID
- Venue
- American Psychologist
- Published
- 2022-07
- Volume
- 77
- Issue
- 5
- Pages
- 660-677
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- PMC
- PMC9768682
- OpenAlex
- W4229451984
- Cited by
- 584
- References
- 73
- Citations by year
- 2026: 83 · 2025: 144 · 2024: 172 · 2023: 143 · 2022: 41
- FWCI
- 114.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- Mainz Research Center for Mental Health
- National Institute on Aging (K76 AG054866)
- Topics
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Social Sciences › Health › Health disparities and outcomes
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Keywords
- loneliness, COVID-19 pandemic, social distancing, prevalence of loneliness, pre-pandemic comparison, mental health, social isolation, risk factors for loneliness
- MeSH terms
- COVID-19, Humans, Loneliness, Prospective Studies, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review