Innovative Technology–Based Interventions to Reduce Stigma Toward People With Mental Illness: Systematic Review and Meta-analysis
Open accessPublished version of a preprint
Abstract
Background: Stigma toward people with mental illness presents serious consequences for the impacted individuals, such as social exclusion and increased difficulties in the recovery process. Recently, several interventions have been developed to mitigate public stigma, based on the use of innovative technologies, such as virtual reality and video games. Objective: This review aims to systematically review, synthesize, measure, and critically discuss experimental studies that measure the effect of technological interventions on stigmatization levels. Methods: This systematic review and meta-analysis was based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines and included studies in English and Spanish published between 2016 and 2021. Searches were run in 5 different databases (ie, PubMed, PsycInfo, Scopus, Cochrane Library, and ScienceDirect). Only randomized controlled trials were included. Two independent reviewers determined the eligibility, extracted data, and rated methodological quality of the studies. Meta-analyses were performed using the Comprehensive Meta-Analysis software. Results: Based on the 1158 articles screened, 72 articles were evaluated as full text, of which 9 were included in the qualitative and quantitative syntheses. A diversity of interventions was observed, including video games, audiovisual simulation of hallucinations, virtual reality, and electronic contact with mental health services users. The meta-analysis (n=1832 participants) demonstrated that these interventions had a consistent medium effect on reducing the level of public stigma (d=–0.64; 95% CI 0.31-0.96; P<.001). Conclusions: Innovative interventions involving the use of technologies are an effective tool in stigma reduction, therefore new challenges are proposed and discussed for the demonstration of their adaptability to different contexts and countries, thus leading to their massification. Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42021261935; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021261935
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review and meta-analysis found that innovative technology–based interventions (video games, virtual reality, audiovisual hallucination simulation, and e-contact) had a medium effect on reducing public stigma toward people with mental illness. Across 9 randomized controlled trials and 1832 participants, the pooled effect was d=–0.64 (95% CI 0.31-0.96; P<.001), with high heterogeneity.
Key findings
- The meta-analysis of 9 RCTs (n=1832) showed a medium effect of technology-based interventions on reducing public stigma: d=–0.64 (95% CI 0.31-0.96; P<.001).
- Interventions included video games (n=4), audiovisual simulation of hallucinations (n=1), virtual reality (n=2), and e-contact with mental health service users (n=2); most studies were with undergraduate students (8/9, 89%).
- One audiovisual hallucination simulation study showed an increase in stigma (P=.036; d=0.32), and one videogame-with-avatars study showed no statistical effect on stigma (P=.14; d=–0.18).
- Heterogeneity was high (P<.001; I2=87.6%; Q=64.96). Publication bias analyses suggested no differences attributable to bias; Rosenthal’s fail-safe N was 180.
Methods
- Systematic review and meta-analysis following PRISMA, registered in PROSPERO (CRD42021261935), searching PubMed, PsycInfo, Scopus, Cochrane Library, and ScienceDirect for English and Spanish articles published March 5, 2016, to March 5, 2021.
- Included only randomized controlled trials using innovative technologies (smartphone apps, videogames, e-contact, or virtual reality) aimed at reducing public stigma toward people with mental illness; 1158 articles were screened, 72 full texts evaluated, and 9 included.
- Two independent reviewers selected studies and extracted data (Cohen κ=0.75); risk of bias was assessed with Cochrane ROB-2; meta-analysis used Comprehensive Meta-Analysis software with random effects models, standardized mean difference, I2 and Q-statistic, trim-and-fill, and fail-safe N.
Limitations
- The paper states: gray literature was not included, which can increase publication bias risk; the small number of studies and high heterogeneity prevented estimating which technology-based intervention was most effective; all included studies focused on high-school and university students, limiting generalizability to the general population; and most studies lacked follow-up, preventing analysis of long-term stigma reduction.
- Evident from the text: only 9 RCTs were pooled, and the funnel plot was not used because fewer than 10 studies were included, so publication bias assessment relied on trim-and-fill and fail-safe N rather than visual funnel-plot inspection.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 56 cited sources checked · 0 supported · 0 flagged
- Findingown data
In a meta-analysis of 9 randomized controlled trials with 1832 participants, technology-based interventions had a consistent medium effect on reducing public stigma (d=-0.64; 95% CI 0.31-0.96; P<.001).
“The meta-analysis (n=1832 participants) demonstrated that these interventions had a consistent medium effect on reducing the level of public stigma (d=–0.64; 95% CI 0.31-0.96; P<.001).”
Quote in the paperSubstantial claim- Rests on an assumption: The diverse technology-based interventions and public stigma scales included in the meta-analysis measure a sufficiently common construct to be pooled into a single effect size.
- Rests on an assumption: The high risk of bias in some included studies does not materially affect the pooled effect estimate.
- Findingown data
Technology-based interventions had medium effects on reducing the level of public stigma compared with the control group (d=-0.64; 95% CI 0.31-0.96; P<.001).
“the technology-based interventions had medium effects on reducing the level of public stigma (d=–0.64; 95% CI 0.31–0.96; P<.001) compared with the control group.”
Quote in the paperSubstantial claim - Findingcitation
The study using videogame with avatars [32] did not show any statistical effect in the level of stigma (P=.14; d=-0.18).
“another that used videogame with avatars [32] did not show any statistical effect in the level of stigma (P=.14; d=–0.18).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [32] source
Not checked in the free run.
- Findingown data
High heterogeneity was observed among the included studies (P<.001; I2=87.6%; Q=64.96).
“High heterogeneity was observed among the included studies (P<.001; I2=87.6%; Q=64.96)”
Quote in the paperSubstantial claim - Findingcitation
The study using audiovisual simulation of symptoms [31] showed an increase in the level of stigma (P=.036; d=0.32).
“Only 1 study [31] that used audiovisual simulation symptoms showed an increase in the level of stigma (P=.036; d=0.32)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] source
Not checked in the free run.
- Findingown data
Results suggest that there were no differences in effect sizes attributable to bias.
“Results suggest that there were no differences in effect sizes attributable to bias.”
Quote in the paperSubstantial claim - Findingown data
Based on the parameter of Duval and Tweedie's trim-and-fill analysis, no studies appear to be missing.
“Based on the parameter of Duval and Tweedie’s trim-and-fill analysis, it seems that no studies are missing.”
Quote in the paperNot a substantial claim - Findingown data
Rosenthal's fail-safe N was 180, suggesting that 180 missing studies with no effects would be necessary to achieve a combined 2-tailed P value exceeding .05.
“Test was equal to 180, suggesting that it would be necessary to allocate and include 180 missing studies with no effects for every observed study to achieve the combined 2-tailed P value exceeding .05.”
Quote in the paperSubstantial claim - Findingown data
Under a random effect model, the point estimate for the combined studies did not differ when comparing the original and the adjusted estimate (in both cases, standardized mean difference 0.63; 95% CI 0.94-0.30).
“Under a random effect model, the point estimate for the combined studies did not differ when comparing the original and the adjusted estimate (in both cases, standardized mean difference 0.63; 95% CI 0.94-0.30).”
Quote in the paperSubstantial claim - Findingcitation
All experimental studies involving technology-based interventions in stigma reduction focus on the young population.
“all experimental studies involving technology-based interventions in stigma reduction focus on the young population”
Quote in the paperSubstantial claim - Study design and conductown data
One included study had high risk of bias in selective reporting.
“Finally, only 1 study [31] had a high ROB in selective reporting”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] source
Not checked in the free run.
- Premisecitation
Funnel plot evaluation of publication bias is not reliable when fewer than 10 studies are pooled in direct comparison.
“The use of the funnel plot for the evaluation of publication bias was not incorporated, because it has been demonstrated that its use is not reliable when the number of studies pooled in direct comparison is less than 10 [27].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] source
Not checked in the free run.
- Study design and conductown data
Interrater reliability for screening and coding was Cohen κ=0.75 (SE 0.11), indicating medium to high agreement among coders.
“We obtained a Cohen κ of 0.75 (SE 0.11), demonstrating a medium to high degree of agreement among coders.”
Quote in the paperNot a substantial claim - Interpretationown data
Innovative interventions involving the use of technologies are an effective tool in stigma reduction.
“Innovative interventions involving the use of technologies are an effective tool in stigma reduction, therefore new challenges are proposed and discussed for the demonstration of their adaptability to different contexts and countries, thus leading to their massification.”
Quote in the paperSubstantial claim- Rests on an assumption: The diverse technology-based interventions and public stigma scales included in the meta-analysis measure a sufficiently common construct to be pooled into a single effect size.
- Rests on an assumption: The high risk of bias in some included studies does not materially affect the pooled effect estimate.
- Study design and conductown data
Most included studies were considered to have low risk of bias in methodological quality.
“As shown in Figure 2, most of the studies included in this review were considered as having low ROB in terms of their methodological quality.”
Quote in the paperNot a substantial claim - Study design and conductown data
Two included studies showed high risk of bias related to allocation concealment.
“Besides, 2 other studies [11,32] showed a high ROB related to the allocation concealment.”
Quote in the paperNot a substantial claim0 of 2 sources checked - Study design and conductcitation
Random effects models were used because of heterogeneity in the type of intervention across studies.
“Random effects models were used due to the heterogeneity in the type of intervention in the studies [30].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [30] source
Not checked in the free run.
- Study design and conductown data
Three included studies showed high risk of bias in blinding of participants and blinding of outcome assessment.
“However, 3 studies [31,32,37] showed a high ROB in the blinding of the participants and blinding of outcome assessment.”
Quote in the paperNot a substantial claim0 of 3 sources checked - Premisecitation
Duval and Tweedie's trim-and-fill analysis offers the best estimate of the unbiased effect [30].
“the test offers the best estimate of the unbiased effect [30].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] source
Not checked in the free run.
- Premisecitation
Virtual reality has demonstrated a reduction of negative perceptions and attitudes toward people with mental illnesses.
“along with a reduction of the negative perceptions and attitudes toward people with mental illnesses [16].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] source
Not checked in the free run.
- Premisecitation
The usefulness and effectiveness of virtual reality can be explained by the degree of immersion in a strongly educational environment, which promotes change of attitudes and beliefs.
“This usefulness and effectiveness can be explained by the degree of immersion in a strongly educational environment, which promotes the change of attitudes and beliefs [17].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] source
Not checked in the free run.
- Interpretationown data
It is highly unlikely that missing studies could alter the substantive conclusion.
“Therefore, it is highly unlikely that missing studies could alter the substantive conclusion.”
Quote in the paperSubstantial claim - Premisecitation
Several research studies show that providing information, such as biographical aspects, is essential to reduce stigma because it allows people to empathize, understand, and change their attitudes, knowledge, and stigmatizing behaviors [44].
“several research studies show that the information provided is essential to reduce stigma, where, for example, it has been helpful to refer to biographical aspects (eg, related to difficulties, personal adversities), because it allows people to empathize, understand, and generate a change in their attitudes, knowledge, and stigmatizing behaviors [44].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [44] Longdon, E, 2017, Isr J Psychiatry Relat Sci
Not checked in the free run.
- Interpretationcitation
The larger effect is probably due to increasing technological development, with greater realism, immersion, and technological interaction [40].
“This is probably due to the increasing technological development, where realism, immersion, and technological interaction are greater, becoming an increasingly natural means of communication and daily application [40].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] source
Not checked in the free run.
- Interpretationown data
The results of this meta-analysis support the use of new and innovative technology-based interventions to reduce stigma toward people with mental illness.
“The results of this meta-analysis support the use of new and innovative technology–based interventions to reduce stigma toward people with mental illness.”
- Also stated in: § Principal Findings · boosted
“Our study demonstrated the usefulness of innovative interventions in stigma reduction”
Quote in the paperSubstantial claim - Also stated in: § Principal Findings · boosted
- Interpretationcitation
The finding that hallucination simulation increased stigma is concordant with a previous meta-analysis [42] showing it can increase social distance and negative attitudes.
“which is concordant with a previous meta-analysis that demonstrated that it can increase social distance and negative attitudes [42].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [42] source
Not checked in the free run.
- Interpretationreasoning
The findings of this study are better (larger effect) compared with a previous meta-analysis [39] that reported only a small effect of contact and educative interventions.
“Its findings are better compared with a previous meta-analysis [39], which reported only a small effect of contact interventions for people with mental illness, and for the educative intervention, both classical and common-type interventions.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [39] source
Not checked in the free run.
- Study design and conductown data
The small number of studies and high heterogeneity prevented us from estimating which technology-based intervention was the most effective.
“the small number of studies and high heterogeneity prevented us from estimating which technology-based intervention was the most effective”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 25
- May combine two claims. 26
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataFour included studies were conducted in Europe, 2 in North America, and 1 each in Asia, Australia, and Latin America.
“As many as 4 studies (44%) were conducted in Europe, 2 (22%) in North America, and only 1 each in Asia (11%), Australia (11%), and Latin America (11%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe 9 included randomized controlled trials used video games (n=4), audiovisual simulation of hallucinations (n=1), virtual reality (n=2), and e-contact with mental health services users through videoconferencing and online chats (n=2).
“A total of 9 randomized control trial studies were included, which utilized a variety of technology-based interventions to reduce stigma, including interventions using video games (n=4), audiovisual simulation of hallucinations (n=1), virtual reality (n=2), and the use of e-contact with mental health services users through videoconferencing and online chats (n=2).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataOf 1158 articles screened, 72 were evaluated as full text, and 9 were included in the qualitative and quantitative syntheses.
“Based on the 1158 articles screened, 72 articles were evaluated as full text, of which 9 were included in the qualitative and quantitative syntheses.”
Quote in the paperNot a substantial claim- Rests on an assumption: The search strategy and databases identified all relevant studies.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataMost participants in the included studies were female, with the proportion of female participants ranging from 50.3% to 81.1%.
“Most of the participants were female. The proportion of female participants ranged from 50.3% to 81.1%”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe mean age of participants in the included studies ranged from 15.7 to 24 years.
“the mean age of the participants ranged from 15.7 to 24 years.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost included studies were conducted with undergraduate students (8/9, 89%).
“Most of these studies were conducted with undergraduate students (8/9, 89%).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataPublic stigma in the included studies was measured through different scales, most commonly the Attribution Questionnaire and the Questionnaire on Student Attitudes Toward Schizophrenia.
“Public stigma in the studies was measured through different scales, with the most commonly used being the Attribution Questionnaire and the Questionnaire on Student Attitudes Toward Schizophrenia.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA total of 9 articles were included in the meta-analysis, with a total sample of 1832 participants.
“A total of 9 articles were included in the meta-analysis, with a total sample of 1832 participants.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe included study using videogames through avatar identification [32] reported a significant effect (B=-0.21; P<.05) for the reduction of social distance, despite no significant effect on stigma.
“one of the included studies, which used videogames through avatar identification [32], despite showing no significant effect on stigma in the combined effect analysis, reported a significance effect (B=–0.21; P<.05) for the reduction of social distance”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [32] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe systematic review and meta-analysis protocol was registered in PROSPERO (CRD42021261935).
“The systematic review and meta-analysis protocol were registered in the Prospective Register of Systematic Reviews (PROSPERO) international database (registration ID: CRD42021261935)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe review was conducted according to PRISMA guidelines and recommendations.
“was conducted according to the guidelines and recommendations of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) [25].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
May combine two claims.
Study design and conductown dataNo included study showed high risk of other bias or random sequence generation.
“and no study showed a high risk of other bias or random sequence generation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationFor 3 studies with more than 1 stigma scale, the multiple measures were combined into a single effect size following methodology for complex data structures.
“As 3 of the studies included more than 1 scale that assessed levels of stigma [11,22,31], we conducted an analysis that combined them into a single effect size. In those cases, we followed the methodology suggestion for complex data structures [30].”
Quote in the paperNot a substantial claim0 of 4 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataA third investigator examined all included articles to review selection and resolve discrepancies.
“A third investigator (LAC) examined all the included articles to review this selection and resolve discrepancies.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductown dataRisk of bias of each study was independently assessed using the Cochrane ROB-2 assessment tool.
“To assess the quality of the selected articles, 2 researchers (MER-R and AJC) independently assessed the risk of bias (ROB) of each study using the Cochrane ROB-2 assessment tool”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenTwo independent reviewers determined eligibility, extracted data, and rated methodological quality of the studies.
“Two independent reviewers determined the eligibility, extracted data, and rated methodological quality of the studies.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataTwo included studies presented incomplete data.
“Regarding data, 2 studies [22,37] presented incomplete data.”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationDiscrimination, prejudice, and stereotypes in society severely impact recovery, quality of life, and well-being of people with mental illnesses and their families, and represent the main gap in accessing specialized mental health services by the general population.
“Thus, discrimination, prejudice, and stereotypes present in society not only severely impact the recovery process, quality of life, and well-being of people with mental illnesses and their families, but also represent the main gap in accessing specialized mental health services by the general population [4,5].”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationResearch has shown high levels of discrimination, stigma, and prejudice toward people with mental health problems, especially schizophrenia and bipolar disorder.
“The aforesaid has great relevance in the global context, where research has shown the presence of high levels of discrimination, stigma, and prejudice toward those impacted by mental health problems, especially schizophrenia and bipolar disorder [6,7].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationPublication bias was quantified using Duval and Tweedie's trim-and-fill analysis and Rosenthal's fail-safe N test.
“In addition, we used statistical procedures to quantify the effect of publication bias, by Duval and Tweedie’s trim-and-fill analysis and Rosenthal’s fail-safe N test [35].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [35] source
Not checked in the free run.
May combine two claims.
PremisecitationStigma toward people with mental illness has a negative effect on their quality of life, therapeutic results, and risk of suicide and mortality.
“It has a negative effect on their quality of life, worse therapeutic results, and even an increased risk of suicide and mortality [1-3].”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVirtual reality has demonstrated utility in the treatment of mental health problems such as phobias and anxiety symptoms.
“For example, it has demonstrated its utility in the treatment of mental health problems, such as phobias and anxiety symptoms, among others [15]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] source
Not checked in the free run.
May combine two claims.
PremisecitationDirect contact with people with mental illnesses and educational initiatives are essential and effective interventions to reduce stigma.
“It has been demonstrated that direct contact with people with mental illnesses and educational initiatives are essential and effective interventions to reduce stigma [8,9].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationFor 2 studies reporting standardized regression, β coefficients were entered into the meta-analysis software as correlation coefficients according to Peterson and Brown.
“In addition, as 2 of the studies [32,33] reported their results through standardized regression, the β coefficients were entered into the comprehensive meta-analysis software (CMA) as correlation coefficient, according to the recommendations of Peterson and Brown [34].”
Quote in the paperNot a substantial claim0 of 3 sources checkedMay combine two claims.
PremisecitationVideo games are an effective tool to reduce anxious and depressive symptomatology in patients and are useful to reduce misconceptions and stigmatization about severe mental illnesses such as schizophrenia or bipolar disorder.
“Among this type of interventions, the use of video games has been highlighted as an effective tool to reduce anxious and depressive symptomatology in patients, and has been useful to reduce misconceptions and stigmatization about severe mental illnesses, such as schizophrenia or bipolar disorder [12,13].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe application of virtual and immersive reality in mental health has become increasingly common.
“In addition, because of the growth of technologies, the application of virtual and immersive reality in mental health has become increasingly common [14].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] source
Not checked in the free run.
May combine two claims.
Premisenone givenGlobally, stigma toward people with mental illness is a serious public health problem and is considered the main barrier to social inclusion and participation of those impacted.
“Globally, stigma toward people with mental illness represents a serious public health problem and is considered the main barrier to social inclusion and participation of those impacted.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe high heterogeneity among included studies was expected due to the variety of interventions.
“which was expected due to the variety of interventions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDirect face-to-face contact with people with mental illness is a key component of successful stigma reduction programs.
“Although direct face-to-face contact with people with mental illness has been shown to be a key component of successful stigma reduction programs, their implementation in virtual learning and innovative spaces is recent [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10] source
Not checked in the free run.
May combine two claims.
Premisecitatione-Contact using chat and synchronous videoconferencing can reduce anxiety, stigma, and stereotypes toward people with mental disorders and promote an inclusive attitude.
“However, e-contact implementation in the field of stigma reduction is new and innovative, and it has been demonstrated that e-contact using chat and synchronous videoconferencing can reduce anxiety, stigma, and stereotypes toward the population impacted by mental disorders, and promote an inclusive attitude [11,22].”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationElectronic contact has been used as a strategy for promoting awareness and reducing prejudice among ideologically different groups.
“Finally, as an innovative intervention, electronic contact (e-contact)—defined as “computer-mediated real-time interactions where members of different groups interact online” through virtual media with mental health services users [20]—has been used as a strategy for promoting awareness and reducing prejudice among ideologically different groups [21].”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationInnovative technology-based interventions have had a great impact on reducing stigma toward people with mental illness, mainly due to their adaptability to different contexts and age ranges.
“In the last years, several authors have shown that innovative technology-based interventions have had a great impact on the reduction of stigma toward people with mental illness, mainly due to its adaptability to different contexts and age ranges [11].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [11] source
Not checked in the free run.
May combine two claims.
PremisecitationSimulation platforms have shown controversial results, with some studies showing increased stigmatization when used through simulation of hallucinatory symptomatology.
“By contrast, the use of simulation platforms has showed controversial results, with some studies showing an increase of stigmatization when used through the simulation of hallucinatory symptomatology, which can promote negative beliefs and attitudes toward people with mental illness [18,19].”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
Interpretationown dataThe interventions have a positive impact and are effective for stigma reduction.
“demonstrating a positive impact and effectiveness of these interventions.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationA recent meta-analysis [41] showed that antistigma interventions involving contact had an immediate small-to-medium effect, equivalent across diverse contact mediums such as videos and presentation.
“a recent meta-analysis showed that antistigma interventions involving contact had an immediate small-to-medium effect, and it was equivalent with diverse types of contact mediums, such as videos and presentation [41].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [41] source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationRosenthal's fail-safe N test is a technique for computing the number of missing studies that would be necessary to nullify the found effect [38].
“Rosenthal’s fail-safe N test is a technique for computing the number of missing studies that would be necessary to nullify the found effect [38].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [38] source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe negative results may be explained by the focus on symptoms rather than on the recovery process, which may increase stereotypes and prejudice, especially toward people with schizophrenia.
“These negative results may be explained by the focus on symptoms rather than on the recovery process, which may increase stereotypes and prejudice, especially toward people with schizophrenia.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningThese types of interventions have a variety of advantages and offer innovative solutions to everyday problems, due to their adaptability to different contexts and lower associated cost, along with the possibility of privacy in a protected environment.
“These types of interventions have a variety of advantages and offer innovative solutions to everyday problems, due to their adaptability to different contexts and lower associated cost, along with the possibility of privacy in a protected environment”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAdaptation of educative and contact components has demonstrated great utility in e-contact with people with mental illness, offering wider dissemination and reaching remote areas [11,22].
“Its adaptation had demonstrated a great utility, for example, in e-contact with people with mental illness, as they offer the possibility of wider dissemination and even the possibility of reaching remote areas [11,22].”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
Study design and conductnone givenAll the studies found and included focused on the population of high-school and university students, which may limit the generalizability of the results to the general population.
“all the studies found and included focused on the population of high-school and university students, which may limit the generalizability of the results to the general population.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductcitationWe did not include gray literature, which can increase the risk of publication bias [45].
“we did not include gray literature, which can increase the risk of publication bias [45].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [45] source
Not checked in the free run.
May combine two claims.
Interpretationown dataInnovative interventions involving virtual reality and communication technologies are effective tools for stigma reduction toward people with mental illness and can be an alternative and a complement for traditional methods on stigma reduction.
“Our meta-analysis showed that innovative interventions involving the use of virtual reality and communication technologies are effective tools for stigma reduction toward people with mental illness and can be an alternative and a complement for the traditional methods on stigma reduction.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe Help Club app provides access to communities of mutual support in mental health in virtual spaces through virtual reality, demonstrating the potential of the metaverse as a space for social interaction.
“we highlight the recently developed app Help Club [48], which provides the possibility of access to communities of mutual support in mental health in virtual spaces, through the use of virtual reality, demonstrating the potential and growing impact of metaverse as a space for social interaction and an increasingly used tool.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [48] Help Club app: Mental Health Help for the MetaverseVery Real Help2022-03-18https://veryrealhelp.com
Not checked in the free run.
May combine two claims.
Study design and conductown dataMost of the included studies did not include follow-up studies, which prevented the analysis of long-term stigma reduction.
“most of the included studies did not include follow-up studies, which prevented the analysis of long-term stigma reduction.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The diverse technology-based interventions and public stigma scales included in the meta-analysis measure a sufficiently common construct to be pooled into a single effect size.
“A diversity of interventions was observed, including video games, audiovisual simulation of hallucinations, virtual reality, and electronic contact with mental health services users.”
“Public stigma in the studies was measured through different scales, with the most commonly used being the Attribution Questionnaire and the Questionnaire on Student Attitudes Toward Schizophrenia.”
“Random effects models were used due to the heterogeneity in the type of intervention in the studies [30].”
The paper relies on this without support.
The high risk of bias in some included studies does not materially affect the pooled effect estimate.
“As shown in Figure 2, most of the studies included in this review were considered as having low ROB in terms of their methodological quality. However, 3 studies [31,32,37] showed a high ROB in the blinding of the participants and blinding of outcome assessment.”
The paper relies on this without support.
The search strategy and databases identified all relevant studies.
“Searches were run in 5 different databases (ie, PubMed, PsycInfo, Scopus, Cochrane Library, and ScienceDirect).”
“In addition, a final manual trace back literature search was conducted in August 2021 to identify any recently published sources/literature.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Digital solutions might be especially well-positioned to help individuals who are seeking support to overcome barriers, for example by offering more flexibility and reducing stigma.
“Excitingly, digital solutions might be especially well-positioned to help individuals who are seeking support to overcome barriers, for example by offering more flexibility and reducing stigma [Rodríguez-Rivas et al., 2022].”
From Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot (2024) · cites this paper as Rodríguez-Rivas et al., 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Stated minimum female proportion conflicts with Table 1
MinorThe text states that the lowest female proportion was 50.3%, but Table 1 lists a study with 50.0% female participants.
“The proportion of female participants ranged from 50.3% to 81.1%”
“| 552 | HSSi | 15.78 (2.65) | 50.0 | QSAS |”
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,759 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Lippa, N. C., & Sanderson, S. C. (2013) · Human Heredity · doi:10.1159/000353712 · Cited by 6,093 · see citing works
Challenging the public stigma of mental illness: a meta-analysis of outcome studies
Corrigan, P. W., Morris, S. B., Michaels, P. J., Rafacz, J. D., & Rüsch, N. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201100529 · Cited by 1,680 · see citing works
On the Use of Beta Coefficients in Meta-Analysis.
Peterson, R. A., & Brown, S. P. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.175 · Cited by 1,643 · see citing works
The Impact of Mental Illness Stigma on Seeking and Participating in Mental Health Care
Corrigan, P. W., Druss, B. G., & Perlick, D. A. (2014) · Psychological Science in the Public Interest · doi:10.1177/1529100614531398 · Cited by 1,642 · see citing works
Gray literature: An important resource in systematic reviews
Paez, A. (2017) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12266 · Cited by 1,459 · see citing works
Makransky, G., & Petersen, G. B. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09586-2 · Cited by 1,438 · see citing works
Link, B. G., Struening, E. L., Neese-Todd, S., Asmussen, S., & Phelan, J. C. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.12.1621 · Cited by 1,254 · see citing works
Commentary: Heterogeneity in meta-analysis should be expected and appropriately quantified
Higgins, J. P. T. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dyn204 · Cited by 995 · see citing works
Vaportzis, E., Giatsi Clausen, M., & Gow, A. J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01687 · Cited by 916 · cited 1× · see citing works
“In addition, all experimental studies involving technology-based interventions in stigma reduction focus on the young population, which represents a major challenge for future studies focused on the development, implementation, and evaluation of these types of interventions for different ages, such as adults and the e…”
BackgroundShi, L., & Lin, L. (2019) · Medicine · doi:10.1097/md.0000000000015987 · Cited by 818 · see citing works
Belur, J., Tompson, L., Thornton, A., & Simon, M. (2021) · Sociological Methods & Research · doi:10.1177/0049124118799372 · Cited by 753 · see citing works
Methodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568 · see citing works
Public Stigma of Mental Illness in the United States: A Systematic Literature Review
Parcesepe, A. M., & Cabassa, L. J. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0430-z · Cited by 554 · cited 1× · see citing works
“The aforesaid has great relevance in the global context, where research has shown the presence of high levels of discrimination, stigma, and prejudice toward those impacted by mental health problems, especially schizophrenia and bipolar disorder [6,7].”
BackgroundGrey literature: An important resource in systematic reviews
Páez, A. (2017) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12265 · Cited by 516 · see citing works
Lehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488 · see citing works
Recent Progress in Virtual Reality Exposure Therapy for Phobias: A Systematic Review
Botella, C., Fernández-Álvarez, J., Guillén, V., García-Palacios, A., & Baños, R. (2017) · Current Psychiatry Reports · doi:10.1007/s11920-017-0788-4 · Cited by 460 · see citing works
Stigma and discrimination limit access to mental health care
Thornicroft, G. (2008) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00002621 · Cited by 432 · cited 2× · see citing works
“As stigma is a complex social phenomenon transversally present in the society [1-6], innovative interventions involving use of technologies can be an effective tool for its reduction.”
BackgroundMorgan, A. J., Reavley, N. J., Ross, A., Too, L. S., & Jorm, A. F. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.05.017 · Cited by 372 · see citing works
Lau, H. M., Smit, J. H., Fleming, T. M., & Riper, H. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00209 · Cited by 328 · see citing works
Virtual reality in psychiatric disorders: A systematic review of reviews
Cieślik, B., Mazurek, J., Rutkowski, S., Kiper, P., Turolla, A., & Szczepańska-Gieracha, J. (2020) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2020.102480 · Cited by 240 · see citing works
Pirhonen, J., Lolich, L., Tuominen, K., Jolanki, O. H., & Timonen, V. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101287 · Cited by 219 · see citing works
Patten, S. B., Remillard, A., Phillips, L., Modgill, G., Szeto, A. C., Kassam, A., & Gardner, D. M. (2012) · BMC Medical Education · doi:10.1186/1472-6920-12-120 · Cited by 164 · see citing works
Publication Bias in Meta-Analysis: Confidence Intervals for Rosenthal’s Fail-Safe Number
Fragkos, K. C., Tsagris, M., & Frangos, C. C. (2014) · International Scholarly Research Notices · doi:10.1155/2014/825383 · Cited by 159 · see citing works
Intergroup contact and mental health stigma: a comparative effectiveness meta-analysis
Maunder, R. D., & White, F. A. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.101749 · Cited by 152 · see citing works
The simulation of hallucinations to reduce the stigma of schizophrenia: A systematic review
Ando, S., Clement, S., Barley, E. A., & Thornicroft, G. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2011.09.011 · Cited by 128 · see citing works
Does the stigma of mental illness contribute to suicidality?
Rüsch, N., Zlati, A., Black, G., & Thornicroft, G. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.145755 · Cited by 122 · see citing works
White, F. A., & Abu-Rayya, H. M. (2012) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.01.007 · Cited by 121 · see citing works
Stigma-Stop: A Serious Game against the Stigma toward Mental Health in Educational Settings
Cangas, A. J., Gómez, N. N., Aguilar-Parra, J. M., Ojeda-Castelo, J. J., Cangas, D., Piedra-Fernandez, J. A., & Gallego, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01385 · Cited by 103 · see citing works
Self-citationJorm, A. F. (2020) · Psychiatric Services · doi:10.1176/appi.ps.201900587 · Cited by 85 · see citing works
Snodgrass, J. G., Bagwell, A., Patry, J. M., Dengah, H. J. F., Smarr-Foster, C., Van Oostenburg, M., & Lacy, M. G. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.09.020 · Cited by 82 · see citing works
Constructs and concepts comprising the stigma of mental illness
Michaels, P. J., López, M., Rüsch, N., & Corrigan, P. W. (2017) · Psychology, Society, & Education · doi:10.25115/psye.v4i2.490 · Cited by 75 · see citing works
Maunder, R. D., White, F. A., & Verrelli, S. (2019) · Group Processes & Intergroup Relations · doi:10.1177/1368430218794873 · Cited by 73 · see citing works
Reducing Mental Health Stigma Through Identification With Video Game Avatars With Mental Illness
Ferchaud, A., Seibert, J., Sellers, N., & Escobar Salazar, N. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02240 · Cited by 67 · see citing works
Pierce, C. A. (2007) · Organizational Research Methods · doi:10.1177/1094428106296641 · Cited by 54 · see citing works
Rodríguez-Rivas, M. E., Cangas, A. J., & Fuentes-Olavarría, D. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.632252 · Cited by 52 · see citing works
Self-citationMullor, D., Sayans-Jiménez, P., Cangas, A. J., & Navarro, N. (2019) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0172 · Cited by 48 · see citing works
Self-citationReducing the Schizophrenia Stigma: A New Approach Based on Augmented Reality
Silva, R. D. D. C., Albuquerque, S. G. C., Muniz, A. D. V., Filho, P. P. R., Ribeiro, S., Pinheiro, P. R., & Albuquerque, V. H. C. (2017) · Computational Intelligence and Neuroscience · doi:10.1155/2017/2721846 · Cited by 47 · see citing works
Yuen, A. S. Y., & Mak, W. W. S. (2021) · Journal of Medical Internet Research · doi:10.2196/23683 · Cited by 44 · see citing works
Longdon, E., & Read, J. (2017) · PubMed · Cited by 42 · see citing works
Stelzmann, D., Toth, R., & Schieferdecker, D. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10132961 · Cited by 41 · see citing works
White, F. A., Verrelli, S., Maunder, R. D., & Kervinen, A. (2019) · The Journal of Sex Research · doi:10.1080/00224499.2018.1491943 · Cited by 36 · see citing works
Cangas, A., Navarro, N., Aguilar-Parra, J., Trigueros, R., Gallego, J., Zárate, R., & Gregg, M. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8101504 · Cited by 30 · see citing works
Self-citationUsing Information and Communication Technologies (ICT) for Mental Health Prevention and Treatment
Fonseca, A., & Osma, J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18020461 · Cited by 30 · see citing works
Shek, A. C., Biondi, A., Ballard, D., Wykes, T., & Simblett, S. K. (2021) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2019.1701501 · Cited by 25 · see citing works
Brown, S. (2020) · Community Mental Health Journal · doi:10.1007/s10597-019-00503-8 · Cited by 20 · see citing works
Attitudes towards people with mental illness among medical students: A qualitative research
Rodríguez-Rivas, M. E. (2021) · Psychology, Society & Education · doi:10.25115/psye.v13i2.3663 · Cited by 12 · see citing works
Self-citationRODRÍGUEZ-RIVAS, M. E., FERRER, J. M. R., LÓPEZ, I. D. A., CAMPOY, J. M. F., ALONSO, L. M., LEÓN, A. M., AGUADO, C. M., & SOLER, R. C. (2021) · Intervención en Contextos Clínicos y de la Salud: Un enfoque práctico desde la investigación. · doi:10.2307/j.ctv2gz3w4s.7 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Longdon, E, 2017, Isr J Psychiatry Relat Sci, 54, 24
Cited by
Sorted by citations
Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot
Habicht, J., Viswanathan, S., Carrington, B., Hauser, T. U., Harper, R., & Rollwage, M. (2024) · Nature Medicine · doi:10.1038/s41591-023-02766-x · Cited by 132 · see citing works
McCullock, S. P., & Scrivano, R. M. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102242 · Cited by 69 · see citing works
Jiang, Z., Seyedi, S. S., Griner, E. L., Abbasi, A., Rad, A. B., Kwon, H., Cotes, R. O., & Clifford, G. D. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3352075 · Cited by 75 · see citing works
Fond, G. B., Vidal, M., joseph, M., Etchecopar‐Etchart, D., Solmi, M., Yon, D. K., Correll, C. U., & Boyer, L. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02003-4 · Cited by 57 · see citing works
Wong, J. C. M., Chua, J. Y. X., Chan, P. Y., & Shorey, S. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16127 · Cited by 70 · see citing works
Rodríguez-Ferrer, J. M., León, A. M., Cangas, A. J., & Aguilar-Parra, J. M. (2022) · JMIR Serious Games · doi:10.2196/34222 · Cited by 36 · see citing works
Self-citationExploring Effects of Chatbot-based Social Contact on Reducing Mental Illness Stigma
Lee, Y., Cui, Y., Jamieson, J., Fu, W., & Yamashita, N. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581384 · Cited by 38 · see citing works
Vita, A., Nibbio, G., & Barlati, S. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116126 · Cited by 34 · see citing works
Using and Appropriating Technology to Support The Menopause Journey in the UK
Burst, E. L., Felice, M. C., & O’Kane, A. A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642694 · Cited by 27 · see citing works
Beyond Textbooks and Standard Practices
de Almeida, R. S. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-1214-8.ch002 · Cited by 23 · see citing works
An Analysis of the Positive and Negative Effects of Cyberpsychotherapy: A Systematic Review
Al-Tarawneh, A. M. A. (2024) · International Conference on Cyber Resilience (ICCR) · doi:10.1109/iccr61006.2024.10533082 · Cited by 22 · see citing works
Kvillemo, P., Nilsson, A., Strandberg, A. K., Björk, K., Elgán, T. H., & Gripenberg, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1044601 · Cited by 20 · see citing works
Digital Interventions to Enhance PrEP Uptake and Adherence Through Stigma Reduction
Lee, J. J.-H., Verdugo, J. L., Xiao, A. Y., & Vo, K. (2023) · Current HIV/AIDS Reports · doi:10.1007/s11904-023-00685-7 · Cited by 19 · see citing works
Effectiveness of digital games promoting young people's mental health: A review of reviews
Vié, C., Ramassamy, K. G., Thellier, D., Labrosse, D., & Montagni, I. (2024) · Digital Health · doi:10.1177/20552076231220814 · Cited by 18 · see citing works
Rodríguez‐Rivas, M. E., Cangas, A. J., Martin, A., Romo, J., Pérez, J. C., Valdebenito, S., Cariola, L. A., Onetto, J., Hernández, B., Cerić, F., et al. (2023) · Games for Health Journal · doi:10.1089/g4h.2023.0118 · Cited by 18 · see citing works
Self-citationZhai, Y., Xiong, Y., Almaawali, M. S., Tian, X., & Du, X. Y. (2025) · General Psychiatry · doi:10.1136/gpsych-2025-102124 · Cited by 22 · see citing works
From Interaction to Attitude: Exploring the Impact of Human-AI Cooperation on Mental Illness Stigma
Song, T., Jamieson, J., Zhu, T., Yamashita, N., & Lee, Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710987 · Cited by 18 · see citing works
Exploring Effects of Chatbot's Interpretation and Self-disclosure on Mental Illness Stigma
Cui, Y., Lee, Y.-J., Jamieson, J., Yamashita, N., & Lee, Y. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637329 · Cited by 18 · see citing works
Szekely, R., Mason, O. J., Frohlich, D. M., & Barley, E. A. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2232049 · Cited by 13 · see citing works
Jiang, Z., Seyedi, S. S., Griner, E. L., Abbasi, A., Rad, A. B., Kwon, H., Cotes, R. O., & Clifford, G. D. (2023) · medRxiv · doi:10.1101/2023.09.11.23295212 · Cited by 11 · see citing works
García‐Soriano, G., Arnáez, S., Chaves, A., del Valle, G. D. V., Roncero, M., & Moritz, S. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.01.168 · Cited by 10 · see citing works
Chaves, A., Arnáez, S., & García‐Soriano, G. (2024) · JMIR mhealth and uhealth · doi:10.2196/48027 · Cited by 8 · see citing works
Rodríguez‐Rivas, M. E., Valdebenito, S., Benavente, M., Alfaro, J., Villacura, P., Chuecas, M. J., Ditzel, A. L., & Galdames, A. (2025) · Psicothema · doi:10.70478/psicothema.2025.37.17 · Cited by 6 · see citing works
Self-citationMurphy, K. A., & Daumit, G. (2023) · Current Cardiology Reports · doi:10.1007/s11886-023-01848-z · Cited by 7 · see citing works
Interventions to decrease health students' stigma toward schizophrenia: A scoping review
Chen, X., Wang, S., Liao, X., Li, Y., Leung, S. F., & Bressington, D. T. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104837 · Cited by 7 · see citing works
Arnáez, S., Roncero, M., Santiago, J. L., del Valle, G. D. V., Cabedo, E., Bottesi, G., & García‐Soriano, G. (2025) · British Journal of Clinical Psychology · doi:10.1111/bjc.12537 · Cited by 5 · see citing works
Barkley, C. M., Mnculwane, S., Merrill, K. G., & Kafaar, Z. (2026) · PLOS mental health. · doi:10.1371/journal.pmen.0000365 · Cited by 5 · see citing works
Morilla-Luchena, A., Rasco, T. G., Moreno, R. M., & Aguado, O. V. (2025) · Cuadernos de Trabajo Social · doi:10.5209/cuts.96376 · Cited by 4 · see citing works
Technology-Based Interventions for Mental Health Support in Bangladesh
Muhammad, F., & Arafat, S. M. Y. (2024) · Springer eBooks · doi:10.1007/978-981-97-0610-5_16 · Cited by 5 · see citing works
Benson, J., Lakeberg, M., & Brand, T. (2024) · Globalization and Health · doi:10.1186/s12992-024-01042-y · Cited by 4 · see citing works
Scaling out a Digital-First Behavioral Health Care Model to Primary Care
Youn, S. J., Schuler, K. L., Sah, P., Jaso, B. A., Pennine, M., O’Dea, H., Eyllon, M., Barnes, J. B., Murillo, L., Orth, L., et al. (2025) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-025-01433-2 · Cited by 5 · see citing works
An Exploratory Study of Chatbot-Based Mindfulness for Mental Health Support
Wang, Y., & Farb, N. A. S. (2025) · Mindfulness · doi:10.1007/s12671-025-02685-7 · Cited by 6 · see citing works
Opie, J. E., Vuong, A. T., McIntosh, J., & Kuntsche, S. (2025) · Mental Health and Digital Technologies · doi:10.1108/mhdt-07-2025-0050 · Cited by 2 · see citing works
Mental illness stigma and attitudes among university students: descriptive study
González, R. Z., Muñoz, R. C., Martínez-Pérez, A., & Barbero, F. L. (2023) · African journal of rhetoric · doi:10.21134/haaj.v23i1.768 · Cited by 3 · see citing works
Technology and Mental Health Counseling
Cespedes, H., Robey, E., & Wilkinson, T. (2023) · Journal of Technology in Counselor Education and Supervision · doi:10.61888/2692-4129.1096 · Cited by 3 · see citing works
Chatbot-Based Interventions for Mental Health SupportPreprint
Wang, Y., & Farb, N. A. S. (2024) · doi:10.31234/osf.io/xj7cz · Cited by 3 · see citing works
Gamified interventions for schizophrenia rehabilitation: A systematic scoping review
Yang, H., Chang, F., Zhu, D., Muroi, F., Liu, Z., Zhang, W., & Cai, J. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102651 · Cited by 3 · see citing works
Bastoni, S., Doğan, K., & Kelders, S. M. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2619650 · Cited by 2 · see citing works
Chan, A. S. W., Tan, R. K. J., Choong, A., Phang, K. C., Li, S., Wu, R., Tang, P. M. K., Ong, E. J., Cheung, J., Boonruang, J., et al. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2025.1684834 · Cited by 2 · see citing works
Exploring the "Freedom to be Me" through Design Sprints with Neurodivergent Scholars
Boyd, L. E., Zolyomi, A., Hassan, S., Ibrahim, S. B., Wu, G., & Kender, K. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3688527 · Cited by 2 · see citing works
Yokota, R., Okuhara, T., Okada, H., Furukawa, E., Shirabe, R., Agawa, T., Kato, H., & Kiuchi, T. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1504842 · Cited by 2 · see citing works
Choomung, P., He, Y., Matsunaga, M., Sakuma, K., Kishi, T., Li, Y., Tanihara, S., Iwata, N., & Ota, A. (2024) · JMIR Formative Research · doi:10.2196/66330 · Cited by 2 · see citing works
Chee, W., Ryu, S., Quan, J., Kim, D., & Im, E. (2025) · Journal of Clinical and Translational Science · doi:10.1017/cts.2025.10132 · Cited by 1 · see citing works
Silva, M. J. F., Gómez, N. N., Cangas, A. J., Aguilar-Parra, J. M., & Trigueros, R. (2024) · International Journal of Adolescence and Youth · doi:10.1080/02673843.2024.2369272 · Cited by 1 · see citing works
Self-citationThe Garden Within: Using Mixed Reality to Foster Wellbeing Through Emotional Regulation
Garcia-Ballesteros, M., Medrano, S. N., Soler-Dominguez, J. L., & Pons, P. (2024) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct64951.2024.00071 · Cited by 1 · see citing works
How commercial video games portraying mental illness are connected to stigma: An exploratory study
Mittmann, G., Neumann, M., & Steiner‐Hofbauer, V. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42804 · Cited by 1 · see citing works
Digital therapeutics in depression and bipolar disorder: a comprehensive systematic review
Orsolini, L., Longo, G., Nuzzo, G. L., & Volpe, U. (2025) · Minerva Psychiatry · doi:10.23736/s2724-6612.25.02637-5 · Cited by 1 · see citing works
Dennis, R.-H., Hoelterhoff, M., & Cariola, L. A. (2024) · i-manager s Journal on Humanities & Social Sciences · doi:10.26634/jhss.4.1.20295
Self-citationSzekely, R., Mason, O. J., Frohlich, D. M., & Barley, E. A. (2024) · Mental Health and Digital Technologies · doi:10.1108/mhdt-03-2024-0010 · Cited by 2 · see citing works
Weiß, E.-M., Unz, D., & Schwab, F. (2025) · Frontiers Virtual Real. · doi:10.3389/frvir.2025.1404156
Rüth, M., Bachmayer, R., & Kaspar, K. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1585571
Stigma and health: an urgent need in the training of health professionals
Rodríguez‐Rivas, M. E., & Infante, S. (2025) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2025.10.019
Self-citationLam, D. L. W., Mak, W. W. S., & Yu, B. C. L. (2025) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.70094 · Cited by 1 · see citing works
Machine learning algorithms for predictive patient counseling
Patel, R., Singh, Y. R., Jadeja, P., & Prajapati, B. G. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00015-7
Benson, J., Lakeberg, M., & Brand, T. (2024) · Figshare · doi:10.6084/m9.figshare.26713349
Benson, J., Lakeberg, M., & Brand, T. (2024) · Figshare · doi:10.6084/m9.figshare.26713346
Benson, J., Lakeberg, M., & Brand, T. (2024) · Figshare · doi:10.6084/m9.figshare.26713343
Benson, J., Lakeberg, M., & Brand, T. (2024) · Figshare · doi:10.6084/m9.figshare.25706175
Relevance of Sustainable Development Goals in the Context of Mental Health
Kar, S. K., Moharana, K. C., Saroj, A., & Kabir, R. (2026) · Springer eBooks · doi:10.1007/978-981-95-2684-0_2
Dlamini, P. P., van Greunen, D., Martínez, O., Rutledge, S. E., Jemmott, J. B., & Icard, L. D. (2026) · Digital Health · doi:10.1177/20552076251413314
Fujita, J., Matsui, M., Takayama, M., Shinoda, S., Moroga, T., Aoki, Y., Ishii, M., Hara, K., & Miyazaki, T. (2026) · Qeios · doi:10.32388/ac4vyw.2
Ye, B., Robillard, J., McDonough, J., & Mihailidis, A. (2026) · Research Square · doi:10.21203/rs.3.rs-9773832/v1
Rodríguez‐Rivas, M. E., Villacura, P., Cangas, A. J., Martin, A., Cariola, L. A., Fuentes‐Olavarría, D., Saavedra, R. Q., & Corrigan, P. W. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00669-5
Self-citationTison, E., Hachet, M., Delsuc, S., Krogmeier, C., Prouzeau, A., & Prouteau, A. (2026) · Annales Médico-psychologiques revue psychiatrique · doi:10.1016/j.amp.2026.01.002
Wang, Y., Liu, J., & Zhu, S. (2026) · Digital Health · doi:10.1177/20552076261490359
Kim, S., Kim, H. M., Kim, K., & Zhu, D. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119855
Beyond Detection: A Critical Perspective on User Agency in Digital Mental Health
Chen, S., & Zhao, Z. (2026) · Graphics Interface · doi:10.1145/3831423.3831450
- Authors
- Rodríguez-Rivas, M. E., Cangas, A. J., Cariola, L. A., Varela, J. J., & Valdebenito, S.
- Affiliations
- University of Almería (ES)
- University of Edinburgh (GB)
- Universidad del Desarrollo (CL)
- University of Cambridge (GB)
- Venue
- JMIR Serious Games
- Publisher
- JMIR Publications Inc.
- Published
- 2022-05-30
- Volume
- 10
- Issue
- 2
- Pages
- e35099
- ISSN
- 2291-9279 (ISSN-L)
- PMC
- PMC9153904
- OpenAlex
- W4226061081
- Semantic Scholar
- 3552b158705016d874ae9c3bf411c3f4e4faf4b6
- Cited by
- 68
- References
- 53
- Citations by year
- 2026: 12 · 2025: 19 · 2024: 24 · 2023: 11 · 2022: 2
- FWCI
- 2.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Serious Games (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- Agenția Națională pentru Cercetare și Dezvoltare
- Agencia Nacional de Investigación y Desarrollo
- CHIST-ERA
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- stigma reduction, public stigma, mental illness, virtual reality, video games, serious games, technology-based interventions, social exclusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review