The DOI matches its Crossref record; 82 of the 88 references it cites were found in a registry or an index; none of the 8 sources its claims cite is checked for support yet.
Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma
Open accessAbstract
BACKGROUND: Melanoma accounts for a small proportion of all skin cancer cases but is responsible for most skin cancer-related deaths. Early detection and treatment can improve survival. Smartphone applications are readily accessible and potentially offer an instant risk assessment of the likelihood of malignancy so that the right people seek further medical attention from a clinician for more detailed assessment of the lesion. There is, however, a risk that melanomas will be missed and treatment delayed if the application reassures the user that their lesion is low risk. OBJECTIVES: To assess the diagnostic accuracy of smartphone applications to rule out cutaneous invasive melanoma and atypical intraepidermal melanocytic variants in adults with concerns about suspicious skin lesions. SEARCH METHODS: We undertook a comprehensive search of the following databases from inception to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA: Studies of any design evaluating smartphone applications intended for use by individuals in a community setting who have lesions that might be suspicious for melanoma or atypical intraepidermal melanocytic variants versus a reference standard of histological confirmation or clinical follow-up and expert opinion. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). Due to scarcity of data and poor quality of studies, we did not perform a meta-analysis for this review. For illustrative purposes, we plotted estimates of sensitivity and specificity on coupled forest plots for each application under consideration. MAIN RESULTS: This review reports on two cohorts of lesions published in two studies. Both studies were at high risk of bias from selective participant recruitment and high rates of non-evaluable images. Concerns about applicability of findings were high due to inclusion only of lesions already selected for excision in a dermatology clinic setting, and image acquisition by clinicians rather than by smartphone app users.We report data for five mobile phone applications and 332 suspicious skin lesions with 86 melanomas across the two studies. Across the four artificial intelligence-based applications that classified lesion images (photographs) as melanomas (one application) or as high risk or 'problematic' lesions (three applications) using a pre-programmed algorithm, sensitivities ranged from 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specificities from 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%). The single application using store-and-forward review of lesion images by a dermatologist had a sensitivity of 98% (95% CI 90% to 100%) and specificity of 30% (95% CI 22% to 40%).The number of test failures (lesion images analysed by the applications but classed as 'unevaluable' and excluded by the study authors) ranged from 3 to 31 (or 2% to 18% of lesions analysed). The store-and-forward application had one of the highest rates of test failure (15%). At least one melanoma was classed as unevaluable in three of the four application evaluations. AUTHORS' CONCLUSIONS: Smartphone applications using artificial intelligence-based analysis have not yet demonstrated sufficient promise in terms of accuracy, and they are associated with a high likelihood of missing melanomas. Applications based on store-and-forward images could have a potential role in the timely presentation of people with potentially malignant lesions by facilitating active self-management health practices and early engagement of those with suspicious skin lesions; however, they may incur a significant increase in resource and workload. Given the paucity of evidence and low methodological quality of existing studies, it is not possible to draw any implications for practice. Nevertheless, this is a rapidly advancing field, and new and better applications with robust reporting of studies could change these conclusions substantially.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This Cochrane review found only two eligible studies (332 lesions, 86 melanomas) and could not produce summary estimates, so the accuracy of smartphone apps for melanoma triage remains unreliable. Automated apps missed a substantial proportion of melanomas, while a store-and-forward dermatologist-review app had high sensitivity but low specificity and frequent test failures.
Key findings
- Across four artificial intelligence-based apps, sensitivity ranged from 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specificity from 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%); with melanoma prevalence of 18% to 37%, the number of melanomas missed was 7 to 55.
- The single store-and-forward app had sensitivity of 98% (95% CI 90% to 100%) and specificity of 30% (95% CI 22% to 40%); the dermatologist missed one melanoma, but 6/60 melanomas assessed were classed as unevaluable.
- Test failures/unevaluable lesions ranged from 3 to 31 (2% to 18% of lesions analysed); the store-and-forward app had one of the highest test-failure rates at 15%.
- In Maier 2015, face-to-face dermatologist diagnosis of the same lesions had sensitivity of 85% (95% CI 65% to 96%) and specificity of 97% (95% CI 93% to 99%), though the review notes these data are not directly comparable to the app’s output.
Methods
- Systematic review of diagnostic test accuracy studies; searched MEDLINE, Embase, CENTRAL, CINAHL and other sources to August 2016, including adults with pigmented or suspicious skin lesions, smartphone apps intended for public use, and histology or acceptable reference standards.
- Included two studies (Wolf 2013, USA; Maier 2015, Germany) providing six datasets; 332 lesions were successfully analysed, including 86 melanomas; the unit of analysis was the lesion.
- Due to scarcity and poor quality of data, no meta-analysis was performed; results were plotted on coupled forest plots, and risk of bias/applicability was assessed with a tailored QUADAS-2 tool.
Limitations
- The paper states the small number and poor quality of included studies reduce reliability, with high risk of bias for patient selection (selective inclusion; case-control design in Wolf 2013) and high applicability concerns because participants were secondary-care lesions scheduled for excision and photographs were taken by doctors rather than smartphone users.
- The paper states test failures/unevaluable images were excluded (2% to 18% of lesions), likely overestimating sensitivity; studies did not report key patient information such as age and gender, and melanoma prevalence was 18% and 35%, much higher than in community settings.
- Evident from the text: no meta-analysis, heterogeneity investigation, sensitivity analyses, or publication-bias assessment was possible, and only two studies were included, so conclusions could change substantially with new higher-quality studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 8 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One app that sends the photograph of a mole or skin lesion to a dermatologist for assessment missed only one melanoma.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The percentage of people with a final diagnosis of melanoma was 18% and 35%, much higher than that observed in community settings.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The num ber of test f ailures (lesion im ages analysed by the applications but classed as unevaluable and excluded by the study authors) ranged f rom 3 to 31 (or 2% to 18% of lesions analysed).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They did not report key patient information such as age and gender.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The photographs were taken by doctors instead of people taking pictures of their lesions with their own smartphones.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the studies excluded between 2% and 18% of images because the applications failed to produce a recommendation.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > How reliable are the results of the studies of this review?
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This m eans that between 27% and 93% of invasive m elanom a or atypical intraepiderm al m elanocytic variants were not picked up as high risk by the autom ated applications (or as m elanom as by one of the f our applications).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies took place in the USA and Germany.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With a prevalence of m elanom a ranging between 18% and 37% f or these evaluations, the num ber of m elanom as m issed was 7 to 55”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The store-and-f orward application had one of the highest rates of test f ailure (15%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- It may state two separate claims as one. 62
- Probably not a substantial claim. 81
- The quote only partly states this claim. 1
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Another 6 melanomas examined by the dermatologist via the application were not classified as high risk; instead the dermatologist was not able to classify the lesion as either 'atypical' (possibly a melanoma) or 'typical' (definitely not a melanoma).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“sensitivities ranged f rom 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specif icities f rom 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The single application using store-and-f orward review of lesion im ages by a derm atologist had a sensitivity of 98% (95% CI 90% to 100%) and specif icity of 30% (95% CI 22% to 40%); the derm atologist m issed one m elanom a”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At least one m elanom a was classed as unevaluable in three of the f our application evaluations, the highest num ber of m elanom as excluded by the derm atologist evaluating the store-and-f orward im ages (6/ 60 m elanom as assessed)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The review included two studies with 332 lesions, including 86 melanomas, analysed by at least one smartphone application.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We included two studies with a total of 332 lesions, 86 of which were melanomas (Summary of findings).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Study authors excluded an additional 31 lesions they considered as test failures for the purposes of this review (see Findings), including 13 due to”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 evaluated four different smartphone applications, providing no names to avoid consumer bias; they numbered the applications one to four to allow an assessment of accuracy.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We did not identify any other systematic reviews of smartphone applications during the preparation of this review.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Wolf 2013 used archived photographs of lesions rather than images taken using a phone and did not report the real names of the applications used.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The studies did not report the number of participants with lesions included in the studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Study participants were people who had skin lesions already scheduled for excision in a dermatology clinic setting rather than smartphone users with concerns about a new or changing mole or skin lesion, and dermatologists were likely to have taken the photographs used with the applications in the clinic setting in both studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Applicability of findings to the review question
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three of the four applications classed at least one melanoma as unevaluable, with the highest number of excluded melanomas (6/60 melanomas assessed) resulting from dermatologist evaluation of the store-and-forward images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The study excluded lesions that were uncommon or had an equivocal diagnosis (such as 'melanoma cannot be ruled out' or 'atypical melanocytic proliferation') and lesions with moderate or high grade atypia.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“total numbers of included lesions were 188 in Wolf 2013 and 144 in Maier 2015.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The test failure rates were: 3% (App 1), 2% (App 2), 6% (App 3) and 15% (App 4; designated by the dermatologist as 'send another photograph' or 'unable to categorise') (Table 1).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three of the four applications classed at least one melanoma as unevaluable, with the dermatologist conducting the assessment for the store-and-forward application (App 4) missing 6 (10%) melanomas for this reason.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 54Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The prevalence of melanoma was 18% in Maier 2015 and 35% in Wolf 2013.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We screened a total of 34,517 unique references for inclusion.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It is notable that Kassianos 2015 identified 39 applications, and we were only able to identify test accuracy evaluations for five.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
What the sources say
- Not checked yetcites Kassianos 2015 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For App 2 in Wolf 2013 (185 lesions and 58 melanoma cases), the resulting sensitivity was 69% (95% CI 55% to 80%), and specificity was 37% (95% CI 29% to 46%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 58Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The single application using store-and-forward review of lesion images by a dermatologist had a sensitivity of 98% (95% CI 90% to100%) and specificity of 30% (95% CI 22% to 40%); the dermatologist missed one melanoma.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sensitivities were around 70% for App 1 in Wolf 2013 (70%, 95% CI 57% to 81%) and for the SkinVision app in Maier 2015 (73%, 95% CI 52% to 88%) but only 7% (95% CI 2% to 16%) for App 3 in Wolf 2013.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three applications were artificial intelligence-based classifications of lesions as 'problematic' versus 'okay' (App 1), 'melanoma' versus 'not melanoma' (App 2) and 'high risk' versus 'medium/low-risk' (App 3) as part of the assessment of the images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“This review reports on two cohorts of lesions published in two studies that provide six datasets (Wolf 2013; Maier 2015).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Both of the studies used photographs of skin lesions that were scheduled for excision in a dermatology clinic setting, and clinicians were the ones who took the photographs instead of people using their own smartphones, potentially leading to the acquisition of higher quality images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The study excluded 20/195 lesions (10%) due to poor image quality or incomplete imaging.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Maier 2015 conducted a prospective case series of patients with melanocytic skin lesions seen routinely at the department of dermatology for skin cancer screening.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“two studies were derivation studies that did not separate data for training and test sets (Ramlakhan 2011; Wadhawan 2011)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to scarcity of data and the poor quality of studies, we did not undertake a meta-analysis for this review.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two studies included fewer than five melanoma cases (Massone 2007; Robson 2012)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedn = 5Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“App 4 used a store-and-forward approach with remote lesion assessment by a qualified dermatologist.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The corresponding specificities for the three applications were 39% (95% CI 31% to 49%; Wolf 2013; 182 lesions and 60 melanomas), 83% (95% CI 75% to 89%; Maier 2015; 144 lesions and 26 melanomas), and 94% (95% CI 87% to 97%; Wolf 2013; 170 lesions and 59 melanomas).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered 16 studies to be potentially eligible for this review of smartphone applications and ultimately included two publications.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Maier 2015 did use smartphone images; however, the details around the imaging process were unclear.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of these, we reviewed 1051 full-text papers for eligibility and included 203 publications in at least one of the suite of reviews of tests to assist in the diagnosis of melanoma or keratinocyte skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Wolf 2013 retrospectively evaluated photographs of lesions selected from their dermatology database of lesions that had been scheduled for excision using a case-control type design.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The applications successfully analysed a total of 332 lesions, including 86 melanomas.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Maier 2015 evaluated an automated risk assessment algorithm using the SkinVision App; this relied on fractal image analysis of three images per lesion.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The sensitivity of the face-to-face assessment was 85% (95% CI 65% to 96%) and specificity, 97% (95% CI 93% to 99%; Figure 8; 144 lesions and 26 melanomas).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across the five different applications that the two studies assessed, sensitivities for the detection of invasive melanoma or atypical intraepidermal melanocytic variants ranged from 7% (95% confidence interval (CI) 2% to 16%) to 98% (95% CI 90% to 100%) and specificities from 30% (95% CI 22% to 40%) to 94% (95% CI 87% to 97%; Figure 7).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The final application, App 4 in Wolf 2013, was a store-and-forward system, with a dermatologist classifying lesion images as atypical or typical.The sensitivity for this application was 98% (95% CI 90% to 100%) and specificity 30% (95% CI 22% to 40%; 159 lesions and 54 melanoma cases).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 54Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 32 43 27 68 0.54 [ 0.41, 0.67 ] 0.61 [ 0.52, 0.70 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 2 185 (58) 3 (2%) 2 (3%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 3 170 (59) 12 (6%) 1 (2%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 3 170 (59) 12 (6%) 1 (2%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 4 159 (54) 29 (15%) 6 (10%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 2 185 (58) 3 (2%) 2 (3%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 1 182 (60) 6 (3%) 0 (0%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 1 182 (60) 6 (3%) 0 (0%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 4 7 55 104 0.07 [ 0.02, 0.16 ] 0.94 [ 0.87, 0.97 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 4 7 55 104 0.07 [ 0.02, 0.16 ] 0.94 [ 0.87, 0.97 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 4 159 (54) 29 (15%) 6 (10%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“SkinVision 144 (26) 31 (18%) Not reported (≤ 14)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 32 43 27 68 0.54 [ 0.41, 0.67 ] 0.61 [ 0.52, 0.70 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“At least one author (JDi or NC) screened titles and abstracts, discussing and resolving any queries by consensus.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A pilot screen of 539 MEDLINE references showed good agreement (89% with a kappa of 0.77) between screeners.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Exclusions due to test f ailures were not reported (1/ 2) or their f inal diagnoses were not described (2/ 2)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We have checked the reference lists of all included papers, and subject experts within the author team reviewed the final list of included studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We did not perform electronic citation searching.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The photographs used were taken by doctors rather than by smartphone users, which seriously impacts the applicability of results.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The prevalence of melanoma in the included studies is much higher than that observed in community settings.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The final diagnosis of melanoma was made by histology, which is likely to have been a reliable method for deciding whether patients really had melanoma*.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > How reliable are the results of the studies of this review?
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We have screened relevant systematic reviews identified by the searches for their included primary studies, and we included any missed by our searches.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Test interpretation was blinded to ref erence standard and pre-specif ied f or artif icial intelligence-based diagnosis (2/ 2).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Tim ing of index and ref erence standards not reported.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Store-and-forward image applications could have a potential role in the timely identification of people with potentially malignant lesions by facilitating early engagement of those with suspicious skin lesions, but they have resource and workload implications.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > What are the implications of this review?
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“No additional limits were used.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The search strategy was designed to capture studies evaluating tests for the diagnosis or staging of skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Both a clinical reviewer (from a team of 12 clinician reviewers) and a methodologist reviewer (JDi or NC) applied inclusion criteria (Appendix 4) to all full text articles, resolving disagreements by consensus or by consultation with a third party (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One clinical (as detailed above) and one methodological reviewer (JDi, NC or LFR) independently extracted data concerning details of the study design, participants, index test(s) or test combinations and criteria for index test positivity, reference standards, and data required to populate a 2 × 2 diagnostic contingency table for each index test using a piloted data extraction form.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Data extraction and management
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The Information Specialist (SB) carried out a comprehensive search for published and unpublished studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We resolved disagreements by consensus or in consultation with a third party (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Data extraction and management
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We applied no date limits.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For each analysis, we included only one dataset per study to avoid multiple counting of lesions.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These participants would have already presented to a doctor with concerns about a particular lesion and therefore are likely represent a more severe spectrum of abnormality, which will artificially increase the sensitivity of the test in comparison to use by smartphone users in general.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We assessed both studies as being at low risk of bias in the index test domain, with the artificial intelligence-based assessment made without knowledge of the histological diagnosis.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The strengths of this review include an in-depth and comprehensive electronic literature search, systematic review methods including double extraction of papers by both clinicians and methodologists, and contact with authors to allow study inclusion or clarify data.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One clinical and one methodological reviewer (JDi, NC or LFR) independently assessed quality for the remaining studies, resolving any disagreement by consensus or in consultation with a third party where necessary (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All studies reported the use of an acceptable reference standard; however, Maier 2015 did not report blinding of histology to the index test result.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One study did not report blinding of the reference standard to the lesion images, and one did not mention interpretation by an experienced histopathologist.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies were blinded for index test interpretation and used pre-specified test thresholds and adequate reference standards.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although there is a theoretical possibility of correlations of test errors when multiple lesions are included from the same patients, most studies include very few patients with multiple lesions, and any potential impact on findings is likely to be very small, particularly in comparison with other concerns regarding risk of bias and applicability.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We examined heterogeneity between studies by visually inspecting the forest plots of sensitivity and specificity and summary receiver operating characteristics (ROC) plots.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Investigations of heterogeneity
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The main concerns for the review are the clinical applicability of the findings and exclusion of unevaluable test results, with likely overestimation of sensitivity.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“as initial treatment in skin cancer is directed to the lesion and not systemically to a patient”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With a prevalence of melanoma ranging between 18% and 37% for these evaluations, the number of melanomas missed was between 7 and 55.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, both studies caused high concern about applicability of the index tests, which were not used as intended in practice.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We did not perform any sensitivity analyses.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Sensitivity analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All had a pre-specified threshold.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We piloted the modified QUADAS-2 tool on five full-text articles.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is not a representative spectrum of lesions that would be observed in daily life but rather a highly selected sample of participants.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One study also excluded equivocal lesions and those with moderate or high-grade atypia, both of which could potentially be more likely to produce unevaluable results or be misclassified by the application.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Applicability of findings to the review question
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“We assessed risk of bias and applicability of included studies using the QUADAS-2 checklist (Whiting 2011), tailored to the topic of skin cancer diagnosis (see Appendix 5).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
What the sources say
- Not checked yetcites Whiting 2011 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, both studies caused high concern regarding included participants and setting, due to un-clear reporting of patient samples and whether they included multiple lesions per patient.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Due to uncertainty about the determinants of publication bias for diagnostic accuracy studies and the inadequacy of tests for detecting funnel plot asymmetry (Deeks 2005), we did not perform any tests to detect publication bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of reporting bias
What the sources say
- Not checked yetcites Deeks 2005 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We planned a clear analysis structure to allow estimation of test accuracy in different study populations and undertook a detailed and replicable analysis of methodologic quality.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluded participants: 202/390 lesion images excluded due to poor image quality, containing identifiable patient information or features, or lacking sufficient clinical or histological information.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“used cross-validation approaches such as 'leave-one-out' cross-validation (Efron 1983);”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Efron 1983 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“however, studies using previously acquired images could be particularly susceptible to information bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > For diagnostic studies
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“In terms of exclusions, we considered studies that excluded particular lesion types (e.g.lentigo maligna), particular lesion sites, or other lesions on the basis of image quality or lack of observer agreement (e.g. on histopathology) to be at high risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Whiting 2011 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that separately sampled malignant and benign lesions to have used a case-control design; and those that supplemented a series of suspicious lesions with additional malignant or benign lesions to be at unclear risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Were all patients included in the analysis?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Available data have limited applicability in practice due to selective participant recruitment from secondary referral settings and the use of images not acquired by the intended users of the smartphone applications (i.e.members of the public).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Smartphone applications for skin lesion triage are intended to be used by members of the public in a community setting.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For the same reason, we could not investigate heterogeneity or perform sensitivity analyses.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For prospective studies and retrospective studies that used the original index test interpretation, the diagnosis will by nature be interpreted and recorded before the result of the reference standard is known;”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluded participants: 20 lesions (10%) excluded due to poor image quality (significant amount of hair, lesion out of focus or multiple lesions in the focus).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Study results can only be reproduced if the diagnostic threshold is described in sufficient detail.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > PARTICIPANT SELECTION (1) -CONCERNS REGARDING APPLICABILITY
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smartphone applications using artificial intelligence-based analysis have not yet demonstrated sufficient promise in terms of accuracy, and they are associated with a high likelihood of missing melanomas.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“In judging the applicability of patient populations to the review question, we considered restriction to particular lesion populations, such as melanocytic, nodular, high risk or restrictions by size to be of high concern for applicability.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Whiting 2011 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We included studies developing new mobile phone applications (i.e.derivation studies) if they used a separate independent 'test set' of participants or images to evaluate the new approach.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We planned to supplement the database searches by searching the annual meetings of appropriate organisations (e.g.British Association of Dermatologists Annual Meeting, American Academy of Dermatology Annual Meeting, European Academy of Dermatology and Venereology Meeting, Society for Melanoma Research Congress, World Congress of Dermatology, European Association of Dermato Oncology)”
- Also stated in: § Acknowledgements · plain
“however, due to the volume of evidence retrieved from database searches and time restrictions we were unable to do this.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Acknowledgements · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“evaluated the accuracy of the presence or absence of individual lesion characteristics or morphological features, with no overall diagnosis of malignancy.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“An additional 31 were excluded as unevaluable (13 lesions (6%) based on two-point-differences and 18 (9%) tie cases with an equal number of results in different risk classes)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedn = 18Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that separately sampled malignant and benign lesions to have used a case-control design; and those that supplemented a series of suspicious lesions with additional malignant or benign lesions to be at unclear risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Was the test applied and interpreted in a clinically applicable manner?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of analysis, we could not restrict analysis to per patient data due to lack of data.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“used a statistical model to produce a data-driven equation or algorithm based on multiple diagnostic features, with no separate test set;”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Were all patients included in the analysis?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that include a high number of lesions in relation to the number of participants in the study to be less representative than studies conducted in a more general population of participants (i.e. if the difference between the number of included lesions and number of included participants is greater than 5%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Applications based on store-and-forward images could have a potential role in the timely presentation of people with potentially malignant lesions by facilitating active self-management health practices and early engagement of those with suspicious skin lesions; however, there are resource and workload implications with a store-and-forward approach.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Given that diagnosis of skin cancer is primarily lesion-based, there is the potential for study participants with multiple lesions to contribute disproportionately to estimates of test accuracy, especially if they are at particular risk of having skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Was a case-control design avoided?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“studies available only as conference abstracts do not allow a comprehensive assessment of study methods or methodological quality.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“This interval was chosen based on a study showing that most false-negative melanomas will be diagnosed within three months of the initial negative index test, although a small number will be diagnosed up to 12 months subsequently (Altamura 2008).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Flow and timing domain (4)
What the sources say
- Not checked yetcites Altamura 2008 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Did the study avoid inappropriate exclusions?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Given the potential for subjective differences in test interpretation for melanoma, the interpretation of the index test blinded to the result of the reference standard is a key means of reducing bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
The prevalence of melanoma in the included studies is much higher than that observed in community settings.
“The percentage of people with a final diagnosis of melanoma was 18% and 35%, much higher than that observed in community settings.”
The paper relies on this without support.
Smartphone applications for skin lesion triage are intended to be used by members of the public in a community setting.
“rather than the community setting where these applications are intended to be used”
“the intended users of the smartphone applications (i.e.members of the public)”
The authors state this as an assumption.
The review assumes that the 'two-point differences cases' excluded in Maier 2015 are lesions whose results fall in non-consecutive risk classes.
“we assume this to mean lesions with results in non-consecutive risk classes, e.g. 1 high risk and 2 low risk”
The authors state this as an assumption.
The review assumes that the interval between the index test and the reference standard in Maier 2015 was less than one month.
“assume it is < 1 month as images of the lesions were taken prior to excision”
The paper relies on this without support.
In routine practice, the clinical diagnosis is included on pathology request forms and histopathologists use it to help interpret the pathology.
“It is normal practice for the clinical diagnosis (usually by visual inspection or dermoscopy) to be included on pathology request forms and for the histopathologist to use this diagnosis to help with the pathology interpretation.”
The paper relies on this without support.
Blinded reading of the histopathology reference standard is not standard practice.
“blinded interpretation of the histopathology reference standard is not normal practice”
“histopathology interpretation is usually conducted with knowledge of the clinical diagnosis (from visual inspection or dermoscopy or both).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A Cochrane review of only two studies that tried to validate algorithm based skin apps suggested that there is a high chance of skin cancers being missed”
From Algorithm based smartphone apps to assess risk of skin cancer in adults: systematic review of diagnostic accuracy studies (2020) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Figure 8 gives the dermatologist test the wrong decision threshold
MinorThe Figure 8 caption labels the face-to-face diagnosis as high risk versus medium/low risk, but the data table identifies its decision as melanoma versus not melanoma.
“7 Face-to-face clinical diagnosis [high risk vs medium/low risk].”
“Test 7. Face-to-face dermatologist diagnosis [decision: melanoma vs not melanoma].”
Maier melanoma count changes from 40 to 60
MinorThe table footnote says the original Maier sample of 195 lesions contained 60 melanomas, whereas the study characteristics give 40 melanomas for that same sample.
“The original sample of 195 lesions included 60 melanomas.”
“Histology (excision) -195 eligible lesions including 40 melanomas;”
Wolf exclusions are described as both common and uncommon lesions
MinorThe methodological-quality discussion says Wolf excluded common lesions, whereas the results section says it excluded uncommon lesions. Both passages also mention equivocal diagnoses, making the difference in lesion frequency explicit.
“Wolf 2013 excluded lesions that were common or with equivocal diagnoses.”
“The study excluded lesions that were uncommon or had an equivocal diagnosis”
Six Wolf lesions are unaccounted for in App 3 results
MinorThe table gives 188 Wolf lesions, but App 3 has 170 successfully assessed lesions and 12 unevaluable lesions, totaling only 182. The other six lesions are not accounted for in the reported App 3 flow.
Reported 188 · recomputed 182
“Wolf 2013 188 lesions (60 melanomas) a Application 1 182 (60) 6 (3%) 0 (0%) Application 2 185 (58) 3 (2%) 2 (3%) Application 3 170 (59) 12 (6%) 1 (2%)”
Citations
Cites
Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012
Ferlay, J., Soerjomataram, I., Dikshit, R., Eser, S., Mathers, C., Rebelo, M., Parkin, D. M., Forman, D., & Bray, F. (2015) · International Journal of Cancer · doi:10.1002/ijc.29210 · Cited by 28,766
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationSiegel, R. L., Miller, K. D., & Jemal, A. (2015) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21254 · Cited by 11,854
Final Version of 2009 AJCC Melanoma Staging and Classification
Balch, C. M., Gershenwald, J. E., Soong, S.-J., Thompson, J. F., Atkins, M. B., Byrd, D. R., Buzaid, A. C., Cochran, A. J., Coit, D. G., Ding, S., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2009.23.4799 · Cited by 4,653
STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Self-citationBalch, C. M., Soong, S., Gershenwald, J. E., Thompson, J. F., Reintgen, D. S., Cascinelli, N., Urist, M. M., McMasters, K. M., Ross, M. I., Kirkwood, J. M., et al. (2001) · Journal of Clinical Oncology · doi:10.1200/jco.2001.19.16.3622 · Cited by 2,383
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Boring, C. C., Squires, T. S., Tong, T., & Montgomery, S. (1994) · CA A Cancer Journal for Clinicians · doi:10.3322/canjclin.44.1.7 · Cited by 1,313
Meta-analysis of risk factors for cutaneous melanoma: II. Sun exposure
Gandini, S., Sera, F., Cattaruzza, M. S., Pasquini, P., Picconi, O., Boyle, P., & Melchi, C. F. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.016 · Cited by 1,266
Flagged first, then by citations
6 of the 88 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Braunmühl, 2015, Smartphone apps for skin cancer diagnosis? The Munich study, Kosmetische Medizin, 36, 152
- Australian Cancer Database, 2017, Melanoma of the skin for Australia (ICD10 C43)
- Ndegwa, 2010, Teledermatology services: rapid review of diagnostic, clinical management, and economic outcomes
Cited by
Sorted by citations
Items 101–144 of 144
Hierarchical attention transformer provides assistant suggestions for orbital rejuvenation surgery
Lian, X., Hu, X., Li, G., Wu, S., Liu, Y., Qin, K., & Liu, K. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1532195 · Cited by 1
Future Trends in Artificial Intelligence for Medical Applications
Chaudhuri, T., & Ghosh, J. (2025) · Advances in medical diagnosis, treatment, and care (AMDTC) book series · doi:10.4018/979-8-3693-9816-6.ch020 · Cited by 1
Diagnosis of skin melanoma using artificial intelligence using the computer vision program
Lamotkin, A. I., Иванович, К. Д., & Анатольевич, Л. И. (2025) · Clinical Medicine (Russian Journal) · doi:10.30629/0023-2149-2025-103-7-540-545 · Cited by 1
Halilaj, I., van Wijk, Y., Jochems, A., & Lambin, P. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821259-2.00010-7 · Cited by 1
Clinico-dermoscopic Diagnosis of Skin Cancers in Skin of Color
Bhat, Y. J., Dar, U. K., & Zeerak, S. (2021) · Indian Journal of Dermatopathology and Diagnostic Dermatology · doi:10.4103/ijdpdd.ijdpdd_8_21 · Cited by 1
Ezquerro, I. M. D. E., Podlipnik, S., Cañueto, J., de la Cuadra-Grande, A., Serra-Guillén, C., Moreno, D., Ferrándiz, L., Dominguez‐Cruz, J. J., de la Cueva, P., Gilaberte, Y., et al. (2023) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2023.02.003 · Cited by 1
Ezquerro, I. M. D. E., Podlipnik, S., Cañueto, J., de la Cuadra-Grande, A., Serra-Guillén, C., Moreno, D., Ferrándiz, L., Dominguez‐Cruz, J. J., de la Cueva, P., Gilaberte, Y., et al. (2023) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2023.02.024 · Cited by 1
Artificial Intelligence in Skin Cancer: A Literature Review from Diagnosis to Prevention and Beyond
Ghorbani, A. (2023) · International Journal of Bioinformatics and Intelligent Computing · doi:10.61797/ijbic.v2i2.251 · Cited by 1
Artificial Intelligence in Skin Cancer: A Literature Review from Diagnosis to Prevention and Beyond
Said, K. K., Rhaimi, C. B., & Alatresh, S. A. (2024) · Journal for Research in Applied Sciences and Biotechnology · doi:10.55544/jrasb.3.5.26 · Cited by 1
Contemporary communication in a clinical trial
Mikhail, M., Shirley, R., Jain, A., & Wormald, J. C. R. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111196 · Cited by 1
Self-citationA Hybrid Automatic Classification Model for Skin Tumour Images
Simić, S., Simić, S. D., Banković, Z., Ivkov‐Simić, M., Villar, J. R., & Simić, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29859-3_61 · Cited by 1
The need for individual testing of applications aimed at early detection of skin cancer
Stans, J. (2020) · Nowotwory Journal of Oncology · doi:10.5603/njo.2020.0054 · Cited by 1
Smartphone and Surgery, Reality or Gadget?
Boughizane, S., Bannour, B., Bannour, I., Hacheni, F., Bannour, I., Masmoudi, M., Boughizane, J., & Youssef, S. (2021) · IntechOpen eBooks · doi:10.5772/intechopen.98889 · Cited by 1
Health Apps in the Area of Conflict Between State Regulation and IT Architectures
Schrahe, D., & Städter, T. (2022) · FOM-Edition · doi:10.1007/978-3-658-33740-7_15 · Cited by 1
Jayakumar, S., Sounderajah, V., Normahani, P., Harling, L., Markar, S. R., Ashrafian, H., & Darzi, A. W. (2021) · Research Square · doi:10.21203/rs.3.rs-329433/v1 · Cited by 1
Ackermann, D. M., Smit, A. K., Janda, M., Kemenade, C. V., Dieng, M., Morton, R. L., Turner, R. M., Cust, A. E., Irwig, L., Hersch, J. K., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-264883/v1 · Cited by 1
How is Artificial Intelligence Transforming the Skin Cancer Screening Pathway? An Umbrella ReviewPreprint
Sollis, L. J., Bunnell, A., Cho, E., Willingham, M. L., Jr., Cruz-Mattos, G., Arii, A., Lum, C., Cassel, K., & Shepherd, J. (2026) · Research Square · doi:10.21203/rs.3.rs-9069373/v1 · Cited by 1
Honorato-Cía, C., Hert, S. G. D., ROBERTIS, E. D., & Grigoraș, I. (2019) · Advances in medical education, research, and ethics (AMERE) book series · doi:10.4018/978-1-5225-9599-1.ch012
L’intelligence artificielle au service de l’orthodontie : l’exemple de Dental Monitoring
Costi, A. (2019) · Revue d Orthopédie Dento-Faciale · doi:10.1051/odf/2019032
Blum, A., Bösch, S., Haenssle, H. A., Fink, C., Hofmann‐Wellenhof, R., Zalaudek, I., Kittler, H., & Tschandl, P. (2020) · Der Hautarzt
Burch, J., & Polcz, M. (2020) · Cochrane Clinical Answers · doi:10.1002/cca.3383
Andreani, S., & Ormazábal, M. (2021) · Piel · doi:10.1016/j.piel.2021.07.001
Dermatologische apps herkennen nog niet vroegtijdig een melanoom
van Merle, A., & Bartelink, M.-L. E. L. (2021) · Huisarts en Wetenschap · doi:10.1007/s12445-021-1276-y
E-36 側頭葉てんかん外科手術後に幻覚妄想状態が出現した2症例
上杉, 秀., 大沼, 悌., & 清水, 弘. (1994) · 日本てんかん学会プログラム・予稿集
Honorato-Cía, C., Hert, S. G. D., ROBERTIS, E. D., & Grigoraș, I. (2021) · IGI Global eBooks · doi:10.4018/978-1-6684-2405-6.ch038
Critères de choix des applications e-santé
Denis, F. (2021) · Actualités Pharmaceutiques · doi:10.1016/j.actpha.2021.10.007
Orrin, E., Cassidy, P. B., Kulkarni, R. P., Berry, E., & Leachman, S. A. (2021) · Springer eBooks · doi:10.1007/978-3-030-82639-0_1 · Cited by 1
Neue Verfahren für Diagnostik und Bildgebung
Sonnet, M. (2022) · ästhetische dermatologie & kosmetologie · doi:10.1007/s12634-022-1621-6
„Toll. Ich bin froh dabei zu sein“. Studie zur Spende digitaler Körperdaten in der Corona-Krise
Urban, M. (2022) · ZQF – Zeitschrift für Qualitative Forschung · doi:10.3224/zqf.v22i2.04
Tran, Q., Chin, Y.-P., Nguyen, P., Lee, M., Yang, H., Huang, C., Le, N. Q. K., Hsu, M., Li, Y., & Su, S. (2020) · doi:10.2196/preprints.17888
Artificial Intelligence and Malignant Melanoma : A Review
Ramezanpour, P., Sasani, S., & Rad, S. G. (2022) · Journal of Student Research · doi:10.47611/jsrhs.v11i3.2675
Developing and Testing Deep Learning Models for Monkeypox and Herpes Zoster Rash Differentiation
Callaway, C. (2023) · Journal of Student Research · doi:10.47611/jsrhs.v12i3.4964
Investigating Skin Cancer Diagnosis Using a Webcam-based Microcontroller System
Kim, R. (2024) · Journal of international research in medical and pharmaceutical sciences · doi:10.56557/jirmeps/2024/v19i18624
Jain, A., Mittal, N., Hanmandlu, M., & Pandey, A. K. (2024) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/979-8-3693-5643-2.ch008
Self-citationFarmer wants a skin check: Improving skin cancer surveillance in rural Australia
Arandjelovic, A. (2024) · Australian Journal of Rural Health · doi:10.1111/ajr.13172
Mobile Application of Convolutional Neural Networks for Melanoma Classification
Omirgaliyev, R., Arystanbekova, A., Alzhanov, A., & Makatov, A. (2024) · IEEE International Conference on Smart Information Systems and Technologies (SIST) · doi:10.1109/sist61555.2024.10629269
Moreira-Filho, J. W., de Carvalho, M. P., Guerra, C., dos Santos, D. R., Veiga-Filho, J., & Veiga, D. F. (2025) · Revista Brasileira de Cirurgia Plástica · doi:10.1055/s-0045-1807277
Székely, O., & Kádár, M. (2025) · IME - Az egészségügyi vezetők szaklapja · doi:10.53020/ime-2025-104
DILEMAS ÉTICOS E LEGAIS DA INTELIGÊNCIA ARTIFICIAL NA SAÚDE: REVISÃO SISTEMÁTICA
GADELHA, P., Silva, F. L. D. L., Porto, E., de Sousa, S. G. B., da Costa, A. G., da Silva, E. R., Porto, E. S. N., & Trajano, L. A. D. (2025) · Revista Contemporânea · doi:10.56083/rcv5n12-048
Bouton, C., Schmeltz, H., Lévèque, C., Gaultier, A., Quereux, G., Dréno, B., Nguyen, J., & Rat, C. (2024) · Figshare · doi:10.6084/m9.figshare.26724923
L., M. A. A., Aguirre-Lam, A. G., Lam-Maldonado, M., & Rodríguez-Zapata, J. F. F. (2026) · Cureus Journal of Computer Science. · doi:10.7759/s44389-026-00147-2
Coen, J. W., McCarthy, S. D. S., & Anderson, H. C. (2026) · Cureus · doi:10.7759/cureus.117269
Foocharoen, C., Sonsilphong, S., Onchan, T., Pongkulkiat, P., Mahakkanukrauh, A., Suwannaroj, S., & Kanarkard, W. (2026) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.20438
Metadata
- Authors
- Chuchu, N., Takwoingi, Y., Dinnes, J., Matin, R. N., Bassett, O., Moreau, J. F., Bayliss, S. E., Davenport, C., Godfrey, K., O'Connell, S., Jain, A., Walter, F. M., Deeks, J. J., Williams, H. C., & Cochrane Skin Cancer Diagnostic Test Accuracy Group
- Affiliations
- University of Birmingham (GB)
- University Hospitals Birmingham NHS Foundation Trust (GB)
- Churchill Hospital (GB)
- Addenbrooke's Hospital (GB)
- University of Pittsburgh Medical Center (US)
- University of Nottingham (GB)
- Cardiff and Vale University Health Board (GB)
- Imperial College Healthcare NHS Trust (GB)
- University of Cambridge (GB)
- Corresponding author
- Dinnes, Jacqueline
- ORCID
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2018-12-04
- Volume
- 2018
- Issue
- 12
- Pages
- CD013192-CD013192
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- PMC
- PMC6517294
- OpenAlex
- W2886914906
- Semantic Scholar
- c82c23917430d434cb08deb9f9339bc64340303d
- Cited by
- 144
- References
- 88
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 16 · 2023: 18 · 2022: 18 · 2021: 29 · 2020: 26 · 2019: 15 · 2018: 7
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cochrane Database of Systematic Reviews (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Nottingham ePrints (University of Nottingham) (submittedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, other-oa)
- Funders
- Melanoma Research Alliance
- National Institute for Health and Care Research (13/89/15, NIHR-CS-012-030)
- British Association of Dermatologists
- Topics
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Cell Biology › melanin and skin pigmentation
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Keywords
- melanoma, mobile application, mobile health, skin lesions, artificial intelligence, diagnostic accuracy, sensitivity and specificity, early detection of skin cancer, image classification, histopathological confirmation, delayed diagnosis, quality of evidence, risk of bias, applicability, cost-effectiveness
- MeSH terms
- Smartphone, Cutaneous Malignant Melanoma, Adult, Algorithms, Diagnostic Errors, Humans, Melanoma, Sensitivity and Specificity, Skin Neoplasms, Triage, Early Detection of Cancer, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review