The DOI matches its Crossref record; 82 of the 88 references it cites were found in a registry or an index; none of the 8 sources its claims cite is checked for support yet.
Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma
Open accessAbstract
BACKGROUND: Melanoma accounts for a small proportion of all skin cancer cases but is responsible for most skin cancer-related deaths. Early detection and treatment can improve survival. Smartphone applications are readily accessible and potentially offer an instant risk assessment of the likelihood of malignancy so that the right people seek further medical attention from a clinician for more detailed assessment of the lesion. There is, however, a risk that melanomas will be missed and treatment delayed if the application reassures the user that their lesion is low risk. OBJECTIVES: To assess the diagnostic accuracy of smartphone applications to rule out cutaneous invasive melanoma and atypical intraepidermal melanocytic variants in adults with concerns about suspicious skin lesions. SEARCH METHODS: We undertook a comprehensive search of the following databases from inception to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA: Studies of any design evaluating smartphone applications intended for use by individuals in a community setting who have lesions that might be suspicious for melanoma or atypical intraepidermal melanocytic variants versus a reference standard of histological confirmation or clinical follow-up and expert opinion. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). Due to scarcity of data and poor quality of studies, we did not perform a meta-analysis for this review. For illustrative purposes, we plotted estimates of sensitivity and specificity on coupled forest plots for each application under consideration. MAIN RESULTS: This review reports on two cohorts of lesions published in two studies. Both studies were at high risk of bias from selective participant recruitment and high rates of non-evaluable images. Concerns about applicability of findings were high due to inclusion only of lesions already selected for excision in a dermatology clinic setting, and image acquisition by clinicians rather than by smartphone app users.We report data for five mobile phone applications and 332 suspicious skin lesions with 86 melanomas across the two studies. Across the four artificial intelligence-based applications that classified lesion images (photographs) as melanomas (one application) or as high risk or 'problematic' lesions (three applications) using a pre-programmed algorithm, sensitivities ranged from 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specificities from 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%). The single application using store-and-forward review of lesion images by a dermatologist had a sensitivity of 98% (95% CI 90% to 100%) and specificity of 30% (95% CI 22% to 40%).The number of test failures (lesion images analysed by the applications but classed as 'unevaluable' and excluded by the study authors) ranged from 3 to 31 (or 2% to 18% of lesions analysed). The store-and-forward application had one of the highest rates of test failure (15%). At least one melanoma was classed as unevaluable in three of the four application evaluations. AUTHORS' CONCLUSIONS: Smartphone applications using artificial intelligence-based analysis have not yet demonstrated sufficient promise in terms of accuracy, and they are associated with a high likelihood of missing melanomas. Applications based on store-and-forward images could have a potential role in the timely presentation of people with potentially malignant lesions by facilitating active self-management health practices and early engagement of those with suspicious skin lesions; however, they may incur a significant increase in resource and workload. Given the paucity of evidence and low methodological quality of existing studies, it is not possible to draw any implications for practice. Nevertheless, this is a rapidly advancing field, and new and better applications with robust reporting of studies could change these conclusions substantially.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This Cochrane review found only two eligible studies (332 lesions, 86 melanomas) and could not produce summary estimates, so the accuracy of smartphone apps for melanoma triage remains unreliable. Automated apps missed a substantial proportion of melanomas, while a store-and-forward dermatologist-review app had high sensitivity but low specificity and frequent test failures.
Key findings
- Across four artificial intelligence-based apps, sensitivity ranged from 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specificity from 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%); with melanoma prevalence of 18% to 37%, the number of melanomas missed was 7 to 55.
- The single store-and-forward app had sensitivity of 98% (95% CI 90% to 100%) and specificity of 30% (95% CI 22% to 40%); the dermatologist missed one melanoma, but 6/60 melanomas assessed were classed as unevaluable.
- Test failures/unevaluable lesions ranged from 3 to 31 (2% to 18% of lesions analysed); the store-and-forward app had one of the highest test-failure rates at 15%.
- In Maier 2015, face-to-face dermatologist diagnosis of the same lesions had sensitivity of 85% (95% CI 65% to 96%) and specificity of 97% (95% CI 93% to 99%), though the review notes these data are not directly comparable to the app’s output.
Methods
- Systematic review of diagnostic test accuracy studies; searched MEDLINE, Embase, CENTRAL, CINAHL and other sources to August 2016, including adults with pigmented or suspicious skin lesions, smartphone apps intended for public use, and histology or acceptable reference standards.
- Included two studies (Wolf 2013, USA; Maier 2015, Germany) providing six datasets; 332 lesions were successfully analysed, including 86 melanomas; the unit of analysis was the lesion.
- Due to scarcity and poor quality of data, no meta-analysis was performed; results were plotted on coupled forest plots, and risk of bias/applicability was assessed with a tailored QUADAS-2 tool.
Limitations
- The paper states the small number and poor quality of included studies reduce reliability, with high risk of bias for patient selection (selective inclusion; case-control design in Wolf 2013) and high applicability concerns because participants were secondary-care lesions scheduled for excision and photographs were taken by doctors rather than smartphone users.
- The paper states test failures/unevaluable images were excluded (2% to 18% of lesions), likely overestimating sensitivity; studies did not report key patient information such as age and gender, and melanoma prevalence was 18% and 35%, much higher than in community settings.
- Evident from the text: no meta-analysis, heterogeneity investigation, sensitivity analyses, or publication-bias assessment was possible, and only two studies were included, so conclusions could change substantially with new higher-quality studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 8 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One app that sends the photograph of a mole or skin lesion to a dermatologist for assessment missed only one melanoma.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The percentage of people with a final diagnosis of melanoma was 18% and 35%, much higher than that observed in community settings.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The num ber of test f ailures (lesion im ages analysed by the applications but classed as unevaluable and excluded by the study authors) ranged f rom 3 to 31 (or 2% to 18% of lesions analysed).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They did not report key patient information such as age and gender.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The photographs were taken by doctors instead of people taking pictures of their lesions with their own smartphones.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the studies excluded between 2% and 18% of images because the applications failed to produce a recommendation.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > How reliable are the results of the studies of this review?
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This m eans that between 27% and 93% of invasive m elanom a or atypical intraepiderm al m elanocytic variants were not picked up as high risk by the autom ated applications (or as m elanom as by one of the f our applications).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies took place in the USA and Germany.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With a prevalence of m elanom a ranging between 18% and 37% f or these evaluations, the num ber of m elanom as m issed was 7 to 55”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The store-and-f orward application had one of the highest rates of test f ailure (15%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- It may state two separate claims as one. 62
- Probably not a substantial claim. 81
- The quote only partly states this claim. 1
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Another 6 melanomas examined by the dermatologist via the application were not classified as high risk; instead the dermatologist was not able to classify the lesion as either 'atypical' (possibly a melanoma) or 'typical' (definitely not a melanoma).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“sensitivities ranged f rom 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specif icities f rom 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The single application using store-and-f orward review of lesion im ages by a derm atologist had a sensitivity of 98% (95% CI 90% to 100%) and specif icity of 30% (95% CI 22% to 40%); the derm atologist m issed one m elanom a”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At least one m elanom a was classed as unevaluable in three of the f our application evaluations, the highest num ber of m elanom as excluded by the derm atologist evaluating the store-and-f orward im ages (6/ 60 m elanom as assessed)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The review included two studies with 332 lesions, including 86 melanomas, analysed by at least one smartphone application.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We included two studies with a total of 332 lesions, 86 of which were melanomas (Summary of findings).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Study authors excluded an additional 31 lesions they considered as test failures for the purposes of this review (see Findings), including 13 due to”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 evaluated four different smartphone applications, providing no names to avoid consumer bias; they numbered the applications one to four to allow an assessment of accuracy.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We did not identify any other systematic reviews of smartphone applications during the preparation of this review.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Wolf 2013 used archived photographs of lesions rather than images taken using a phone and did not report the real names of the applications used.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The studies did not report the number of participants with lesions included in the studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Study participants were people who had skin lesions already scheduled for excision in a dermatology clinic setting rather than smartphone users with concerns about a new or changing mole or skin lesion, and dermatologists were likely to have taken the photographs used with the applications in the clinic setting in both studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Applicability of findings to the review question
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three of the four applications classed at least one melanoma as unevaluable, with the highest number of excluded melanomas (6/60 melanomas assessed) resulting from dermatologist evaluation of the store-and-forward images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The study excluded lesions that were uncommon or had an equivocal diagnosis (such as 'melanoma cannot be ruled out' or 'atypical melanocytic proliferation') and lesions with moderate or high grade atypia.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“total numbers of included lesions were 188 in Wolf 2013 and 144 in Maier 2015.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The test failure rates were: 3% (App 1), 2% (App 2), 6% (App 3) and 15% (App 4; designated by the dermatologist as 'send another photograph' or 'unable to categorise') (Table 1).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three of the four applications classed at least one melanoma as unevaluable, with the dermatologist conducting the assessment for the store-and-forward application (App 4) missing 6 (10%) melanomas for this reason.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 54Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The prevalence of melanoma was 18% in Maier 2015 and 35% in Wolf 2013.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We screened a total of 34,517 unique references for inclusion.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It is notable that Kassianos 2015 identified 39 applications, and we were only able to identify test accuracy evaluations for five.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
What the sources say
- Not checked yetcites Kassianos 2015 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For App 2 in Wolf 2013 (185 lesions and 58 melanoma cases), the resulting sensitivity was 69% (95% CI 55% to 80%), and specificity was 37% (95% CI 29% to 46%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 58Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The single application using store-and-forward review of lesion images by a dermatologist had a sensitivity of 98% (95% CI 90% to100%) and specificity of 30% (95% CI 22% to 40%); the dermatologist missed one melanoma.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sensitivities were around 70% for App 1 in Wolf 2013 (70%, 95% CI 57% to 81%) and for the SkinVision app in Maier 2015 (73%, 95% CI 52% to 88%) but only 7% (95% CI 2% to 16%) for App 3 in Wolf 2013.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three applications were artificial intelligence-based classifications of lesions as 'problematic' versus 'okay' (App 1), 'melanoma' versus 'not melanoma' (App 2) and 'high risk' versus 'medium/low-risk' (App 3) as part of the assessment of the images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“This review reports on two cohorts of lesions published in two studies that provide six datasets (Wolf 2013; Maier 2015).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Both of the studies used photographs of skin lesions that were scheduled for excision in a dermatology clinic setting, and clinicians were the ones who took the photographs instead of people using their own smartphones, potentially leading to the acquisition of higher quality images.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The study excluded 20/195 lesions (10%) due to poor image quality or incomplete imaging.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Maier 2015 conducted a prospective case series of patients with melanocytic skin lesions seen routinely at the department of dermatology for skin cancer screening.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“two studies were derivation studies that did not separate data for training and test sets (Ramlakhan 2011; Wadhawan 2011)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to scarcity of data and the poor quality of studies, we did not undertake a meta-analysis for this review.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two studies included fewer than five melanoma cases (Massone 2007; Robson 2012)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedn = 5Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“App 4 used a store-and-forward approach with remote lesion assessment by a qualified dermatologist.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The corresponding specificities for the three applications were 39% (95% CI 31% to 49%; Wolf 2013; 182 lesions and 60 melanomas), 83% (95% CI 75% to 89%; Maier 2015; 144 lesions and 26 melanomas), and 94% (95% CI 87% to 97%; Wolf 2013; 170 lesions and 59 melanomas).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered 16 studies to be potentially eligible for this review of smartphone applications and ultimately included two publications.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Maier 2015 did use smartphone images; however, the details around the imaging process were unclear.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of these, we reviewed 1051 full-text papers for eligibility and included 203 publications in at least one of the suite of reviews of tests to assist in the diagnosis of melanoma or keratinocyte skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Wolf 2013 retrospectively evaluated photographs of lesions selected from their dermatology database of lesions that had been scheduled for excision using a case-control type design.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The applications successfully analysed a total of 332 lesions, including 86 melanomas.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Maier 2015 evaluated an automated risk assessment algorithm using the SkinVision App; this relied on fractal image analysis of three images per lesion.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > R E S U L T S Results of the search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The sensitivity of the face-to-face assessment was 85% (95% CI 65% to 96%) and specificity, 97% (95% CI 93% to 99%; Figure 8; 144 lesions and 26 melanomas).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across the five different applications that the two studies assessed, sensitivities for the detection of invasive melanoma or atypical intraepidermal melanocytic variants ranged from 7% (95% confidence interval (CI) 2% to 16%) to 98% (95% CI 90% to 100%) and specificities from 30% (95% CI 22% to 40%) to 94% (95% CI 87% to 97%; Figure 7).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The final application, App 4 in Wolf 2013, was a store-and-forward system, with a dermatologist classifying lesion images as atypical or typical.The sensitivity for this application was 98% (95% CI 90% to 100%) and specificity 30% (95% CI 22% to 40%; 159 lesions and 54 melanoma cases).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Findings Detection of invasive melanoma or atypical intraepidermal melanocytic variants
Strength:plain· not yet calibratedn = 54Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 32 43 27 68 0.54 [ 0.41, 0.67 ] 0.61 [ 0.52, 0.70 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 2 185 (58) 3 (2%) 2 (3%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 3 170 (59) 12 (6%) 1 (2%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 3 170 (59) 12 (6%) 1 (2%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 4 159 (54) 29 (15%) 6 (10%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 2 185 (58) 3 (2%) 2 (3%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 1 182 (60) 6 (3%) 0 (0%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 1 182 (60) 6 (3%) 0 (0%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 4 7 55 104 0.07 [ 0.02, 0.16 ] 0.94 [ 0.87, 0.97 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 4 7 55 104 0.07 [ 0.02, 0.16 ] 0.94 [ 0.87, 0.97 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Application 4 159 (54) 29 (15%) 6 (10%)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“SkinVision 144 (26) 31 (18%) Not reported (≤ 14)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A D D I T I O N A L T A B L E S
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Wolf 2013 32 43 27 68 0.54 [ 0.41, 0.67 ] 0.61 [ 0.52, 0.70 ]”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Tests. Data tables by test
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“At least one author (JDi or NC) screened titles and abstracts, discussing and resolving any queries by consensus.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A pilot screen of 539 MEDLINE references showed good agreement (89% with a kappa of 0.77) between screeners.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Exclusions due to test f ailures were not reported (1/ 2) or their f inal diagnoses were not described (2/ 2)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We have checked the reference lists of all included papers, and subject experts within the author team reviewed the final list of included studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We did not perform electronic citation searching.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The photographs used were taken by doctors rather than by smartphone users, which seriously impacts the applicability of results.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Who do the results of this review apply to?
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The prevalence of melanoma in the included studies is much higher than that observed in community settings.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The final diagnosis of melanoma was made by histology, which is likely to have been a reliable method for deciding whether patients really had melanoma*.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > How reliable are the results of the studies of this review?
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We have screened relevant systematic reviews identified by the searches for their included primary studies, and we included any missed by our searches.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Searching other resources
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Test interpretation was blinded to ref erence standard and pre-specif ied f or artif icial intelligence-based diagnosis (2/ 2).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Tim ing of index and ref erence standards not reported.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Store-and-forward image applications could have a potential role in the timely identification of people with potentially malignant lesions by facilitating early engagement of those with suspicious skin lesions, but they have resource and workload implications.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > What are the implications of this review?
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“No additional limits were used.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The search strategy was designed to capture studies evaluating tests for the diagnosis or staging of skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Both a clinical reviewer (from a team of 12 clinician reviewers) and a methodologist reviewer (JDi or NC) applied inclusion criteria (Appendix 4) to all full text articles, resolving disagreements by consensus or by consultation with a third party (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Selection of studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One clinical (as detailed above) and one methodological reviewer (JDi, NC or LFR) independently extracted data concerning details of the study design, participants, index test(s) or test combinations and criteria for index test positivity, reference standards, and data required to populate a 2 × 2 diagnostic contingency table for each index test using a piloted data extraction form.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Data extraction and management
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The Information Specialist (SB) carried out a comprehensive search for published and unpublished studies.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We resolved disagreements by consensus or in consultation with a third party (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Data extraction and management
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We applied no date limits.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Search methods for identification of studies Electronic searches
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For each analysis, we included only one dataset per study to avoid multiple counting of lesions.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These participants would have already presented to a doctor with concerns about a particular lesion and therefore are likely represent a more severe spectrum of abnormality, which will artificially increase the sensitivity of the test in comparison to use by smartphone users in general.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We assessed both studies as being at low risk of bias in the index test domain, with the artificial intelligence-based assessment made without knowledge of the histological diagnosis.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The strengths of this review include an in-depth and comprehensive electronic literature search, systematic review methods including double extraction of papers by both clinicians and methodologists, and contact with authors to allow study inclusion or clarify data.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One clinical and one methodological reviewer (JDi, NC or LFR) independently assessed quality for the remaining studies, resolving any disagreement by consensus or in consultation with a third party where necessary (JDe, CD, HW or RM).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All studies reported the use of an acceptable reference standard; however, Maier 2015 did not report blinding of histology to the index test result.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One study did not report blinding of the reference standard to the lesion images, and one did not mention interpretation by an experienced histopathologist.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies were blinded for index test interpretation and used pre-specified test thresholds and adequate reference standards.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although there is a theoretical possibility of correlations of test errors when multiple lesions are included from the same patients, most studies include very few patients with multiple lesions, and any potential impact on findings is likely to be very small, particularly in comparison with other concerns regarding risk of bias and applicability.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We examined heterogeneity between studies by visually inspecting the forest plots of sensitivity and specificity and summary receiver operating characteristics (ROC) plots.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Investigations of heterogeneity
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The main concerns for the review are the clinical applicability of the findings and exclusion of unevaluable test results, with likely overestimation of sensitivity.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“as initial treatment in skin cancer is directed to the lesion and not systemically to a patient”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Statistical analysis and data synthesis
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With a prevalence of melanoma ranging between 18% and 37% for these evaluations, the number of melanomas missed was between 7 and 55.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > D I S C U S S I O N Summary of main results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, both studies caused high concern about applicability of the index tests, which were not used as intended in practice.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We did not perform any sensitivity analyses.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Sensitivity analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All had a pre-specified threshold.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We piloted the modified QUADAS-2 tool on five full-text articles.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is not a representative spectrum of lesions that would be observed in daily life but rather a highly selected sample of participants.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One study also excluded equivocal lesions and those with moderate or high-grade atypia, both of which could potentially be more likely to produce unevaluable results or be misclassified by the application.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Applicability of findings to the review question
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“We assessed risk of bias and applicability of included studies using the QUADAS-2 checklist (Whiting 2011), tailored to the topic of skin cancer diagnosis (see Appendix 5).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of methodological quality
What the sources say
- Not checked yetcites Whiting 2011 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, both studies caused high concern regarding included participants and setting, due to un-clear reporting of patient samples and whether they included multiple lesions per patient.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Methodological quality of included studies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Due to uncertainty about the determinants of publication bias for diagnostic accuracy studies and the inadequacy of tests for detecting funnel plot asymmetry (Deeks 2005), we did not perform any tests to detect publication bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Assessment of reporting bias
What the sources say
- Not checked yetcites Deeks 2005 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We planned a clear analysis structure to allow estimation of test accuracy in different study populations and undertook a detailed and replicable analysis of methodologic quality.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Strengths and weaknesses of the review
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluded participants: 202/390 lesion images excluded due to poor image quality, containing identifiable patient information or features, or lacking sufficient clinical or histological information.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“used cross-validation approaches such as 'leave-one-out' cross-validation (Efron 1983);”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Efron 1983 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“however, studies using previously acquired images could be particularly susceptible to information bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > For diagnostic studies
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“In terms of exclusions, we considered studies that excluded particular lesion types (e.g.lentigo maligna), particular lesion sites, or other lesions on the basis of image quality or lack of observer agreement (e.g. on histopathology) to be at high risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Whiting 2011 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that separately sampled malignant and benign lesions to have used a case-control design; and those that supplemented a series of suspicious lesions with additional malignant or benign lesions to be at unclear risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Were all patients included in the analysis?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Available data have limited applicability in practice due to selective participant recruitment from secondary referral settings and the use of images not acquired by the intended users of the smartphone applications (i.e.members of the public).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Smartphone applications for skin lesion triage are intended to be used by members of the public in a community setting.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For the same reason, we could not investigate heterogeneity or perform sensitivity analyses.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For prospective studies and retrospective studies that used the original index test interpretation, the diagnosis will by nature be interpreted and recorded before the result of the reference standard is known;”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluded participants: 20 lesions (10%) excluded due to poor image quality (significant amount of hair, lesion out of focus or multiple lesions in the focus).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Study results can only be reproduced if the diagnostic threshold is described in sufficient detail.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > PARTICIPANT SELECTION (1) -CONCERNS REGARDING APPLICABILITY
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smartphone applications using artificial intelligence-based analysis have not yet demonstrated sufficient promise in terms of accuracy, and they are associated with a high likelihood of missing melanomas.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“In judging the applicability of patient populations to the review question, we considered restriction to particular lesion populations, such as melanocytic, nodular, high risk or restrictions by size to be of high concern for applicability.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
What the sources say
- Not checked yetcites Whiting 2011 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We included studies developing new mobile phone applications (i.e.derivation studies) if they used a separate independent 'test set' of participants or images to evaluate the new approach.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We planned to supplement the database searches by searching the annual meetings of appropriate organisations (e.g.British Association of Dermatologists Annual Meeting, American Academy of Dermatology Annual Meeting, European Academy of Dermatology and Venereology Meeting, Society for Melanoma Research Congress, World Congress of Dermatology, European Association of Dermato Oncology)”
- Also stated in: § Acknowledgements · plain
“however, due to the volume of evidence retrieved from database searches and time restrictions we were unable to do this.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Acknowledgements · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“evaluated the accuracy of the presence or absence of individual lesion characteristics or morphological features, with no overall diagnosis of malignancy.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“An additional 31 were excluded as unevaluable (13 lesions (6%) based on two-point-differences and 18 (9%) tie cases with an equal number of results in different risk classes)”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedn = 18Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that separately sampled malignant and benign lesions to have used a case-control design; and those that supplemented a series of suspicious lesions with additional malignant or benign lesions to be at unclear risk of bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Was the test applied and interpreted in a clinically applicable manner?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of analysis, we could not restrict analysis to per patient data due to lack of data.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Acknowledgements
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“used a statistical model to produce a data-driven equation or algorithm based on multiple diagnostic features, with no separate test set;”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Were all patients included in the analysis?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We considered studies that include a high number of lesions in relation to the number of participants in the study to be less representative than studies conducted in a more general population of participants (i.e. if the difference between the number of included lesions and number of included participants is greater than 5%).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Applications based on store-and-forward images could have a potential role in the timely presentation of people with potentially malignant lesions by facilitating active self-management health practices and early engagement of those with suspicious skin lesions; however, there are resource and workload implications with a store-and-forward approach.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > A U T H O R S ' C O N C L U S I O N S Implications for practice
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Given that diagnosis of skin cancer is primarily lesion-based, there is the potential for study participants with multiple lesions to contribute disproportionately to estimates of test accuracy, especially if they are at particular risk of having skin cancer.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Was a case-control design avoided?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“studies available only as conference abstracts do not allow a comprehensive assessment of study methods or methodological quality.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“This interval was chosen based on a study showing that most false-negative melanomas will be diagnosed within three months of the initial negative index test, although a small number will be diagnosed up to 12 months subsequently (Altamura 2008).”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Flow and timing domain (4)
What the sources say
- Not checked yetcites Altamura 2008 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Did the study avoid inappropriate exclusions?No”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Characteristics of included studies [ordered by study ID]
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Given the potential for subjective differences in test interpretation for melanoma, the interpretation of the index test blinded to the result of the reference standard is a key means of reducing bias.”
§ Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma (Review) > Additional information
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
The prevalence of melanoma in the included studies is much higher than that observed in community settings.
“The percentage of people with a final diagnosis of melanoma was 18% and 35%, much higher than that observed in community settings.”
The paper relies on this without support.
Smartphone applications for skin lesion triage are intended to be used by members of the public in a community setting.
“rather than the community setting where these applications are intended to be used”
“the intended users of the smartphone applications (i.e.members of the public)”
The authors state this as an assumption.
The review assumes that the 'two-point differences cases' excluded in Maier 2015 are lesions whose results fall in non-consecutive risk classes.
“we assume this to mean lesions with results in non-consecutive risk classes, e.g. 1 high risk and 2 low risk”
The authors state this as an assumption.
The review assumes that the interval between the index test and the reference standard in Maier 2015 was less than one month.
“assume it is < 1 month as images of the lesions were taken prior to excision”
The paper relies on this without support.
In routine practice, the clinical diagnosis is included on pathology request forms and histopathologists use it to help interpret the pathology.
“It is normal practice for the clinical diagnosis (usually by visual inspection or dermoscopy) to be included on pathology request forms and for the histopathologist to use this diagnosis to help with the pathology interpretation.”
The paper relies on this without support.
Blinded reading of the histopathology reference standard is not standard practice.
“blinded interpretation of the histopathology reference standard is not normal practice”
“histopathology interpretation is usually conducted with knowledge of the clinical diagnosis (from visual inspection or dermoscopy or both).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A Cochrane review of only two studies that tried to validate algorithm based skin apps suggested that there is a high chance of skin cancers being missed”
From Algorithm based smartphone apps to assess risk of skin cancer in adults: systematic review of diagnostic accuracy studies (2020) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Figure 8 gives the dermatologist test the wrong decision threshold
MinorThe Figure 8 caption labels the face-to-face diagnosis as high risk versus medium/low risk, but the data table identifies its decision as melanoma versus not melanoma.
“7 Face-to-face clinical diagnosis [high risk vs medium/low risk].”
“Test 7. Face-to-face dermatologist diagnosis [decision: melanoma vs not melanoma].”
Maier melanoma count changes from 40 to 60
MinorThe table footnote says the original Maier sample of 195 lesions contained 60 melanomas, whereas the study characteristics give 40 melanomas for that same sample.
“The original sample of 195 lesions included 60 melanomas.”
“Histology (excision) -195 eligible lesions including 40 melanomas;”
Wolf exclusions are described as both common and uncommon lesions
MinorThe methodological-quality discussion says Wolf excluded common lesions, whereas the results section says it excluded uncommon lesions. Both passages also mention equivocal diagnoses, making the difference in lesion frequency explicit.
“Wolf 2013 excluded lesions that were common or with equivocal diagnoses.”
“The study excluded lesions that were uncommon or had an equivocal diagnosis”
Six Wolf lesions are unaccounted for in App 3 results
MinorThe table gives 188 Wolf lesions, but App 3 has 170 successfully assessed lesions and 12 unevaluable lesions, totaling only 182. The other six lesions are not accounted for in the reported App 3 flow.
Reported 188 · recomputed 182
“Wolf 2013 188 lesions (60 melanomas) a Application 1 182 (60) 6 (3%) 0 (0%) Application 2 185 (58) 3 (2%) 2 (3%) Application 3 170 (59) 12 (6%) 1 (2%)”
Citations
Cites
Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012
Ferlay, J., Soerjomataram, I., Dikshit, R., Eser, S., Mathers, C., Rebelo, M., Parkin, D. M., Forman, D., & Bray, F. (2015) · International Journal of Cancer · doi:10.1002/ijc.29210 · Cited by 28,766
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationSiegel, R. L., Miller, K. D., & Jemal, A. (2015) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21254 · Cited by 11,854
Final Version of 2009 AJCC Melanoma Staging and Classification
Balch, C. M., Gershenwald, J. E., Soong, S.-J., Thompson, J. F., Atkins, M. B., Byrd, D. R., Buzaid, A. C., Cochran, A. J., Coit, D. G., Ding, S., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2009.23.4799 · Cited by 4,653
STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Self-citationBalch, C. M., Soong, S., Gershenwald, J. E., Thompson, J. F., Reintgen, D. S., Cascinelli, N., Urist, M. M., McMasters, K. M., Ross, M. I., Kirkwood, J. M., et al. (2001) · Journal of Clinical Oncology · doi:10.1200/jco.2001.19.16.3622 · Cited by 2,383
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Boring, C. C., Squires, T. S., Tong, T., & Montgomery, S. (1994) · CA A Cancer Journal for Clinicians · doi:10.3322/canjclin.44.1.7 · Cited by 1,313
Meta-analysis of risk factors for cutaneous melanoma: II. Sun exposure
Gandini, S., Sera, F., Cattaruzza, M. S., Pasquini, P., Picconi, O., Boyle, P., & Melchi, C. F. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.016 · Cited by 1,266
Flagged first, then by citations
6 of the 88 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Braunmühl, 2015, Smartphone apps for skin cancer diagnosis? The Munich study, Kosmetische Medizin, 36, 152
- Australian Cancer Database, 2017, Melanoma of the skin for Australia (ICD10 C43)
- Ndegwa, 2010, Teledermatology services: rapid review of diagnostic, clinical management, and economic outcomes
Cited by
Sorted by citations
Artificial Intelligence in Medicine: Where Are We Now?
Kulkarni, S., Seneviratne, N., Baig, M. S., & Khan, A. H. A. (2019) · Academic Radiology · doi:10.1016/j.acra.2019.10.001 · Cited by 301
Freeman, K., Dinnes, J., Chuchu, N., Takwoingi, Y., Bayliss, S. E., Matin, R. N., Jain, A., Walter, F. M., Williams, H. C., & Deeks, J. J. (2020) · BMJ · doi:10.1136/bmj.m127 · Cited by 260
Self-citationDermoscopy, with and without visual inspection, for diagnosing melanoma in adults
Dinnes, J., Deeks, J. J., Chuchu, N., di Ruffano, L. F., Matin, R., Thomson, D. R., Wong, K. Y., Aldridge, R. B., Abbott, R. A., Fawzy, M., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011902.pub2 · Cited by 255
Self-citationPhillips, M. R., Marsden, H., Jaffe, W., Matin, R., Wali, G. N., Greenhalgh, J., McGrath, E., James, R., Ladoyanni, E., Bewley, A., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.13436 · Cited by 236
Self-citationArtificial Intelligence in Dermatology—Where We Are and the Way to the Future: A Review
Hogarty, D. T., Su, J. C., Phan, K. H., Attia, M., Hossny, M., Nahavandi, S., Lenane, P., Moloney, F. J., & Yazdabadi, A. (2019) · American Journal of Clinical Dermatology · doi:10.1007/s40257-019-00462-6 · Cited by 195
Teledermatology for diagnosing skin cancer in adults.
Chuchu, N., Dinnes, J., Takwoingi, Y., Matin, R. N., Bayliss, S. E., Davenport, C., Moreau, J. F., Bassett, O., Godfrey, K., O'Sullivan, C., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013193 · Cited by 175
Self-citationdi Ruffano, L. F., Takwoingi, Y., Dinnes, J., Chuchu, N., Bayliss, S. E., Davenport, C. F., Matin, R., Godfrey, K., O'Sullivan, C., Gulati, A., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013186 · Cited by 151
Self-citationMobile health technology: a novel tool in chronic disease management
Fan, K., & Zhao, Y. (2021) · Intelligent Medicine · doi:10.1016/j.imed.2021.06.003 · Cited by 150
Artificial Intelligence in Skin Cancer Diagnosis: A Reality Check
Brancaccio, G., Balato, A., Malvehy, J., Puig, S., Argenziano, G., & Kittler, H. (2023) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2023.10.004 · Cited by 143
Use of artificial intelligence in dermatology
De, A., Sarda, A., Gupta, S., & DAS, S. K. (2020) · Indian Journal of Dermatology · doi:10.4103/ijd.ijd_418_20 · Cited by 119
Advances in melanoma: epidemiology, diagnosis, and prognosis
Waseh, S., & Lee, J. B. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1268479 · Cited by 120
Jayakumar, S., Sounderajah, V., Normahani, P., Harling, L., Markar, S. R., Ashrafian, H., & Darzi, A. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00544-y · Cited by 110
Reflectance confocal microscopy for diagnosing cutaneous melanoma in adults
Dinnes, J., Deeks, J. J., Saleh, D. B., Chuchu, N., Bayliss, S. E., Patel, L., Davenport, C. F., Takwoingi, Y., Godfrey, K., Matin, R., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013190 · Cited by 102
Self-citationPangti, R., Mathur, J., Chouhan, V., Kumar, S. M., Rajput, L., Shah, S., Gupta, A., Dixit, A., Dholakia, D., Gupta, S., et al. (2020) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.16967 · Cited by 87
Dinnes, J., Deeks, J. J., Chuchu, N., Matin, R., Wong, K. Y., Aldridge, R. B., Durack, A., Gulati, A., Chan, S. A., Johnston, L., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011901.pub2 · Cited by 122
Self-citationArtificial Intelligence in the Detection of Skin Cancer.
Beltrami, E. J., Brown, A. C., Salmon, P., Leffell, D., Ko, J., & Grant-Kels, J. (2022) · Journal of American Academy of Dermatology · doi:10.1016/j.jaad.2022.08.028 · Cited by 65
Reflectance confocal microscopy for diagnosing keratinocyte skin cancers in adults
Dinnes, J., Deeks, J. J., Chuchu, N., Saleh, D. B., Bayliss, S. E., Takwoingi, Y., Davenport, C. F., Patel, L., Matin, R., O'Sullivan, C., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013191 · Cited by 78
Self-citationThe role of medical smartphone apps in clinical decision-support: A literature review
Watson, H. A., Tribe, R. M., & Shennan, A. H. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101707 · Cited by 78
Current State of Dermatology Mobile Applications With Artificial Intelligence Features
Wongvibulsin, S., Yan, M. J., Pahalyants, V., Murphy, W., Daneshjou, R., & Rotemberg, V. (2024) · JAMA Dermatology · doi:10.1001/jamadermatol.2024.0468 · Cited by 69
Deep learning for dermatologists: Part II. Current applications
Puri, P., Comfere, N. I., Drage, L. A., Shamim, H., Bezalel, S. A., Pittelkow, M. R., Davis, M. D. P., Wang, M., Mangold, A. R., Tollefson, M. M., et al. (2020) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2020.05.053 · Cited by 70
Jahn, A. S., Navarini, A. A., Cerminara, S. E., Kostner, L., Huber, S. M., Kunz, M., Maul, J., Dummer, R., Sommer, S., Neuner, A. D., et al. (2022) · Cancers · doi:10.3390/cancers14153829 · Cited by 62
Han, S. S., Moon, I. J., Kim, S. H., Na, J., Kim, M. S., Park, G., Park, I., Kim, K., Lim, W., Lee, J. H., et al. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003381 · Cited by 62
Development of Smartphone Apps for Skin Cancer Risk Assessment: Progress and Promise
de Carvalho, T. M., Noels, E., Wakkee, M., Udrea, A., & Nijsten, T. E. C. (2019) · JMIR Dermatology · doi:10.2196/13376 · Cited by 60
Accuracy of commercially available smartphone applications for the detection of melanoma
Sun, M., Kentley, J., Mehta, P. P., Dusza, S. W., Halpern, A. C., & Rotemberg, V. M. (2021) · British Journal of Dermatology · doi:10.1111/bjd.20903 · Cited by 44
Lucius, M., All, J. D., All, J. A. D., Belvisi, M., Radizza, L., Lanfranconi, M., Lorenzatti, V., & Galmarini, C. M. (2020) · Diagnostics · doi:10.3390/diagnostics10110969 · Cited by 43
Micocci, M., Borsci, S., Thakerar, V., Walne, S., Manshadi, Y., Edridge, F., Mullarkey, D., Buckle, P., & Hanna, G. B. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10143101 · Cited by 39
New diagnostic and imaging technologies in dermatology
Jartarkar, S. R., Patil, A. D., Wollina, U., Gold, M. H., Stege, H. M., Grabbe, S., & Goldust, M. (2021) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.14499 · Cited by 39
Nahm, W. J., Sohail, N., Burshtein, J. G., Goldust, M., & Tsoukas, M. M. (2025) · International Journal of Dermatology · doi:10.1111/ijd.17847 · Cited by 49
New AI-algorithms on smartphones to detect skin cancer in a clinical setting—A validation study
Kränke, T., Tripolt‐Droschl, K., Röd, L., Hofmann‐Wellenhof, R., Koppitz, M., & Tripolt, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280670 · Cited by 35
Situación actual de la prevención del cáncer de piel: una revisión sistemática
Alonso-Belmonte, C., Montero‐Vílchez, T., Arias‐Santiago, S., & Buendía‐Eisman, A. (2022) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2022.04.015 · Cited by 36
Zaar, O., Larson, A., Polesie, S., Saleh, K., Tarstedt, M., Olives, A., Suárez, A. L., Gillstedt, M., & Neittaanmäki, N. (2020) · Acta Dermato Venereologica · doi:10.2340/00015555-3624 · Cited by 30
Web-based study on Chinese dermatologists’ attitudes towards artificial intelligence
Shen, C., Li, C., Xu, F., Wang, Z., Shen, X., Gao, J., Ko, R., Jing, Y., Tang, X., Yu, R., et al. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2019.12.102 · Cited by 31
Unerwünschte Effekte digitaler Gesundheitstechnologien: Eine Public-Health-Perspektive
Schüz, B., & Urban, M. (2020) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-019-03088-5 · Cited by 28
Taylor, M., Liu, X., Denniston, A. K., Esteva, A., Ko, J., Daneshjou, R., & Chan, A. (2021) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2021.02.744 · Cited by 28
Legal and ethical considerations of artificial intelligence in skin cancer diagnosis
Jobson, D., Mar, V., & Freckelton, I. R. (2021) · Australasian Journal of Dermatology · doi:10.1111/ajd.13690 · Cited by 31
Bertucci, F., Corroller, A. L., Monneur, A., Moulin, J.-F., Fluzin, S., Maraninchi, D., & Gonçalvès, A. (2019) · Cancers · doi:10.3390/cancers11020219 · Cited by 27
Artificial intelligence in melanoma: A systematic review
Zhang, S., Wang, Y., Zheng, Q., Li, J., Huang, J., & Long, X. (2022) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.15323 · Cited by 30
Non-Melanoma Skin Cancer Detection in the Age of Advanced Technology: A Review
Stafford, H. D., Buell, J. B., Chiang, E., Ramesh, U. R., Migden, M. R., Nagarajan, P., Amit, M., & Yaniv, D. (2023) · Cancers · doi:10.3390/cancers15123094 · Cited by 31
Exfoliative cytology for diagnosing basal cell carcinoma and other skin cancers in adults
di Ruffano, L. F., Dinnes, J., Chuchu, N., Bayliss, S. E., Takwoingi, Y., Davenport, C. F., Matin, R., O'Sullivan, C., Roskell, D. E., Deeks, J. J., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013187 · Cited by 27
Self-citationRoles of artificial intelligence in wellness, healthy living, and healthy status sensing
Cho, P. J., Singh, K., & Dunn, J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821259-2.00009-0 · Cited by 23
Miller, I. J., Rosic, N. N., Stapelberg, M., Hudson, J., Coxon, P., Furness, J., Walsh, J., & Climstein, M. (2024) · Cancers · doi:10.3390/cancers16071443 · Cited by 23
Automatic Focus Assessment on Dermoscopic Images Acquired with Smartphones
Alves, J. E., Moreira, D., Alves, P., Rosado, L., & Vasconcelos, M. J. M. (2019) · Sensors · doi:10.3390/s19224957 · Cited by 22
Acceptance of Medical Artificial Intelligence in Skin Cancer Screening: Choice-Based Conjoint Survey
Jagemann, I., Wensing, O., Stegemann, M., & Hirschfeld, G. H. F. (2023) · JMIR Formative Research · doi:10.2196/46402 · Cited by 24
Artificial Intelligence in Skin Cancer
Reiter, O., Rotemberg, V. M., Köse, K., & Halpern, A. C. (2019) · Current Dermatology Reports · doi:10.1007/s13671-019-00267-0 · Cited by 21
Flament, F., Zhang, Y., Yu, Z., Jiang, R., Houghton, J., Duthil, L. S., Arcin, V., Daniel, R., Perrier, J., Niviere, J., et al. (2021) · Skin Research and Technology · doi:10.1111/srt.13061 · Cited by 21
Hewitt, R. M., Ploszajski, M., Purcell, C., Pattinson, R., Jones, B. E., Wren, G. H., Hughes, O., Ridd, M. J., Thompson, A. R., & Bundy, C. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1024879 · Cited by 26
Ackermann, D. M., Smit, A. K., Janda, M., van Kemenade, C. H., Dieng, M., Morton, R. L., Turner, R. M., Cust, A. E., Irwig, L., Hersch, J. K., et al. (2021) · Trials · doi:10.1186/s13063-021-05231-7 · Cited by 20
Bach, T. A., Kaarstad, M., Solberg, E. A., & Babić, A. (2025) · AI and Ethics · doi:10.1007/s43681-024-00648-7 · Cited by 19
The role of mobile teledermoscopy in skin cancer triage and management during the COVID-19 pandemic
Lee, C., Witkowski, A. M., Żychowska, M., & Łudzik, J. (2022) · Indian Journal of Dermatology Venereology and Leprology · doi:10.25259/ijdvl_118_2022 · Cited by 16
Chin, Y. P., Hou, Z. Y., Lee, M.-Y., Chu, H. M., Wang, H. H., Lin, Y. T., Gittin, A., Chien, S.-C., Nguyễn, P. A., Li, L. C., et al. (2020) · British Journal of Dermatology · doi:10.1111/bjd.18859 · Cited by 17
Use of mobile applications in dermatology
Kaliyadan, F., & Ashique, K. T. (2020) · Indian Journal of Dermatology · doi:10.4103/ijd.ijd_422_20 · Cited by 18
Camera-based optical palpation
Sanderson, R. W., Fang, Q., Curatolo, A., Adams, W., Lakhiani, D. D., Ismail, H. M., Foo, K. Y., Dessauvagie, B. F., Latham, B. I., Yeomans, C., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-72603-5 · Cited by 17
Künstliche Intelligenz und Smartphone-Programm-Applikationen (Apps)
Blum, A., Bosch, S., Haenssle, H. A., Fink, C., Hofmann‐Wellenhof, R., Zalaudek, I., Kittler, H., & Tschandl, P. (2020) · Der Hautarzt · doi:10.1007/s00105-020-04658-4 · Cited by 17
Mylle, S., Verhaeghe, E., Coile, L. V., de Maele, B. V., Hoorens, I., & Brochez, L. (2021) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.17129 · Cited by 15
Adelson, P. L., & Eckert, M. C. (2020) · Australian journal of advanced nursing · doi:10.37464/2020.372.74 · Cited by 15
[Translated article] Current State of Skin Cancer Prevention: A Systematic Review
Alonso-Belmonte, C., Montero‐Vílchez, T., Arias‐Santiago, S., & Buendía‐Eisman, A. (2022) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2022.04.018 · Cited by 16
Augmented and Virtual Reality in Dermatology—Where Do We Stand and What Comes Next?
Bonmarin, M., Läuchli, S., & Navarini, A. A. (2022) · Dermato · doi:10.3390/dermato2010001 · Cited by 13
Bouton, C., Schmeltz, H., Lévèque, C., Gaultier, A., Quereux, G., Dréno, B., Nguyen, J., & Rat, C. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11106-9 · Cited by 12
Medical Education for the 21st Century
Firstenberg, M. S., & Stawicki, S. P. (2021) · IntechOpen eBooks · doi:10.5772/intechopen.95701 · Cited by 13
Chin, Y. P., Huang, I., Hou, Z. Y., Chen, P., Bassir, F., Wang, H.-H., Lin, Y. T., & Li, Y. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105649 · Cited by 12
Cheng, S. Y., Li, Z., Zhang, W., Sun, Z., Fan, Z., Luo, J., & Liu, H. (2021) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2020.630790 · Cited by 12
Deep Convolutional Neural Networks on Automatic Classification for Skin Tumour Images
Simić, S., Simić, S. D., Banković, Z., Ivkov‐Simić, M., Villar, J. R., & Simić, D. (2021) · Logic Journal of IGPL · doi:10.1093/jigpal/jzab009 · Cited by 12
Leeflang, M., Davenport, C. F., & Bossuyt, P. M. (2023) · doi:10.1002/9781119756194.ch5 · Cited by 12
Self-citationTaber, P. A., Armin, J. S., Orozco, G., Fiol, G. D., Erdrich, J., Kawamoto, K., & Israni, S. T. (2023) · Current Oncology Reports · doi:10.1007/s11912-023-01376-7 · Cited by 11
Steeb, T., Wessely, A., French, L. E., Heppt, M. V., & Berking, C. (2019) · Acta Dermato Venereologica · doi:10.2340/00015555-3240 · Cited by 11
Ziętek, M., Nowacki, M. S., Wierzbicki, J., Matkowski, R., Maciejczyk, A., Czajkowski, R., & Pawlak, E. (2022) · Advances in Dermatology and Allergology · doi:10.5114/ada.2022.113605 · Cited by 10
Dubuc, A., Zitouni, A., Thomas, C., Kémoun, P., Cousty, S., Monsarrat, P., & Laurencin‐Dalicieux, S. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11216596 · Cited by 9
Artificial intelligence in dermatology
Abraham, A., Sobhanakumari, K., & Mohan, A. (2020) · Journal of Skin and Sexually Transmitted Diseases · doi:10.25259/jsstd_49_2020 · Cited by 11
Allanson, E., Phoolcharoen, N., Salcedo, M. P., Fellman, B. M., & Schmeler, K. M. (2021) · JCO Global Oncology · doi:10.1200/go.21.00168 · Cited by 11
Screening and novel diagnostic technologies for melanoma: an update
Hwang, J. C., Peacker, B. L., & Hartman, R. I. (2025) · Melanoma Management · doi:10.1080/20450885.2025.2536999 · Cited by 8
Puri, P., Yiannias, J. A., Mangold, A. R., Swanson, D. C., & Pittelkow, M. R. (2020) · JAAD International · doi:10.1016/j.jdin.2020.09.004 · Cited by 8
Deep Learning-Powered Mobile Application For Early Skin Cancer Detection
Afifi, S. M., Kaur, R., GholamHosseini, H., Azzam, O., & Taha, R. (2024) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi63661.2024.10851700 · Cited by 7
Adherence to Primary Prevention and Skin Self-Examination Practices by Spanish Melanoma Patients
Torrecilla-Martínez, I., Manrique‐Silva, E., Traves, V., Requena, C., & Nagore, E. (2021) · Dermatology · doi:10.1159/000512887 · Cited by 7
The future of artificial intelligence in healthcare
Radakovich, N., & Nazha, A. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820273-9.00016-6 · Cited by 7
Habgood, E., McCormack, C. J., Walter, F. M., & Emery, J. D. (2021) · JMIR Dermatology · doi:10.2196/22583 · Cited by 6
Self-citationYazdanparast, T., Shamsipour, M., Ayatollahi, A., Delavar, S., Ahmadi, M., Samadi, A., & Firooz, A. (2024) · Indian Journal of Dermatology · doi:10.4103/ijd.ijd_61_24 · Cited by 6
Artificial Intelligence in Gynaecology Oncology
Sawan, S., Eftekhari, N., Linton‐Reid, K., Wood, N., Numan, T. A., Aboagye, E. O., & Angione, C. (2025) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.70005 · Cited by 13
Congdon, N. M., & Davis, C. M. (2023) · Skin Health and Disease · doi:10.1002/ski2.295 · Cited by 6
Gellatly, Z. S., Lagha, I. B., Ternov, N. K., Berry, E., Nelson, K. C., & Seiverling, E. V. (2023) · Current Dermatology Reports · doi:10.1007/s13671-023-00407-7 · Cited by 6
Wagner, S., & Serve, H. L. (2019) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/a-0740-8480 · Cited by 6
Lehner, G. M., Gockeln, L., Naber, B. M., Thamm, J. R., Schuh, S., Duttler, G., Rottenkolber, A., Hartmann, D., Krämer, F., & Welzel, J. (2024) · Skin Research and Technology · doi:10.1111/srt.13632 · Cited by 4
Oyedeji, M. O. (2024) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-024-00478-x · Cited by 5
Mobile Apps for Helping Patient-Users: Is It Still Far-Fetched?
Siristatidis, C. S., Pouliakis, A., Karageorgiou, V., & Vogiatzi, P. (2019) · Sustainability · doi:10.3390/su12010106 · Cited by 7
Beutter, C. N. L., Zeller, K., Martens, U. M., Pfleiderer, B., & Fegeler, C. (2023) · JMIR Cancer · doi:10.2196/44985 · Cited by 5
Malvehy, J., Dréno, B., Barba, E., Dirschka, T., Fumero, E., Greis, C., Gupta, G., Lacarrubba, F., Micali, G., Moreno, D., et al. (2023) · Dermatology Practical & Conceptual · doi:10.5826/dpc.1303a181 · Cited by 5
Khatun, N., Spinelli, G., & Colecchia, F. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1394386 · Cited by 6
COVID ‐19: An opportunity to build dermatology's digital future
Puri, P., Comfere, N. I., Pittelkow, M. R., Bezalel, S. A., & Murphree, D. H. (2020) · Dermatologic Therapy · doi:10.1111/dth.14149 · Cited by 4
Artificial intelligence in medicine creates real risk management and litigation issues
Keris, M. P. (2020) · Journal of Healthcare Risk Management · doi:10.1002/jhrm.21445 · Cited by 6
DiaMole: Mole Detection and Segmentation Software for Mobile Phone Skin Images
Liu, S., Chen, Z., Zhou, H., He, K., Duan, M., Zheng, Q., Xiong, P., Huang, L., Yu, Q., Su, G., et al. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/6698176 · Cited by 3
AI on Oral Mucosal Lesion Detection
Keser, G., Pekiner, F. N., & Orhan, K. (2023) · Springer eBooks · doi:10.1007/978-3-031-43827-1_9 · Cited by 3
Gençoğlu, Ş. (2024) · Journal of Health Sciences and Medicine · doi:10.32322/jhsm.1358284 · Cited by 3
Pigmented Lesion Assay for Suspected Melanoma Lesions: A Health Technology Assessment.
(2021) · PubMed Central · Cited by 3
Artificial intelligence in solving dermatological problems
Shpudeiko, V., Sokolov, K., & Sidaruk, H. (2022) · Dermatology Review · doi:10.5114/dr.2022.125685 · Cited by 3
Digital Technology for Person-Centered Care
Glare, P. A., Liliana, L. D. S., Kirisci, L., & Ashton-James, C. E. (2023) · Springer eBooks · doi:10.1007/978-3-031-17650-0_15 · Cited by 3
Dermatologic Follow-up and Assessment of Suspicious Lesions
Iacullo, J., Barriera‐Silvestrini, P., & Knackstedt, T. (2021) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2021.05.006 · Cited by 2
Further evaluation is required for smartphone-aided diagnosis of skin cancer
Walter, F. M., & Emery, J. D. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30021-2 · Cited by 2
Self-citationCell Phone Selfies: Clinching the Diagnosis of Iris Microhemangiomatosis
Price, K. W., Gorham, J. P., & Wells, J. R. (2021) · Ocular Oncology and Pathology · doi:10.1159/000512343 · Cited by 2
Cazzaniga, S., Ponti, L. D., Baratelli, G. M., Francione, S., Vecchia, C. L., Landro, A. D., Carugno, A., Mercurio, M. D., Germi, L., Trevisan, G., et al. (2022) · Dermatology Reports · doi:10.4081/dr.2022.9500 · Cited by 2
Slit lamp polarized dermoscopy: a cost-effective tool to assess eyelid lesions
Leonardo, F. H. L., Osaki, M. H., Biazim, D. F., Leonardo, Y. M. O., & Osaki, T. H. (2022) · International Ophthalmology · doi:10.1007/s10792-022-02505-0 · Cited by 2
O uso de inteligência artificial na interpretação de exames médicos
Braga, T. M., Soares, L. M., Ferreira, A. C. G., de Siqueira, A. C. F. L., Held, J. M. V. D. M. W., da Gama, M. E. C. N., Frizon, A. B., Ribeiro, R. B., de Medeiros, G. L. P., & Silvestri, L. M. (2024) · Brazilian Journal of Health Review · doi:10.34119/bjhrv7n3-507 · Cited by 1
Metadata
- Authors
- Chuchu, N., Takwoingi, Y., Dinnes, J., Matin, R. N., Bassett, O., Moreau, J. F., Bayliss, S. E., Davenport, C., Godfrey, K., O'Connell, S., Jain, A., Walter, F. M., Deeks, J. J., Williams, H. C., & Cochrane Skin Cancer Diagnostic Test Accuracy Group
- Affiliations
- University of Birmingham (GB)
- University Hospitals Birmingham NHS Foundation Trust (GB)
- Churchill Hospital (GB)
- Addenbrooke's Hospital (GB)
- University of Pittsburgh Medical Center (US)
- University of Nottingham (GB)
- Cardiff and Vale University Health Board (GB)
- Imperial College Healthcare NHS Trust (GB)
- University of Cambridge (GB)
- Corresponding author
- Dinnes, Jacqueline
- ORCID
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2018-12-04
- Volume
- 2018
- Issue
- 12
- Pages
- CD013192-CD013192
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- PMC
- PMC6517294
- OpenAlex
- W2886914906
- Semantic Scholar
- c82c23917430d434cb08deb9f9339bc64340303d
- Cited by
- 144
- References
- 88
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 16 · 2023: 18 · 2022: 18 · 2021: 29 · 2020: 26 · 2019: 15 · 2018: 7
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cochrane Database of Systematic Reviews (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Nottingham ePrints (University of Nottingham) (submittedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, other-oa)
- Funders
- Melanoma Research Alliance
- National Institute for Health and Care Research (13/89/15, NIHR-CS-012-030)
- British Association of Dermatologists
- Topics
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Cell Biology › melanin and skin pigmentation
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Keywords
- melanoma, mobile application, mobile health, skin lesions, artificial intelligence, diagnostic accuracy, sensitivity and specificity, early detection of skin cancer, image classification, histopathological confirmation, delayed diagnosis, quality of evidence, risk of bias, applicability, cost-effectiveness
- MeSH terms
- Smartphone, Cutaneous Malignant Melanoma, Adult, Algorithms, Diagnostic Errors, Humans, Melanoma, Sensitivity and Specificity, Skin Neoplasms, Triage, Early Detection of Cancer, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review