Cited by 18Mobile Health and mHealth ApplicationsOvarian function and disordersArtificial Intelligence in Healthcare

Identifying Women at Risk for Polycystic Ovary Syndrome Using a Mobile Health App: Virtual Tool Functionality Assessment

Open access
Rodriguez, Erika Marie, Thomas, Daniel, Druet, Anna, Vlajic-Wheeler, Marija, Lane, Kevin James, Mahalingaiah, Shruthi·2020·JMIR Formative Research

Published version of a preprint

Abstract

Background: Polycystic ovary syndrome (PCOS) is an endocrine disrupting disorder affecting about 10% of reproductive-aged women. PCOS diagnosis may be delayed several years and may require multiple physicians, resulting in lost time for risk-reducing interventions. Menstrual tracking apps are a potential tool to alert women of their risk while also prompting evaluation from a medical professional. Objective: The primary objective of this study was to develop and pilot test the irregular cycle feature, a predictive model that generated a PCOS risk score, in the menstrual tracking app, Clue. The secondary objectives were to run the model using virtual test subjects, create a quantitative risk score, compare the feature’s risk score with that of a physician, and determine the sensitivity and specificity of the model before empirical testing on human subjects. Methods: A literature review was conducted to generate a list of signs and symptoms of PCOS, termed variables. Variables were then assigned a probability and built into a Bayesian network. Questions were created based on these variables. A total of 9 virtual test subjects were identified using self-reported menstrual cycles and answers to the feature’s questions. Upon completion of the questionnaire, a Result Screen and Doctor’s Report summarizing the probability of having PCOS was displayed. This provided information about PCOS and data to facilitate diagnosis by a medical professional. To assess the accuracy of the feature, the same set of 9 virtual test subjects was assigned probabilities by the feature and the physician, who served as the gold standard. The feature recommended individuals with a score greater than or equal to 25% to follow-up with a physician. Differences between the feature and physician scores were evaluated using a t test and a Pearson correlation coefficient in 8 of the 9 virtual test subjects. A second iteration was conducted to assess the feature’s probability capabilities. Results: The irregular cycle feature’s first iteration produced 1 false-positive compared with the physician score and had an absolute mean difference of 15.5% (SD 15.1%) among the virtual test subjects. The second iteration had 2 false positives compared with the physician score and had an absolute mean difference of 18.8% (SD 13.6%). The feature overpredicted the virtual test subjects’ risk of PCOS compared with the physician. However, a significant positive correlation existed between the feature and physician score (Pearson correlation coefficient=0.82; P=.01). The second iteration performed worse, with a Pearson correlation coefficient of 0.73 (P=.03). Conclusions: The first iteration of the feature outperformed the second and better predicted the probability of PCOS. Although further research is needed with a more robust sample size, this pilot study indicates the potential value for developing a screening tool to prompt high-risk subjects to seek evaluation by a medical professional.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/15094

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Nine included studies mention the use of machine learning.

    “Nine included studies mention the use of machine learning [63,64,65,66,67,76,87,88,89] (Supplementary File S3).”

    From Polycystic Ovary Syndrome and the Internet of Things: A Scoping Review (2024) · cites this paper as [67]

    The Methods (Creating the Framework; page unavailable) describe a Bayesian-network model used to generate PCOS risk scores, supporting this paper’s inclusion as a study of an algorithmic prediction tool. They say the network’s probabilities were manually encoded, however, and our copy does not explicitly mention machine learning. This source also cannot establish the citing paper’s count of nine included studies. (LLM, conf=0.81)

    Experimental — accuracy not yet measured
  • One study developed a prediction model capable of generating a PCOS risk score and tested it by analyzing data from the irregular cycle feature of the app Clue, with the model showing a higher probability of prediction when compared to assessment by a clinician.

    “One study developed a prediction model capable of generating a PCOS risk score and tested it by analyzing data from the irregular cycle feature of the app Clue, with the model showing a higher probability of prediction when compared to assessment by a clinician [67].”

    From Polycystic Ovary Syndrome and the Internet of Things: A Scoping Review (2024) · cites this paper as [67]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • The majority of machine learning studies originated from India (n = 5), while three originated from the USA, and one from New Zealand.

    “The majority of these studies originated from India (n = 5) [63,64,65,66,88], while three originated from the USA (n = 3) [67,87,89], and one from New Zealand [76].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Rodriguez, E. M., Thomas, D., Druet, A., Vlajic-Wheeler, M., Lane, K. J., & Mahalingaiah, S.
Affiliations
Boston University (US)
Corresponding author
Mahalingaiah, Shruthi
Venue
JMIR Formative Research
Published
2020-05-14
Volume
4
Issue
5
Pages
e15094
ISSN
2561-326X (ISSN-L)
OpenAlex
W3012954192
Cited by
18
References
20
Citations by year
2026: 2 · 2025: 5 · 2024: 4 · 2023: 7
FWCI
1.83
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • OpenBU (Boston University) (submittedVersion)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Medicine › Reproductive Medicine › Ovarian function and disorders
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
polycystic ovary syndrome, menstrual tracking apps, clues, mobile health, Bayesian networks, menstrual irregularity, PCOS symptoms, physician comparison, risk score, delayed diagnosis, women's health technology, sensitivity and specificity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review