Development of the Initial Surveys for the All of Us Research Program
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Background: The All of Us Research Program is building a national longitudinal cohort and collecting data from multiple information sources (e.g., biospecimens, electronic health records, and mobile/wearable technologies) to advance precision medicine. Participant-provided information, collected via surveys, will complement and augment these information sources. We report the process used to develop and refine the initial three surveys for this program. Methods: The All of Us survey development process included: (1) prioritization of domains for scientific needs, (2) examination of existing validated instruments, (3) content creation, (4) evaluation and refinement via cognitive interviews and online testing, (5) content review by key stakeholders, and (6) launch in the All of Us electronic participant portal. All content was translated into Spanish. Results: We conducted cognitive interviews in English and Spanish with 169 participants, and 573 individuals completed online testing. Feedback led to over 40 item content changes. Lessons learned included: (1) validated survey instruments performed well in diverse populations reflective of All of Us; (2) parallel evaluation of multiple languages can ensure optimal survey deployment; (3) recruitment challenges in diverse populations required multiple strategies; and (4) key stakeholders improved integration of surveys into larger Program context. Conclusions: This efficient, iterative process led to successful testing, refinement, and launch of three All of Us surveys. Reuse of All of Us surveys, available at http://researchallofus.org, may facilitate large consortia targeting diverse populations in English and Spanish to capture participant-provided information to supplement other data, such as genetic, physical measurements, or data from electronic health records.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Self-citationMining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680 · cited 1×
“Research has also demonstrated the power of routine clinical information extracted from the electronic health record (EHR); others are also exploring the utility of newer modalities such as wearable biosensors and environmental data 11–23 .”
BackgroundResearch synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615
Big Data In Health Care: Using Analytics To Identify And Manage High-Risk And High-Cost Patients
Bates, D. W., Saria, S., Ohno-Machado, L., Shah, A., & Escobar, G. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0041 · Cited by 1,235
Barriers to recruiting underrepresented populations to cancer clinical trials: a systematic review
Ford, J. G., Howerton, M. W., Lai, G. Y., Gary, T. L., Bolen, S., Gibbons, M. C., Tilburt, J., Baffi, C., Tanpitukpongse, T. P., Wilson, R. F., et al. (2008) · Cancer · doi:10.1002/cncr.23157 · Cited by 1,083
Million Veteran Program: A mega-biobank to study genetic influences on health and disease
Gaziano, J. M., Concato, J., Brophy, M., Fiore, L., Pyarajan, S., Breeling, J., Whitbourne, S., Deen, J., Shannon, C., Humphries, D., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.016 · Cited by 1,055
Next-generation phenotyping of electronic health records
Hripcsak, G., & Albers, D. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001145 · Cited by 795
Baig, M. M., GholamHosseini, H., Moqeem, A. A., Mirza, F., & Lindén, M. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0760-1 · Cited by 351 · cited 1×
“Sexual and/or gender minorities 5 (7) 23 (7) 14 (15) 40 (17)”
Johansson, D., Malmgren, K., & Alt Murphy, M. (2018) · Journal of Neurology · doi:10.1007/s00415-018-8786-y · Cited by 188 · cited 1×
“Individuals with 3 or more chronic conditions 13 (18) 99 (29) 11 (12) 45 (19)”
Ambient Sensors for Elderly Care and Independent Living: A Survey
Uddin, M. Z., Khaksar, W., & Torresen, J. (2018) · Sensors · doi:10.3390/s18072027 · Cited by 166
Cited by
The “All of Us” Research Program
The All of Us Research Program Investigators (2019) · New England Journal of Medicine · doi:10.1056/nejmsr1809937 · Cited by 2,440
The “All of Us” Research Program
(2019) · New England Journal of Medicine · doi:10.1056/nejmc1912496 · Cited by 843
Batty, G. D., Gale, C. R., Kivimäki, M., Deary, I. J., & Bell, S. (2020) · BMJ · doi:10.1136/bmj.m131 · Cited by 635
The All of Us Research Program: Data quality, utility, and diversity
Ramirez, A. H., Sulieman, L., Schlueter, D. J., Halvorson, A., Qian, J., Ratsimbazafy, F., Loperena, R., Mayo, K., Basford, M., Deflaux, N., et al. (2022) · Patterns · doi:10.1016/j.patter.2022.100570 · Cited by 352
Self-citationDiversity and inclusion for the All of Us research program: A scoping review
Mapes, B. M., Foster, C. S., Kusnoor, S. V., Epelbaum, M. I., AuYoung, M., Jenkins, G., Lopez-Class, M., Richardson-Heron, D., Elmi, A., Surkan, K., et al. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234962 · Cited by 273
“[13] Researchers interested in studying specific subsets of these groups (for example, individuals < 3 or >80), are able to do so based on the way in which these demographic data have been collected.”
BackgroundSelf-citation
Metadata
- Authors
- Cronin, R. M., Jerome, R. N., Mapes, B., Andrade, R., Johnston, R., Ayala, J., Schlundt, D., Bonnet, K., Kripalani, S., Goggins, K., Wallston, K. A., Couper, M. P., Elliott, M. R., Harris, P., Begale, M., Munoz, F., Lopez-Class, M., Cella, D., Condon, D., AuYoung, M., Mazor, K. M., Mikita, S., Manganiello, M., Borselli, N., Fowler, S., Rutter, J. L., Denny, J. C., Karlson, E. W., Ahmedani, B. K., & O’Donnell, C. J.
- Venue
- Epidemiology
- Published
- 2019-07
- Volume
- 30
- Issue
- 4
- Pages
- 597-608
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2942504851
- Cited by
- 82
- References
- 10
- FWCI
- 8.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development of the Initial Surveys for the All of Us Research Program. https://app.cochat.ai/papers/10.1097/ede.0000000000001028
- The paper
- Cronin, R. M., Jerome, R. N., Mapes, B., Andrade, R., Johnston, R., Ayala, J., Schlundt, D., Bonnet, K., Kripalani, S., Goggins, K., Wallston, K. A., Couper, M. P., Elliott, M. R., Harris, P., Begale, M., Munoz, F., Lopez-Class, M., Cella, D., Condon, D., . . . O’Donnell, C. J. (2019). Development of the Initial Surveys for the All of Us Research Program. Epidemiology. https://doi.org/10.1097/ede.0000000000001028
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.