The development of a clinical outcomes survey research application: Assessment CenterSM
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
IntroductionThe National Institutes of Health sponsored Patient-Reported Outcome Measurement Information System (PROMIS) aimed to create item banks and computerized adaptive tests (CATs) across multiple domains for individuals with a range of chronic diseases.PurposeWeb-based software was created to enable a researcher to create study-specific Websites that could administer PROMIS CATs and other instruments to research participants or clinical samples. This paper outlines the process used to develop a user-friendly, free, Web-based resource (Assessment CenterSM) for storage, retrieval, organization, sharing, and administration of patient-reported outcomes (PRO) instruments.MethodsJoint Application Design (JAD) sessions were conducted with representatives from numerous institutions in order to supply a general wish list of features. Use Cases were then written to ensure that end user expectations matched programmer specifications. Program development included daily programmer “scrum” sessions, weekly Usability Acceptability Testing (UAT) and continuous Quality Assurance (QA) activities pre- and post-release.ResultsAssessment Center includes features that promote instrument development including item histories, data management, and storage of statistical analysis results.ConclusionsThis case study of software development highlights the collection and incorporation of user input throughout the development process. Potential future applications of Assessment Center in clinical research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Self-citationCella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · cited 1×
“org) aimed to leverage advances in modern psychometric theory to develop item banks and a computerized adaptive testing (CAT) system that would allow for the precise and efficient measurement of patient-reported outcomes (PROs) in clinical research across a wide range of chronic diseases [2].”
Self-citationElectronic health records in ambulatory care—a national survey of physicians
DesRoches, C. M., Campbell, E. G., Rao, S. R., Donelan, K., Ferris, T. G., Jha, A., Kaushal, R., Levy, D. E., Rosenbaum, S., Shields, A. E., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0802005 · Cited by 1,111 · cited 1×
“With appropriate safeguards and patient protections, respondent data from clinical practice sites could provide a rich repository of data for clinical research [29, 30].”
Zerhouni, E. (2003) · Science · doi:10.1126/science.1091867 · Cited by 918
NIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895
Self-citationEvaluation of Item Candidates: The PROMIS Qualitative Item Review
DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007) · Medical Care · doi:10.1097/01.mlr.0000254567.79743.e2 · Cited by 719 · cited 1×
“Items identified from established questionnaires or written for PROMIS by experts were subjected to rigorous qualitative review [ 3 ] and were tested in a large, diverse sample from the general population and with clinical patients [4].”
Garcia, S. F., Cella, D., Clauser, S. B., Flynn, K. E., Lad, T., Lai, J.-S., Reeve, B. B., Wilder Smith, A., Stone, A. A., & Weinfurt, K. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.2341 · Cited by 407
Cited by
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132
“…item banks (Buysse et al., 2010; Cella et al., 2010; Fries et al., 2009; Revicki et al., 2009), algorithms and an electronic testing platform for computerized adaptive tests (Gershon et al., 2010), and static short forms (for more information, see www.nihpromis.org and www.assessmentcenter.net).”
MethodSelf-citationGershon, R. C., Lai, J. S., Bode, R., Choi, S., Moy, C., Bleck, T., Miller, D., Peterman, A., & Cella, D. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9958-8 · Cited by 361
Self-citationSnyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1d84 · Cited by 258
Bringing PROMIS to practice: Brief and precise symptom screening in ambulatory cancer care
Wagner, L. I., Schink, J., Bass, M., Patel, S., Diaz, M. V., Rothrock, N., Pearman, T., Gershon, R., Penedo, F. J., Rosen, S., et al. (2015) · Cancer · doi:10.1002/cncr.29104 · Cited by 233
“21 PROMIS T score clinical severity thresholds were previously determined with a standard setting exercise that converged clinician expert ratings and patient self-reported severity scores.”
MethodSelf-citationDeveloping a Valid Patient-Reported Outcome Measure
Rothrock, N. E., Kaiser, K. A., & Cella, D. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.195 · Cited by 222
Self-citation
Metadata
- Authors
- Gershon, R., Rothrock, N. E., Hanrahan, R. T., Jansky, L. J., Harniss, M., & Riley, W.
- Venue
- Quality of Life Research
- Published
- 2010-03-21
- Volume
- 19
- Issue
- 5
- Pages
- 677-685
- ISSN
- 0962-9343 (ISSN-L)
- 1573-2649
- OpenAlex
- W2083824420
- Cited by
- 148
- References
- 7
- FWCI
- 10.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The development of a clinical outcomes survey research application: Assessment CenterSM. https://app.cochat.ai/papers/10.1007/s11136-010-9634-4
- The paper
- Gershon, R., Rothrock, N. E., Hanrahan, R. T., Jansky, L. J., Harniss, M., & Riley, W. (2010). The development of a clinical outcomes survey research application: Assessment CenterSM. Quality of Life Research. https://doi.org/10.1007/s11136-010-9634-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.