Performance of health status measures with a pen based personal digital assistant
Open accessAbstract
Background Increasing use of self reported health status in clinical practice and research, as well as patient appreciation of monitoring fluctuations of health over time, suggest a need for more frequent collection of data. Electronic use of health status measures in the follow up of patients is a possible way to achieve this.Objective To compare self reported health status measures in a personal digital assistant (PDA) version and a paper/pencil version for test-retest reliability, agreement between scores, and feasibility.Methods 30 patients with stable rheumatoid arthritis (mean age 61.6 years, range 49.8 to 70.0; mean disease duration, 16.7 years; 63% female; 67% rheumatoid factor positive; 46.6% on disease modifying antirheumatic drugs) completed self reported health status measures (pain, fatigue, and global health on visual analogue scales (VAS), rheumatoid arthritis disease activity index, modified health assessment questionnaire, SF-36) in a conventional paper based questionnaire version and on a PDA (HP iPAQ, model h5450). Completion was repeated after five to seven days.Results Test-retest reliability was similar, as evaluated by the Bland-Altman approach, the coefficient of variation, and intraclass correlation coefficients. The scores showed acceptable agreement, but with a slight tendency to higher scores on VAS with the PDA than the paper/pencil version. No significant differences were seen for measures of feasibility (time to complete, satisfaction score), but 65.5% preferred PDA, 20.7% preferred paper, and 13.8% had no preference.Conclusions The clinimetric performance of paper/pencil versions of self reported health status measures was similar to an electronic version, using an inexpensive PDA.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Collecting health data using a digital survey does not affect test reliability with respect to a paper version.
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5]”
From Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study (2020) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965 · see citing works
Felson, D. T., Anderson, J. J., Boers, M., Bombardier, C., Chernoff, M., Fried, B. J., Fürst, D. E., Goldsmith, C. H., Kieszak, S. M., Lightfoot, R. W., et al. (1993) · Arthritis & Rheumatism · doi:10.1002/art.1780360601 · Cited by 1,639 · see citing works
Pincus, T., Summey, J. A., Soraci, S. A., Wallston, K. A., & Hummon, N. P. (1983) · Arthritis & Rheumatism · doi:10.1002/art.1780261107 · Cited by 1,339 · see citing works
Patient compliance with paper and electronic diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00320-3 · Cited by 910 · see citing works
Bellamy, N., Kirwan, J., Boers, M., Brooks, P., Strand, V., Tugwell, P., Altman, R. D., Brandt, K. D., Dougados, M., & Lequesne, M. G. (1997) · PubMed · Cited by 745 · see citing works
Drossaers-Bakker, K. W., de Buck, M., van Zeben, D., Zwinderman, A. H., Breedveld, F. C., & Hazes, J. M. W. (1999) · Arthritis & Rheumatism · doi:10.1002/1529-0131(199909)42:9 · Cited by 373 · see citing works
Velikova, G., Wright, E. P., Smith, A. B., Cull, A., Gould, A., Forman, D., Perren, T., Stead, M., Brown, J., & Selby, P. J. (1999) · Journal of Clinical Oncology · doi:10.1200/jco.1999.17.3.998 · Cited by 339 · see citing works
Geborek, P., Kapetanovic, M. C., Petersson, I. F., & Saxne, T. (2002) · Annals of the Rheumatic Diseases · doi:10.1136/ard.61.9.793 · Cited by 253 · see citing works
Electronic diaries for monitoring chronic pain: 1-year validation study
Jamison, R. N., Raymond, S. A., Levine, J. G., Slawsby, E. A., Nedeljković, S. S., & Katz, N. P. (2001) · Pain · doi:10.1016/s0304-3959(00)00450-4 · Cited by 249 · see citing works
Kirwan, J., HEWLETT, S. E., Heiberg, T., Hughes, R. A., Carr, M., Hehir, M., Kvien, T. K., Minnock, P., Newman, S. P., Quest, E. M., et al. (2005) · PubMed · Cited by 222 · see citing works
Self-citationOutcomes from the Patient Perspective Workshop at OMERACT 6.
Kirwan, J., Heiberg, T., HEWLETT, S. E., Hughes, R. A., Kvien, T. K., Ahlmén, M., Boers, M., Minnock, P., Saag, K. G., Shea, B., et al. (2003) · PubMed · Cited by 216 · see citing works
Self-citationJamison, R. N., Gracely, R. H., Raymond, S. A., Levine, J. G., Marino, B., Herrmann, T. J., Daly, M., Fram, D. H., & Katz, N. P. (2002) · Pain · doi:10.1016/s0304-3959(02)00178-1 · Cited by 209 · see citing works
Kvien, T. K., Kaasa, S., & Smedstad, L. M. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00099-7 · Cited by 168 · see citing works
Self-citationFransen, J., Langenegger, T., Michel, B. A., & Stucki, G. (2000) · Rheumatology · doi:10.1093/rheumatology/39.3.321 · Cited by 156 · see citing works
Bliven, B. D., Kaufman, S. E., & Spertus, J. A. (2001) · Quality of Life Research · doi:10.1023/a:1016740312904 · Cited by 146 · see citing works
Wolfe, F., Lassere, M. N., van der Heijde, D. M. F. M., Stucki, G., Suarez-Almazor, M. E., Pincus, T., Eberhardt, K., Kvien, T. K., Symmons, D. P. M., Silman, A. J., et al. (1999) · PubMed · Cited by 139 · see citing works
Self-citationComputerized Quality-of-Life Screening in a Cancer Pain Clinic
Carlson, L. E., Speca, M., Hagen, N., & Taenzer, P. (2001) · Journal of Palliative Care · doi:10.1177/082585970101700108 · Cited by 89 · see citing works
The use of handheld computers in clinical trials
Koop, A., & Mösges, R. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00224-6 · Cited by 81 · see citing works
Kleinman, L., Leidy, N. K., Crawley, J. A., Bonomi, A. E., & Schoenfeld, P. (2001) · Medical Care · doi:10.1097/00005650-200102000-00008 · Cited by 75 · see citing works
Nyholm, D., Kowalski, J. H., & Aquilonius, S. (2003) · Movement Disorders · doi:10.1002/mds.10690 · Cited by 67 · see citing works
VanDenKerkhof, E. G., Goldstein, D. H., Lane, J., et al. (2003) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/bf03021034 · Cited by 64 · see citing works
Wilson, A. S., Kitas, G. D., Carruthers, D. M., Reay, C. A., Skan, J., Harris, S. K., Treharne, G. J., Young, S. P., & Bacon, P. A. (2002) · Lara D. Veeken · doi:10.1093/rheumatology/41.3.268 · Cited by 64 · see citing works
Comparison of commonly used orthopaedic outcome measures using palm‐top computers and paper surveys
Saleh, K. J., Radosevich, D. M., Kassim, R. A., Moussa, M., Dykes, D., Bottolfson, H., Gioe, T. J., & Robinson, H. (2002) · Journal of Orthopaedic Research® · doi:10.1016/s0736-0266(02)00059-1 · Cited by 63 · see citing works
Kirwan, J., Ahlmén, M., de Wit, M. P. T., Heiberg, T., Hehir, M., HEWLETT, S. E., Katz, P., Minnock, P., Quest, E. M., & Richards, P. (2005) · PubMed · Cited by 53 · see citing works
Self-citationA web-compatible instrument for measuring self-reported disease activity in arthritis.
Athale, N., Sturley, A., Skoczen, S., Kavanaugh, A., & Lenert, L. A. (2004) · PubMed · Cited by 50 · see citing works
Williams, C. A. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1527 · Cited by 40 · see citing works
The Oslo experience with arthritis registries.
Kvien, T. K., & Uhlig, T. (2004) · PubMed · Cited by 40 · see citing works
Self-citationOMERACT 6 brings new perspectives to rheumatology measurement research.
Saag, K. G. (2003) · PubMed · Cited by 32 · see citing works
Al‐Ubaydli, M. (2004) · BMJ · doi:10.1136/bmj.328.7449.1181 · Cited by 25 · see citing works
Data Management Using the Personal Digital Assistant in an Acute Pain Service
Chan, S.-Y., Chu, C. P. W., Cheng, B. C. P., et al. (2004) · Anaesthesia and Intensive Care · doi:10.1177/0310057x0403200113 · Cited by 20 · see citing works
Quest, E. M., Aanerud, G. J., Kaarud, S., Collins, S., Leong, A. L., Smedeby, B., Denny-Waters, A., Mellors, R., Taylor, D., & de Wit, M. P. T. (2003) · PubMed · Cited by 17 · see citing works
Self-citationMosley‐Williams, A., & Williams, C. (2004) · Arthritis & Rheumatism · doi:10.1002/art.11497 · Cited by 10 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [1]1. Wolfe F, Pincus T. Listening to the patient: a practical guide to self-report questionnaires in clinical care. Arthritis Rheum 1999;42:1797-808.
Cited by
Sorted by citations
Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00231.x · Cited by 623 · see citing works
Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety
Abend, R., Dan, O., Maoz, K., Raz, S., & Bar-Haim, Y. (2014) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2014.06.004 · Cited by 217 · see citing works
Dale, O., & Hagen, K. B. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.04.005 · Cited by 191 · see citing works
Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study
ter Stal, S., Broekhuis, M., van Velsen, L., Hermens, H., & Tabak, M. (2020) · JMIR Human Factors · doi:10.2196/19987 · Cited by 36 · see citing works
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5], and several”
Background
- Authors
- Kvien, T. K., Mowinckel, P., Heiberg, T., Dammann, K. L., Dale, Ø., Aanerud, G. J., Alme, T. N., & Uhlig, T.
- Affiliations
- Diakonhjemmet Hospital (NO)
- Oslo University Hospital (NO)
- Corresponding author
- Kvien, T K
- ORCID
- Venue
- Annals of the Rheumatic Diseases
- Publisher
- Elsevier BV
- Published
- 2005-10
- Volume
- 64
- Issue
- 10
- Pages
- 1480-1484
- ISSN
- 0003-4967 (ISSN-L)
- PMC
- PMC1755226
- OpenAlex
- W2068324131
- Cited by
- 92
- References
- 32
- Citations by year
- 2025: 1 · 2022: 1 · 2021: 2 · 2020: 5 · 2019: 4 · 2018: 3 · 2017: 1 · 2016: 8 · 2015: 2 · 2014: 4 · 2013: 8 · 2012: 2
- FWCI
- 18.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annals of the Rheumatic Diseases (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Norsk Revmatikerforbund
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Rheumatology › Rheumatoid Arthritis Research and Therapies
- Keywords
- self-rated health, personal digital assistants, rheumatoid arthritis, test-retest reliability, clinimetric properties, paper-based questionnaires, patient-reported outcome measures, fatigue, global health, disease activity
- MeSH terms
- Aged, Arthritis, Rheumatoid, Attitude to Computers, Feasibility Studies, Female, Health Status Indicators, Humans, Male, Middle Aged, Pain Measurement, Surveys and Questionnaires, Self Disclosure, Reproducibility of Results, Medical Records Systems, Computerized, Treatment Outcome, Computers, Handheld
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
