Validity, reliability and responsiveness of digital visual analogue scales for chronic spontaneous urticaria monitoring: A CRUSE ® mobile health study
Open accessAbstract
Background: CRUSE® is an app that allows patients with chronic spontaneous urticaria (CSU) to monitor their daily disease activity through the use of visual analogue scales (VASs). We aimed to determine the concurrent validity, reliability, responsiveness and minimal important difference (MID) of CRUSE® VASs. Method s: We evaluated the properties of three daily VASs: VAS for how much patients were affected by their CSU (‘VAS urticaria’), VAS for the impact of urticaria on work/school productivity (‘VAS productivity’) and the VAS of EQ‐5D. Concurrent validity was assessed by measuring the association between each VAS and the Urticaria Activity Score (UAS). Intra‐rater reliability was determined based on the data of users providing multiple daily questionnaires within the same day. Test–retest reliability and responsiveness (ability to change), respectively, were tested in clinically stable and clinically unstable users. MIDs were determined using distribution‐based methods. Results: We included 5938 patients (67,380 days). Concurrent validity was high, with VAS urticaria being more strongly associated with the UAS score than the remaining VASs. Intra‐rater reliability was also high, with intraclass correlation coefficients (ICC) being above 0.950 for all VASs. Moderate‐high test–retest reliability and responsiveness were observed, with reliability ICC being highest for VAS EQ‐5D and responsiveness being highest for VAS urticaria. The MID for VAS urticaria was 17 (out of 100) units, compared to 15 units for VAS productivity and 11 units for VAS EQ‐5D. Conclusion: Daily VASs for CSU available in the CRUSE® app display high concurrent validity and intra‐rater reliability and moderate‐high test–retest reliability and responsiveness.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 29,639 · see citing works
Revicki, D. A., Hays, R. D., Cella, D. F., & Sloan, J. A. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.012 · Cited by 2,384 · see citing works
Validity and reliability of measurement instruments used in research
Kimberlin, C. L., & Winterstein, A. G. (2008) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp070364 · Cited by 1,805 · see citing works
Methods for assessing responsiveness
Husted, J., Cook, R. J., Farewell, V. T., & Gladman, D. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00206-1 · Cited by 1,478 · see citing works
Zuberbier, T., Abdul Latiff, A. H., Abuzakouk, M., Aquilina, S., Asero, R., Baker, D., Ballmer‐Weber, B., Bangert, C., Ben‐Shoshan, M., Bernstein, J. A., et al. (2022) · Allergy · doi:10.1111/all.15090 · Cited by 1,263 · see citing works
Self-citationWeller, K., Groffik, A., Church, M. K., Hawro, T., Krause, K., Metz, M., Martus, P., Casale, T. B., Staubach, P., & Maurer, M. (2014) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2013.12.1076 · Cited by 419 · see citing works
Self-citationMouelhi, Y., Jouve, E., Castelli, C., & Gentile, S. (2020) · Health and Quality of Life Outcomes · doi:10.1186/s12955-020-01344-w · Cited by 397 · see citing works
The global burden of chronic urticaria for the patient and society*
Gonçalo, M., Giménez-Arnau, A. M., Al-Ahmad, M. S., Ben‐Shoshan, M., Bernstein, J. A., Ensina, L. F., Fomina, D. S., Galván, C. A., Godse, K. V., Grattan, C. E. H., et al. (2020) · British Journal of Dermatology · doi:10.1111/bjd.19561 · Cited by 387 · see citing works
Self-citationMaurer, M., Abuzakouk, M., Bérard, F., Canonica, W., Oude Elberink, H., Giménez‐Arnau, A., Grattan, C., Hollis, K., Knulst, A., Lacour, J. ‐., et al. (2017) · Allergy · doi:10.1111/all.13209 · Cited by 383 · see citing works
Self-citationQin, S., Nelson, L. M., McLeod, L., Eremenco, S. L., & Coons, S. J. (2018) · Quality of Life Research · doi:10.1007/s11136-018-2076-0 · Cited by 241 · see citing works
Development, validation, and initial results of the Angioedema Activity Score
Weller, K., Groffik, A., Magerl, M. A. K., Tohme, N., Martus, P., Krause, K., Metz, M., Staubach, P., & Maurer, M. (2013) · Allergy · doi:10.1111/all.12209 · Cited by 208 · see citing works
Self-citationQuality of life and patients' satisfaction in chronic urticaria and respiratory allergy
Baiardini, I., Giardini, A., Pasquali, M., et al. (2003) · Allergy · doi:10.1034/j.1398-9995.2003.00091.x · Cited by 207 · see citing works
EQ-5D-5L norms for the urban Chinese population in China
Yang, Z., Busschbach, J. J. V., Liu, G., & Luo, N. (2018) · Health and Quality of Life Outcomes · doi:10.1186/s12955-018-1036-2 · Cited by 182 · see citing works
The Urticaria Activity Score—Validity, Reliability, and Responsiveness
Hawro, T., Ohanyan, T., Schoepke, N., Metz, M., Peveling‐Oberhag, A., Staubach, P., Maurer, M., & Weller, K. (2017) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2017.10.001 · Cited by 153 · see citing works
Self-citationWeller, K., Donoso, T., Magerl, M. A. K., Aygören‐Pürsün, E., Staubach, P., Martinez‐Saguer, I., Hawro, T., Altrichter, S., Krause, K., Siebenhaar, F., et al. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.02.038 · Cited by 130 · see citing works
Self-citationDeveloping and Validating Clinical Questionnaires
Rosellini, A. J., & Brown, T. A. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-115343 · Cited by 102 · see citing works
Weller, K., Donoso, T., Magerl, M. A. K., Aygören‐Pürsün, E., Staubach, P., Martinez‐Saguer, I., Hawro, T., Altrichter, S., Krause, K., Siebenhaar, F., et al. (2019) · Allergy · doi:10.1111/all.14144 · Cited by 97 · see citing works
Self-citationDevelopment and validation of combined symptom‐medication scores for allergic rhinitis*
Sousa‐Pinto, B., Azevedo, L. F., Jutel, M., Agache, I. O., Canonica, G. W., Czarlewski, W., Papadopoulos, N. G., Bergmann, K., Devillier, P., Laune, D., et al. (2021) · Allergy · doi:10.1111/all.15199 · Cited by 77 · see citing works
Self-citationValidity, reliability, and responsiveness of daily monitoring visual analog scales in MASK‐air®
Sousa‐Pinto, B., Eklund, P., Pfaar, O., Klimek, L., Zuberbier, T., Czarlewski, W., Bédard, A., Bindslev‐Jensen, C., Bedbrook, A., Bosnic-Anticevich, S. Z., et al. (2021) · Clinical and Translational Allergy · doi:10.1002/clt2.12062 · Cited by 60 · see citing works
Self-citationBousquet, J., Antó, J. M., Sousa‐Pinto, B., Czarlewski, W., Bedbrook, A., Haahtela, T., Klimek, L., Pfaar, O., Kuna, P., Kupczyk, M., et al. (2023) · Clinical and Translational Allergy · doi:10.1002/clt2.12215 · Cited by 58 · see citing works
Self-citationFonseca, J., Nogueira‐Silva, L., Morais‐Almeida, M., Sá‐Sousa, A., Azevedo, L. F., Ferreira, J. A., Ferreira, M. B., Alves, R. R., Bugalho‐Almeida, A., & Bousquet, J. (2012) · Clinical and Translational Allergy · doi:10.1186/2045-7022-2-16 · Cited by 52 · see citing works
Self-citationSousa‐Pinto, B., Jácome, C. I. O., Pereira, A. M., Regateiro, F. S., Almeida, R., Czarlewski, W., Kulus, M., Shamji, M. H., Boulet, L., Bonini, M., et al. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00020-1 · Cited by 38 · see citing works
Self-citationNeisinger, S., Sousa Pinto, B., Ramanauskaite, A., Bousquet, J., Weller, K., Metz, M., Magerl, M., Kocatürk, E., Cherrez‐Ojeda, I., Gimenez‐Arnau, A. M., et al. (2024) · Clinical and Translational Allergy · doi:10.1002/clt2.12328 · Cited by 37 · see citing works
Self-citationAutomatic screening of self‐evaluation apps for urticaria and angioedema shows a high unmet need
Antó, A., Maurer, R. R., Giménez‐Arnau, A. M., Chérrez-Ojeda, I., Hawro, T., Magerl, M. A. K., Metz, M., Weller, K., Zuberbier, T., Bousquet, J., et al. (2021) · Allergy · doi:10.1111/all.15061 · Cited by 17 · see citing works
Self-citationChodziuk, A. C., Ghazanfar, M. N., & Thomsen, S. F. (2019) · Dermatologic Therapy · doi:10.1111/dth.12902 · Cited by 4 · see citing works
Self-citationAbreu, M., Santos, A. F. D., Gama, J. M. R., et al. (2024) · Clinical Interventions in Aging · doi:10.2147/cia.s448797 · Cited by 4 · see citing works
Zhang, D. G., Sørensen, J. A., Ghazanfar, M. N., et al. (2023) · Allergy · doi:10.1111/all.15955 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hindelang, M., Zink, A., Knitza, J., Darkow, R., Welcker, M., Biedermann, T., May, S., & Muehlensiepen, F. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13043-7 · Cited by 4 · see citing works
“The CRUSE® study demonstrated their feasibility [18, 19], with Sousa-Pinto et al. [20]. confirming their reliability.”
Influential
- Authors
- Sousa‐Pinto, B., Ramanauskaite, A., Neisinger, S., Witte‐Händel, E., Gimenez‐Arnau, A. M., Guillet, C., Parisi, C. A. S., Katelaris, C. H., Fomina, D., Larenas‐Linnemann, D., García, E., Kocatürk, E., Siebenhaar, F., Lima, H., Kaidashev, I., Nasr, I., Canales, I. O., Ojeda, I. C., Hébert, J., Bousquet, J., Bernstein, J. A., Peter, J., Sanchez, J., Sousa, J. I. L., Kulthanan, K., Weller, K., Godse, K., Rutkowski, K., Lapina, L., Bouillet, L., Han, L. L., Ensina, L. F., Gonçalo, M., Magerl, M., van Doorn, M., Metz, M., Khoshkhui, M., Hide, M., Türk, M., Kurjāne, N., Conlon, N., Salameh, P., Kolkhir, P., Asero, R., Stepanenko, R., Altrichter, S., Gil‐Mata, S., Thomsen, S. F., Zuberbier, T., Tsaryk, V., Ye, Y., Brzoza, Z., Zhao, Z., & Maurer, M.
- Affiliations
- Universidade do Porto (PT)
- Institute of Allergology Charité—Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt‐Universität zu Berlin Berlin Germany
- Humboldt-Universität zu Berlin (DE)
- Department of Dermatology, Urticaria Center of Reference, and Excellence (UCARE) Hospital del Mar, IMIM, Universitat Pompeu Fabra Barcelona Spain
- University Hospital Zurich (CH)
- Hospital Italiano de Buenos Aires (AR)
- Camden and Campbelltown Hospitals (AU)
- Sechenov University (RU)
- Hospital Médica Sur (MX)
- Universidad de Los Andes (CO)
- Koç University (TR)
- McMaster University (CA)
- Poltava State Medical University Poltava Ukraine
- Royal Hospital (OM)
- Department of Dermatology, Faculty of Medicine Pontifical Catholic University of Chile Santiago Chile
- Universidad Espíritu Santo Samborondón, Ecuador, Respiralab Research Center Guayaquil Ecuador
- Centre hospitalier universitaire de Québec (CA)
- University of Cincinnati (US)
- University of Cape Town (ZA)
- Universidad de Antioquia (CO)
- Department of Allergy UCARE, Clinica San Felipe Lima Peru
- Siriraj Hospital (TH)
- DY Patil Deemed to be University (IN)
- Guy's Hospital (GB)
- Allergic Diseases Diagnosis and Treatment Center Riga Stradins University, Pauls Stradins Clinical University Hospital Riga Latvia
- Centre Hospitalier Universitaire de Grenoble (FR)
- Greater Bay Area Institute of Precision Medicine (Guangzhou), School of Life Sciences Fudan University Shanghai China
- Division of Allergy, Clinical Immunology and Rheumatology, Department of Pediatrics Federal University of Sao Paulo Sao Paulo Brazil
- Unidade Local de Saúde de Coimbra (PT)
- Department of Dermatology UCARE, Erasmus MC Rotterdam The Netherlands
- Mashhad University of Medical Sciences (IR)
- Hiroshima University (JP)
- Erciyes University (TR)
- Pauls Stradiņš Clinical University Hospital (LV)
- Trinity College Dublin (IE)
- University of Nicosia (CY)
- Ambulatorio di Allergologia Clinica San Carlo Paderno Dugnano (MI) Italy
- Bogomolets National Medical University (UA)
- Johannes Kepler University of Linz (AT)
- University of Copenhagen (DK)
- Ajou University (KR)
- University of Opole (PL)
- Peking University First Hospital (CN)
- Corresponding author
- Sousa‐Pinto, Bernardo
- ORCID
- Sousa‐Pinto, Bernardo
- Ramanauskaite, Aiste
- Neisinger, Sophia
- Witte‐Händel, Ellen
- Gimenez‐Arnau, Ana M.
- Guillet, Carole
- Parisi, Claudio Alberto S.
- Katelaris, Constance H.
- Fomina, Daria
- Larenas‐Linnemann, Désirée
- García, Elizabeth
- Kocatürk, Emek
- Siebenhaar, Frank
- Lima, Hermenio
- Kaidashev, Igor
- Nasr, Iman
- Canales, Isabel Ogueta
- Ojeda, Ivan Cherrez
- Bousquet, Jean
- Bernstein, Jonathan A.
- Peter, Jonny
- Sanchez, Jorge
- Sousa, Jose Ignacio Larco
- Kulthanan, Kanokvalai
- Weller, Karsten
- Godse, Kiran
- Rutkowski, Krzysztof
- Lapina, Lasma
- Bouillet, Laurence
- Han, Leo Lianyi
- Ensina, Luis Felipe
- Gonçalo, Margarida
- Magerl, Markus
- van Doorn, Martijn
- Metz, Martin
- Khoshkhui, Maryam
- Hide, Michihiro
- Türk, Murat
- Kurjāne, Nataļja
- Conlon, Niall
- Salameh, Pascale
- Kolkhir, Pavel
- Asero, Riccardo
- Stepanenko, Roman
- Altrichter, Sabine
- Gil‐Mata, Sara
- Thomsen, Simon Francis
- Zuberbier, Torsten
- Tsaryk, Vladyslav
- Ye, Young‐Min
- Brzoza, Zenon
- Zhao, Zuotao
- Maurer, Marcus
- Venue
- Allergy
- Publisher
- Wiley
- Published
- 2024-10-24
- Volume
- 80
- Issue
- 3
- Pages
- 750-761
- ISSN
- 0105-4538 (ISSN-L)
- 1398-9995
- OpenAlex
- W4403733567
- Cited by
- 11
- References
- 27
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 1
- FWCI
- 3.54
- Type
- journal article
- Language
- en
- Open access
- green
- pure.eur.nl
- Licence
- Locations
- Allergy (publishedVersion)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- Erciyes University - AVESIS (submittedVersion)
- HAL (submittedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- AJOU Open Repository (Ajou University) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Amgen
- AstraZeneca
- Celldex Therapeutics
- Centro de Investigação em Tecnologias e Serviços de Saúde (UIDB/4255/2020)
- Fundação para a Ciência e a Tecnologia (UIDB/ 4255/2020)
- Topics
- Health Sciences › Medicine › Rheumatology › Urticaria and Related Conditions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- chronic spontaneous urticaria, mobile health, disease activity monitoring, concurrent validity, test-retest reliability, responsiveness, minimal important difference, EQ-5D, urticaria activity score, patient-reported outcomes
- MeSH terms
- Chronic Urticaria, Adult, Aged, Female, Humans, Male, Middle Aged, Surveys and Questionnaires, Severity of Illness Index, Reproducibility of Results, Telemedicine, Young Adult, Mobile Applications, Visual Analog Scale
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
