. A systematic survey instrument translation process for multi-country, comparative health workforce studies.
Open accessAbstract
Background As health services research (HSR) expands across the globe, researchers will adopt health services and health worker evaluation instruments developed in one country for use in another. This paper explores the cross-cultural methodological challenges involved in translating HSR in the language and context of different health systems.Objectives To describe the pre-data collection systematic translation process used in a twelve country, eleven language nursing workforce survey.Design and settings We illustrate the potential advantages of Content Validity Indexing (CVI) techniques to validate a nursing workforce survey developed for RN4CAST, a twelve country (Belgium, England, Finland, Germany, Greece, Ireland, Netherlands, Norway, Poland, Spain, Sweden, and Switzerland), eleven language (with modifications for regional dialects, including Dutch, English, Finnish, French, German, Greek, Italian, Norwegian, Polish, Spanish, and Swedish), comparative nursing workforce study in Europe.Participants Expert review panels comprised of practicing nurses from twelve European countries who evaluated cross-cultural relevance, including translation, of a nursing workforce survey instrument developed by experts in the field.Methods The method described in this paper used Content Validity Indexing (CVI) techniques with chance correction and provides researchers with a systematic approach for standardizing language translation processes while simultaneously evaluating the cross-cultural applicability of a survey instrument in the new context.Results The cross-cultural evaluation process produced CVI scores for the instrument ranging from .61 to .95. The process successfully identified potentially problematic survey items and errors with translation.Conclusions The translation approach described here may help researchers reduce threats to data validity and improve instrument reliability in multinational health services research studies involving comparisons across health systems and language translation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Overtime working has been associated with adverse quality because of cumulative fatigue, lack of rest, and adverse working environments.
“Overtime working has also been associated with adverse quality because of cumulative fatigue, lack of rest, and adverse working environments. 21,22”
From Nurses’ Shift Length and Overtime Working in 12 European Countries: The Association With Perceived Quality of Care and Patient Safety (2014) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646 · see citing works
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542 · see citing works
Back-translation for cross-cultural research.
Brislin, R. W. (1970) · Journal of Cross-Cultural Psychology · doi:10.1177/135910457000100301 · Cited by 14,091 · see citing works
Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.397 · Cited by 12,852 · see citing works
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 6× · see citing works
“We also recommend, as do Polit et al. (2007), having well defined criteria for selecting the expert raters.”
BackgroundMethodInfluentialGuillemin, F., Bombardier, C., & Beaton, D. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90142-n · Cited by 6,060 · see citing works
Is the CVI an acceptable indicator of content validity? Appraisal and recommendations
Polit, D. F., Beck, C. T., & Owen, S. V. (2007) · Research in Nursing & Health · doi:10.1002/nur.20199 · Cited by 5,273 · see citing works
Hospital Nurse Staffing and Patient Mortality, Nurse Burnout, and Job Dissatisfaction
Aiken, L. H. (2002) · JAMA · doi:10.1001/jama.288.16.1987 · Cited by 5,226 · see citing works
Self-citationStatistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756 · see citing works
Methods and Data Analysis for Cross-Cultural Research
van de Vijver, F. J. R., & Leung, K. Y. (2021) · Cambridge University Press eBooks · doi:10.1017/9781107415188 · Cited by 2,611 · see citing works
(1981) · PubMed · Cited by 2,253 · see citing works
Development of the practice environment scale of the nursing work index†‡
Lake, E. T. (2002) · Research in Nursing & Health · doi:10.1002/nur.10032 · Cited by 1,769 · see citing works
Statistical Methods for Rates and Proportions.
Plewis, I., & Fleiss, J. L. (1982) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2982107 · Cited by 1,753 · see citing works
Nurses’ Reports On Hospital Care In Five Countries
Aiken, L. H., Clarke, S. P., Sloane, D. M., Sochalski, J. A., Busse, R., Clarke, H. F., Giovannetti, P., Hunt, J., Rafferty, A. M., & Shamian, J. (2001) · Health Affairs · doi:10.1377/hlthaff.20.3.43 · Cited by 1,623 · see citing works
Self-citationInstrument translation process: a methods review
Maneesriwongul, W., & Dixon, J. K. (2004) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2004.03185.x · Cited by 1,322 · see citing works
Gjersing, L., Caplehorn, J. R. M., & Clausen, T. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-13 · Cited by 909 · see citing works
Translation of scales in cross‐cultural research: issues and techniques
Cha, E., Kim, K. H., & Erlen, J. A. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04242.x · Cited by 852 · see citing works
An Adaptation of Brislin???s Translation Model for Cross-cultural Research
Jones, P. S., Lee, J. W., Phillips, L. R., Zhang, X. E., & Jaceldo, K. B. (2001) · Nursing Research · doi:10.1097/00006199-200109000-00008 · Cited by 846 · see citing works
(2003) · Technometrics · doi:10.1198/tech.2003.s151 · Cited by 839 · see citing works
A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach.
Herdman, M., Fox-Rushby, J. A., & Badia, X. C. (1998) · Quality of Life Research · doi:10.1023/a:1024985930536 · Cited by 835 · see citing works
Developing Instruments for Cross-Cultural Psychiatric Research
Flaherty, J. A., Gaviria, F. M., Pathak, D. S., Mitchell, T., Wintrob, R. M., Richman, J. A., & Birz, S. (1988) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198805000-00001 · Cited by 820 · see citing works
Hospital staffing, organization, and quality of care: cross-national findings
Aiken, L. H. (2002) · International Journal for Quality in Health Care · doi:10.1093/intqhc/14.1.5 · Cited by 728 · see citing works
Self-citation(2003) · Choice Reviews Online · doi:10.5860/choice.40-5510 · Cited by 626 · see citing works
Lost in Translation: Methodological Considerations in Cross-Cultural Research
Peña, E. D. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01064.x · Cited by 620 · see citing works
Rafferty, A. M., Clarke, S. P., Coles, J., Ball, J., James, P., McKee, M., & Aiken, L. H. (2006) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2006.08.003 · Cited by 522 · see citing works
Self-citationOperacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia
Reichenheim, M. E., & de Moraes, C. L. (2007) · Revista de Saúde Pública · doi:10.1590/s0034-89102006005000035 · Cited by 521 · see citing works
‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires
Herdman, M., Fox-Rushby, J., & Badia, X. C. (1997) · Quality of Life Research · doi:10.1023/a:1026410721664 · Cited by 470 · see citing works
Validating an instrument for clinical supervision using an expert panel
Hyrkäs, K. E., Appelqvist‐Schmidlechner, K., & Oksa, L. (2003) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(03)00036-1 · Cited by 430 · see citing works
Nurse forecasting in Europe (RN4CAST): Rationale, design and methodology
Sermeus, W., Aiken, L. H., den Heede, K. V., Rafferty, A. M., Griffiths, P., Moreno‐Casbas, T., Busse, R., Lindqvist, R., Scott, P. A., Bruyneel, L., et al. (2011) · BMC Nursing · doi:10.1186/1472-6955-10-6 · Cited by 399 · see citing works
Self-citationTranslating Instruments Into Other Languages: Development and Testing Processes
Hilton, A., & Skrutkowski, M. (2002) · Cancer Nursing · doi:10.1097/00002820-200202000-00001 · Cited by 379 · see citing works
Variations in Nursing Practice Environments
Lake, E. T., & Friese, C. R. (2006) · Nursing Research · doi:10.1097/00006199-200601000-00001 · Cited by 354 · see citing works
Health and psychosocial effects of flexible working hours
Janßen, D., & Nachreiner, F. (2004) · Revista de Saúde Pública · doi:10.1590/s0034-89102004000700003 · Cited by 286 · see citing works
An Examination of Questionnaire Evaluation by Expert Reviewers
Olson, K. M. (2010) · Field Methods · doi:10.1177/1525822x10379795 · Cited by 253 · see citing works
Global Use of the Practice Environment Scale of the Nursing Work Index
Warshawsky, N. E., & Havens, D. S. (2010) · Nursing Research · doi:10.1097/nnr.0b013e3181ffa79c · Cited by 249 · see citing works
Developing multiple language versions of instruments for intercultural research
Erkut, S. (2010) · Child Development Perspectives · doi:10.1111/j.1750-8606.2009.00111.x · Cited by 241 · see citing works
Cultural adaptation and translation of measures: An integrated method
Sidani, S., Guruge, S., Miranda, J., Ford‐Gilboe, M., & Varcoe, C. (2010) · Research in Nursing & Health · doi:10.1002/nur.20364 · Cited by 207 · see citing works
Challenges and Strategies of Instrument Translation
Wang, W.-L., Lee, H.-L., & Fetzer, S. J. (2006) · Western Journal of Nursing Research · doi:10.1177/0193945905284712 · Cited by 184 · see citing works
Cross-Cultural Adaptation of a Psychometric Instrument
Perneger, T., Leplège, A., & Etter, J. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00088-8 · Cited by 182 · see citing works
Issues, Challenges, and Solutions in Translating Study Instruments
Weeks, A., Swerissen, H., & Belfrage, J. (2007) · Evaluation Review · doi:10.1177/0193841x06294184 · Cited by 168 · see citing works
Mallinckrodt, B. S., & Wang, C.-C. (2004) · Journal of Counseling Psychology · doi:10.1037/0022-0167.51.3.368 · Cited by 154 · see citing works
Team Effectiveness in Multinational Organizations
Gibson, C. B., Zellmer-Bruhn, M. E., & Schwab, D. P. (2003) · Group & Organization Management · doi:10.1177/1059601103251685 · Cited by 112 · see citing works
Bruyneel, L., den Heede, K. V., Diya, L., Aiken, L. H., & Sermeus, W. (2009) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2009.01272.x · Cited by 90 · see citing works
Self-citationDeveloping Cross Cultural Measurement
Tran, T. V. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195325089.001.0001 · Cited by 88 · see citing works
Differential Item Functioning (DIF) and the Mini-Mental State Examination (MMSE)
Ramirez, M. M., Teresi, J. A., Holmes, D., Gurland, B. J., & Lantigua, R. (2006) · Medical Care · doi:10.1097/01.mlr.0000245181.96133.db · Cited by 86 · see citing works
Rigor in cross-cultural nursing research
Im, E., Page, R. L., Lin, L., Tsai, H.-M., & Cheng, C. (2004) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2004.04.003 · Cited by 81 · see citing works
Nice and Tidy: Translation and Representation
Temple, B. (2005) · Sociological Research Online · doi:10.5153/sro.1058 · Cited by 77 · see citing works
Cross-Cultural Instrument Translation: Assessment, Translation, and Statistical Applications
Mason, T. C. (2005) · American annals of the deaf · doi:10.1353/aad.2005.0020 · Cited by 76 · see citing works
Methods and Frameworks for Crosscultural Measurement
Johnson, T. P. (2006) · Medical Care · doi:10.1097/01.mlr.0000245424.16482.f1 · Cited by 67 · see citing works
Thrasher, J. F., Quah, A. C. K., Dominick, G. M., Borland, R., Driezen, P., Awang, R., Omar, M., Hosking, W., Sirirassamee, B., & Boado, M. (2011) · Field Methods · doi:10.1177/1525822x11418176 · Cited by 38 · see citing works
Choi, B., Bjorner, J. B., Östergren, P., et al. (2009) · International Journal of Behavioral Medicine · doi:10.1007/s12529-009-9048-2 · Cited by 35 · see citing works
A pilot study of a systematic method for translating patient satisfaction questionnaires
Liu, K., Squires, A. P., & You, L.-M. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2010.05569.x · Cited by 26 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Grant JS Davis LL Selection and use of content experts for instrument development Research in Nursing and Health 1997 20 269 274 9179180
- Maslach C Schaufeli WB Leiter MP Job burnout Annual Review of Psychology 2001 52 397 422 11148311
- Reichenheim ME Moraes CL Operationalizing the cross-cultural adaptation of epidemiological measurement instruments Revista de Saude Publica 2007 41 4 665 73 17589768
Cited by
Sorted by citations
Griffiths, P., Dall’Ora, C., Simon, M., Ball, J., Lindqvist, R., Rafferty, A.-M., Schoonhoven, L., Tishelman, C., & Aiken, L. H. (2014) · Medical Care · doi:10.1097/mlr.0000000000000233 · Cited by 316 · see citing works
“6).(26) Nurses were asked to report the number of hours worked, the period of the day, and whether they had worked beyond their contracted hours on the last shift they worked.”
BackgroundSelf-citationVisiers-Jiménez, L., Kuokkanen, L., Leino-Kilpi, H., Löyttyniemi, E., Turjamaa, R., Brugnolli, A., Gaspar, F., Nemcová, J., Palese, A., Rua, M., et al. (2022) · Healthcare · doi:10.3390/healthcare10050754 · Cited by 20 · see citing works
- Authors
- Squires, A., Aiken, L. H., van den Heede, K., Sermeus, W., Bruyneel, L., Lindqvist, R., Schoonhoven, L., Stromseng, I., Busse, R., Brzostek, T., Ensio, A., Moreno-Casbas, M., Rafferty, A. M., Schubert, M., Zikos, D., & Matthews, A.
- Affiliations
- New York University (US)
- University of Pennsylvania (US)
- KU Leuven (BE)
- Karolinska Institutet (SE)
- Technische Universität Berlin (DE)
- Jagiellonian University (PL)
- University of Eastern Finland (FI)
- King's College London (GB)
- University of Basel (CH)
- National and Kapodistrian University of Athens (GR)
- Dublin City University (IE)
- Corresponding author
- Squires, Allison
- ORCID
- Venue
- International Journal of Nursing Studies
- Publisher
- Elsevier BV
- Published
- 2013-02
- Volume
- 50
- Issue
- 2
- Pages
- 264-273
- ISSN
- 0020-7489 (ISSN-L)
- PMC
- PMC3395768
- OpenAlex
- W2017571303
- Cited by
- 265
- References
- 52
- Citations by year
- 2026: 15 · 2025: 26 · 2024: 26 · 2023: 16 · 2022: 20 · 2021: 19 · 2020: 24 · 2019: 23 · 2018: 21 · 2017: 17 · 2016: 18 · 2015: 11 · 2014: 8 · 2013: 11 · 2012: 10
- FWCI
- 62.19
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Journal of Nursing Studies (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
- Jagiellonian University Repository (Jagiellonian University) (submittedVersion, other-oa)
- Iris (University of Trento) (submittedVersion)
- Research Portal (King's College London) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- National Institutes of Health (P30NR05043)
- Seventh Framework Programme (223468)
- European Commission
- National Institute of Nursing Research
- Topics
- Social Sciences › Education › Health Education and Validation
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- cross-cultural adaptation, RN4CAST, expert panel review, instrument validation
- MeSH terms
- Data Collection, Nursing Staff, Translating, Internationality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
