The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries.
Abstract
Objectives: Develop and validate a WHO Standards-based online questionnaire to measure the quality of maternal and newborn care (QMNC) around the time of childbirth from the health workers’ perspective. Design: Mixed-methods study. Setting: Six countries of the WHO European Region. Participants and methods: The questionnaire is based on lessons learnt in previous studies, and was developed in three sequential phases: (1) WHO Quality Measures were prioritised and content, construct and face validity were assessed through a Delphi involving a multidisciplinary board of experts from 11 countries of the WHO European Region; (2) translation/back translation of the English version was conducted following The Professional Society for Health Economics and Outcomes Research guidelines; (3) internal consistency, intrarater reliability and acceptability were assessed among 600 health workers in six countries. Results: The questionnaire included 40 items based on WHO Standards Quality Measures, equally divided into four domains: provision of care, experience of care, availability of human and physical resources, organisational changes due to COVID-19; and its organised in six sections. It was translated/back translated in 12 languages: Bosnian, Croatian, French, German, Italian, Norwegian, Portuguese, Romanian, Russian, Slovenian, Spanish and Swedish. The Cronbach’s alpha values were ≥0.70 for each questionnaire section where questions were hypothesised to be interrelated, indicating good internal consistence. Cohen K or Gwet’s AC1 values were ≥0.60, suggesting good intrarater reliability, except for one question. Acceptability was good with only 1.70% of health workers requesting minimal changes in question wording. Conclusions: Findings suggest that the questionnaire has good content, construct, face validity, internal consistency, intrarater reliability and acceptability in six countries of the WHO European Region. Future studies may further explore the questionnaire’s use in other countries, and how to translate evidence generated by this tool into policies to improve the QMNC. Trail registration number: NCT04847336
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We collected data using a validated, self-administrated, anonymous online questionnaire [22] based on WHO standards [15].”
From Health workers’ perspectives on the quality of maternal and newborn health care around the time of childbirth: Results of the Improving MAternal Newborn carE in the EURO Region (IMAgiNE EURO) project in 12 countries of the World Health Organization European Region (2024) · cites this paper as [22]
In the citing paper
“samples and study periods of the IMAgiNE EURO maternal surveys [23,24] vs our study using HWs survey [22] are not directly comparable.”
From Health workers’ perspectives on the quality of maternal and newborn health care around the time of childbirth: Results of the Improving MAternal Newborn carE in the EURO Region (IMAgiNE EURO) project in 12 countries of the World Health Organization European Region (2024) · cites this paper as [22]
In the citing paper
“The IMAgiNE EURO project provides data overall collected through a systematic methodology – two validated questionnaires [21,22] on 80 WHO standard-based quality measures (40 related to service providers and 40 related to service users)”
From Health workers’ perspectives on the quality of maternal and newborn health care around the time of childbirth: Results of the Improving MAternal Newborn carE in the EURO Region (IMAgiNE EURO) project in 12 countries of the World Health Organization European Region (2024) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sousa, V. D., & Rojjanasrirat, W. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01434.x · Cited by 3,322
Health Measurement Scales: A practical guide to their development and use
Streiner, D. L., Norman, G. R., & Cairney, J. (2014) · doi:10.1093/med/9780199685219.001.0001 · Cited by 2,564
Taherdoost, H. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.3205040 · Cited by 2,047
Kyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.98126 · Cited by 1,882 · cited 1×
“Further research may explore in depth the use of this questionnaire in other countries, documenting the responsiveness of the QMNC index, and test approaches for translating data generated into quality improvement policies across settings.”
Tsang, S., Royse, C., & Terkawi, A. (2017) · Saudi Journal of Anaesthesia · doi:10.4103/sja.sja_203_17 · Cited by 1,692
Bohren, M. A., Vogel, J. P., Hunter, E. C., Lutsiv, O., Makh, S. K., Souza, J. P., Aguiar, C., Saraiva Coneglian, F., Diniz, A. L. A., Tunçalp, Ö., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001847 · Cited by 1,656
Physician wellness: a missing quality indicator
Wallace, J. E., Lemaire, J. B., & Ghali, W. A. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61424-0 · Cited by 1,608
Quality of care for pregnant women and newborns—the WHO vision
Tunçalp, Ӧ., Were, W., MacLennan, C., Oladapo, O., Gülmezoglu, A., Bahl, R., Daelmans, B., Mathai, M., Say, L., Kristensen, F., et al. (2015) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.13451 · Cited by 1,101
Chmielewska, B., Barratt, I., Townsend, R., Kalafat, E., van der Meulen, J., Gurol-Urganci, I., O'Brien, P., Morris, E., Draycott, T., Thangaratinam, S., et al. (2021) · The Lancet Global Health · doi:10.1016/s2214-109x(21)00079-6 · Cited by 1,092
High Agreement and High Prevalence: The Paradox of Cohen’s Kappa
Zec, S., Soriani, N., Comoretto, R., & Baldi, I. (2017) · The Open Nursing Journal · doi:10.2174/1874434601711010211 · Cited by 169
Research works printed but not linked: 39
- Prochaska, 2015, Human rights in maternity care, Midwifery, 31, 1015, 10.1016/j.midw.2015.09.006 · doi:10.1016/j.midw.2015.09.006
- 10.1016/S0140-6736(16)31527-6 · DOI · Paper page
- 10.1016/S0140-6736(16)31333-2 · DOI · Paper page
- OECD/European Union . Health at a glance: Europe 2020: state of health in the EU cycle, 2020. Available: https://doi.org/10.1787/82129230-en. [Accessed 27 Apr 2021]. · DOI · Paper page
- 10.1136/bmjgh-2020-002967 · DOI · Paper page
- 10.1136/bmjopen-2020-042555 · DOI
- Gajbhiye, 2021, Differential impact of COVID-19 in pregnant women from high-income countries and low- to middle-income countries: a systematic review and meta-analysis, Int J Gynaecol Obstet, 155, 48-56, 10.1002/ijgo.13793 · DOI
- Villar, 2021, Maternal and neonatal morbidity and mortality among pregnant women with and without COVID-19 infection: the INTERCOVID multinational cohort study, JAMA Pediatr, 175, 817, 10.1001/jamapediatrics.2021.1050 · DOI · Paper page
- Bozorgmehr, 2020, COVID and the convergence of three crises in Europe, Lancet Public Health, 5, e247, 10.1016/S2468-2667(20)30078-5 · doi:10.1016/s2468-2667(20)30078-5
- 10.1136/bmj.m1075 · DOI
- Nanda, 2021, COVID-19: a comprehensive review of epidemiology and public health system response in Nordic region, Int J Health Serv, 51, 287, 10.1177/0020731421994840 · DOI
- Kruk, 2015, What is a resilient health system? lessons from Ebola, The Lancet, 385, 1910, 10.1016/S0140-6736(15)60755-3 · DOI · Paper page
- 10.1186/s12992-015-0117-9 · DOI · Paper page
- 10.1136/bmjoq-2018-000525 · DOI · Paper page
- 10.1136/bmjopen-2020-048195 · DOI · Paper page
- Lazzerini M , Mariani I , de MeloELima TR . WHO standards-based tools to measure service providers’ and service users’ views on the quality of hospital child care: development and validation in Italy. BMJ Open 2021:e052115.doi:10.1136/bmjopen-2021-052115 · DOI · Paper page
- 10.1136/bmjopen-2020-037063 · DOI
- Lazzerini, 2020, Women's suggestions on how to improve the quality of maternal and newborn hospital care: a qualitative study in Italy using the who standards as framework for the analysis, BMC Pregnancy Childbirth, 20, 10.1186/s12884-020-02893-0 · DOI
- Lazzerini, 2022, Quality of facility-based maternal and newborn care around the time of childbirth during the COVID-19 pandemic: online survey investigating maternal perspectives in 12 countries of the who European region, Lancet Reg Health Eur, 13
- 10.1016/j.jclinepi.2006.03.012 · DOI · Paper page
- Sawyer, 2013, Measures of satisfaction with care during labour and birth: a comparative review, BMC Pregnancy Childbirth, 13, 10.1186/1471-2393-13-108 · DOI · Paper page
- 10.1111/j.1524-4733.2005.04054.x · DOI · Paper page
- Braithwaite, 2003, Using the Internet to conduct surveys of health professionals: a valid alternative?, Fam Pract, 20, 10.1093/fampra/cmg509 · DOI · Paper page
- 10.1177/0163278707300634 · DOI
- Poon, 2020, Global interim guidance on coronavirus disease 2019 (COVID-19) during pregnancy and puerperium from FIGO and allied partners: information for healthcare professionals, Int J Gynaecol Obstet, 149, 273-286, 10.1002/ijgo.13156 · DOI · Paper page
- Vivilaki, 2020, Respectful midwifery care during the COVID-19 pandemic, Eur J Midwifery, 4, 8
- Lazzerini, 2020, Delayed access or provision of care in Italy resulting from fear of COVID-19, Lancet Child Adolesc Health, 4, e10, 10.1016/S2352-4642(20)30108-5 · DOI · Paper page
- 10.1016/s2468-2667(20)30060-8 · DOI · Paper page
- Afulani, 2019, Person-Centred maternity care in low-income and middle-income countries: analysis of data from Kenya, Ghana, and India, Lancet Glob Health, 7, e96, 10.1016/S2214-109X(18)30403-0 · DOI · Paper page
- Vedam, 2017, The mothers on respect (MOR) index: measuring quality, safety, and human rights in childbirth, SSM Popul Health, 3, 201, 10.1016/j.ssmph.2017.01.005 · DOI · Paper page
- 10.1371/journal.pone.0171804 · DOI · Paper page
- 10.5116/ijme.4dfb.8dfd · DOI · Paper page
- 10.1177/001316446002000104 · DOI · Paper page
- 10.1016/0895-4356(90)90158-L · DOI · Paper page
- 10.2307/2529310 · DOI · Paper page
- Abdelrahman, 2021, Dental practice closure during the first wave of COVID-19 and associated professional, practice and structural determinants: a multi-country survey, BMC Oral Health, 21, 10.1186/s12903-021-01601-4 · DOI
- Delgado, 2020, Personal safety during the COVID-19 pandemic: realities and perspectives of healthcare workers in Latin America, Int J Environ Res Public Health, 17, 10.3390/ijerph17082798 · DOI · Paper page
- 10.2471/BLT.16.180190 · DOI · Paper page
- Bombard, 2018, Engaging patients to improve quality of care: a systematic review, Implementation Sci, 13, 98, 10.1186/s13012-018-0784-z · DOI · Paper page
Cited by
Valente, E. P., Mariani, I., Bomben, A., Morano, S., Gemperle, M., Otelea, M. R., Miani, C., Elden, H., Sarantaki, A., Costa, R., et al. (2024) · Journal of Global Health · doi:10.7189/jogh.14.04164 · Cited by 2
Self-citation
Metadata
- Authors
- Valente, E. P., Covi, B., Mariani, I., Morano, S., Otelea, M., Nanu, I., Nanu, M. I., Elden, H., Linden, K., Zaigham, M., Vik, E. S., Kongslien, S., Nedberg, I., Costa, R., Rodrigues, C., Dias, H., Drandić, D., Kurbanović, M., Sacks, E., Muzigaba, M., Lincetto, O., & Lazzerini, M.
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2022-04
- Volume
- 12
- Issue
- 4
- Pages
- e056753
- ISSN
- 2044-6055
- Cited by
- 12
- References
- 11
- Language
- en
- Funders
- Institute for Maternal and Child Health IRCCS Burlo Garofolo, Trieste, Italy. (N/A)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries. https://app.cochat.ai/papers/10.1136/bmjopen-2021-056753
- The paper
- Valente, E. P., Covi, B., Mariani, I., Morano, S., Otelea, M., Nanu, I., Nanu, M. I., Elden, H., Linden, K., Zaigham, M., Vik, E. S., Kongslien, S., Nedberg, I., Costa, R., Rodrigues, C., Dias, H., Drandić, D., Kurbanović, M., Sacks, E., . . . Lazzerini, M. (2022). WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries. BMJ Open. https://doi.org/10.1136/bmjopen-2021-056753
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.