‘Trying to pin down jelly’ - exploring intuitive processes in quality assessment for meta-ethnography
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Studies that systematically search for and synthesise qualitative research are becoming more evident in health care, and they can make an important contribution to patient care. However, there is still no agreement as to whether, or how we should appraise studies for inclusion. We aimed to explore the intuitive processes that determined the 'quality' of qualitative research for inclusion in qualitative research syntheses. We were particularly interested to explore the way that knowledge was constructed. METHODS: We used qualitative methods to explore the process of quality appraisal within a team of seven qualitative researchers funded to undertake a meta-ethnography of chronic non-malignant musculoskeletal pain. Team discussions took place monthly between October 2010 and June 2012 and were recorded and transcribed. Data was coded and organised using constant comparative method. The development of our conceptual analysis was both iterative and collaborative. The strength of this team approach to quality came from open and honest discussion, where team members felt free to agree, disagree, or change their position within the safety of the group. RESULTS: We suggest two core facets of quality for inclusion in meta-ethnography - (1) Conceptual clarity; how clearly has the author articulated a concept that facilitates theoretical insight. (2) Interpretive rigour; fundamentally, can the interpretation 'be trusted?' Our findings showed that three important categories help the reader to judge interpretive rigour: (ii) What is the context of the interpretation? (ii) How inductive is the interpretation? (iii) Has the researcher challenged their interpretation? CONCLUSIONS: We highlight that methods alone do not determine the quality of research for inclusion into a meta-ethnography. The strength of a concept and its capacity to facilitate theoretical insight is integral to meta-ethnography, and arguably to the quality of research. However, we suggest that to be judged 'good enough' there also needs to be some assurance that qualitative findings are more than simply anecdotal. Although our conceptual model was developed specifically for meta-ethnography, it may be transferable to other research methodologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
The SAGE Handbook of Grounded Theory
Bryant, A., & Charmaz, K. (2007) · SAGE · doi:10.4135/9781848607941 · Cited by 2,798
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Qualitative research methods in health technology assessment: a review of the literature.
Murphy, Dingwall, Greatbatch, Parker, & Watson (1998) · Health Technology Assessment · doi:10.3310/hta2160 · Cited by 1,107 · cited 1×
“Suggested criteria for appraising quality vary considerably [4], and appraisal checklists do not seem to produce consistent judgements [3].”
BackgroundConducting a meta-ethnography of qualitative literature: Lessons learnt
Atkins, S., Lewin, S., Smith, H., Engel, M., Fretheim, A., & Volmink, J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-21 · Cited by 981
Resisting medicines: a synthesis of qualitative studies of medicine taking
Pound, P., Britten, N., Morgan, M., Yardley, L., Pope, C., Daker-White, G., & Campbell, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.11.063 · Cited by 868 · cited 2×
“It is currently the most widely cited method of qualitative synthesis in health care research [2,15], and has been used in several areas of health research [2,5,16-18].”
MethodThe problem of appraising qualitative research
Dixon-Woods, M. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.008714 · Cited by 653 · cited 2×
“Some researchers suggest that we attempt to distinguish ‘fatal flaws’ in qualitative systematic review [3,11].”
BackgroundEvaluating meta-ethnography: systematic analysis and synthesis of qualitative research
Campbell, R., Pound, P., Morgan, M., Daker-White, G., Britten, N., Pill, R., Yardley, L., Pope, C., & Donovan, J. (2011) · Health Technology Assessment · doi:10.3310/hta15430 · Cited by 619
Dixon-Woods, M., Sutton, A., Shaw, R., Miller, T., Smith, J., Young, B., Bonas, S., Booth, A., & Jones, D. (2007) · Journal of Health Services Research & Policy · doi:10.1258/135581907779497486 · Cited by 546
Malpass, A., Shaw, A., Sharp, D., Walter, F., Feder, G., Ridd, M., & Kessler, D. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2008.09.068 · Cited by 368
Cited by
Validity, reliability, and generalizability in qualitative research
Leung, L. (2015) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.161306 · Cited by 1,404
“[39] Finally, Toye et al.[40] reported the practicality of using “conceptual clarity” and “interpretative rigor” as intuitive criteria for assessing quality in meta‑ethnography, which somehow echoed Rolfe’s controversial aesthetic theory of research reports.”
BackgroundAmes, H., Glenton, C., & Lewin, S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0665-4 · Cited by 609
Improving reporting of meta-ethnography: the eMERGe reporting guidance
France, E. F., Cunningham, M., Ring, N., Uny, I., Duncan, E. A. S., Jepson, R. G., Maxwell, M., Roberts, R. J., Turley, R. L., Booth, A., et al. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0600-0 · Cited by 469
Benoot, C., Hannes, K., & Bilsen, J. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0114-6 · Cited by 370
Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., & Barker, K. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-80 · Cited by 322
Self-citation
Metadata
- Authors
- Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K.
- Venue
- BMC Medical Research Methodology
- Published
- 2013-03-21
- Volume
- 13
- Issue
- 1
- Pages
- 46-46
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2046318951
- Cited by
- 153
- References
- 13
- FWCI
- 46.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ‘Trying to pin down jelly’ - exploring intuitive processes in quality assessment for meta-ethnography. https://app.cochat.ai/papers/10.1186/1471-2288-13-46
- The paper
- Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K. (2013). ‘Trying to pin down jelly’ - exploring intuitive processes in quality assessment for meta-ethnography. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-13-46
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.