The Challenges of Searching for and Retrieving Qualitative Studies
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
The authors’ purpose in this article is to report the results of their search and retrieval efforts to date in an ongoing study to develop the procedural, analytic, and interpretive techniques to conduct qualitative meta-synthesis projects, using studies on women with HIV infection as the method case. For researchers conducting qualitative meta-synthesis projects, the ideal goal is to retrieve all of the relevant studies in a field—not simply a sample of them. Bates’s model of berrypicking is used as the framework to describe the techniques used to conduct these searches. The authors discuss, in particular, the challenges of working with bibliographic databases, including choosing which databases to search, learning about the idiosyncrasies of working with each database, developing a list of search terms, and refining inclusion criteria regarding which studies to include in the meta-synthesis. Recommendations are given for searchers and writers of qualitative research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However you look, qualitative research is difficult to find [40-42].”
From Methods for the thematic synthesis of qualitative research in systematic reviews (2008) · cites this paper as [40]
Citations
Cites
Delmont, S., & Mason, J. (1997) · The British Journal of Sociology · doi:10.2307/591613 · Cited by 4,262
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Noblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
The design of browsing and berrypicking techniques for the online search interface
Bates, M. J. (1989) · Online Review · doi:10.1108/eb024320 · Cited by 1,757 · cited 9×
“Just as a berrypicker would meander through the bushes, looking for clumps of berries (Bates, 1989), the searcher wanders through the information forest, changing directions as needed to follow up on various leads and shifts in thinking.”
BackgroundMethodInfluentialQualitative metasynthesis: Issues and techniques
Sandelowski, M., Docherty, S., & Emden, C. (1997) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199708)20:4<365::aid-nur9>3.0.co;2-e · Cited by 1,046
Self-citationCampbell, R., Pound, P., Pope, C., Britten, N., Pill, R., Morgan, M., & Donovan, J. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(02)00064-3 · Cited by 921
Information Seeking in Electronic Environments
Marchionini, G. (1995) · doi:10.1017/cbo9780511626388 · Cited by 833
Wolf, F. (1986) · doi:10.4135/9781412984980 · Cited by 784
Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINE
Haynes, R. B., Wilczynski, N., McKibbon, K. A., Walker, C. J., & Sinclair, J. C. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95153434 · Cited by 765
Meta-Synthesis of Qualitative Findings
Jensen, L. A., & Allen, M. N. (1996) · Qualitative Health Research · doi:10.1177/104973239600600407 · Cited by 484 · cited 1×
“…product and the analytic processes by which the findings of studies are aggregated, integrated, summarized, or otherwise put together (Estabrooks, Field, & Morse, 1994; Jensen & Allen, 1996; Kearney, 1998; Noblit & Hare, 1988; Sandelowski, Docherty, & Emden, 1997; Schrieber, Crooks, & Stern, 1997).”
Text Information Retrieval Systems
Meadow, C. T., Kraft, D. H., & Boyce, B. R. (1992) · Cited by 367
Including qualitative research in systematic reviews: opportunities and problems
Dixon‐Woods, M., Fitzpatrick, R., & Roberts, K. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00257.x · Cited by 298
Aggregating Qualitative Findings: An Approach to Theory Development
Estabrooks, C. A., Field, P. A., & Morse, J. M. (1994) · Qualitative Health Research · doi:10.1177/104973239400400410 · Cited by 261
Medical Subject Headings Used to Search the Biomedical Literature
Coletti, M. H., & Bleich, H. L. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080317 · Cited by 236 · cited 4×
“We used the words anywhere option to ensure a comprehensive search, which is a common technique in information retrieval (Coletti & Bleich, 2001; Marchionini, 1995; Meadow et al., 2000).”
BackgroundMethodInfluentialInformation graphics: A comprehensive illustrated reference
Wilson, R. D. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(19980401)49:4<383::aid-asi11>3.0.co;2-v · Cited by 171
Hjørland, B. (2001) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.1131 · Cited by 165 · cited 1×
“For example, most database systems (e.g., MEDLINE ) have human indexers, and as with any work performed by humans, they can make mistakes entering information into an electronic citation database (Coletti & Bleich, 2001; Hjorland, 2001; Meadow et al., 2000).”
BackgroundEmpirical studies of end-user information searching
Sutcliffe, A. G., Ennis, M., & Watkinson, S. J. (2000) · Journal of the American Society for Information Science · doi:10.1002/1097-4571(2000)9999:9999<::aid-asi1033>3.0.co;2-5 · Cited by 133
The knowledge?behavior gap in use of health information
Sligo, F. X., & Jameson, A. M. (2000) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(2000)51:9<858::aid-asi80>3.0.co;2-q · Cited by 127
Ready-to-wear: Discovering grounded formal theory
Kearney, M. H. (1998) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199804)21:2<179::aid-nur8>3.0.co;2-g · Cited by 115 · cited 1×
“…product and the analytic processes by which the findings of studies are aggregated, integrated, summarized, or otherwise put together (Estabrooks, Field, & Morse, 1994; Jensen & Allen, 1996; Kearney, 1998; Noblit & Hare, 1988; Sandelowski, Docherty, & Emden, 1997; Schrieber, Crooks, & Stern, 1997).”
Psychological and Spiritual Growth in Women Living with HIV
Dunbar, H. T., Mueller, C. W., Medina, C., & Wolf, T. (1998) · Social Work · doi:10.1093/sw/43.2.144 · Cited by 92
Document representations and clues to document relevance
Barry, C. L. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1998)49:14<1293::aid-asi7>3.0.co;2-e · Cited by 74
Expectant fathers: Influence of perinatal education on stress, coping, and spousal relations
Diemer, G. A. (1997) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199708)20:4<281::aid-nur2>3.0.co;2-c · Cited by 67
Self-citationKang, D.-H., Coe, C. L., Karaszewski, J., & McCarthy, D. O. (1998) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199804)21:2<117::aid-nur3>3.0.co;2-m · Cited by 47
10. Synthesizing the Research: Themes, Challenges, and Opportunities
Pastor, M., & Mollenkopf, J. H. (2016) · Cornell University Press eBooks · doi:10.7591/9781501703959-011 · Cited by 47
When information retrieval measures agree about the relative quality of document rankings
Losee, R. M. (2000) · Journal of the American Society for Information Science · Cited by 27
Khan, K., & Locatis, C. N. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1998)49:14<1334::aid-asi14>3.0.co;2-0 · Cited by 22
Mizspellin and Medline: Table 1
Ray, J. G., & Vermeulen, M. J. (1996) · BMJ · doi:10.1136/bmj.313.7072.1658 · Cited by 20 · cited 1×
“%) misspelled words occurred within the abstract only and that 98 of the 200 articles with misspelled text words might be missed if a searcher conducted a MEDLINE search using the correctly spelled word alone without the heading (Ray & Vermeulen, 1996).”
BackgroundChudnov, D., Crooker, C. A., & Parker, K. (2000) · Serials Review · doi:10.1080/00987913.2000.10764619 · Cited by 4
In Women’s Words: The Values and Lived Experiences of HIV-Infected Women
KASS, N. E., & Faden, R. (1996) · doi:10.1093/oso/9780195099584.003.0016 · Cited by 3
Research works printed but not linked: 6
- Cooper, H., 1998, Synthesizing research
- Evans, D., 2002, Journal of the Medical Librarians Association, 90, 290
- Jasco, P., 1996, Online, 20, 24
- 10.1002/(SICI)1097-4571(2000)51:9<834::AID-ASI60>3.0.CO;2-1 · doi:10.1002/(sici)1097-4571(2000)51:9<834::aid-asi60>3.0.co;2-1
- Schrieber, R., 1997, Completing a qualitative project, 311
- 2000, Ulrich’s Periodicals Directory
Cited by
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis
Cooke, A., Smith, D., & Booth, A. (2012) · Qualitative Health Research · doi:10.1177/1049732312452938 · Cited by 2,608
“It has been suggested that the indexing of articles for most databases does not take place according to research methodology (Barroso et al., 2003).”
BackgroundSustainability‐oriented Innovation: A Systematic Review
Adams, R., Jeanrenaud, S., Bessant, J., Denyer, D., & Overy, P. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12068 · Cited by 1,584
“The selection process largely followed that outlined in Barroso et al. (2003), including scanning all citations identified from the various databases and web searches and within-team review to validate selections.”
Meta‐synthesis method for qualitative research: a literature review
Walsh, D., & Downe, S. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03380.x · Cited by 1,246
Rasmussen, M., Krølner, R. F., Klepp, K., Lytle, L., Brug, J., Bere, E. T., & Due, P. (2006) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-3-22 · Cited by 1,412
Metadata
- Authors
- Barroso, J., Gollop, C. J., Sandelowski, M., Meynell, J., Pearce, P. F., & Collins, L. J.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- Western Journal of Nursing Research
- Publisher
- SAGE Publications
- Published
- 2003-03
- Volume
- 25
- Issue
- 2
- Pages
- 153-178
- ISSN
- 0193-9459 (ISSN-L)
- 1552-8456
- OpenAlex
- W2049349167
- Cited by
- 272
- References
- 25
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 9 · 2023: 10 · 2022: 11 · 2021: 14 · 2020: 8 · 2019: 10 · 2018: 11 · 2017: 14 · 2016: 24 · 2015: 18 · 2014: 11 · 2013: 24 · 2012: 14
- FWCI
- 13.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Western Journal of Nursing Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Nursing Research (R01NR004907)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Keywords
- qualitative meta-synthesis, literature search strategies, bibliographic databases, inclusion criteria, qualitative research writing
- MeSH terms
- Humans, Review Literature as Topic, Meta-Analysis as Topic, Nursing Methodology Research, Databases, Factual, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.