CoChat

Evaluating qualitative research

Open access
Stiles, William B · 1999 · Evidence Based Mental Health
Cited by 236

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Abstract

Evaluating qualitative researchQualitative research, like all scientific research, consists of comparing ideas with observations.In good research, the ideas are thereby changed-strengthened, weakened, qualified, or elaborated.Criteria for evaluating qualitative research focus both on the process and on the product-that is, on the research methods that are used and on the changed ideas themselves (the interpretation).Many qualitative investigators explicitly reject the possibility of absolute objectivity and truth.The concept of objectivity is replaced by the concept of permeability, the capacity of understanding to be changed by encounters with observations.Investigators argue that we cannot view reality from outside of our own frame of reference.Instead, good practice in research seeks to ensure that understanding is permeated by observation.Investigator bias can be reframed as impermeability (interpretations not permeated by empirical observations).Good practice in reporting seeks to show readers how understanding has been changed.The traditional goal of truth of statements is replaced by the goal of understanding by people.Thus, the validity of an interpretation is always in relation to some person, and criteria for assessing validity depend on who that person is (eg, reader, investigator, research participant).Qualitative research differs from traditional quantitative research on human experience in several ways.Results are typically reported in words rather than primarily in numbers.This may take the form of narratives (eg, case studies) and typically includes a rich array of descriptive terms, rather than focusing on a few common dimensions or scales.Investigators use their (imperfect) empathic understanding of participants' inner experiences as data.Events are understood and reported in their unique context.Materials may be chosen for study because they are good examples rather than because they are representative of some larger population.Sample size and composition may be informed by emerging results (eg, cases chosen to fill gaps; data gathering continued until new cases seem redundant).Emancipation or enhancement of participants may be considered as a legitimate purpose of the research.As a consequence of these characteristics, interpretations are always tentative and bound by context.The outline that follows was based on a review of how qualitative research on human experience was being conducted and reported. 1It includes lists of evaluative criteria for assessing (a) good practice in conducting the research and (b) validity of interpretations.These lists have been drawn from many sources, 1 and overlapping lists have been published by others. 2-8I encourage readers to consult these complementary sources.I have tried to make the lists inclusive, but they are neither exhaustive nor mutually exclusive, nor do all items apply equally to every piece of qualitative research.The term "qualitative research" refers to method rather than topic, and these lists may be understood differently in the context of research on different topics.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/ebmh.2.4.99

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 236

Metadata

Authors
Stiles, W. B.
Venue
Evidence Based Mental Health
Publisher
BMJ
Published
1999-11
Volume
2
Issue
4
Pages
99-101
ISSN
  • 1362-0347 (ISSN-L)
  • 1468-960X
OpenAlex
W2055493706
Cited by
236
References
1
FWCI
19.82
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.