The DOI matches its Crossref record; 45 of the 47 references it cites were found in a registry or an index; 3 of the 31 sources its claims cite were checked for support.
The Question of Efficacy
Abstract
<section class="abstract">Historians avoid studying the efficacy of therapy before the age of the double-blind randomised trial. A related topic that has been the cause of great confusion is the meaning of the placebo effect and the efficacy of placebos. Medical anthropology and sociology, although they do not usually study the past, offer extremely useful tools for dealing rationally with both issues. This study uses their methods, among others, to argue that the body’s response to specific therapy is only one component of understanding efficacy, and that the others are much more useful in historical studies, especially those of other cultures. The case studies given in this paper are based on largely medical texts from sixteenth- to seventeenth-century China. </section>
Overview
CoChat Summary
TL;DR
Sivin argues that historical studies of therapeutic efficacy should not rely on double-blind-trial notions or the confused “placebo effect,” but should analyze efficacy through three bodily responses: autonomous, specific, and meaning. Using medical anthropology and Chinese medical texts, he shows that disease categories and criteria of efficacy vary by time and culture, and that classical Chinese medicine’s strengths lay mainly in chronic care and the meaning response.
Key findings
- Efficacy in health care includes three distinct responses: the body’s autonomous recovery/homeostasis, the specific response to biological, chemical, or physical intervention, and the meaning response to symbols, relationships, and personal interaction; the specific response is only one component.
- The term “placebo effect” is a “hodge-podge” of phenomena—nature taking its course, regression to the mean, routine care, patient-doctor relationship, expectation, and research circumstances—so Moerman’s “meaning response” is a better label.
- Modern US medicine is unbalanced: a cited survey states that “less than 3% of health funding is directed to prevention efforts,” and chronic disease control is compared to where the nation was a century ago with basic sanitation.
- Disease entities change across time and culture: *jiaoqi* began by about 500 CE as an often fatal disease, later became beri-beri in modern medicine, and now increasingly refers to athlete’s foot; fever in the late nineteenth-century US was a disease with many symptoms, not merely elevated temperature.
Methods
- Conceptual and historical essay using medical anthropology and sociology, especially Daniel Moerman’s “meaning response” and T. J. Kaptchuk’s critiques of placebo research, to reframe efficacy.
- Case examples draw on Chinese medical sources, including *Origins and Symptoms of Medical Disorders* (611), *San yin ji yi bing yuan lun cui* (c. 1174), and Qing palace medical archives; the abstract states the case studies are based largely on sixteenth- to seventeenth-century Chinese medical texts, while the text also focuses on eleventh-century China (960–1127).
- Analysis is comparative and interpretive rather than statistical; the paper notes that imperial Chinese records are fragmentary and contain “no statistics at all.”
Limitations
- Stated: it is “impossible to compare in detail” the strengths and limitations of Chinese therapy in the eleventh century with modern biomedicine because they have too little in common.
- Stated: knowledge of religious curing, local curers, and illiterate or semi-literate herbalists is “abysmally ignorant,” and the history of medical ritual remains unstudied, limiting comparison.
- Evident: this is a single-author conceptual essay relying on secondary literature and illustrative historical cases, not a systematic clinical or epidemiological study.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 22 Not valid · 32 Not checked · 71 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“With due attention to the social dimension, he demonstrates that human decisions regularly change disease entities.”
What the sources say
- Supportedcites Cunningham 2002 source
In §3, “The 1999 statistics” (page not provided), Cunningham says disease identities changed across periods and that this happens through human action. He also points to changes in medical thinking and social attitudes. (LLM, conf=0.94)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In England, as he demonstrates for several points over the past 400 years, the categories used for reporting causes of death differed fundamentally from those that physicians today are qualified to choose between.”
What the sources say
- Supportedcites Cunningham 2002 source
In ‘The 1999 statistics’ (page not provided), Cunningham compares cause-of-death categories from 1632, 1839, and 1999 and says their arrays and underlying concepts of disease differ. He also explains that modern medical reporting uses the International Classification of Diseases, supporting the contrast with the categories available in earlier periods. (LLM, conf=0.93)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This response, for all of the primary-care physicians with whom I have discussed their work, makes patience-on their part and the patient's-the most effective resource for the self-limiting majority of clinical problems-colds, flus, muscular aches and pains, and common digestive problems.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“But in classical medicine its meaning was quite different.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In the US in the late nineteenth century, fever was a disease with many symptoms, including cold sensations and elevated pulse rate.”
What the sources say
- Not matchedcites Dunglison 1874
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
36 more claims
Create a free account to see all 128 claims and every source verdict.
- Probably not a substantial claim. 64
- It may state two separate claims as one. 45
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ It also includes the circumstances of research itself: · p. 9
“The classic study is Rubinstein and Brown 1984.”
§ Secondary Sources · p. 26
“Rubenstein, R. A. and R. T. Brown 1984, 'An Evaluation of the Validity of the Diagnostic Category and Attention Deficit Disorder'”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ What Does Efficacy Mean? · p. 5
“9 Moerman 2000, p. 56.”
§ Secondary Sources · p. 25
“Moerman, D. 2000, 'Cultural Variations in the Placebo Effect: Ulcers, Anxiety, and Blood Pressure', Medical Anthropology Quarterly , 14 (1): 1-22.”
Citations
Cites
Kleinman, A. (1980) · doi:10.1525/9780520340848 · Cited by 4,945
Placebos without Deception: A Randomized Controlled Trial in Irritable Bowel Syndrome
Kaptchuk, T. J., Friedlander, E., Kelley, J. M., Sanchez, M. N., Kokkotou, E., Singer, J. P., Kowalczykowski, M., Miller, F. G., Kirsch, I., & Lembo, A. J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015591 · Cited by 900
Attention-Deficit Hyperactivity Disorder
Hinshaw, S. P., & Zalecki, C. (2001) · Handbook of Conceptualization and Treatment of Child Psychopathology · doi:10.1016/b978-008043362-2/50006-8 · Cited by 584
Whyte, S. R., van der Geest, S., & Hardon, A. P. (2003) · UvA-DARE (University of Amsterdam) · Cited by 581
Meaning Medicine and the “Placebo Effect”
Moerman, D. E. (2002) · doi:10.1017/cbo9780511810855 · Cited by 401
Death foretold: prophecy and prognosis in medical care
(2000) · Choice Reviews Online · doi:10.5860/choice.38-0972 · Cited by 394
Slaying the dragon: The history of addiction treatment and recovery in America
Jonnes, J. (1999) · Journal of the History of the Behavioral Sciences · doi:10.1002/(sici)1520-6696(199921)35:2<187::aid-jhbs9>3.0.co;2-v · Cited by 387
A Midwife's Tale: The Life of Martha Ballard, Based on Her Diary, 1785-1812.
Karlsen, C. F., & Ulrich, L. T. (1991) · The Journal of American History · doi:10.2307/2078289 · Cited by 353
The placebo effect: An interdisciplinary exploration
Sullivan, M. D. (1998) · Journal of the History of the Behavioral Sciences · doi:10.1002/(sici)1520-6696(199821)34:2<221::aid-jhbs31>3.0.co;2-u · Cited by 340
‘Powerful Placebo: The Dark Side of the Randomised Controlled Trial’
Kaptchuk, T. J. (1998) · The Lancet · doi:10.1016/s0140-6736(97)10111-8 · Cited by 339
Research works printed but not linked: 15
- Aronowitz, 1998, Making Sense of Illness: Science, Society, and Disease
- Brockliss, 1997, The Medical World of Early Modern France
- Chen, 1990, 清宮醫案研究 (A study of the Qing medical archives)
- Csordas, 1996, ‘The Therapeutic Process’, 3
- Dunglison, 1874 [1839], Medical Lexicon: A Dictionary of Medical Science: Containing a Concise Explanation of the Various Subjects and Terms
- Geertz, 1973 [1966], ‘Religion as a Cultural System’, 87
- Green, 1994, ‘Documenting Medieval Women’s Medical Practice’, 322
- Kaptchuk, 2013, ‘Placebo-controlled Randomized Trials and Chinese Medicine’, 329
- Lock, 1996, ‘A Critical-interpretive Approach in Medical Anthropology: Rituals and Routines of Discipline and Dissent’, 41
- Morris, 1997, ‘Placebo, Pain, and Belief: A Biocultural Model’, 187
- 2007, Public Health Advances through Chronic Disease Prevention: 1986–2006
- Pelling, 1998, The Common Lot: Sickness, Medical Occupations and the Urban Poor in Early Modern England
- Price, 1997, ‘The Contribution of Desire and Expectation to Placebo Analgesia: Implications for New Research Strategies’, 116
- Spiro, 1997, ‘Clinical Reflections on the Placebo Phenomenon’, 37
- Stein, 1973, ‘Ethanol and its Discontents: Paradoxes of Inebriation and Sobriety in American Culture’, Journal of Psychoanalytic Anthropology, 5, 355
Cited by
“Use Me as Your Test!”: Patients, Practitioners, and the Commensurability of Virtue
Hsiung, H. (2022) · Osiris · doi:10.1086/719230 · Cited by 3
Les pratiques "magico"-médicales dans la chine antique et médiévale : textes et objets
Caro, É. (2025) · theses.fr (ABES) · doi:10.70675/cebe7407za350z4721za6f8z7e1f28192860
Nylan, M. (2024) · International Journal of Divination and Prognostication · doi:10.1163/25899201-bja10014
Metadata
- Authors
- Sivin, N.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Sivin, Nathan
- Venue
- Asian Medicine
- Publisher
- Walter de Gruyter GmbH
- Published
- 2015-10-03
- Volume
- 10
- Issue
- 1-2
- Pages
- 9-35
- ISSN
- 1573-420X (ISSN-L)
- 1573-4218
- OpenAlex
- W4252274701
- Cited by
- 6
- References
- 47
- Citations by year
- 2025: 2 · 2024: 2 · 2022: 1 · 2017: 1
- FWCI
- 6.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Asian Medicine (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History › History of Medicine Studies
- Social Sciences › Arts and Humanities › History and Philosophy of Science › History of Science and Medicine
- Health Sciences › Medicine › Complementary and alternative medicine › Traditional Chinese Medicine Studies
- Keywords
- placebo effect, placebo response, medical anthropology, medical sociology, history of medicine, Chinese medical texts, historical medical texts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-21, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-21 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Question of Efficacy. https://app.cochat.ai/papers/10.1163/15734218-12341349
- The paper
- Sivin, N. (2015). The Question of Efficacy. Asian Medicine. https://doi.org/10.1163/15734218-12341349
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.