The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index; 1 of the 17 sources its claims cite were checked for support.
Evaluation of Drug Combination Effect Using a Bliss Independence Dose–Response Surface Model
Open accessAbstract
To test the anticancer effect of combining two drugs targeting different biological pathways, the popular way to show synergistic effect of drug combination is a heat map or surface plot based on the percent excess the Bliss prediction using the average response measures at each combination dose. Such graphs, however, are inefficient in the drug screening process and it does not give a statistical inference on synergistic effect. To make a statistically rigorous and robust conclusion for drug combination effect, we present a two-stage Bliss independence response surface model to estimate an overall interaction index (τ) with 95% confidence interval (CI). By taking into all data points account, the overall τ with 95% CI can be applied to determine if the drug combination effect is synergistic overall. Using some example data, the two-stage model was compared to a couple of classic models following Bliss rule. The data analysis results obtained from our model reflect the pattern shown from other models. The application of overall τ helps investigators to make decision easier and accelerate the preclinical drug screening.
Overview
CoChat Summary
TL;DR
The paper proposes a two-stage Bliss independence dose–response surface model that estimates an overall interaction index (τ) with a 95% confidence interval for two-drug combinations. It applies the method to LN229 glioblastoma viability data for Gamitrinib plus PI3K inhibitors and compares it with per-dose and one-stage approaches.
Key findings
- The overall τ with 95% CI classifies combination effects as synergistic when τ < 1, independent when τ = 1, and antagonistic when τ > 1; if the upper confidence bound is below 1, the combination is concluded to be significantly synergistic overall.
- In the example data, Gamitrinib plus BKM120 showed no overall synergy, while Gamitrinib plus BEZ235 showed significant overall synergy. For BEZ235, all series 95% CIs except Gamitrinib at dose 0.222 were below 1; for BKM120, all CIs crossed or sat above 1.
- The one-stage Whitehead model agreed with the proposed method for Gamitrinib plus BKM120 (non-synergistic), but for Gamitrinib plus BEZ235 it failed to estimate some parameter variances, leaving an incomplete correlation matrix and producing a SAS warning. It also failed to converge for Lee et al. (2007) data and had a similar issue with Chou and Talalay’s Table 2 data.
- Bootstrap estimates stabilized after 100 resamples; the 95% CI was computed as exp(mean log τ ± 1.96 × SE), with empirical quantiles recommended for non-normal distributions using a larger number such as 1000 bootstrap samples.
Methods
- Two-stage modeling: first, single-drug dose–response curves were fit with a four-parameter logistic/Hill equation (U = 1 and L = 0 fixed) using nlsLM in R to estimate log(IC50) and Hill slope; second, the overall τ was estimated from a Bliss response surface via a bisection algorithm and nlsLM, with bootstrap resampling from the bivariate normal distribution of first-stage parameters.
- Data: LN229 glioblastoma cells were plated in 384-well format and treated in a 7×7 matrix with Gamitrinib and PI3K inhibitors (BKM120, BEZ235) using a 1:3 dilution series from 2.00 μM to 0.008 μM for 18 h at 37°C. Viability was measured by fluorescence and normalized to 10 μM doxorubicin (positive control) and 0.2% DMSO (negative control); inhibition was calculated as 1 − viability. Each combination experiment was run twice, and Gamitrinib quadruplets were averaged.
- Comparisons: the same examples were analyzed with Zhao et al. (2014) per-dose excess-over-Bliss grid plots and with Whitehead et al. (2008) one-stage SAS NLIN modeling.
Limitations
- The paper states that Bliss and Loewe are models and are unlikely to capture the full complexity of any drug combination; choosing between them depends on current understanding of whether the drugs act through the same pathway.
- The proposed two-stage method requires each single drug’s dose–response curve to be well fitted by the Hill equation or four-parameter logistic model; if not, alternative first-stage models are needed, which the authors identify as future work.
- The paper notes that the bootstrap confidence interval assumes approximate normality of log τ, and that empirical quantiles with a larger bootstrap sample are more robust for non-normal distributions. Evident from the text: the evaluation uses only one cell line and two drug combinations, with no simulation study or formal operating-characteristic assessment reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 4 Not valid · 14 Not checked · 29 Own results and interpretations
In the paper
“The one-stage modeling failed to converge when we analyzed the data from Lee et al (2007) (Table 4).”
§ Evaluation of drug combination effect using a Bliss independence dose-response surface model > Data Example and Analysis Results > Interaction Indexes
What the sources say
- Not checked — no full text of the sourcecites Lee et al (2007) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 2 A shows that the lower bounds of the 95% CI of excess over Bliss scores are many negative across the combination doses of Gamitrinib and BKM120.”
§ Evaluation of drug combination effect using a Bliss independence dose-response surface model > Data Example and Analysis Results > Excess over Bliss Scores
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“A similar issue occurred when the one-stage method was applied to analyze other data such as Chou and Talalay’s (1981) Table 2 data (Table 4).”
§ Evaluation of drug combination effect using a Bliss independence dose-response surface model > Data Example and Analysis Results > Interaction Indexes
What the sources say
- Not matchedcites Chou and Talalay’s (1981)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The overall interaction index (the first data point) indicates that combinations of Gamitrinib and BKM120 don’t have a synergistic effect overall.”
§ Evaluation of drug combination effect using a Bliss independence dose-response surface model > Data Example and Analysis Results > Interaction Indexes
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“But for the example data “Gami+BEZ235”, the one-stage method yielded unreliable estimates since it failed to estimate the variance of some parameters, when made the approximate correlation matrix incomplete.”
§ Evaluation of drug combination effect using a Bliss independence dose-response surface model > Data Example and Analysis Results > Interaction Indexes
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 47 claims and every source verdict.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“It should be noted that some of the drugs with which 5‐fluorouracil was combined were used in very high concentrations compared with our study, for example, 100 μM for kaempferol and 50 μM for tenacissocide G [36, 37].”
From Synergistic Potential of Argentatins A and B to Improve 5‐Fluorouracil Cytotoxicity in Colorectal Cancer Cell Models (2024) · cites this paper as [36]
Experimental — accuracy not yet measured
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Arzneimittelforschung: Erstanwendung am Menschen in der Phase I
Miletzki, B., & Gleiter, C. H. (2005) · Bundesgesundheitsblatt Gesundheitsforsch.Gesundheitsschutz · doi:10.1007/s00103-005-1024-7 · Cited by 9,355
Chou, T.-C., & Talalay, P. (1984) · Advances in Enzyme Regulation · doi:10.1016/0065-2571(84)90007-4 · Cited by 7,178 · cited 3×
“The Bliss independence interaction index τ for combination effect of two drugs can be expressed as Equation (4) (Chou and Talalay 1981, 1984): τ = da Dy,A + db Dy,B + dadb Dy,ADy,B ⎧⎨ ⎩ < 1 Synergism = 1 Independent > 1 Antagonism (4) To estimate an overall Bliss interaction index, we performed…”
BackgroundChou, T.-C. (2006) · Pharmacological Reviews · doi:10.1124/pr.58.3.10 · Cited by 5,163 · cited 4×
“…years, many methods have been proposed (Loewe 1953; Bliss 1956; Carter et al. 1988; Berenbaum 1989; Greco, Par, and Rustum 1990; Machado and Robinson 1994; Greco, Bravo, and Parsons 1995; Dawson, Carter, and Gennings 2002; Chou 2006; Fitzgerald et al. 2006; Lee et al. 2007; Whitehead et al. 2008).”
MethodInfluential(2024) · Pharmacological Reviews · doi:10.1124/pr · Cited by 2,664
Tumour micro-environment elicits innate resistance to RAF inhibitors through HGF secretion
Straussman, R., Morikawa, T., Shee, K., Barzily-Rokni, M., Qian, Z. R., Du, J., Davis, A., Mongare, M. M., Gould, J., Frederick, D. T., et al. (2012) · Nature · doi:10.1038/nature11183 · Cited by 1,771 · cited 1×
“Instead, many biologists have become accustomed to using heat maps or surface plots based simply on “excess over Bliss” for determining drug combination effect (Straussman et al. 2012; Ghosh et al. 2015; O’Neil et al. 2016; Sun, Bao, and Shao 2016; Zimmera et al. 2016).”
BackgroundThe search for synergy: a critical review from a response surface perspective.
Greco, W. R., Bravo, G., & Parsons, J. C. (1995) · Pharmacological Reviews · doi:10.1016/s0031-6997(25)06847-4 · Cited by 1,434 · cited 1×
“…years, many methods have been proposed (Loewe 1953; Bliss 1956; Carter et al. 1988; Berenbaum 1989; Greco, Par, and Rustum 1990; Machado and Robinson 1994; Greco, Bravo, and Parsons 1995; Dawson, Carter, and Gennings 2002; Chou 2006; Fitzgerald et al. 2006; Lee et al. 2007; Whitehead et al. 2008).”
MethodBerenbaum, M. C. (1989) · Pharmacological Reviews · doi:10.1016/s0031-6997(25)00026-2 · Cited by 1,414
(1953) · PubMed · Cited by 942
Systems biology and combination therapy in the quest for clinical efficacy
Fitzgerald, J. B., Schoeberl, B., Nielsen, U. B., & Sorger, P. K. (2006) · Nature Chemical Biology · doi:10.1038/nchembio817 · Cited by 570 · cited 1×
“…years, many methods have been proposed (Loewe 1953; Bliss 1956; Carter et al. 1988; Berenbaum 1989; Greco, Par, and Rustum 1990; Machado and Robinson 1994; Greco, Bravo, and Parsons 1995; Dawson, Carter, and Gennings 2002; Chou 2006; Fitzgerald et al. 2006; Lee et al. 2007; Whitehead et al. 2008).”
Method
Research works printed but not linked: 2
- Greco W. R., 1990, Cancer Research, 50, 5318
- Loewe S., 1953, Arzneimittelforschung, 3, 285
Cited by
Statistical determination of synergy based on Bliss definition of drugs independence
Demidenko, E., & Miller, T. W. (2019) · PLOS ONE · doi:10.1371/journal.pone.0224137 · Cited by 187
Co‐targeting BET and MEK as salvage therapy for MAPK and checkpoint inhibitor‐resistant melanoma
Echevarría-Vargas, I. M., Reyes-Uribe, P. I., Guterres, A. N., Yin, X., Kossenkov, A. V., Liu, Q., Zhang, G., Krepler, C., Cheng, C., Wei, Z., et al. (2018) · EMBO Molecular Medicine · doi:10.15252/emmm.201708446 · Cited by 96
“To determine synergy, interaction index was calculated for every combination using a dose–response surface model based on Bliss independence principle (Harbron, 2010; Liu et al, 2018).”
MethodSelf-citationGohar, A. V., Cassel, J. A., Mohammed, F. S., Zarei, M., Hue, J. J., Hajihassani, O., Graor, H. J., Srikanth, Y. V. V., Karim, S. A., Abbas, A., et al. (2022) · Nature Cancer · doi:10.1038/s43018-022-00393-y · Cited by 93
Olszewski, K. L., Barsotti, A. M., Feng, X., Momcilovic, M., Liu, K. G., Kim, J., Morris, K., Lamarque, C., Gaffney, J., Yu, X., et al. (2021) · Cell chemical biology · doi:10.1016/j.chembiol.2021.10.007 · Cited by 82
Drug-Drug Interactions and Synergy: From Pharmacological Models to Clinical Application
Calzetta, L., Page, C. P., Matera, M. G., Cazzola, M., & Rogliani, P. (2024) · Pharmacological Reviews · doi:10.1124/pharmrev.124.000951 · Cited by 82
Metadata
- Authors
- Liu, Q., Yin, X., Languino, L. R., & Altieri, D. C.
- Affiliations
- The Wistar Institute (US)
- Thomas Jefferson University (US)
- Venue
- Statistics in Biopharmaceutical Research
- Publisher
- Informa UK Limited
- Published
- 2018-04-03
- Volume
- 10
- Issue
- 2
- Pages
- 112-122
- ISSN
- 1946-6315 (ISSN-L)
- PMC
- PMC6415926
- OpenAlex
- W2788684488
- Cited by
- 208
- References
- 31
- Citations by year
- 2026: 54 · 2025: 37 · 2024: 37 · 2023: 26 · 2022: 26 · 2021: 16 · 2020: 8 · 2019: 3 · 2018: 1
- FWCI
- 5.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Statistics in Biopharmaceutical Research (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- the Office of the Assistant Secretary of Defense for Health Affairs (W81XWH-13-1-0193)
- National Institutes of Health (Cancer Center Support Grant (CCSG) CA010815,P01 CA140043)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- drug synergy, Bliss independence model, interaction index, confidence interval estimation, anticancer drug combination, two-stage model, drug screening
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of Drug Combination Effect Using a Bliss Independence Dose–Response Surface Model. https://app.cochat.ai/papers/10.1080/19466315.2018.1437071
- The paper
- Liu, Q., Yin, X., Languino, L. R., & Altieri, D. C. (2018). Evaluation of Drug Combination Effect Using a Bliss Independence Dose–Response Surface Model. Statistics in Biopharmaceutical Research. https://doi.org/10.1080/19466315.2018.1437071
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.