The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index; 7 of the 75 sources its claims cite were checked for support.
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Open accessAbstract
Endogenous selection bias is a central problem for causal inference. Recognizing the problem, however, can be difficult in practice. This article introduces a purely graphical way of characterizing endogenous selection bias and of understanding its consequences (Hernán et al. 2004). We use causal graphs (direct acyclic graphs, or DAGs) to highlight that endogenous selection bias stems from conditioning (e.g., controlling, stratifying, or selecting) on a so-called collider variable, i.e., a variable that is itself caused by two other variables, one that is (or is associated with) the treatment and another that is (or is associated with) the outcome. Endogenous selection bias can result from direct conditioning on the outcome variable, a post-outcome variable, a post-treatment variable, and even a pre-treatment variable. We highlight the difference between endogenous selection bias, common-cause confounding, and overcontrol bias and discuss numerous examples from social stratification, cultural sociology, social network analysis, political sociology, social demography, and the sociology of education.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
60 Own interpretation · 27 No full text of the sources · 18 No basis given · 9 Sources not found · 7 Not checked yet · 4 Supported · 2 Partly supported · 1 Supported so far · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“This is exactly what Gangl & Ziefle’s (2009) selectivity-corrected analysis of the motherhood wage penalty finds.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
What the sources say
- Supportedcites Gangl & Ziefle 2009 source
The paper states that previous research tended to underestimate the motherhood wage penalty because it did not systematically account for dynamic selection into employment. Its Summary and Conclusions passage also reports that its selectivity-corrected estimates often exceed earlier estimates. (LLM, conf=0.94)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Over time, the number of cases available for analysis decreases, sometimes drastically so (e.g., Behr et al. 2005, Alderman et al. 2001).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
What the sources say
- Not checked — no full text of the sourcecites Behr et al. 2005 source
- Supportedcites Alderman et al. 2001 source
The Introduction reports that longitudinal datasets lose cases between survey rounds, with attrition ranging from 6% to 50%; it says there is often considerable attrition. This supports the claim that the number of cases available for analysis can decrease drastically over time. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Most prospective longitudinal studies experience attrition over time.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Shalizi & Thomas (2011) recently showed that latent homophily bias constitutes a previously unrecognized example of endogenous selection bias, where the social tie itself plays the role of the pre-treatment collider.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites Shalizi & Thomas 2011 source
In “Identifying Contagion From Non-Neighbors” (page unavailable), the paper explicitly says that selecting or conditioning on the social tie Aij activates a collider. Its account of network formation before observable outcomes also supports describing the tie as pre-treatment. “Endogenous selection bias” is a paraphrase of this mechanism, not the paper’s terminology. (LLM, conf=0.91)
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“If the analyst is willing to assume that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment, then it is sufficient to control for all variables that (directly or indirectly) cause treatment or outcome or both (VanderWeele & Shpitser 2011).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites VanderWeele & Shpitser 2011 source
Theorem 1 (Section 3) states that if any subset of measured pretreatment covariates blocks all backdoor paths from treatment to outcome, the subset comprising all observed causes of treatment or outcome does too. The Introduction states the same conditional result for confounding control. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The analyst assumes that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment.
- Supported
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Surveys of sample selection bias in sociology tend to emphasize examples where selection is affected by the treatment or the outcome, i.e., where sample selection occurs after treatment”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“all nonparametric identification problems can be classified as one of three underlying problems: overcontrol bias, confounding bias, and endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Identification analysis requires a theory (i.e., a model or assumptions) of how the data were generated.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Identification (assuming ideal data) is a necessary precondition for unbiased estimation (with real data).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
In the paper
“there is, at present, no universal solution to estimating causal effects in the presence of endogenous selection”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
What the sources say
- Not checked — no full text of the sourcecites Stolzenberg & Relles 1997 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“the analyst’s theory of data generation can never be fully tested empirically”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
What the sources say
- Not matchedcites Robins & Wasserman 1999
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
- Probably not a substantial claim. 27
- It may state two separate claims as one. 34
- The quote only partly states this claim. 1
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One solution to this problem is to model tie formation (and dissolution) explicitly (Shalizi & Thomas 2011). In the model of Figure 12, this can be accomplished by measuring and conditioning on the tie-forming characteristics of individual i, Ui, or individual j, Uj, or both.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Partly supportedcites Shalizi & Thomas 2011 sourceExperimental — accuracy not yet measured
In “Contagion Effects Are Nonparametrically Unidentifiable” (page unavailable), the paper says that making the traits influencing tie formation observable can remove the confounding path, supporting the proposed conditioning on tie-forming characteristics. But it does not present explicitly modeling tie formation and dissolution alone as a solution: it says allowing ties to vary over time does not help, and describes successful explicit models as also requiring strong assumptions and adequate observed covariates. (LLM, conf=0.84)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Greenland (2003), in particular, has derived useful analytic results and approximations for the relative size of endogenous selection bias and confounding bias in DAGs with binary variables (see also Kaufman et al. 2009).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
- Partly supportedcites Kaufman et al. 2009 sourceExperimental — accuracy not yet measured
Section 2.2 describes analytic bounds for causal risk differences in DAGs with binary variables, supporting the general connection made by “see also Kaufman et al. 2009” (page unavailable). The paper does not report approximations comparing the relative size of endogenous selection bias and confounding bias; the searched passages address causal-effect bounds instead. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
Every source the paper cites for this claim was checked and supports it.
In the paper
“In short, there exists no set of pre-treatment controls that is sufficient for identifying the causal effect of T on Y, and hence the VanderWeele & Shpitser (2011) rule does not apply.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites VanderWeele & Shpitser 2011 source
Theorem 1 (Section 3) guarantees that the selected controls suffice only if some subset of measured pretreatment covariates blocks all backdoor paths. Section 4 explicitly says that when no subset suffices, the controls selected by the criterion will not suffice either. Thus the rule's identification guarantee does not apply to the situation described; the source does not itself assess Figure 13c. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, bias can also arise if sample selection occurs prior to treatment.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Missing arrows are essential for inferring causal information from data.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Confounding originates from common causes, whereas endogenous selection originates from common outcomes.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Collider variables may occur before or after the treatment and before or after the outcome.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We highlight the difference between endogenous selection bias, common-cause confounding, and overcontrol bias”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Endogenous selection can result from conditioning on an outcome, but it can also result from conditioning on variables that have been affected by the outcome, variables that temporally precede the outcome, and even variables that temporally precede the treatment (Greenland 2003).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“a generalization of conventional linear path diagrams (Wright 1934, Blalock 1964, Duncan 1966, Bollen 1989) that is entirely nonparametric”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not matchedcites Pearl 1995, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Elwert 2013 source
- Not matchedcites Wright 1934, Blalock 1964, Duncan 1966, Bollen 1989
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recognizing the problem, however, can be difficult in practice.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Endogenous selection bias results from conditioning on an endogenous variable that is caused by two other variables, one that is (or is associated with) the treatment and one that is (or is associated with) the outcome”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“missing arrows represent the sharp assumption of no causal effect between variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“DAGs encode the analyst’s qualitative causal assumptions about the data-generating process in the population”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
What the sources say
- Not checked — no full text of the sourcecites Pearl 2009 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
In the paper
“Sample selection bias occurs when the selection of observations into a sample is not independent of the outcome”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Winship & Mare 1992 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Confounding bias results from failing to control for a common cause variable that one should have controlled for, whereas endogenous selection bias results from controlling for a common outcome variable that one should not have controlled for.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recognizing endogenous selection bias can be difficult, especially when sample selection occurs prior to treatment or when no selection (in the sense of discarding observations) takes place.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Because class size is randomized, T and Y share no common cause, and the total effect of treatment, T, on the outcome, Y, is identified by their marginal association.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If this assumption is correct, then analyzing complete cases only, i.e., conditioning on not having attrited, is entirely unproblematic; the causal effect P→D is identified without any adjustments for attrition.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In Figure 9a, attrition is completely random with respect to both treatment and outcome.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“overcontrol bias, confounding bias, and endogenous selection bias are distinct phenomena: They arise from different causal structures, and they call for different remedies.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > The Building Blocks: Causation, Confounding, and Endogenous Selection
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“these three configurations correspond exactly to the sources of causation, confounding bias, and endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > The Building Blocks: Causation, Confounding, and Endogenous Selection
What the sources say
- Not matchedcites Pearl 1988, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“conditioning on a noncollider blocks the flow of association along a path, whereas conditioning on a collider opens the flow of association.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > Identification in General DAGs
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, under the assumptions of Figure 10b, controlling for Q will remove at least some of the confounding bias exerted by U and not introduce any new biases.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“outright selection on an outcome, or selection on a variable affected by the outcome, is always potentially problematic.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If, however, there are unmeasured factors, such as marital distress, U, that jointly affect attrition and divorce, as in Figure 9c, then C becomes a collider along the noncausal path between poverty and divorce, P→C←U→D, and conditioning on C will unblock this path and distort the association between poverty and divorce.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Furthermore, they found that although controlling for additional pre-treatment variables generally reduced bias, sometimes including additional controls increased bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Not checked — no full text of the sourcecites Steiner et al. 2010 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 10a starts by positing the usual assumption that innate ability, U, confounds the effect of schooling on wages via the unblocked noncausal path S←U→W. Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: Innate ability confounds the effect of schooling on wages.
- Rests on an assumption: True innate ability is unobserved.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We hypothesize that the finding is due to endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgeddirect- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true.
- The authors state this as an assumption: In the music study example, additional explanatory variables are not considered.
- Rests on an assumption: In the music example, topping the Billboard charts has a positive effect on inclusion in the Rolling Stone 500 in the population of all albums.
- The authors state this as an assumption: In the music example, there is no common-cause confounding.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In Figure 9b, poverty is assumed to affect the risk of dropping out, P→C. Nevertheless, the causal effect of P→D remains identified. As in Figure 9a, conditioning on C in Figure 9b does not lead to bias because conditioning on C does not open any noncausal paths between P and D.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In Figure 9b, poverty affects the risk of dropping out.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the analyst restricts the analysis to employed women, he will thus condition on the collider E, unblock the non-causal path from motherhood to offer wages, M→WR→E←WO, and induce endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Many social science data sets include information on motherhood but not on women's reservation wage.
- Rests on an assumption: Data typically include information on offer wages only for women who are employed.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“does not transmit association and is said to be blocked, closed, or d-separated if the path contains a noncollider, C, that has been conditioned on”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > Identification in General DAGs
What the sources say
- Not matchedcites Pearl 1988, 1995
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is the source of informative censoring and attrition bias in longitudinal studies, and it is a central problem of mediation analysis in the search for social mechanisms and the estimation of direct and indirect effects.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Note that this second—but not the first—endogenous selection problem persists even if the noncollider WR is measured and controlled.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Either practice can lead to endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To the extent that U strongly affects Q, Q is a valid proxy for U. But to the extent that Q does not perfectly measure U, the effect of S on W remains partially confounded.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The odds ratio from the logistic regression of R on B in this selected sample would then be downward biased compared with the true population odds ratio and possibly flip directions, ORS = aSd/bc < ad/bc = ORP.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In the music example, there is no common-cause confounding.
- Rests on an assumption: Most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.
None of the sources cited for this claim have been checked yet.
In the paper
“One class of pre-treatment variables that analysts should approach with caution is pretreatment colliders (Pearl 1995, Greenland et al. 1999b, Hernán et al. 2002, Greenland 2003, Hernán et al. 2004, Elwert 2013).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
None of the sources cited for this claim have been checked yet.
In the paper
“It is well known that outright selection on the outcome, as well as conditioning on a variable affected by the outcome, can lead to bias”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
What the sources say
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using DAGs, sociologists can formally analyze the consequences of their theoretical assumptions and determine whether causal inference is possible.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here, X is both a confounder (on the noncausal paths T←X←U1→Y and T←X←U2→Y) and a collider (on the noncausal path T←U2→X←U1→Y). Controlling for X would remove confounding but induce endogenous selection, and not controlling for X would do the opposite.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By contrast, in Figure 13b, X is a collider that blocks the noncausal path between treatment and outcome, T←U2→X←U1→Y. Conditioning on X would open this noncausal path and induce endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The most general advice to be derived from the first two groups—post-outcome and intermediate collider examples—is straightforward: When estimating total causal effects, avoid conditioning on post-treatment variables (Rosenbaum 1984).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Rosenbaum 1984 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In Figure 13a, X is indeed a common-cause confounder as it sits on an open noncausal path between treatment and outcome, T←X→Y. Conditioning on X will block this noncausal path and identify the causal effect of T on Y.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Hudson et al. (2008) apply these results productively in a study of familial coaggregation of diseases.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Hudson et al. 2008 source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of course, this advice can be hard to follow in practice when conditioning is implicit in the data-collection scheme or the result of selective nonresponse and attrition.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We caution, however, that these rules of thumb for binary-variable DAGs do not necessarily generalize to DAGs with differently distributed variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Given that assumption-free causal inference is impossible, sociologists must rely on theory, prudent substantive judgment, and well-founded prior knowledge to assess the threat of bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: Assumption-free causal inference is impossible.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this review, we have argued that understanding endogenous selection bias is central for understanding the identification of causal effects in sociology.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The virtue of this advice is that it prevents the analyst from conditioning on a pretreatment collider.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such analyses will strengthen confidence in a causal claim when it is warranted and explicitly indicate sources of potential bias— including endogenous selection bias—when a causal claim is not appropriate.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is possible that these increases in bias resulted from controlling for pre-treatment colliders.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Interrogating the simple steps necessary for separating causal from noncausal associations, we next saw that endogenous selection bias is logically on par with confounding bias and overcontrol bias in the sense that all nonparametric identification problems can be reduced to confounding (i.e., not conditioning on a common cause), overcontrol (i.e., conditioning on a variable on the causal pathway”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both models, the pre-treatment variable X meets the commonsense, purely associational, definition of confounding: (a) X temporally precedes treatment, T; (b) X is associated with the treatment; and (c) X is associated with the outcome, Y.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“Furthermore, if the pre-treatment variable is both a collider and a confounder (as in Figure 13c), then conditioning on it may remove more bias than it induces, even though nonparametric point identification is still not feasible.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If it is known that the pre-treatment collider is not also a confounder, then the solution is not to condition on it when possible”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(this is not possible in social network analysis, where conditioning on the pretreatment social tie is implicit in the research question).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
In the paper
“Second, conditioning on an intermediate collider may lead to bias that is larger than the effects pointing into the collider, although the bias will usually be smaller than those effects if the intermediate collider does not itself exert a causal effect on the outcome.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We believe that DAGs provide such a language because they focus the analyst’s attention on what matters for nonparametric identification of causal effects: qualitative assumptions about the causal relationships between variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
The authors state this as an assumption.
The DAGs in this review display all observed and unobserved common causes in the process under investigation.
“we assume that the DAGs in this review display all observed and unobserved common causes in the process under investigation.”
The authors state this as an assumption.
In the Hollywood example, beauty and talent are unassociated in the general population.
“Suppose, for argument’s sake, that beauty and talent are unassociated in the general population”
The authors state this as an assumption.
In the Hollywood example, beauty and talent are separately sufficient for becoming a successful Hollywood actor.
“Suppose further that beauty and talent are separately sufficient for becoming a successful Hollywood actor.”
The authors state this as an assumption.
In the Hausman and Wise example, education and the error term U are independent in the population.
“Assume, for clarity and without loss of generality, that E and U are independent in the population”
The authors state this as an assumption.
In the Lin et al. example, income and child support payments are treated as sharing no common causes.
“Without loss of generality, we neglect that I and P may share common causes.”
The authors state this as an assumption.
In the music study example, additional explanatory variables are not considered.
“For clarity, we do not consider additional explanatory variables in the study.”
The paper relies on this without support.
In the music example, topping the Billboard charts has a positive effect on inclusion in the Rolling Stone 500 in the population of all albums.
“The treatment is topping the Billboard charts, B, which presumably has a positive effect on R in the population of all albums.”
The authors state this as an assumption.
In the music example, there is no common-cause confounding.
“In the absence of common-cause confounding (as encoded in Figure 7)”
The paper relies on this without support.
Most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.
“most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.”
The authors state this as an assumption.
Motherhood affects a woman's reservation wage.
“Following standard labor market theory, assume that motherhood will affect a woman’s reservation wage, WR, i.e., the wage that would be necessary to draw her out of the home and into the workforce.”
The paper relies on this without support.
A woman accepts employment only if the wage offer meets or exceeds her reservation wage.
“Employment, E, is a function of both the wage offer and the reservation wage because a woman will only accept the job if the wage offer meets or exceeds her reservation wage.”
The authors state this as an assumption.
Motherhood and offer wages share no common cause.
“(For simplicity, assume that M and WO share no common cause.)”
The authors state this as an assumption.
In Figure 9a, attrition is completely random with respect to both treatment and outcome.
“attrition is assumed to be completely random with respect to both treatment and outcome.”
The authors state this as an assumption.
In Figure 9b, poverty affects the risk of dropping out.
“In Figure 9b, poverty is assumed to affect the risk of dropping out, P→C.”
The paper relies on this without support.
Many social science data sets include information on motherhood but not on women's reservation wage.
“Many social science data sets include information on motherhood, M, but they typically do not include information on women’s reservation wage, WR.”
The paper relies on this without support.
Data typically include information on offer wages only for women who are employed.
“Importantly, the data typically include information on offer wages, WO, only for those women who are actually employed.”
The paper relies on this without support.
Most prospective longitudinal studies experience attrition over time.
“Most prospective longitudinal (panel) studies experience attrition over time.”
The paper relies on this without support.
Schooling is not randomly assigned, and individuals with higher innate ability are more likely to obtain more schooling and favorable later outcomes regardless of schooling.
“Schooling, of course, is not randomly assigned to students: On average, individuals with higher innate ability are both more likely to obtain more schooling and more likely to achieve favorable outcomes later in life regardless of their level of schooling.”
The authors state this as an assumption.
Innate ability confounds the effect of schooling on wages.
“Figure 10a starts by positing the usual assumption that innate ability, U, confounds the effect of schooling on wages via the unblocked noncausal path S←U→W.”
The paper relies on this without support.
True innate ability is unobserved.
“Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
The authors state this as an assumption.
Civic engagement does not spread between friends.
“For expositional clarity, assume that civic engagement does not spread between friends [i.e., no arrow Yi(t)→Yj(t+1)].”
The authors state this as an assumption.
Each person's civic engagement is caused by their own characteristics, which are at least partially unobserved.
“Instead, each person’s civic engagement is caused by their own characteristics, U, such as altruism, which are at least partially unobserved [giving arrows Yi(t)←Ui→Yi(t+1) and Yj(t)←Uj→Yj(t+1)].”
The authors state this as an assumption.
Tie formation is homophilous, such that altruistic people form preferential attachments.
“Tie formation is homophilous, such that altruistic people form preferential attachments, Ui→Fi,j←Uj.”
The authors state this as an assumption.
The analyst assumes that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment.
“If the analyst is willing to assume that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment, then it is sufficient to control for all variables that (directly or indirectly) cause treatment or outcome or both (VanderWeele & Shpitser 2011).”
The authors state this as an assumption.
There exists some sufficient set of observed controls.
“Nevertheless, the advice is still conditional on some theory of data generation, however coarsely articulated, specifically that there exists some sufficient set of observed controls.”
The paper relies on this without support.
Assumption-free causal inference is impossible.
“Given that assumption-free causal inference is impossible, sociologists must rely on theory, prudent substantive judgment, and well-founded prior knowledge to assess the threat of bias.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The direct line between two variables in a network graph appears to suggest a direct (causal) relationship between them, but there are several other possibilities:”
From Using person-specific networks in psychotherapy: challenges, limitations, and how we could use them anyway (2020) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
“Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
“To be concrete, consider the effect of schooling, S, on wages, W.”
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,944
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2072165 · Cited by 17,475
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
(1976) · Annals of Economic and Social Measurement · Cited by 5,035
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Research works printed but not linked: 12
- Angrist JD, 1996, J. Am. Stat. Assoc., 8, 328
- Bareinboim E, 2012, Proc. 15th Int. Conf. Artif. Intell. Stat.(AISTATS), April 21–23, 2012, La Palma, Canary Islands, 22, 100
- Farr W, 1858, Transaction National Association Promotion Social Science, 504
- Glymour MM, 2008, Modern Epidemiology, 183
- Hausman JA, 1981, The Econometrics of Discrete Data, 365
- Heckman JJ, 1976, Ann. Econ. Soc. Meas., 5, 475
- Kim JH, 1983, Proc. 8th Int. Jt. Conf. Artif. Intell. (IJCAI-83), Karlsruhe, FRG, Aug. 8–12, 1983, 190
- Lin I, 1999, J. Off. Stat., 15, 143
- Pearl J, 2001, Proc. 17th Conf. Uncertain. Artif. Intell., Aug. 2–5, 2001, Seattle, WA, 411
- VanderWeele TJ, 2009, J. Mach. Learn., 10, 699
- Ver Steeg G, 2011, Proc. 27th Conf. Uncertain. Artif. Intell.(UAI2011), July 14–17, 2011, Barcelona, Spain, 717
- Verma T, 1988, Proc. 4th Workshop Uncertain. Artif. Intell., 352
Cited by
Sorted by citations
Items 501–600 of 1,194
Baranowska-Rataj, A., Högberg, B., & Bernardi, L. (2023) · European Sociological Review · doi:10.1093/esr/jcad038 · Cited by 10
Conceptualizing, Assessing, and Improving the Quality of Digital Behavioral Data
Weiß, B., Leitgöb, H., & Wagner, C. (2025) · Social Science Computer Review · doi:10.1177/08944393251367041 · Cited by 8
“For example, eliminating confounding and endogenous selection bias is essential for causal inference (e.g., Elwert & Winship, 2014; Pearl, 2009), while prediction and classi fi cation tasks demand the inclusion of variables with high predictive power.”
Data collection, weighting, and modeling techniques to estimate consistent population parameters
Robbennolt, D., Pendyala, R. M., & Bhat, C. R. (2025) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2025.103349 · Cited by 8
Unattended Pregnancies and Perinatal Mortality in Georgia
Manjavidze, T., Rylander, C., Skjeldestad, F. E., Kazakhashvili, N., & Anda, E. E. (2020) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s243207 · Cited by 8
Approach–Avoidance Theories of Personality
Corr, P. J., & Krupıć, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.025 · Cited by 12
Sauer, S. M., Mitnick, C. D., Khan, U. A., et al. (2023) · Clinical Infectious Diseases · doi:10.1093/cid/ciad589 · Cited by 8
“Finally, our results on HIV as a determinant of recurrence may be affected by collider bias [31, 32].”
ResultWhen Perception Trumps Reality
Sand, A., & Nilsson, M. E. (2017) · Psychological Science · doi:10.1177/0956797616684681 · Cited by 8
“…such an alternative causal path is critical for our stratified analyses (as in the case of analyses in, e.g., Goodhew et al., 2011; Lamy et al., 2009), because this stratification involves the risks of introducing biases into causal effect estimates (e.g., collider bias; Elwert & Winship, 2014).”
Walters, G. D. (2018) · Substance Use & Misuse · doi:10.1080/10826084.2018.1424914 · Cited by 8
“Conditioning on the precursor to an outcome can sometimes inflate regression coefficients through endogenous selection bias or what is commonly referred to as a collider effect (Elwert & Winship, 2014).”
BackgroundThe Transmission of Multigenerational Educational Inequality
Fiel, J. E. (2018) · Social Forces · doi:10.1093/sf/soy090 · Cited by 8
Loter, K., Becker, O. A., Mikucka, M., & Wolf, C. (2019) · Journal of Family Research · doi:10.3224/zff.v31i2.03 · Cited by 8
Multidimensional Mortality Selection: Why Individual Dimensions of Frailty Don’t Act Like Frailty
Wrigley‐Field, E. (2020) · Demography · doi:10.1007/s13524-020-00858-8 · Cited by 8
A novel framework for classification of selection processes in epidemiological research
Björk, J., Nilsson, A., Bonander, C., & Strömberg, U. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01015-w · Cited by 9
Walters, G. D. (2020) · Crime & Delinquency · doi:10.1177/0011128720962449 · Cited by 8
“Because endogenous selection bias can lead to inflated path coefficients when an outcome is conditioned on a precursor measure (Elwert & Winship, 2014), a second sensitivity analysis was performed by removing all precursor measures from the three regression equations and redoing the analyses.”
MethodPartisan Affective Polarization
Ársælsson, K. M. (2020) · Public Opinion Quarterly · doi:10.1093/poq/nfaa060 · Cited by 12
Violent Victimization and Adolescents’ Attitudes Toward Romantic Relationships and Sexual Activity
Warner, T. D., & Warner, D. F. (2022) · Journal of Interpersonal Violence · doi:10.1177/08862605211072173 · Cited by 8
“To guard against overcontrol bias (Elwert & Winship, 2014), we only considered variables prior work (as discussed above) suggests may be common causes of both YVV and relationship attitudes.”
MethodEllison, G. T. H., Mattes, R., Rhoma, H., & de Wet, T. (2022) · South African Journal of Science · doi:10.17159/sajs.2022/13301 · Cited by 7
Perceptions of Pay Satisfaction and Pay Justice: Two Sides of the Same Coin?
Valet, P. (2023) · Social Indicators Research · doi:10.1007/s11205-022-03059-5 · Cited by 20
“In the language of modern causal analysis and directed acyclic graphs, I only controlled for variables that lie on an open backdoor path (Elwert & Winship, 2014; Rohrer, 2018).”
MethodNeural Evidence for Boundary Updating as the Source of the Repulsive Bias in Classification
Lee, H., Lee, H.-J., Choe, K. W., & Lee, S. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0166-23.2023 · Cited by 9
Decomposition of Gender or Racial Inequality with Endogenous Intervening Covariates
Yamaguchi, K. (2015) · Sociological Methodology · doi:10.1177/0081175015583985 · Cited by 8
“…however, covariates V are intervening variables, and even though X is assumed to be independent of U, the control for covariates V, which are common causal descendants of X and U, induces nonindependence between U and X (Elwert and Winship 2014; 394 Yamaguchi Morgan and Winship 2007; Pearl 2009).”
BackgroundBozoyan, C., & Wolbring, T. (2015) · Journal of Contextual Economics – Schmollers Jahrbuch · doi:10.3790/schm.135.1.83 · Cited by 8
Caprara, G. V., & Vecchione, M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.038 · Cited by 9
Walters, G. D. (2017) · Crime & Delinquency · doi:10.1177/0011128717722011 · Cited by 8
“Conditioning on a precursor to an outcome, however, can create endogenous selection bias or collider effects (Elwert & Winship, 2014).”
BackgroundLarson, S. J. (2018) · Public Integrity · doi:10.1080/10999922.2018.1441595 · Cited by 9
“…based on extant literature, including: (a) Educational attainment addresses potential endogeneity between the independent and dependent variables (Elwert & Winship, 2014); (b) Homeownership controls for the impact of gaps based on discriminatory housing policy (Freeman, 2005; Jackman & Jackman,…”
BackgroundWarner, T. D., & Warner, D. F. (2019) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-019-00122-7 · Cited by 9
“To guard against overcontrol bias [31], we only considered variables that were measured at wave I (with two exceptions, described below) and that prior work (as discussed above) suggests may be common causes of both YVV and sexual risk behaviors.”
MethodHow Nearby Homicides Affect Young Women's Pregnancy Desires: Evidence From a Quasi-Experiment
Weitzman, A., Barber, J. S., Heinze, J. E., et al. (2021) · Demography · doi:10.1215/00703370-9160045 · Cited by 8
“Doing so would risk collider bias, whereby homicides and shifting pregnancy desires affect other mutable traits of women, such as their relationship status or parity, in ways that could distort the estimated effect of homicides (Cole et al. 2009; Elwert and Winship 2014).”
BackgroundDoes Marriage Increase Couples’ Life Satisfaction?
Gattig, A., & Minkus, L. (2021) · Comparative Population Studies · doi:10.12765/cpos-2021-05 · Cited by 8
Valdés, M. T. (2021) · Educational Review · doi:10.1080/00131911.2021.1978400 · Cited by 8
“In Figure 2, I have drawn a Directed Acyclic Graph (DAG) describing the strategy to identify that effect (Elwert & Winship, 2014), where Y stands for the outcome of interest (educational expectations), T refers to the treatment (being derived either into a prevocational programme or an adaptation…”
MethodHeritable environments: bias due to conditioning on a collider in models with polygenic scoresPreprint
Akimova, E. T., Breen, R., Brazel, D. M., & Mills, M. C. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.02.364539 · Cited by 8
Trust and Fertility DynamicsPreprint
Aassve, A., Billari, F. C., & Pessin, L. (2018) · doi:10.31235/osf.io/vxht7 · Cited by 8
Recent Developments in Causal Inference and Machine LearningPreprint
Brand, J. E., Zhou, X., & Xie, Y. (2022) · doi:10.31235/osf.io/627tz · Cited by 8
Kim, J., & Park, G. (2024) · Cities · doi:10.1016/j.cities.2024.105428 · Cited by 8
A caution on sibling comparisons in studying effects of the rearing environment
Engzell, P., & Hällsten, M. (2024) · European Sociological Review · doi:10.1093/esr/jcae037 · Cited by 16
Kolkman, D., Lee, G. K., & van Witteloostuijn, A. C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309318 · Cited by 6
A Guide to Causal Inference in Life-Event Studies
Lawes, M., West, S. G., & Eid, M. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241302015 · Cited by 10
“In contrast to confounders, mediator and collider variables should not be controlled for because they are causally affected by the exposure itself; they are posttreatment variables (Elwert & Winship, 2014; Pearl, 2009; Rohrer, 2018; Rosenbaum, 1984; Rubin, 1974).”
Walters, G. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211034220 · Cited by 7
“Because conditioning on a prior administration of a repeated or parallel measure of a predicted variable can potentially inflate path coefficients (Elwert & Winship, 2014), endogenous selection bias was evaluated by recalculating the analyses without the earlier measure or measures.”
BackgroundExposure to Nearby Homicides and Young Women’s Reproductive Lives during the Transition to Adulthood
Weitzman, A., Barber, J. S., Heinze, J. E., Kusunoki, Y., & Zimmerman, M. A. (2023) · American Journal of Sociology · doi:10.1086/727892 · Cited by 7
Through the lens of causal inference: Decisions and pitfalls of covariate selection
Chen, G., Cai, Z., & Taylor, P. A. (2024) · Aperture Neuro · doi:10.52294/001c.124817 · Cited by 12
Educating for Democracy? Going to College Increases Political Participation
Jensen, A. V. (2025) · British Journal of Political Science · doi:10.1017/s0007123424000486 · Cited by 7
“Due to possible post-treatment bias, I present the results both with and without post-treatment covariates (Elwert and Winship 2014).”
Induced Dependence, Factor Interaction, and Discriminating Between Causal Structures
Balabanov, O. S. (2016) · Cybernetics and Systems Analysis · doi:10.1007/s10559-016-9794-5 · Cited by 7
Wong, S. H., & Zeng, Y. (2016) · Social Science Research · doi:10.1016/j.ssresearch.2016.11.002 · Cited by 8
Causes, theories, and the past in political science
Gordon, S. C., & Simpson, H. K. (2019) · Public Choice · doi:10.1007/s11127-019-00703-6 · Cited by 7
“This form of selection bias is sometimes called Berkson’s paradox, and in the more recent nonparametric causal identification literature is cited as an example of “conditioning on a collider” (Elwert and Winship 2014).”
BackgroundConceptual and Historical Perspectives
Cloninger, S. C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.004 · Cited by 8
Pulmonary adverse drug event data in hypertension with implications on COVID-19 morbidity
Jaberi‐Douraki, M., Meyer, E. G., Riviere, J. E., Gedara, N. I. M., Kawakami, J., Wyckoff, G. J., & Xu, X. (2021) · Scientific Reports · doi:10.1038/s41598-021-92734-7 · Cited by 7
Might Temporal Logic Improve the Specification of Directed Acyclic Graphs (DAGs)?
Ellison, G. T. H. (2021) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2021.1936311 · Cited by 6
Premature Death Risk from Young Adulthood Incarceration
Witteveen, D. (2021) · Sociological Quarterly · doi:10.1080/00380253.2021.1923379 · Cited by 7
“None of the models contain variables measured after 1992 to avoid invalid identification by conditioning on a variable on the path between the treatment and the outcome (Elwert and Winship 2014).”
BackgroundPoint of Reference: A Multisited Exploration of African Migration and Fertility in France
Behrman, J. A., & Weitzman, A. (2022) · International Migration Review · doi:10.1177/01979183211046571 · Cited by 10
Plot-level impacts of improved lentil varieties in Bangladesh
Yigezu, Y. A., Rahman, M. W., El‐Shater, T., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262146 · Cited by 7
“However, the IV approach helps to control biases arising from self-selection [32,33], omitted variables [32] and due to inclusion of variables which we should not have controlled for [34].”
MethodBretschi, D., & Weiß, B. (2022) · Social Science Computer Review · doi:10.1177/08944393221117267 · Cited by 7
Zane, S. N., & Pupo, J. A. (2022) · Journal of Youth and Adolescence · doi:10.1007/s10964-022-01686-2 · Cited by 7
“If so, then the influence of extralegal factors on the early detention decision would mask the influence of extralegal factors on the placement decision— being “controlled away” (Elwert & Winship, 2014).”
BackgroundIannelli, C., Breen, R., & Duta, A. (2023) · European Sociological Review · doi:10.1093/esr/jcad056 · Cited by 7
Aarsman, S. R., Greenwood, C. J., Linardon, J., Rodgers, R. F., Messer, M., Jarman, H. K., & Fuller‐Tyszkiewicz, M. (2024) · Body Image · doi:10.1016/j.bodyim.2024.101704 · Cited by 7
Fairness: plurality, causality, and insurability
Fahrenwaldt, M., Furrer, C., Hiabu, M., Huang, F., Jørgensen, F. H., Lindholm, M., Loftus, J. R., Steffensen, M., & Tsanakas, A. (2024) · European Actuarial Journal · doi:10.1007/s13385-024-00387-3 · Cited by 7
“When a model or algorithm is used for many impactful decisions—consider credit risk scores—the output of such a model becomes what we might call a ‘universal collider’, and its use for decisions will induce associations among the input variables [9].”
Steiner, P. M., Park, S., & Kim, Y. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1205470 · Cited by 7
Walters, G. D., & Espelage, D. L. (2018) · Crime & Delinquency · doi:10.1177/0011128717749858 · Cited by 7
“Because conditioning on the precursor to an outcome can inflate path coefficients and introduce endogenous selection bias into a regression analysis (Elwert & Winship, 2014), a second sensitivity analysis was performed whereby the precursors to the two mediator variables and one dependent variable…”
The effects of housing supply restrictions on partisan geography
Sorens, J. (2018) · Political Geography · doi:10.1016/j.polgeo.2018.07.007 · Cited by 7
The Importance of Mediation Analysis in Substance-Use Prevention
O’Rourke, H. P., & MacKinnon, D. P. (2019) · Advances in prevention science · doi:10.1007/978-3-030-00627-3_15 · Cited by 9
Efeitos diretos e indiretos do Programa Bolsa Família nas eleições presidenciais brasileiras
Simoni, S. (2021) · Opinião Pública · doi:10.1590/1807-01912021271230 · Cited by 10
Lee, M., Halpern-Manners, A., & Warren, J. R. (2021) · Epidemiology · doi:10.1097/ede.0000000000001382 · Cited by 7
Fauser, S., & Scheuring, S. (2021) · Advances in Life Course Research · doi:10.1016/j.alcr.2021.100445 · Cited by 7
Chronic stress and executive functioning: A specification-curve analysis
Möschl, M., Schmidt, K., Enge, S., Weckesser, L. J., & Miller, R. E. (2021) · Physiology & Behavior · doi:10.1016/j.physbeh.2021.113639 · Cited by 9
Third moment-based causal inference
Wiedermann, W. (2022) · Behaviormetrika · doi:10.1007/s41237-021-00154-8 · Cited by 7
From rapid decline to high growth: where in the distribution did COVID hit hardest?
Coad, A., Bauer, P., Domnick, C., et al. (2023) · Journal of Small Business and Enterprise Development · doi:10.1108/jsbed-02-2023-0061 · Cited by 7
Electoral formula, legal threshold and the number of parties
Górecki, M. A., & Kukołowicz, P. (2017) · Party Politics · doi:10.1177/1354068816688360 · Cited by 7
“Unfortunately, this practice leads to serious concerns as controlling for a post-treatment variable might introduce selection bias (Elwert and Winship, 2014).”
BackgroundLife events and life satisfaction: Estimating effects of multiple life events in combined modelsPreprint
Krämer, M. D., Rohrer, J. M., Lucas, R. E., & Richter, D. (2023) · doi:10.31234/osf.io/wfg8h · Cited by 7
Epidemiologische Beiträge zur Klinischen Psychologie
Beesdo-Baum, K., Höfler, M., Jacobi, F., & Wittchen, H.-U. (2020) · Klinische Psychologie & Psychotherapie · doi:10.1007/978-3-662-61814-1_3 · Cited by 6
Shareholder Activism and the Deterrence Effect of Democratic Politician Shareholders
DesJardine, M. R., Shi, W., & Werner, T. (2024) · Organization science (Providence, R.I.) · doi:10.1287/orsc.2023.17495 · Cited by 4
Bi, K., Merrin, G. J., Li, T., Sun, X., Chai, Y., Lu, Z., & Chen, S. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251326571 · Cited by 7
“These include but are not limited to measurement error, sample-selection bias, treatment-effect heterogeneity, and bias introduced by third variables that do not necessarily cause both the treatment and outcome (i.e., collider bias; Elwert & Winship, 2014; Matthay & Glymour, 2020).”
Religious centrality across 22 countries
Woodberry, R. D., Johnson, K. A., Case, B. W., Bradshaw, M., VanderWeele, T. J., & Johnson, B. R. (2025) · Scientific Reports · doi:10.1038/s41598-025-99183-6 · Cited by 8
“85 86–90 This is also true for longitudinal analyses of individuals.”
Overview of Challenges in Brain-Based Predictive Modeling: Toward Meaningful Predictive Insights
Komeyer, V., Nieto, N., Eickhoff, S. B., Raimondo, F., & Patil, K. R. (2025) · Biological Psychiatry · doi:10.1016/j.biopsych.2025.09.003 · Cited by 6
Kratz, F., & Brüderl, J. (2025) · European Sociological Review · doi:10.1093/esr/jcaf038 · Cited by 10
Schulte, N., Nussbaum, J. A., Kanbach, D. K., Steinhoff, M. M., & Kraus, S. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103338 · Cited by 8
Posel, D., & Oyenubi, A. (2023) · Social Science & Medicine (1967) · doi:10.1016/j.socscimed.2023.116133 · Cited by 5
Zhao, Y., He, D., & Reszka, S. (2023) · Crime & Delinquency · doi:10.1177/00111287231218706 · Cited by 6
“Another particular concern is possible endogenous selection bias (Elwert & Winship, 2014) which suggests that the selection of the outcome or sample is influenced by the very characteristics being studied.”
Walters, G. D., Kremser, J., & Runell, L. (2024) · Aggressive Behavior · doi:10.1002/ab.22134 · Cited by 6
Introduction to causal graphs for education researchers
Feng, Y. (2024) · Asia Pacific Education Review · doi:10.1007/s12564-024-09980-3 · Cited by 6
“However, collider bias can nevertheless be induced by conditioning on pre-treatment colliders, or due to nonrandom sample selection (i.e., the endogenous selection bias , Elwert & Winship, 2014).”
Zhang, Y., Li, H., & Ren, G. (2024) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2024.104369 · Cited by 6
Sleep and interrogation: does losing sleep impact criminal history disclosure?
Križan, Z., Miller, A. J., & Meissner, C. A. (2021) · SLEEP · doi:10.1093/sleep/zsab124 · Cited by 6
“All remaining participants were included in the experimental analyses regardless of their (varying) compliance with the sleep schedule, as to minimize data loss and avoid endogenous selection biases in estimates of experimental effects [36].”
BackgroundSelf-Efficacy in Parents and Children and Its Relationship to Future Delinquent Behavior in Children
Walters, G. D. (2020) · Youth & Society · doi:10.1177/0044118x20959230 · Cited by 6
“A second sensitivity test, this one designed to rule out endogenous selection bias or a collider effect, was conducted by running the analyses without precursor measures given that conditioning on a precursor can sometimes inflate path coefficients (Elwert & Winship, 2014).”
BackgroundMethodBledsoe, A. (2020) · American Behavioral Scientist · doi:10.1177/0002764220959686 · Cited by 6
Educational Expansion, Social Class, and Choosing Latin as a Strategy of Distinction
Gerhards, J., Köhler, U., & Sawert, T. (2021) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2021-0021 · Cited by 6
Baranowska-Rataj, A. (2022) · Acta Sociologica · doi:10.1177/00016993211066261 · Cited by 6
Populism has relationship issues: collider effects and immigration policy in Italy
Woods, D. (2022) · Global Public Policy and Governance · doi:10.1007/s43508-022-00035-0 · Cited by 6
“In the literature on collider variables, “confounding originates from common causes....” Most of this literature is obviously dealing with the biases that arise from confounders in statistical studies (Elwert & Winship, 2014).”
BackgroundChoi, J., Dekkers, O. M., & le Cessie, S. (2022) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5437 · Cited by 5
The Political Economy of Crime: Did Universal Credit Increase Crime Rates?
Tiratelli, M., Bradford, B., & Yesberg, J. A. (2022) · The British Journal of Criminology · doi:10.1093/bjc/azac043 · Cited by 11
Brown, S., Song, M., Cook, T. D., & Garet, M. S. (2022) · American Educational Research Journal · doi:10.3102/00028312221136565 · Cited by 6
“…are patterned and even by more esoteric processes like the operation of collider variables (Angrist & Pischke, 2008; Ding & Miratrix, 2015; Elwert & Winship, 2014; Pearl et al., 2016) or the inadvertent elimination of what would otherwise have been a perfect instrumental variable (Pearl,…”
BackgroundThe effect of nursing home closure on local employment in the United States
Xu, L., Sharma, H., & Wehby, G. L. (2022) · Health Services Research · doi:10.1111/1475-6773.14125 · Cited by 6
Sampling methods in personality pathology research: Some data and recommendations.
Vanwoerden, S., Chandler, J., Cano, K., Mehta, P. D., Pilkonis, P. A., & Sharp, C. (2023) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000593 · Cited by 6
The intervening role of social integration in the effect of education on subjective mental health
Kroh, J., & Prechsl, S. (2023) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2023.100786 · Cited by 7
Ex-post evaluation of transport interventions with causal mediation analysis
Zhang, Y., Li, H., & Ren, G. (2023) · Transportation · doi:10.1007/s11116-023-10413-0 · Cited by 6
“For comprehensive discussion on post-treatment conditioning, see for instance, Rosenbaum (1984), Elwert and Winship (2014), Montgomery et al. (2018).”
Covariate selection in causal learning under non-Gaussianity
Zhang, B., & Wiedermann, W. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02217-y · Cited by 6
Identifying culture as cause: Challenges and opportunities
Lonati, S., Lalive, R., & Efferson, C. M. (2024) · Evolutionary Human Sciences · doi:10.1017/ehs.2023.35 · Cited by 6
“This problem is related to an issue that might be familiar to evolutionary scholars – colliders (Cinelli et al., 2022; Elwert & Winship, 2014; Hernán et al., 2004).”
BackgroundBiegert, T., & Kühhirt, M. (2018) · European Sociological Review · doi:10.1093/esr/jcy003 · Cited by 6
“But a spurious association may also result if censoring (and thus observation of contract type) were related to job exit type and entering temporary employment (Elwert and Winship, 2014; Winship and Mare, 1992).”
Seiler, S. (2018) · The History of the Family · doi:10.1080/1081602x.2018.1431559 · Cited by 6
“To avoid biases caused by collider variables I used separate models to estimate the effects of availability of a nearby railway station and of industrialization (Elwert & Winship, 2014).”
MethodRejoinder: Can We Weight Models by Their Probability of Being True?
Muñoz, J., & Young, C. (2018) · Sociological Methodology · doi:10.1177/0081175018796841 · Cited by 6
“O’Brien notes that “not all independent variables in the model should be controlled” (this volume, p. 35) and details pitfalls of overcontrolling with intervening or collider variables (see also Clarke, Kenkel, and Rueda 2018; Elwert and Winship 2014; Heckman and Navarro-Lozano 2004; King 1991).”
BackgroundMajor Discrimination Experiences, Education, and Genes
Das, A. (2019) · Journal of Aging and Health · doi:10.1177/0898264319851661 · Cited by 6
“Briefly, a collider is a variable that is itself caused by two other variables, one that is (or is associated with) the treatment and another that is (or is associated with) the outcome (Elwert & Winship, 2014).”
BackgroundWalters, G. D. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.07.009 · Cited by 6
Walters, G. D. (2020) · Journal of Crime and Justice · doi:10.1080/0735648x.2019.1701527 · Cited by 8
“Because conditioning on the precursor to an outcome can in fl ate path coe ffi cients via endogenous selection bias or a collider e ff ect (Elwert and Winship 2014), a second sensitivity analysis was conducted in which path coe ffi cients were recalculated without controlling for prior o ff ending.”
MethodWalters, G. D. (2020) · The Prison Journal · doi:10.1177/0032885520978374 · Cited by 7
“Contrasting offenders who were sentenced to prison or probation by judges who differed in their propensity to imprison defendants, Harding et al. (2017) discovered that those sentenced to prison were significantly more likely to be arrested within 3 years of release than those sentenced to probation, although the effe…”
BackgroundMethodHsieh, C., & Li, Q. (2021) · Applied Research in Quality of Life · doi:10.1007/s11482-020-09904-4 · Cited by 6
Langston, M. E., Sfanos, K. S., Khan, S., et al. (2021) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-20-1009 · Cited by 6
Metadata
- Authors
- Elwert, F., & Winship, C.
- Affiliations
- University of Wisconsin–Madison (US)
- Harvard University (US)
- Venue
- Annual Review of Sociology
- Publisher
- Annual Reviews
- Published
- 2014-07-30
- Volume
- 40
- Issue
- 1
- Pages
- 31-53
- ISSN
- 0360-0572 (ISSN-L)
- 1545-2115
- PMC
- PMC6089543
- OpenAlex
- W2097829006
- Semantic Scholar
- 9fcc6fe93c9ce0c0b4773c18074c01bdf71db52d
- Cited by
- 1,168
- References
- 120
- Citations by year
- 2026: 70 · 2025: 102 · 2024: 156 · 2023: 156 · 2022: 122 · 2021: 125 · 2020: 150 · 2019: 94 · 2018: 82 · 2017: 52 · 2016: 29 · 2015: 23 · 2014: 7
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Sociology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Aging (P30AG017266)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD047873)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- collider bias, causal inference, causal graphs, social stratification, sociology of culture, social network analysis, political sociology, social demography, sociology of education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
