The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index; 7 of the 75 sources its claims cite were checked for support.
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Open accessAbstract
Endogenous selection bias is a central problem for causal inference. Recognizing the problem, however, can be difficult in practice. This article introduces a purely graphical way of characterizing endogenous selection bias and of understanding its consequences (Hernán et al. 2004). We use causal graphs (direct acyclic graphs, or DAGs) to highlight that endogenous selection bias stems from conditioning (e.g., controlling, stratifying, or selecting) on a so-called collider variable, i.e., a variable that is itself caused by two other variables, one that is (or is associated with) the treatment and another that is (or is associated with) the outcome. Endogenous selection bias can result from direct conditioning on the outcome variable, a post-outcome variable, a post-treatment variable, and even a pre-treatment variable. We highlight the difference between endogenous selection bias, common-cause confounding, and overcontrol bias and discuss numerous examples from social stratification, cultural sociology, social network analysis, political sociology, social demography, and the sociology of education.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
60 Own interpretation · 27 No full text of the sources · 18 No basis given · 9 Sources not found · 7 Not checked yet · 4 Supported · 2 Partly supported · 1 Supported so far · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“This is exactly what Gangl & Ziefle’s (2009) selectivity-corrected analysis of the motherhood wage penalty finds.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
What the sources say
- Supportedcites Gangl & Ziefle 2009 source
The paper states that previous research tended to underestimate the motherhood wage penalty because it did not systematically account for dynamic selection into employment. Its Summary and Conclusions passage also reports that its selectivity-corrected estimates often exceed earlier estimates. (LLM, conf=0.94)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Over time, the number of cases available for analysis decreases, sometimes drastically so (e.g., Behr et al. 2005, Alderman et al. 2001).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
What the sources say
- Not checked — no full text of the sourcecites Behr et al. 2005 source
- Supportedcites Alderman et al. 2001 source
The Introduction reports that longitudinal datasets lose cases between survey rounds, with attrition ranging from 6% to 50%; it says there is often considerable attrition. This supports the claim that the number of cases available for analysis can decrease drastically over time. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Most prospective longitudinal studies experience attrition over time.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Shalizi & Thomas (2011) recently showed that latent homophily bias constitutes a previously unrecognized example of endogenous selection bias, where the social tie itself plays the role of the pre-treatment collider.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites Shalizi & Thomas 2011 source
In “Identifying Contagion From Non-Neighbors” (page unavailable), the paper explicitly says that selecting or conditioning on the social tie Aij activates a collider. Its account of network formation before observable outcomes also supports describing the tie as pre-treatment. “Endogenous selection bias” is a paraphrase of this mechanism, not the paper’s terminology. (LLM, conf=0.91)
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“If the analyst is willing to assume that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment, then it is sufficient to control for all variables that (directly or indirectly) cause treatment or outcome or both (VanderWeele & Shpitser 2011).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites VanderWeele & Shpitser 2011 source
Theorem 1 (Section 3) states that if any subset of measured pretreatment covariates blocks all backdoor paths from treatment to outcome, the subset comprising all observed causes of treatment or outcome does too. The Introduction states the same conditional result for confounding control. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The analyst assumes that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment.
- Supported
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Surveys of sample selection bias in sociology tend to emphasize examples where selection is affected by the treatment or the outcome, i.e., where sample selection occurs after treatment”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“all nonparametric identification problems can be classified as one of three underlying problems: overcontrol bias, confounding bias, and endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Identification analysis requires a theory (i.e., a model or assumptions) of how the data were generated.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Identification (assuming ideal data) is a necessary precondition for unbiased estimation (with real data).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
In the paper
“there is, at present, no universal solution to estimating causal effects in the presence of endogenous selection”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
What the sources say
- Not checked — no full text of the sourcecites Stolzenberg & Relles 1997 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“the analyst’s theory of data generation can never be fully tested empirically”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 2. IDENTIFICATION VERSUS ESTIMATION
What the sources say
- Not matchedcites Robins & Wasserman 1999
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
- Probably not a substantial claim. 27
- It may state two separate claims as one. 34
- The quote only partly states this claim. 1
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One solution to this problem is to model tie formation (and dissolution) explicitly (Shalizi & Thomas 2011). In the model of Figure 12, this can be accomplished by measuring and conditioning on the tie-forming characteristics of individual i, Ui, or individual j, Uj, or both.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Partly supportedcites Shalizi & Thomas 2011 sourceExperimental — accuracy not yet measured
In “Contagion Effects Are Nonparametrically Unidentifiable” (page unavailable), the paper says that making the traits influencing tie formation observable can remove the confounding path, supporting the proposed conditioning on tie-forming characteristics. But it does not present explicitly modeling tie formation and dissolution alone as a solution: it says allowing ties to vary over time does not help, and describes successful explicit models as also requiring strong assumptions and adequate observed covariates. (LLM, conf=0.84)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Greenland (2003), in particular, has derived useful analytic results and approximations for the relative size of endogenous selection bias and confounding bias in DAGs with binary variables (see also Kaufman et al. 2009).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
- Partly supportedcites Kaufman et al. 2009 sourceExperimental — accuracy not yet measured
Section 2.2 describes analytic bounds for causal risk differences in DAGs with binary variables, supporting the general connection made by “see also Kaufman et al. 2009” (page unavailable). The paper does not report approximations comparing the relative size of endogenous selection bias and confounding bias; the searched passages address causal-effect bounds instead. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
Every source the paper cites for this claim was checked and supports it.
In the paper
“In short, there exists no set of pre-treatment controls that is sufficient for identifying the causal effect of T on Y, and hence the VanderWeele & Shpitser (2011) rule does not apply.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Supportedcites VanderWeele & Shpitser 2011 source
Theorem 1 (Section 3) guarantees that the selected controls suffice only if some subset of measured pretreatment covariates blocks all backdoor paths. Section 4 explicitly says that when no subset suffices, the controls selected by the criterion will not suffice either. Thus the rule's identification guarantee does not apply to the situation described; the source does not itself assess Figure 13c. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, bias can also arise if sample selection occurs prior to treatment.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Missing arrows are essential for inferring causal information from data.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Confounding originates from common causes, whereas endogenous selection originates from common outcomes.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Collider variables may occur before or after the treatment and before or after the outcome.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We highlight the difference between endogenous selection bias, common-cause confounding, and overcontrol bias”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Endogenous selection can result from conditioning on an outcome, but it can also result from conditioning on variables that have been affected by the outcome, variables that temporally precede the outcome, and even variables that temporally precede the treatment (Greenland 2003).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“a generalization of conventional linear path diagrams (Wright 1934, Blalock 1964, Duncan 1966, Bollen 1989) that is entirely nonparametric”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not matchedcites Pearl 1995, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Elwert 2013 source
- Not matchedcites Wright 1934, Blalock 1964, Duncan 1966, Bollen 1989
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recognizing the problem, however, can be difficult in practice.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Endogenous selection bias results from conditioning on an endogenous variable that is caused by two other variables, one that is (or is associated with) the treatment and one that is (or is associated with) the outcome”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“missing arrows represent the sharp assumption of no causal effect between variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“DAGs encode the analyst’s qualitative causal assumptions about the data-generating process in the population”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 3. DAGs IN BRIEF3
What the sources say
- Not checked — no full text of the sourcecites Pearl 2009 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
In the paper
“Sample selection bias occurs when the selection of observations into a sample is not independent of the outcome”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Winship & Mare 1992 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Confounding bias results from failing to control for a common cause variable that one should have controlled for, whereas endogenous selection bias results from controlling for a common outcome variable that one should not have controlled for.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recognizing endogenous selection bias can be difficult, especially when sample selection occurs prior to treatment or when no selection (in the sense of discarding observations) takes place.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 1. INTRODUCTION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Because class size is randomized, T and Y share no common cause, and the total effect of treatment, T, on the outcome, Y, is identified by their marginal association.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If this assumption is correct, then analyzing complete cases only, i.e., conditioning on not having attrited, is entirely unproblematic; the causal effect P→D is identified without any adjustments for attrition.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In Figure 9a, attrition is completely random with respect to both treatment and outcome.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“overcontrol bias, confounding bias, and endogenous selection bias are distinct phenomena: They arise from different causal structures, and they call for different remedies.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > The Building Blocks: Causation, Confounding, and Endogenous Selection
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“these three configurations correspond exactly to the sources of causation, confounding bias, and endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > The Building Blocks: Causation, Confounding, and Endogenous Selection
What the sources say
- Not matchedcites Pearl 1988, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“conditioning on a noncollider blocks the flow of association along a path, whereas conditioning on a collider opens the flow of association.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > Identification in General DAGs
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, under the assumptions of Figure 10b, controlling for Q will remove at least some of the confounding bias exerted by U and not introduce any new biases.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“outright selection on an outcome, or selection on a variable affected by the outcome, is always potentially problematic.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If, however, there are unmeasured factors, such as marital distress, U, that jointly affect attrition and divorce, as in Figure 9c, then C becomes a collider along the noncausal path between poverty and divorce, P→C←U→D, and conditioning on C will unblock this path and distort the association between poverty and divorce.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Furthermore, they found that although controlling for additional pre-treatment variables generally reduced bias, sometimes including additional controls increased bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Not checked — no full text of the sourcecites Steiner et al. 2010 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 10a starts by positing the usual assumption that innate ability, U, confounds the effect of schooling on wages via the unblocked noncausal path S←U→W. Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: Innate ability confounds the effect of schooling on wages.
- Rests on an assumption: True innate ability is unobserved.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We hypothesize that the finding is due to endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgeddirect- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true.
- The authors state this as an assumption: In the music study example, additional explanatory variables are not considered.
- Rests on an assumption: In the music example, topping the Billboard charts has a positive effect on inclusion in the Rolling Stone 500 in the population of all albums.
- The authors state this as an assumption: In the music example, there is no common-cause confounding.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In Figure 9b, poverty is assumed to affect the risk of dropping out, P→C. Nevertheless, the causal effect of P→D remains identified. As in Figure 9a, conditioning on C in Figure 9b does not lead to bias because conditioning on C does not open any noncausal paths between P and D.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In Figure 9b, poverty affects the risk of dropping out.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the analyst restricts the analysis to employed women, he will thus condition on the collider E, unblock the non-causal path from motherhood to offer wages, M→WR→E←WO, and induce endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Many social science data sets include information on motherhood but not on women's reservation wage.
- Rests on an assumption: Data typically include information on offer wages only for women who are employed.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“does not transmit association and is said to be blocked, closed, or d-separated if the path contains a noncollider, C, that has been conditioned on”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 4. SOURCES OF ASSOCIATION: CAUSATION, CONFOUNDING, AND ENDOGENOUS SELECTION > Identification in General DAGs
What the sources say
- Not matchedcites Pearl 1988, 1995
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is the source of informative censoring and attrition bias in longitudinal studies, and it is a central problem of mediation analysis in the search for social mechanisms and the estimation of direct and indirect effects.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Note that this second—but not the first—endogenous selection problem persists even if the noncollider WR is measured and controlled.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Either practice can lead to endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To the extent that U strongly affects Q, Q is a valid proxy for U. But to the extent that Q does not perfectly measure U, the effect of S on W remains partially confounded.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The odds ratio from the logistic regression of R on B in this selected sample would then be downward biased compared with the true population odds ratio and possibly flip directions, ORS = aSd/bc < ad/bc = ORP.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: In the music example, there is no common-cause confounding.
- Rests on an assumption: Most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.
None of the sources cited for this claim have been checked yet.
In the paper
“One class of pre-treatment variables that analysts should approach with caution is pretreatment colliders (Pearl 1995, Greenland et al. 1999b, Hernán et al. 2002, Greenland 2003, Hernán et al. 2004, Elwert 2013).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
What the sources say
- Not checked — no full text of the sourcecites Pearl 1995 source
- Not matchedcites Greenland et al. 1999b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hernán et al. 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
None of the sources cited for this claim have been checked yet.
In the paper
“It is well known that outright selection on the outcome, as well as conditioning on a variable affected by the outcome, can lead to bias”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a (Post-) Outcome Collider
What the sources say
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using DAGs, sociologists can formally analyze the consequences of their theoretical assumptions and determine whether causal inference is possible.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here, X is both a confounder (on the noncausal paths T←X←U1→Y and T←X←U2→Y) and a collider (on the noncausal path T←U2→X←U1→Y). Controlling for X would remove confounding but induce endogenous selection, and not controlling for X would do the opposite.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By contrast, in Figure 13b, X is a collider that blocks the noncausal path between treatment and outcome, T←U2→X←U1→Y. Conditioning on X would open this noncausal path and induce endogenous selection bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The most general advice to be derived from the first two groups—post-outcome and intermediate collider examples—is straightforward: When estimating total causal effects, avoid conditioning on post-treatment variables (Rosenbaum 1984).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Rosenbaum 1984 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In Figure 13a, X is indeed a common-cause confounder as it sits on an open noncausal path between treatment and outcome, T←X→Y. Conditioning on X will block this noncausal path and identify the causal effect of T on Y.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Hudson et al. (2008) apply these results productively in a study of familial coaggregation of diseases.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Hudson et al. 2008 source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of course, this advice can be hard to follow in practice when conditioning is implicit in the data-collection scheme or the result of selective nonresponse and attrition.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We caution, however, that these rules of thumb for binary-variable DAGs do not necessarily generalize to DAGs with differently distributed variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Given that assumption-free causal inference is impossible, sociologists must rely on theory, prudent substantive judgment, and well-founded prior knowledge to assess the threat of bias.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: Assumption-free causal inference is impossible.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this review, we have argued that understanding endogenous selection bias is central for understanding the identification of causal effects in sociology.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The virtue of this advice is that it prevents the analyst from conditioning on a pretreatment collider.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such analyses will strengthen confidence in a causal claim when it is warranted and explicitly indicate sources of potential bias— including endogenous selection bias—when a causal claim is not appropriate.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is possible that these increases in bias resulted from controlling for pre-treatment colliders.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Interrogating the simple steps necessary for separating causal from noncausal associations, we next saw that endogenous selection bias is logically on par with confounding bias and overcontrol bias in the sense that all nonparametric identification problems can be reduced to confounding (i.e., not conditioning on a common cause), overcontrol (i.e., conditioning on a variable on the causal pathway”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not matchedcites Verma & Pearl 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both models, the pre-treatment variable X meets the commonsense, purely associational, definition of confounding: (a) X temporally precedes treatment, T; (b) X is associated with the treatment; and (c) X is associated with the outcome, Y.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on a Pre-Treatment Collider
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“Furthermore, if the pre-treatment variable is both a collider and a confounder (as in Figure 13c), then conditioning on it may remove more bias than it induces, even though nonparametric point identification is still not feasible.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If it is known that the pre-treatment collider is not also a confounder, then the solution is not to condition on it when possible”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(this is not possible in social network analysis, where conditioning on the pretreatment social tie is implicit in the research question).”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
In the paper
“Second, conditioning on an intermediate collider may lead to bias that is larger than the effects pointing into the collider, although the bias will usually be smaller than those effects if the intermediate collider does not itself exert a causal effect on the outcome.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
What the sources say
- Not checked — no full text of the sourcecites Greenland 2003 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We believe that DAGs provide such a language because they focus the analyst’s attention on what matters for nonparametric identification of causal effects: qualitative assumptions about the causal relationships between variables.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 6. DISCUSSION AND CONCLUSION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
The authors state this as an assumption.
The DAGs in this review display all observed and unobserved common causes in the process under investigation.
“we assume that the DAGs in this review display all observed and unobserved common causes in the process under investigation.”
The authors state this as an assumption.
In the Hollywood example, beauty and talent are unassociated in the general population.
“Suppose, for argument’s sake, that beauty and talent are unassociated in the general population”
The authors state this as an assumption.
In the Hollywood example, beauty and talent are separately sufficient for becoming a successful Hollywood actor.
“Suppose further that beauty and talent are separately sufficient for becoming a successful Hollywood actor.”
The authors state this as an assumption.
In the Hausman and Wise example, education and the error term U are independent in the population.
“Assume, for clarity and without loss of generality, that E and U are independent in the population”
The authors state this as an assumption.
In the Lin et al. example, income and child support payments are treated as sharing no common causes.
“Without loss of generality, we neglect that I and P may share common causes.”
The authors state this as an assumption.
In the music study example, additional explanatory variables are not considered.
“For clarity, we do not consider additional explanatory variables in the study.”
The paper relies on this without support.
In the music example, topping the Billboard charts has a positive effect on inclusion in the Rolling Stone 500 in the population of all albums.
“The treatment is topping the Billboard charts, B, which presumably has a positive effect on R in the population of all albums.”
The authors state this as an assumption.
In the music example, there is no common-cause confounding.
“In the absence of common-cause confounding (as encoded in Figure 7)”
The paper relies on this without support.
Most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.
“most albums ever released neither topped the charts nor won inclusion in the Rolling Stone 500.”
The authors state this as an assumption.
Motherhood affects a woman's reservation wage.
“Following standard labor market theory, assume that motherhood will affect a woman’s reservation wage, WR, i.e., the wage that would be necessary to draw her out of the home and into the workforce.”
The paper relies on this without support.
A woman accepts employment only if the wage offer meets or exceeds her reservation wage.
“Employment, E, is a function of both the wage offer and the reservation wage because a woman will only accept the job if the wage offer meets or exceeds her reservation wage.”
The authors state this as an assumption.
Motherhood and offer wages share no common cause.
“(For simplicity, assume that M and WO share no common cause.)”
The authors state this as an assumption.
In Figure 9a, attrition is completely random with respect to both treatment and outcome.
“attrition is assumed to be completely random with respect to both treatment and outcome.”
The authors state this as an assumption.
In Figure 9b, poverty affects the risk of dropping out.
“In Figure 9b, poverty is assumed to affect the risk of dropping out, P→C.”
The paper relies on this without support.
Many social science data sets include information on motherhood but not on women's reservation wage.
“Many social science data sets include information on motherhood, M, but they typically do not include information on women’s reservation wage, WR.”
The paper relies on this without support.
Data typically include information on offer wages only for women who are employed.
“Importantly, the data typically include information on offer wages, WO, only for those women who are actually employed.”
The paper relies on this without support.
Most prospective longitudinal studies experience attrition over time.
“Most prospective longitudinal (panel) studies experience attrition over time.”
The paper relies on this without support.
Schooling is not randomly assigned, and individuals with higher innate ability are more likely to obtain more schooling and favorable later outcomes regardless of schooling.
“Schooling, of course, is not randomly assigned to students: On average, individuals with higher innate ability are both more likely to obtain more schooling and more likely to achieve favorable outcomes later in life regardless of their level of schooling.”
The authors state this as an assumption.
Innate ability confounds the effect of schooling on wages.
“Figure 10a starts by positing the usual assumption that innate ability, U, confounds the effect of schooling on wages via the unblocked noncausal path S←U→W.”
The paper relies on this without support.
True innate ability is unobserved.
“Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
The authors state this as an assumption.
Civic engagement does not spread between friends.
“For expositional clarity, assume that civic engagement does not spread between friends [i.e., no arrow Yi(t)→Yj(t+1)].”
The authors state this as an assumption.
Each person's civic engagement is caused by their own characteristics, which are at least partially unobserved.
“Instead, each person’s civic engagement is caused by their own characteristics, U, such as altruism, which are at least partially unobserved [giving arrows Yi(t)←Ui→Yi(t+1) and Yj(t)←Uj→Yj(t+1)].”
The authors state this as an assumption.
Tie formation is homophilous, such that altruistic people form preferential attachments.
“Tie formation is homophilous, such that altruistic people form preferential attachments, Ui→Fi,j←Uj.”
The authors state this as an assumption.
The analyst assumes that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment.
“If the analyst is willing to assume that controlling for some combination of observed pre-treatment variables is sufficient to identify the total causal effect of treatment, then it is sufficient to control for all variables that (directly or indirectly) cause treatment or outcome or both (VanderWeele & Shpitser 2011).”
The authors state this as an assumption.
There exists some sufficient set of observed controls.
“Nevertheless, the advice is still conditional on some theory of data generation, however coarsely articulated, specifically that there exists some sufficient set of observed controls.”
The paper relies on this without support.
Assumption-free causal inference is impossible.
“Given that assumption-free causal inference is impossible, sociologists must rely on theory, prudent substantive judgment, and well-founded prior knowledge to assess the threat of bias.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The direct line between two variables in a network graph appears to suggest a direct (causal) relationship between them, but there are several other possibilities:”
From Using person-specific networks in psychotherapy: challenges, limitations, and how we could use them anyway (2020) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
“Because true innate ability is unobserved, the path cannot be blocked, and the effect S→Y is not identified.”
§ Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable > 5. EXAMPLES OF ENDOGENOUS SELECTION BIAS IN SOCIOLOGY > Conditioning on an Intermediate Variable
“To be concrete, consider the effect of schooling, S, on wages, W.”
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,944
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2072165 · Cited by 17,475
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
(1976) · Annals of Economic and Social Measurement · Cited by 5,035
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Research works printed but not linked: 12
- Angrist JD, 1996, J. Am. Stat. Assoc., 8, 328
- Bareinboim E, 2012, Proc. 15th Int. Conf. Artif. Intell. Stat.(AISTATS), April 21–23, 2012, La Palma, Canary Islands, 22, 100
- Farr W, 1858, Transaction National Association Promotion Social Science, 504
- Glymour MM, 2008, Modern Epidemiology, 183
- Hausman JA, 1981, The Econometrics of Discrete Data, 365
- Heckman JJ, 1976, Ann. Econ. Soc. Meas., 5, 475
- Kim JH, 1983, Proc. 8th Int. Jt. Conf. Artif. Intell. (IJCAI-83), Karlsruhe, FRG, Aug. 8–12, 1983, 190
- Lin I, 1999, J. Off. Stat., 15, 143
- Pearl J, 2001, Proc. 17th Conf. Uncertain. Artif. Intell., Aug. 2–5, 2001, Seattle, WA, 411
- VanderWeele TJ, 2009, J. Mach. Learn., 10, 699
- Ver Steeg G, 2011, Proc. 27th Conf. Uncertain. Artif. Intell.(UAI2011), July 14–17, 2011, Barcelona, Spain, 717
- Verma T, 1988, Proc. 4th Workshop Uncertain. Artif. Intell., 352
Cited by
Sorted by citations
Items 601–700 of 1,194
Forsyth, R. J., Hamilton, C., Ingram, M., et al. (2021) · Developmental Neurorehabilitation · doi:10.1080/17518423.2021.1964631 · Cited by 6
Patient traits shape health-care stakeholders’ choices on how to best allocate life-saving care
Crabtree, C. D., Holbein, J. B., & Monson, J. Q. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01280-9 · Cited by 6
Lefebvre, G., & Samoilenko, M. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0444-z · Cited by 6
“Then, to investigate the potential for confounding or collider bias [20, 21] when using (L)BW or SGA, we pursue with more complex scenarios that incorporate a single confounder of the relationships between the exposure, GA, and BW.”
MethodHow Endogenous System Bias Can Distort Decision-Making in Criminal Justice Systems
Pierce, G. L., Rodriguez‐Whitney, E., Drakulich, K., Shatz, S. F., & Radelet, M. L. (2023) · Social Justice Research · doi:10.1007/s11211-023-00408-8 · Cited by 9
“Confounding biases originate from common causes and “results from failing to control for a common cause variable that one should have controlled for” (Elwert & Winship, 2014, p. 32).”
BackgroundChanges in the Economic Returns to Attending Prestigious Institutions in Norway
Borgen, N. T. (2015) · European Societies · doi:10.1080/14616696.2015.1009843 · Cited by 6
“This selection on the outcome variable, however, may introduce endogenous selection bias (Elwert and Winship 2014).”
BackgroundMethodChou, W. (2017) · American Sociological Review · doi:10.1177/0003122417690497 · Cited by 6
Roydhouse, J. K., Gutman, R., Bhatnagar, V., Kluetz, P. G., Sridhara, R., & Mishra-Kalyani, P. S. (2019) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4875 · Cited by 6
“Analyses conditional on intermediate variables can produced biased results.(5,6) Truncation by death(7,8) or other causes(9,10) is an intermediate variable.”
BackgroundLi, T., Jones, C. M. C., Shah, M. N., Cushman, J. T., & Jusko, T. A. (2017) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x17000292 · Cited by 6
Grätz, M. (2019) · RePEc: Research Papers in Economics · Cited by 6
Wodtke, G. T., & Zhou, X. (2019) · doi:10.31235/osf.io/86d2k · Cited by 6
Lundberg, I. (2020) · doi:10.31235/osf.io/gx4y3 · Cited by 6
Graphical Causal Models for Survey InferencePreprint
Schuessler, J., & Selb, P. (2019) · doi:10.31235/osf.io/hbg3m · Cited by 6
Causal attributions of poverty: a social stratification analysis
Marquis, L., Kuhn, U., & Tillmann, R. (2025) · Frontiers in Sociology · doi:10.3389/fsoc.2025.1591235 · Cited by 7
“We thus avoid “overcontrol bias,” which arises when including a variable that lies on the causal path between the two variables of interest (Elwert and Winship, 2014).”
Causal Inference for Dummies: A Tutorial on Directed Acyclic Graphs and Balancing Weights
Primbs, M. A., Bijlstra, G., Holland, R. W., & Thoemmes, F. J. (2025) · Social Cognition · doi:10.1521/soco.2025.43.3.217 · Cited by 6
Lu, H., Zivich, P. N., Rudolph, J. E., Liew, Z., Mukherjee, B., & Li, F. (2025) · International Journal of Epidemiology · doi:10.1093/ije/dyaf109 · Cited by 6
Causality and ability beliefs: An introduction to confounders and colliders
Al‐Hoorie, A. H., & Hiver, P. V. (2025) · Studies in Second Language Learning and Teaching · doi:10.14746/ssllt.48231 · Cited by 8
Wong, J. J., Urquhart, O., Carrasco‐Labra, A., Schisterman, E. F., & Glick, M. (2025) · Journal of Dental Research · doi:10.1177/00220345251387660 · Cited by 7
“When C is conditioned on (by including only individuals who appear in claims databases), researchers inadvertently open a backdoor path between A and Y via S 1 and S 2 (Elwert and Winship 2014).”
Causal Inferences from Digital Behavioral Data
Leitgöb, H., & Keusch, F. (2026) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-026-01050-3 · Cited by 6
“Relevant aspects include information on treatment assignment, observed and unobserved variables, sample selection, and item nonresponse (e.g., Bareinboim et al. 2014; Elwert and Winship 2014; Mohan and Pearl 2021; Schuessler and Selb 2025).”
Aboukaoud, M., Hoch, B., Weiser, M., & Amiaz, R. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.121802 · Cited by 6
Novak, A. S. (2023) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2023.102063 · Cited by 5
Keller, T., & Elwert, F. (2023) · Sociological Science · doi:10.15195/v10.a28 · Cited by 5
“…usual concerns over observational peer effects estimation apply to the fore-going two studies (Angrist 2014; Bramoullé, Djebbari, and Fortin 2020; Elwert and Winship 2014; Shalizi and Thomas 2011), including the possibility of unobserved selection into deskmate allocations within classrooms…”
BackgroundSelf-citationEstimating the effect of intergroup contact over years: evidence from a youth program in Israel
Asimovic, N., Ditlmann, R. K., & Samii, C. (2024) · Political Science Research and Methods · doi:10.1017/psrm.2024.8 · Cited by 4
“…apply the method that we used for year one outcomes for year two outcomes, we would be estimating: where the outcomes for the “ no drop-out ” types E [ Y 2 (1)|Age = 11, S = 1] could differ from the overall mean E [ Y 2 (1)|Age = 11] because S is a “ collider ” variable (Elwert and Winship, 2014).”
Juratic, M. L. C. (2024) · European Journal of Political Research · doi:10.1111/1475-6765.12718 · Cited by 7
Characterisation and calibration of multiversal methods
Cantone, G. G., & Tomaselli, V. (2024) · Advances in Data Analysis and Classification · doi:10.1007/s11634-024-00610-9 · Cited by 6
“…bias as much as the introduction of a collider interaction, but while confounders are relatively easy to identify a priori , colliders are not because they could be nested in the data-generating process of the sampling procedures (Elwert and Winship 2014; Clarke et al. 2018; Munafò et al. 2018).”
Lee, B., & Pescosolido, B. A. (2024) · American Sociological Review · doi:10.1177/00031224241288179 · Cited by 7
“…shapes unemployment as well as suicide risks (Milner et al. 2014; Wray et al. 2011), controlling for mental health in cross-sectional studies like ours is challenging because it may induce a collider bias given that unemployment can also increase mental health problems (Elwert and Winship 2014).”
Status Transfer across Borders: The Mediating Role of Common Partners in First Entry
Liu, Y., MAULA, M. V. J., & Pinkham, B. (2024) · Journal of Management Studies · doi:10.1111/joms.13176 · Cited by 6
“Crossover” in Depressive Symptoms Among Older Couples: Are Previous Findings Artifactual?
Das, A. (2018) · Journal of Aging and Health · doi:10.1177/0898264318800919 · Cited by 5
Schito, M. (2020) · Journal of Industry Competition and Trade · doi:10.1007/s10842-020-00348-y · Cited by 5
Lee, G. K., & Bettis, R. (2022) · Strategy Science · doi:10.1287/stsc.2022.0169 · Cited by 5
Saari, H., Ryynänen, O., Lönnroos, E., Kekolahti, P., Mäntyselkä, P. T., & Kokko, S. J. (2022) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2022.07.004 · Cited by 5
Smallenbroek, O. (2023) · European Journal of Population / Revue européenne de Démographie · doi:10.1007/s10680-023-09677-0 · Cited by 5
“The model on marriage does not control for cohabitation status, as it may act as a collider variable (Elwert & Winship, 2014).”
BackgroundWalters, G. D. (2024) · Deviant Behavior · doi:10.1080/01639625.2024.2328350 · Cited by 6
“…testing designed to rule out omitted variable bias was performed using Kenny’s (2013) “failsafe ef” procedure: (r my.x ) x (sd m.x ) x (sd y.x )/(sd m ) x (sd y ), and endogenous selection bias (Elwert and Winship 2014) was evaluated by removing all precursor measures and re-doing the analyses.”
Theory Figures and Causal Claims in Sociology
Brett, G., & Silver, D. (2024) · The American Sociologist · doi:10.1007/s12108-024-09632-4 · Cited by 5
“However, in recent years the focus on causal modelling has shifted toward directed acyclical graphs (DAGs) which emerged from path diagrams (Elwert, 2013; Elwert & Winship, 2014).”
Advancing Group-Based Disparities Research and Beyond: A Cautionary Note on Selection Bias
Ren, D., & Loh, W. W. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241260256 · Cited by 7
“Although selection bias has been well recognized in other fields, such as medicine (Hernán & Monge, 2023), public health (Smith, 2020), and sociology (Elwert & Winship, 2014), it has yet to receive much attention in psychology.”
The daily experience of hunger in UK females with and without food insecurity
Neal, C., Pepper, G. V., Shannon, O. M., Allen, C., Melissa Bateson, B., & Nettle, D. (2024) · Appetite · doi:10.1016/j.appet.2024.107732 · Cited by 5
“…variables, F (4, 280) = 1.96, p = .100, η 2 = 0.027; significant effect of FI on dependent variables, F (4, 280) = 2.83, p = .025, η 2 = 0.042; though, this analysis is arguably inadvisable due to the risk of collider bias if BMI is causally affected by hunger and FI (Elwert and Winship (2014)).”
BackgroundInfluentialThe persistence of social inequality in adult mortality in rural Spain, death cohorts 1546–1940
Marco‐Gracia, F. J., & de Haro, V. A. L. (2024) · Cliometrica · doi:10.1007/s11698-024-00298-z · Cited by 6
“A more complex issue is the possible presence of selection effects arising from higher levels of child mortality or morbidity among individuals in lower SES categories (Elwert and Winship 2014; Inwood and Maxwell-Stewart 2020; Schneider 2020).”
Smith, C. M., Grodsky, E., & Warren, J. R. (2019) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2019.100424 · Cited by 5
Analyse binärer abhängiger Variablen
Weiss, F. (2020) · Springer eBooks · doi:10.1007/978-3-658-30237-5_3 · Cited by 5
States and Situations, Traits and Environments
Asendorpf, J. B., & Rauthmann, J. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.007 · Cited by 10
Personality, Preferences and Socioeconomic Behavior
Ferguson, E., Zhao, K., & Smillie, L. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.044 · Cited by 6
Cognitive Impulsivity as a Mediator of the Parental Knowledge-Childhood Aggression Relationship
Walters, G. D., & Espelage, D. L. (2021) · The Journal of Early Adolescence · doi:10.1177/0272431620983447 · Cited by 5
“Endogenous selection bias, which can occur when an outcome measure is conditioned on a precursor measure (Elwert & Winship, 2014), was evaluated by removing all precursor measures and redoing the analyses.”
MethodEstimating sibling spillover effects with unobserved confounding using gain-scores
Mallinson, D. C., & Elwert, F. (2022) · Annals of Epidemiology · doi:10.1016/j.annepidem.2021.12.010 · Cited by 5
Self-citationLane, T. J. (2021) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-021-09988-1 · Cited by 5
Berger, R. D., & Krumpal, I. (2021) · Springer eBooks · doi:10.1007/978-3-658-33536-6_5 · Cited by 6
Firesetting, cognitive impulsivity, and the antisocial spectrum
Walters, G. D. (2022) · Psychology Crime and Law · doi:10.1080/1068316x.2022.2049777 · Cited by 5
“…conditioning on the precursor to an outcome can potentially in fl ate path coe ffi cients through endogenous selection bias or a collider e ff ect (Elwert & Winship, 2014), a second sensitivity analysis was performed in which the four precursor measures (Firesetting-0, Insen-sitivity-1,…”
MethodGender differences between teachers’ assessments and test based assessments. Evidence from Spain
Gutiérrez, Ó. D. M., Prieto-Latorre, C., & Sánchez‐Rodríguez, M. I. (2023) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2023.2251715 · Cited by 5
Identifying the role of high school in educational inequality: A causal mediation approach
Fujihara, S. (2024) · Social Science Research · doi:10.1016/j.ssresearch.2024.103077 · Cited by 6
Zur Verhaltensvalidität von Vignettenexperimenten
Petzold, K., & Wolbring, T. (2018) · Schriftenreihe der ASI - Arbeitsgemeinschaft Sozialwissenschaftlicher Institute · doi:10.1007/978-3-658-24517-7_10 · Cited by 2
Peters, G.-J. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/38vfn · Cited by 5
Comment: Some Challenges When Estimating the Impact of Model Uncertainty on Coefficient Instability
O’Brien, R. M. (2018) · Sociological Methodology · doi:10.1177/0081175018790569 · Cited by 4
“…treatment variable (independent variable of interest) to the dependent variable or when two or more of the independent variables have paths into another independent variable (a collider variable), and in a few other situations (Elwert and Winship 2014; Hernán, Hernández-Diaz, and Robins 2004).”
BackgroundThe Future Strikes Back. Using Future Treatments to Detect and Reduce Hidden BiasPreprint
Elwert, F., & Pfeffer, F. T. (2018) · doi:10.31235/osf.io/yhtpu · Cited by 5
Self-citationEnvironmental Change and Migration Aspirations: Evidence from BangladeshPreprint
Koubi, V., Freihardt, J., & Rudolph, L. (2022) · doi:10.31235/osf.io/h5q9y · Cited by 5
Causal Machine Learning: A Deductive–Inductive Framework for Sociological Research
Jeon, N., & Brand, J. E. (2026) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-026-01053-0 · Cited by 5
“This guides researchers in selecting covariates for adjustment (Cinelli et al. 2024; Elwert 2013; Elwert and Winship 2014).”
Immigrant status and the social returns to academic achievement in adolescence
Ye, L. Z., & Fletcher, J. M. (2022) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2021.2020630 · Cited by 5
“We did not include participation in extracurricular activities in our main analyses to avoid an overly large overcontrol bias (Elwert and Winship 2014).”
BackgroundHögberg, B., & Baranowska-Rataj, A. (2024) · Advances in Life Course Research · doi:10.1016/j.alcr.2024.100607 · Cited by 4
Civic Lessons That Last? Religiosity and Volunteering on the Way to Adulthood
Lim, C., & Wiertz, D. (2024) · American Sociological Review · doi:10.1177/00031224241258791 · Cited by 5
“The combination of these two possibilities would induce collider bias (Elwert and Winship 2014).”
InfluentialImpact of Technology on Physical Activity Levels of Childhood Cancer Survivors: A Systematic Review
Sümengen, A. A., Savaş, E. H., Ay, A., Koyuncu, İ. E., Erkul, M., & Semerci, R. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151757 · Cited by 5
Cuzulan, B., Schultz-Nielsen, M. L., & Fallesen, P. (2025) · Demography · doi:10.1215/00703370-11791081 · Cited by 4
Luchinskaya, D., & Tzanakou, C. (2025) · Studies in Higher Education · doi:10.1080/03075079.2025.2490801 · Cited by 4
“While including these factors may introduce endogenous selection and overcontrol bias, potentially violating assumption 4 (Elwert and Winship 2014), it allows us to account for their mediating roles, isolating the direct effect of work experience on earnings.”
The Target Study: A Conceptual Model and Framework for Measuring Disparity
Jackson, J. W., Hsu, Y., Greer, R. C., Boonyasai, R. T., & Howe, C. J. (2025) · Sociological Methods & Research · doi:10.1177/00491241251314037 · Cited by 16
Götz, M., Carnes, C. M., Hill, A., & O’Boyle, E. H. (2025) · Academy of Management Journal · doi:10.5465/amj.2024.0355 · Cited by 4
Parental education and children’s cognitive development: a prospective approach
Klein, M., & Kühhirt, M. (2025) · Social Forces · doi:10.1093/sf/soaf146 · Cited by 8
Mediating the Bullying-to-Delinquency Transition With Peer Delinquency and Cognitive Insensitivity
Walters, G. D., Runell, L., & Kremser, J. (2022) · Crime & Delinquency · doi:10.1177/00111287221118885 · Cited by 4
“Omitted variable bias was tested using Kenny’s (2013) “failsafe ef” procedure, (rmy.x) × (sdm.x) × (sdy.x)/ (sdm) × (sdy), and endogenous selection bias (Elwert & Winship, 2014) was tested by removing the precursor measures from each of the regression equations and redoing the analysis.”
MethodResultEmployment and mental health of youth in Egypt: Does job security matter?
Ehab, M. (2023) · SSM - Mental Health · doi:10.1016/j.ssmmh.2023.100201 · Cited by 6
To Blend in or Hide Out? A Network Analysis on Maritime Criminal Co-voyages in Taiwan
Chiang, Y.-S., Chang, Y.-C., & Weng, W. (2023) · Journal of Quantitative Criminology · doi:10.1007/s10940-023-09572-1 · Cited by 4
“Omitting these unarrested actors introduces a selection bias to the analysis and interpretation of the result (Elwert and Winship 2014).”
Labussière, M. (2023) · European Sociological Review · doi:10.1093/esr/jcad027 · Cited by 4
Friedrich, C. (2023) · Journal of Family Research · doi:10.20377/jfr-907 · Cited by 4
“Moreover, employment could mediate the effect of births on agency; if so, its inclusion in the models would lead to overcontrol bias (Elwert & Winship, 2014).”
BackgroundCausal diagrams for civil and structural engineers
Naser, M. Z. (2024) · Structures · doi:10.1016/j.istruc.2024.106398 · Cited by 4
“According to Elwert and Winship [30], “ … a so-called collider variable, i.e., a variable that is itself caused by two other variables, one that is (or is associated with) the treatment and another that is (or is associated with) the outcome .””
Mikkola, E. J. A., Perälä, M., Hotulainen, R., Salmenkivi, E., & Kallioniemi, A. J. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102414 · Cited by 4
Labor Market Consequences of Grandparenthood
Joo, W.-T., Elwert, F., & Munk, M. D. (2024) · Sociological Science · doi:10.15195/v11.a22 · Cited by 3
Self-citationPistocchi, V., Triventi, M., & Agneessens, F. (2024) · The Journal of Early Adolescence · doi:10.1177/02724316241273445 · Cited by 4
“To remedy as best as possible such an endogenous selection bias (Elwert & Winship, 2014), resulting from students with poor academic achievement being selected as victims by bullies, we relied on entropy balancing between bullied and non-bullied groups (Hainmueller, 2012).”
The gender income gap and the role of family formation revisited
Ochsenfeld, F. (2017) · Journal for Labour Market Research · doi:10.1007/s12651-017-0225-5 · Cited by 4
The Effect of Retirement on Male Mortality. Quasi-experimental Evidence from Norway
Rogne, A. F., & Syse, A. (2018) · European Sociological Review · doi:10.1093/esr/jcy023 · Cited by 4
Walters, G. D. (2019) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-019-09360-3 · Cited by 4
Zufriedenheit in der Partnerschaft und Untreue: Ein Zusammenhang, zwei Richtungen
Bozoyan, C., & Schmiedeberg, C. (2020) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-020-00660-9 · Cited by 4
Hall, A. (2021) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2021-0016 · Cited by 4
Hall, A. (2021) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-021-00808-1 · Cited by 4
Hsu, C. (2022) · Longitudinal and Life Course Studies · doi:10.1332/175795921x16379265590317 · Cited by 4
Temperament and Brain Networks of Attention
Rothbart, M. K., Posner, M. I., & Sheese, B. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.016 · Cited by 8
Social sampling shapes preferences for redistribution: Evidence from a national survey experiment
Sumaktoyo, N. G., Breunig, C., & Gaissmaier, W. (2022) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2022.104341 · Cited by 4
Family structure and delinquency: Antisocial cognition as a mediating mechanism
Walters, G. D., Runell, L., & Kremser, J. (2022) · Journal of Adolescence · doi:10.1002/jad.12063 · Cited by 5
The Effects of Undergraduate Financing on Advanced Degree Attainment
Witteveen, D. (2022) · Social Forces · doi:10.1093/sf/soac044 · Cited by 4
Petzold, K., & Netz, N. (2022) · Higher education research and science studies · doi:10.1007/978-3-658-36921-7_7 · Cited by 4
Gervasoni, C. (2023) · Acta Politica · doi:10.1057/s41269-022-00282-3 · Cited by 5
“Conditioning on it, therefore, produces over-control bias (Elwert and Winship 2014) in the regression results below.”
Zane, S. N., & Pupo, J. A. (2023) · Journal of Research in Crime and Delinquency · doi:10.1177/00224278231165888 · Cited by 4
“6 The non-random reduction in sample size from initial referral to judicial disposition introduces the possibility of selection bias (Elwert and Winship 2014).”
BackgroundSocioeconomic differences in the long-term effects of teacher absence on student outcomes
Borgen, N. T., Markussen, S., & Raaum, O. (2023) · European Societies · doi:10.1080/14616696.2023.2212744 · Cited by 7
Electoral Systems, Partisan Politics, and Income Redistribution: A Critical Quasi -Experiment
Górecki, M. A., & Pierzgalski, M. (2023) · Comparative Political Studies · doi:10.1177/00104140231169018 · Cited by 3
“Such an approach could yield post-treatment bias (e.g., Elwert & Winship, 2014).”
BackgroundRacial bias in media coverage: accounting for structural position and public interest
Shor, E., & van de Rijt, A. (2023) · European Sociological Review · doi:10.1093/esr/jcad031 · Cited by 4
Environmental inequality and disparities in school readiness: The role of neurotoxic lead
Schachner, J. N., & Wodtke, G. T. (2023) · Child Development · doi:10.1111/cdev.13949 · Cited by 4
Protest Policing, Normative Alignment, and Riot Gear: An Experiment
Thompson, A. J., Pickett, J. T., Graham, A., & Cullen, F. T. (2023) · Crime & Delinquency · doi:10.1177/00111287231189718 · Cited by 4
“We do not include control variables, as they are unnecessary in experimental analyses, especially when the focus is only on total (rather than indirect) effects of randomized manipulations, as it is in our study (Berk et al., 2013; Elwert & Winship, 2014).”
Structural Position in the Global Economy and Major Episodes of Civil Violence, 1970 to 2018
Kollmeyer, C. J. (2023) · Sociology of Development · doi:10.1525/sod.2022.0021 · Cited by 4
Weber, S., Mascherek, A., Augustin, J., Cheng, B., Thomalla, G., Hoven, H., Harth, V., Augustin, M., Gallinat, J., & Kühn, S. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1267900 · Cited by 4
College Is Not the Great Equalizer in Japan
Fujihara, S., & Ishida, H. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231231225558 · Cited by 5
“Similar to other disciplines in social science research, sociological studies have been concerned with the question of causality (Elwert and Winship 2014; Gangl 2010; Morgan and Winship 2014; Sobel 1996).”
Colombarolli, C. (2024) · Housing Studies · doi:10.1080/02673037.2024.2369144 · Cited by 7
“For more details: (King et al ., 1994; Elwert & Winship, 2014).”
The Great Recession and shifting patterns of college effects for young men
Curry, M. (2018) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2018.11.003 · Cited by 4
How education did (and did not) accentuate partisan differences during the Ebola outbreak of 2014-15
Martin, C. C. (2020) · Journal of Social and Political Psychology · doi:10.5964/jspp.v8i1.1072 · Cited by 4
“These true and specious facts then influence individual attitudes so controlling for factual knowledge can induce overcontrol bias, i.e., conditioning on a mediator (Elwert & Winship, 2014).”
BackgroundLing, Z., & Tam, T. (2019) · Chinese Journal of Sociology · doi:10.1177/2057150x18817245 · Cited by 4
Genes, Childhood Trauma, and Late Life Depressive Symptoms
Das, A. (2019) · Journal of Aging and Health · doi:10.1177/0898264319861001 · Cited by 5
Seebruck, R., & Savage, S. V. (2019) · Social Problems · doi:10.1093/socpro/spz030 · Cited by 7
Biesanz, J. C., & Wallace, J. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.006 · Cited by 7
Metadata
- Authors
- Elwert, F., & Winship, C.
- Affiliations
- University of Wisconsin–Madison (US)
- Harvard University (US)
- Venue
- Annual Review of Sociology
- Publisher
- Annual Reviews
- Published
- 2014-07-30
- Volume
- 40
- Issue
- 1
- Pages
- 31-53
- ISSN
- 0360-0572 (ISSN-L)
- 1545-2115
- PMC
- PMC6089543
- OpenAlex
- W2097829006
- Semantic Scholar
- 9fcc6fe93c9ce0c0b4773c18074c01bdf71db52d
- Cited by
- 1,168
- References
- 120
- Citations by year
- 2026: 70 · 2025: 102 · 2024: 156 · 2023: 156 · 2022: 122 · 2021: 125 · 2020: 150 · 2019: 94 · 2018: 82 · 2017: 52 · 2016: 29 · 2015: 23 · 2014: 7
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Sociology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Aging (P30AG017266)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD047873)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- collider bias, causal inference, causal graphs, social stratification, sociology of culture, social network analysis, political sociology, social demography, sociology of education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
