Identification, Inference and Sensitivity Analysis for Causal Mediation Effects
Open accessAbstract
Causal mediation analysis is routinely conducted by applied researchers in a variety of disciplines. The goal of such an analysis is to investigate alternative causal mechanisms by examining the roles of intermediate variables that lie in the causal paths between the treatment and outcome variables. In this paper we first prove that under a particular version of sequential ignorability assumption, the average causal mediation effect (ACME) is nonparametrically identified. We compare our identification assumption with those proposed in the literature. Some practical implications of our identification result are also discussed. In particular, the popular estimator based on the linear structural equation model (LSEM) can be interpreted as an ACME estimator once additional parametric assumptions are made. We show that these assumptions can easily be relaxed within and outside of the LSEM framework and propose simple nonparametric estimation strategies. Second, and perhaps most importantly, we propose a new sensitivity analysis that can be easily implemented by applied researchers within the LSEM framework. Like the existing identifying assumptions, the proposed sequential ignorability assumption may be too strong in many applied settings. Thus, sensitivity analysis is essential in order to examine the robustness of empirical findings to the possible existence of an unmeasured confounder. Finally, we apply the proposed methods to a randomized experiment from political psychology. We also make easy-to-use software available to implement the proposed methods.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proves nonparametric identification of the average causal mediation effect (ACME) under a sequential ignorability assumption that does not condition on post-treatment confounders, shows when the popular linear structural equation model (LSEM) product-of-coefficients estimator can be given a causal interpretation, and proposes a sensitivity analysis for unmeasured pre-treatment confounding. It applies the methods to a randomized media-framing experiment and finds the parametric estimates relatively robust to some violations, while nonparametric sensitivity bounds are more sensitive.
Key findings
- Under Assumption 1 (sequential ignorability), the ACME and average natural direct effects are nonparametrically identified; the LSEM estimator \(\delta(0)=\delta(1)=\beta_2\gamma\) is valid under this assumption plus the no-interaction assumption.
- The proposed sensitivity analysis uses \(\rho \equiv \mathrm{Corr}(\varepsilon_{i2},\varepsilon_{i3})\); in the media-framing application, the original negative ACME conclusion is maintained unless \(\rho < -0.68\), and the 95% confidence interval covers zero only when \(-0.79 < \rho < -0.49\).
- In the media-framing experiment (\(n=136\); 67 free-speech frame, 69 public-order frame), parametric estimates were \(\delta(0)=-0.566\) \([-1.081,-0.050]\), \(\delta(1)=-0.451\) \([-0.871,-0.031]\), and total effect \(\tau=-0.540\) \([-1.207,0.127]\); nonparametric estimates were \(\delta(0)=-0.596\) \([-1.168,-0.024]\), \(\delta(1)=-0.374\) \([-0.823,0.074]\), and \(\tau=-0.540\) \([-1.206,0.126]\).
- A nonparametric sensitivity analysis for binary mediator/outcome found the estimates more sensitive: upper bounds crossed zero at \(\upsilon=0.019\) for \(\delta(1)\) and \(\upsilon=0.022\) for \(\delta(0)\).
- Monte Carlo simulations with true \(\delta(0)=0.675\) and \(\delta(1)=4.03\) showed nonparametric estimators had smaller bias but larger variance than parametric estimators; 95% CI coverage converged to nominal as sample size increased.
Methods
- Potential outcomes framework with binary treatment \(T_i\), mediator \(M_i\), outcome \(Y_i\), and pre-treatment covariates \(X_i\); defines ACME \(\delta(t)=E\{Y_i(t,M_i(1))-Y_i(t,M_i(0))\}\).
- Proves identification under Assumption 1, compares it with Pearl (2001), Robins (2003), Petersen et al. (2006), and Rubin (2004), and derives LSEM implications including interaction and no-interaction cases.
- Proposes parametric and nonparametric estimators, derives asymptotic variance for the nonparametric plug-in estimator, conducts a Monte Carlo experiment (sample sizes 50, 100, 500; 50,000 iterations), and applies methods to Nelson, Clawson, and Oxley’s (1997) randomized media-framing experiment.
Limitations
- The paper states Assumption 1 may be too strong in many applied settings, especially when the treatment is randomized but the mediator is not; it cannot condition on observed or unobserved post-treatment confounders.
- The proposed sensitivity analysis addresses unmeasured pre-treatment confounding but does not address possible post-treatment confounders; the nonparametric sensitivity analysis is developed only for the special case of binary mediator and outcome.
- The paper states future work is needed on multiple mediators, measurement error in the mediator, and experimental designs that identify causal mediation effects under weaker assumptions; the empirical example also makes evident that subjects’ attitudes were observed rather than randomized.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 26 cited sources checked · 0 supported · 0 flagged
- Findingnone given
The variance is larger for the nonparametric estimator than for the parametric estimator.
“As expected, the variance is larger for the nonparametric estimator than the parametric estimator.”
Quote in the paperNot a substantial claim - Findingown data
The performance of the estimators is quite good in this particular simulation setting.
“The performance of the estimators turns out to be quite good in this particular setting.”
Quote in the paperNot a substantial claim - Findingown data
The public order treatment decreased the subjects' tolerance toward the Ku Klux Klan speech in the news clips compared to the free speech frame.
“Moreover, the public order treatment decreased the subjects' tolerance toward the Ku Klux Klan speech in the news clips compared to the free speech frame.”
Quote in the paperNot a substantial claim - Findingown data
Being exposed to the public order frame as opposed to the free speech frame significantly increased the subjects' perceived importance of public order.
“For example, being exposed to the public order frame as opposed to the free speech frame significantly increased the subjects' perceived importance of public order”
Quote in the paperNot a substantial claim - Findingown data
Even with sample size as small as 50, estimated biases are essentially zero for the nonparametric estimates.
“Even with sample size as small as 50, estimated biases are essentially zero for the nonparametric estimates.”
Quote in the paperNot a substantial claim
- Findingown data
In the media framing experiment, the media frame treatment appears to influence both types of response variables in the expected directions.
“As is clear from the last column, the media frame treatment appears to influence both types of response variables in the expected directions.”
Quote in the paperNot a substantial claim - Findingown data
The direction of the original estimate is maintained if the unobserved confounder explains less than 26.7% of the original variance in the mediator, regardless of the degree of confounding for the outcome.
“Similarly, the direction of the original estimate is maintained if the unobserved confounder explains less than 26.7% (14.7%) of the original variance in the mediator (outcome), regardless of the degree of confounding for the outcome (mediator).”
Quote in the paperSubstantial claim - Findingown data
The estimated ACME under the free speech condition [δ(0)] is larger than the effect under the public order condition [δ(1)] for both the parametric and nonparametric estimators.
“These results show that the estimated ACME under the free speech condition [ δ(0)] is larger than the effect under the public order condition [ δ(1)] for both the parametric and nonparametric estimators.”
Quote in the paperNot a substantial claim - Findingreasoning
The estimated average total effect is identical to that without Assumption 2.
“Finally, the estimated average total effect is identical to that without Assumption 2.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
- Findingown data
The original conclusion about the direction of the ACME under Assumption 1 would be maintained unless ρ is less than -0.68.
“The analysis indicates that the original conclusion about the direction of the ACME under Assumption 1 (represented by the dashed horizontal line) would be maintained unless ρ is less than -0.68.”
Quote in the paperSubstantial claim - Findingown data
The convergence of confidence intervals to nominal coverage occurs much more quickly for the parametric estimator than for the nonparametric estimator.
“The convergence occurs much more quickly for the parametric estimator”
Quote in the paperNot a substantial claim - Findingown data
The 95% confidence interval for the nonparametric estimate of δ(1) includes zero.
“In fact, the 95% confidence interval for the nonparametric estimate of δ(1) includes zero.”
Quote in the paperSubstantial claim - Findingown data
The convergence of coverage occurs much more quickly for the parametric estimator.
“The convergence occurs much more quickly for the parametric estimator.”
Quote in the paperNot a substantial claim - Findingown data
The 95% confidence intervals converge to the nominal coverage as the sample size increases.
“The 95% confidence intervals converge to the nominal coverage as the sample size increases.”
Quote in the paperNot a substantial claim - Findingown data
We fail to reject the null hypothesis of δ(0) = δ(1) under the parametric analysis, with a p-value of 0.238.
“However, we fail to reject the null hypothesis of δ(0) = δ(1) under the parametric analysis, with a p-value of 0.238.”
Quote in the paperSubstantial claim - Findingown data
The confidence intervals of the estimators converge to the nominal coverage as the sample size increases.
“The confidence intervals converge to the nominal coverage as the sample size increases.”
Quote in the paperNot a substantial claim - Findingown data
The point estimates of the ACME are rather sensitive to the violation of the sequential ignorability assumption.
“The results suggest that the point estimates of the ACME are rather sensitive to the violation of the sequential ignorability assumption.”
Quote in the paperSubstantial claim - Findingown data
The direction of the original estimate is maintained if the unobserved confounder explains less than 14.7% of the original variance in the outcome, regardless of the degree of confounding for the mediator.
“Similarly, the direction of the original estimate is maintained if the unobserved confounder explains less than 26.7% (14.7%) of the original variance in the mediator (outcome), regardless of the degree of confounding for the outcome (mediator).”
Quote in the paperSubstantial claim - Findingnone given
Even for the alternative situation where the unobserved confounder has opposite effects on mediator and outcome, the ACME is still guaranteed to be negative as long as the unobserved confounder explains less than 27.7% of the variance in the mediator or outcome that is left unexplained by the treatment alone, no matter how large the corresponding portion of the variance in the other variable may.
“However, even for this alternative situation, the ACME is still guaranteed to be negative as long as the unobserved confounder explains less than 27.7% of the variance in the mediator or outcome that is left unexplained by the treatment alone, no matter how large the corresponding portion of the variance in the other variable may be.”
Quote in the paperSubstantial claim - Findingown data
The result is less robust to the existence of an unobserved confounder that has opposite effects on the mediator and outcome.
“On the other hand, the result is less robust to the existence of an unobserved confounder that has opposite effects on the mediator and outcome.”
Quote in the paperSubstantial claim - Findingnone given
The sharp bounds widen as the value of υ increases, until they flatten out and become equal to the no-assumption bounds.
“The sharp bounds widen as we increase the value of υ, until they flatten out and become equal to the no-assumption bounds given in equations ( 29) and ( 30).”
Quote in the paperNot a substantial claim - Interpretationreasoning
Baron and Kenny's (1986) popular LSEM estimator can be interpreted as an ACME estimator under the proposed assumption if additional parametric assumptions are satisfied.
“In particular, Baron and Kenny's (1986) popular estimator (Google Scholar records over 17 thousand citations for this paper), which is based on a linear structural equation model (LSEM), can be interpreted as an ACME estimator under the proposed assumption if additional parametric assumptions are satisfied.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Baron and Kenny's (1986)
Not checked in the free run.
- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- Interpretationreasoning
Under Assumption 1, the average causal mediation effect (ACME) and the average natural direct effects are nonparametrically identified by the expressions given in Theorem 1.
“Under Assumption 1, the ACME and the average natural direct effects are nonparametrically identified as fol-lows for t = 0, 1:”
- Also stated in: § Abstract · plain
“we first prove that under a particular version of sequential ignorability assumption, the average causal mediation effect (ACME) is nonparametrically identified.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- The authors state this as an assumption: The potential outcome depends only on the values of the treatment and mediating variables and not on how they are realized.
- Also stated in: § Abstract · plain
- Interpretationnone given
The additional parametric assumptions needed to interpret the LSEM estimator as an ACME estimator can be easily relaxed within and outside of the LSEM framework.
“We show that these additional assumptions can be easily relaxed within and outside of the LSEM framework.”
Quote in the paperSubstantial claim - Interpretationreasoning
The no-interaction assumption for the ACME δ(1) = δ(0) is equivalent to the no-interaction assumption for the average natural direct effects ζ(1) = ζ(0).
“This assumption is equivalent to the no-interaction assumption for the average natural direct effects, ζ (1) = ζ (0).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
- Interpretationreasoning
Under Assumption 1, the standard LSEM defined in equations (12) and (13) makes the no-interaction assumption about the ACME: δ(1) = δ(0).
“It is important to note that under Assumption 1, the standard LSEM defined in equations ( 12) and ( 13) makes the following no-interaction assumption about the ACME:”
- Also stated in: § 3.4 Implications for Linear Structural Equation Model · plain
“ASSUMPTION 2 (No-interaction between the Treatment and the ACME). δ(1) = δ(0).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
- Also stated in: § 3.4 Implications for Linear Structural Equation Model · plain
- Interpretationreasoning
The ACME equals the product of two terms representing the average effect of T on M and that of M on Y, holding T at t.
“Thus, the ACME equals the product of two terms representing the average effect of T i on M i and that of M i on Y i (holding T i at t), respectively.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The inability to randomize subjects' attitudes implies that there are likely to be unobserved covariates that confound the relationship between the mediator and the outcome.
“This implies that there is likely to be unobserved covariates that confound the relationship between the mediator and the outcome.”
Quote in the paperSubstantial claim - Interpretationcitation
The identification result does not hold under the standard sequential ignorability assumption.
“However, as mentioned above, this identification result does not hold under the standard sequential ignorability assumption.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Avin, Shpitser and Pearl (2005)
Not checked in the free run.
- cites Robins (2003)
Not checked in the free run.
- Interpretationreasoning
The sequential ignorability assumption cannot be directly tested even in randomized experiments.
“Given the fact that the sequential ignorability assumption cannot be directly tested even in randomized experiments, sensitivity analysis must play an essential role in causal mediation analysis.”
Quote in the paperSubstantial claim - Interpretationreasoning
When M is discrete, δ(t) can be equivalently expressed as equation (16).
“To see this, note that δ(t) can be equivalently expressed as [dropping the integration over P (X i ) for notational simplicity] δ(t) = J -1 m=0 E(Y i |M i = m, T i = t, X i ) • {Pr(M i = m|T i = 1, X i ) (16) -Pr(M i = m|T i = 0, X i )}, when M i is discrete.”
Quote in the paperNot a substantial claim - Interpretationcitation
These estimation strategies are quite general and can be applied to a wide range of statistical models.
“These estimation strategies are quite general in that they can be applied to a wide range of statistical models.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Theorem 1 shows that if equation (10) is replaced with equation (4), which is possible when the treatment is randomized, then Petersen et al.'s additional assumption is unnecessary for nonparametric identification.
“Theorem 1 shows that if equation ( 10) is replaced with equation ( 4), which is possible when the treatment is randomized, then this additional assumption is unnecessary for the nonparametric identification.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- Interpretationreasoning
Theorem 1 shows that under the sequential ignorability assumption that does not condition on post-treatment covariates, the no-interaction assumption is not required for nonparametric identification.
“In contrast, Theorem 1 shows that under the sequential ignorability assumption that does not condition on the post-treatment covariates, the nointeraction assumption is not required for the nonparametric identification.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- Study design and conductnone given
Under the simulation setup, Assumption 1 is satisfied.
“Under this setup, Assumption 1 is satisfied.”
Quote in the paperSubstantial claim - Interpretationreasoning
The ACME can be nonzero even when the average total causal effect is zero when the mediation effect offsets the direct effect of the treatment.
“This happens when the mediation effect offsets the direct effect of the treatment.”
Quote in the paperSubstantial claim - Interpretationreasoning
The data generating process in the simulation implies the parametric regression models in equations (21) and (22).
“Also, note that this data generating process implies the following parametric regression models for the observed data:”
Quote in the paperNot a substantial claim - Interpretationnone given
Both identification results hold for general treatment regimes, unlike some of the previous results.
“Both identification results hold for general treatment regimes, unlike some of the previous results.”
Quote in the paperSubstantial claim - Premisecitation
The problem of comparing E(Y_i(1,M_i(1))-Y_i(0,M_i(0))|M_i(1)=M_i(0)) with the average direct effect is that the two quantities are defined for different subsets of the population.
“as VanderWeele (2008) points out, the problem of such comparison is that two quantities are defined for different subsets of the population.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites VanderWeele (2008)
Not checked in the free run.
- Interpretationnone given
The nonparametric regression estimator in equation (19) is asymptotically consistent for the ACME under Assumption 1 if μtm(x) and νtm(x) are consistent for μtm(x) and νtm(x), respectively.
“This estimator is also asymptotically consistent for the ACME under Assumption 1 if μtm (x) and νtm (x) are consistent for μ tm (x) and ν tm (x), respectively.”
Quote in the paperSubstantial claim - Interpretationreasoning
By the law of large numbers, the nonparametric estimator in equation (18) asymptotically converges to the true ACME under Assumption 1.
“By the law of large numbers, this estimator asymptotically converges to the true ACME under Assumption 1.”
Quote in the paperSubstantial claim - Interpretationreasoning
Under Assumption 1 and the model defined by equations (12) and (15), the ACME is identified as δ(t) = β2(γ + tκ) for t = 0, 1.
“Under Assumption 1 and the model defined by equations ( 12) and ( 15), we can identify the ACME as δ(t) = β 2 (γ + tκ) for t = 0, 1.”
Quote in the paperSubstantial claim - Interpretationreasoning
There exists an important trade-off: allowing for conditioning on observed post-treatment confounders requires an additional assumption for the identification of the ACME.
“Therefore, there exists an important trade-off; allowing for conditioning on observed post-treatment confounders requires an additional assumption for the identification of the ACME.”
Quote in the paperSubstantial claim - Interpretationreasoning
The existence of such confounders represents a violation of a key assumption for identifying the causal mechanism.
“As we formally show in the next section, the existence of such confounders represents a violation of a key assumption for identifying the causal mechanism.”
Quote in the paperSubstantial claim - Interpretationreasoning
This explains why the application of Rubin's approach has been limited to studies with a discrete (often binary) mediator.
“This explains why the application of this approach has been limited to the studies with a discrete (often binary) mediator.”
Quote in the paperNot a substantial claim - Interpretationnone given
The identification result given in Theorem 1 holds for any type of mediator, whether discrete or continuous.
“In contrast, the identification result given in Theorem 1 holds for any type of mediator, whether discrete or continuous.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- Premisecitation
Under Robins' FRCISTG model, the no-interaction assumption is sufficient to identify the ACME.
“Under this model, Robins (2003, Theorem 2.1) shows that the following additional assumption is sufficient to identify the ACME:”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Robins (2003, Theorem 2.1)
Not checked in the free run.
- Interpretationreasoning
Under the LSEM given by equations (12) and (13) and Assumption 1, the estimation of the ACME is straightforward because the error terms are independent of each other.
“Under the LSEM given by equations ( 12) and (13) and Assumption 1, the estimation of the ACME is straightforward since the error terms are independent of each other.”
Quote in the paperSubstantial claim - Interpretationreasoning
Assumption 2 is not required for the identification of the ACME under the LSEM.
“As Theorem 1 suggests, Assumption 2 is not required for the identification of the ACME under the LSEM.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
- Premisecitation
Hafeman and VanderWeele (2010) show that if the mediator is binary, the ACME can be identified with a weaker set of assumptions than Assumption 1.
“Fourth, in the appendix of a recent paper, Hafeman and VanderWeele (2010) show that if the mediator is binary, the ACME can be identified with a weaker set of assumptions than Assumption 1.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hafeman and VanderWeele (2010)
Not checked in the free run.
- Interpretationnone given
The asymptotic variance in Theorem 3 can be consistently estimated by replacing unknown population quantities with their corresponding sample counterparts.
“This asymptotic variance can be consistently estimated by replacing unknown population quantities with their corresponding sample counterparts.”
Quote in the paperSubstantial claim - Premisecitation
In the media framing study, the original researchers were only able to randomize news stories but not subjects' attitudes.
“One crucial limitation of this study, however, is that like many other psychological experiments the original researchers were only able to randomize news stories but not subjects' attitudes.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Nelson, Clawson and Oxley (1997)
Not checked in the free run.
- Interpretationnone given
Assumption 1 implies Pearl's equations (6) and (7).
“Indeed, it can be shown that Assumption 1 implies equations ( 6) and ( 7).”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
- Interpretationnone given
In the LSEM, conditioning on observed pre-treatment covariates by adding them as regressors in each equation changes none of the results given, provided the model includes no posttreatment confounders.
“Although we adhere to their original model, one may further condition on any observed pre-treatment covariates by including them as additional regressors in each equation.This will change none of the results given below so long as the model includes no posttreatment confounders.”
Quote in the paperNot a substantial claim - Interpretationnone given
In some cases, it is possible to address the main source of confounding by conditioning on pre-treatment variables alone.
“In some cases, however, it is possible to address the main source of confounding by conditioning on pre-treatment variables alone (see Section 6 for an example).”
Quote in the paperNot a substantial claim - Interpretationcitation
Nonparametric identification of natural direct and indirect effects is not possible without an additional assumption if equation (5) holds only after conditioning on post-treatment confounders Z_i as well as pre-treatment covariates X_i.
“As shown by Avin, Shpitser and Pearl (2005) and also pointed out by Robins (2003), the nonparametric identification of natural direct and indirect effects is not possible without an additional assumption if equation ( 5) holds only after conditioning on the post-treatment confounders Z i as well as the pre-treatment covariates X i”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Avin, Shpitser and Pearl (2005)
Not checked in the free run.
- cites Robins (2003)
Not checked in the free run.
- Interpretationreasoning
When the model contains the interaction term as in equation (15), the asymptotic variance can be computed in a similar manner, for example using the delta method formula given.
“When the model contains the interaction term as in equation ( 15) (so that Assumption 2 is relaxed), the asymptotic variance can be computed in a similar manner.For example, using the delta method, we have Var( δ(t)) ≈ (γ + tκ) 2 Var( β2 ) + β 2 2 {Var( γ ) + t Var( κ) + 2t Cov( γ , κ)} for t = 0, 1.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The proposal by Kraemer et al. (2008) that mediation effects can be established by testing either γ = 0 or κ = 0 is neither a necessary nor sufficient condition for δ(t) to be zero.
“This conflicts with the proposal by Kraemer et al. (2008) that the existence of mediation effects can be established by testing either γ = 0 or κ = 0, which is clearly neither a necessary nor sufficient condition for δ(t) to be zero.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kraemer et al. (2008)
Not checked in the free run.
- Interpretationreasoning
Equation (5) may fail because there may exist unmeasured pre-treatment covariates that confound the relationship between the mediator and the outcome.
“First, there may exist unmeasured pre-treatment covariates that confound the relationship between the mediator and the outcome.”
Quote in the paperSubstantial claim - Interpretationreasoning
If δ(t) = β2γ is negative, the true ACME is also guaranteed to be negative if ρ < ρ holds.
“For example, if δ(t) = β2 γ is negative, the true ACME is also guaranteed to be negative if ρ < ρ holds.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Researchers can specify values of (R2*M, R2*Y) or (R2M, R2Y) and the sign of λ2λ3 to determine values of ρ and estimate the ACME based on these values of ρ.
“Thus, in this framework, researchers can specify the values of (R 2 * M , R 2 * Y ) or ( R 2 M , R 2 Y ) as well as the sign of λ 2 λ 3 in order to determine values of ρ and estimate the ACME based on these values of ρ.”
Quote in the paperSubstantial claim - Interpretationreasoning
The partial derivative of the ACME with respect to ρ implies that the ACME is either monotonically increasing or decreasing in ρ, depending on the sign of β2.
“Second, the partial derivative of the ACME with respect to ρ implies that the ACME is either monotonically increasing or decreasing in ρ, depending on the sign of β 2 .”
Quote in the paperNot a substantial claim - Interpretationreasoning
Under Assumption 1, ρ = 0 if and only if E{εi2(Ti)εi3(Ti,Mi(Ti))} = 0.
“Thus, under Assumption 1, we have ρ = 0 ⇐⇒ E{ε i2 (T i )ε i3 (T i , M i (T i ))} = 0.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- The authors state this as an assumption: The standard LSEM (linear structural equation model) holds.
- Interpretationown data
The original finding about the negative ACME is relatively robust to the violation of equation (5) of Assumption 1 under the LSEM.
“Thus, the original finding about the negative ACME is relatively robust to the violation of equation ( 5) of Assumption 1 under the LSEM.”
Quote in the paperSubstantial claim - Interpretationreasoning
Given these estimates, the covariance matrix of (εi1, εi2) can be consistently estimated by computing the sample covariance matrix of the residuals.
“Given these estimates, the covariance matrix of (ε i1 , ε i2 ), whose elements are (σ 2 1 , σ 2 2 , ρσ 1 σ 2 ), can be consistently estimated by computing the sample covariance matrix of the residuals”
Quote in the paperSubstantial claim - Interpretationreasoning
The original results can be given a causal interpretation under sequential ignorability, that is, Assumption 1.
“As we showed in Section 3.4, the original results can be given a causal interpretation under sequential ignorability, that is, Assumption 1.”
Quote in the paperSubstantial claim - Interpretationreasoning
Equation (5) may fail because there may exist observed or unobserved posttreatment confounders.
“Second, there may exist observed or unobserved posttreatment confounders.”
Quote in the paperSubstantial claim - Interpretationreasoning
The data generating process contains no information about the credibility of the sequential ignorability assumption.
“Indeed, as we formally show below, the data generating process contains no information about the credibility of the sequential ignorability assumption.”
Quote in the paperSubstantial claim - Interpretationreasoning
A nonzero correlation parameter ρ can be interpreted as the existence of omitted variables that are related to both the observed value of the mediator M and the potential outcomes Y even after conditioning on treatment T and observed covariates X.
“A nonzero correlation parameter can be interpreted as the existence of omitted variables that are related to both the observed value of the mediator M i and the potential outcomes Y i even after conditioning on the treatment variable T i (and the observed covariates X i ).”
Quote in the paperSubstantial claim - Interpretationreasoning
Under Assumption 1 and the LSEM, the ACME equals β2γ.
“Using these expressions and Theorem 1, the ACME can be shown to equal β 2 γ .”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- The authors state this as an assumption: The standard LSEM (linear structural equation model) holds.
- Interpretationreasoning
This implies that the conclusion is plausible given even fairly large departures from the ignorability of the mediator.
“This implies that the conclusion is plausible given even fairly large departures from the ignorability of the mediator.”
Quote in the paperSubstantial claim - Interpretationreasoning
Given a fixed value of sensitivity parameter υ, sharp bounds on the ACME can be obtained by numerically solving the linear optimization problem with the linear constraints implied by equations (32) and (33) as well as the relationship implied by the ignorability of the treatment assignment.
“Then, given a fixed value of sensitivity parameter υ, you can obtain the sharp bounds on the ACME by numerically solving the linear optimization problem with the linear constraints implied by equations (32) and ( 33) as well as the following relationship implied by the ignorability of the treatment assignment:”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- Interpretationown data
Based on the failure to reject δ(0) = δ(1), the no-interaction assumption could be regarded as appropriate.
“Based on this finding, the no-interaction assumption could be regarded as appropriate.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
- Interpretationreasoning
Assumption 1 implies ρ = 0.
“In Appendix C we show that Assumption 1 implies ρ = 0.”
Quote in the paperSubstantial claim - Interpretationreasoning
Under Assumption 1, the model parameters in the LSEM are identified.
“We first show that under Assumption 1 the model parameters in the LSEM are identified.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- The authors state this as an assumption: The standard LSEM (linear structural equation model) holds.
- Interpretationreasoning
The ACME can be written as a linear function of unknown parameters π.
“Finally, note that the ACME can be written as the following linear function of unknown parameters π m 1 m 0 y 11 y 10 y 01 y 00 :”
Quote in the paperSubstantial claim - Study design and conductnone given
The proposed sensitivity analysis does not address the possible existence of post-treatment confounders.
“The proposed sensitivity analysis, however, does not address the possible existence of post-treatment confounders”
Quote in the paperNot a substantial claim - Interpretationreasoning
Given a particular value of ρ, δ(t) is identified.
“Thus, given a particular value of ρ, δ(t) is identified.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- The authors state this as an assumption: The standard LSEM (linear structural equation model) holds.
- Interpretationreasoning
Unbiased estimates of (α1, α2, β1, β2) can be obtained by fitting equation-by-equation least squares of equations (11) and (12).
“First, the unbiased estimates of (α 1 , α 2 , β 1 , β 2 ) can be obtained by fitting the equation-by-equation least squares of equations ( 11) and ( 12).”
Quote in the paperSubstantial claim - Interpretationreasoning
Since the original researchers randomized news stories but subjects' attitudes were merely observed, it is unlikely the sequential ignorability assumption holds.
“However, since the original researchers randomized news stories but subjects' attitudes were merely observed, it is unlikely this assumption holds.”
Quote in the paperSubstantial claim - Interpretationreasoning
The estimates based on the standard LSEM can be given valid causal interpretations under the proposed framework.
“Second, we prove that the estimates based on the standard LSEM can be given valid causal interpretations under our proposed framework.”
- Also stated in: § 7. CONCLUDING REMARKS · plain
“In this paper we show that under a set of assumptions this popular product of coefficients estimator can be given a causal interpretation.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sequential ignorability assumption (Assumption 1) holds.
- The authors state this as an assumption: The standard LSEM (linear structural equation model) holds.
- Also stated in: § 7. CONCLUDING REMARKS · plain
- Interpretationreasoning
The sequential ignorability assumption is satisfied if and only if the sensitivity parameter υ equals 0.
“Clearly, if and only if υ = 0, the sequential ignorability assumption is satisfied.”
Quote in the paperSubstantial claim - Interpretationreasoning
The ACME is symmetric about (ρ, δ(t)) = (0, β2ρσ1/σ2).
“The ACME is also symmetric about (ρ, δ(t)) = (0, β 2 ρσ 1 /σ 2 ).”
Quote in the paperNot a substantial claim - Interpretationreasoning
Under the LSEM, the data generating process is not informative at all about either the sensitivity parameter ρ or the ACME without equation (5).
“Finally, Theorem 4 implies the following corollary, which shows that under the LSEM the data generating process is not informative at all about either the sensitivity parameter ρ or the ACME without equation ( 5).”
Quote in the paperSubstantial claim - Interpretationnone given
The proposed framework does not allow the presence of a post-treatment variable that confounds the relationship between mediator and outcome.
“Fourth, an important limitation of our framework is that it does not allow the presence of a post-treatment variable that confounds the relationship between mediator and outcome.”
Quote in the paperSubstantial claim- The authors state this as an assumption: There is no post-treatment variable that confounds the relationship between mediator and outcome.
- Classified as probably not a substantial claim. 35
- May combine two claims. 29
- The quote only partly states this claim. 2
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataBeing exposed to the public order frame as opposed to the free speech frame decreased the subjects' perceived importance of free speech, although the latter effect is not statistically significant.
“while decreasing the importance of free speech (although the latter effect is not statistically significant).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe parametric estimators are slightly more biased for small sample sizes, but they converge to the true values by the time the sample size reaches 500.
“The parametric estimators are slightly more biased for the small sample sizes, but they converge to the true values by the time the sample size reaches 500.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUnder the scenario where the unobserved pre-treatment confounder represents subjects' political ideology, the original conclusion about the direction of the ACME is perfectly robust to the violation of sequential ignorability, because the estimated ACME is always negative in the upper right quadrant of each plot.
“Under this scenario, the original conclusion about the direction of the ACME is perfectly robust to the violation of sequential ignorability, because the estimated ACME is always negative in the upper right quadrant of each plot.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataNonparametric estimators have smaller bias than the parametric estimator, though their variance is much larger.
“The results indicate that nonparametric estimators have smaller bias than the parametric estimator though its variance is much larger.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFor most of the estimates, the 95% confidence intervals do not contain zero, mirroring the finding from the original study that general attitudes about public order mediated the effect of the media frame.
“For most of the estimates, the 95% confidence intervals do not contain zero, mirroring the finding from the original study that general attitudes about public order mediated the effect of the media frame.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe nonparametric bounds on the ACME for binary mediator and outcome always contain zero, implying that the sign of the ACME is not identified without an additional assumption even in this special case.
“These bounds always contain zero, implying that the sign of the ACME is not identified without an additional assumption even in this special case.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThis result holds even after taking into account sampling variability, as the confidence interval covers zero only when -0.79 < ρ < -0.49.
“This result holds even after we take into account the sampling variability, as the confidence interval covers the value of zero only when -0.79 < ρ < -0.49.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataUnder the no-interaction assumption, the estimated ACME is between the previous two estimates, and the 95% confidence interval does not contain zero.
“As expected, the estimated ACME is between the previous two estimates, and the 95% confidence interval does not contain zero.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
May combine two claims.
Findingown dataThe nonparametric sensitivity analysis estimates are rather sensitive to the violation of Assumption 1, in contrast to the parametric sensitivity analyses reported in Section 6.2, where the estimates appeared quite robust.
“In contrast to the parametric sensitivity analysis reported in Section 6.2, the estimates are shown to be rather sensitive to the violation of Assumption 1.”
- Also stated in: § APPENDIX E: NONPARAMETRIC SENSITIVITY ANALYSIS · hedged
“This contrasts with the parametric sensitivity analyses reported in Section 6.2, where the estimates of the ACME appeared quite robust to the violation of Assumption 1.”
Quote in the paperSubstantial claim- Also stated in: § APPENDIX E: NONPARAMETRIC SENSITIVITY ANALYSIS · hedged
May combine two claims.
Findingown dataFor both δ(1) and δ(0), the upper bounds sharply increase as the value of υ increases and cross the zero line at small values of υ (0.019 for δ(1) and 0.022 for δ(0)).
“For both δ(1) and δ(0), the upper bounds sharply increase as we increase the value of υ and cross the zero line at small values of υ [0.019 for δ(1) and 0.022 for δ(0)].”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataFor both estimators, the coverage probabilities fully converged to their nominal values by the time the sample size reached 5000.
“(Although not reported in the table, we confirmed that for both estimators the coverage probabilities fully converged to their nominal values by the time the sample size reached 5000.)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenWhen the mediator is continuous, the population proportion of those with M_i(1)=M_i(0) can be essentially zero.
“Another difficulty of this approach is that when the mediator is continuous the population proportion of those with M i (1) = M i (0) can be essentially zero.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningAssumption 2 is related to and implied by Robins' no-interaction assumption given in equation (9), but differs in being written in terms of the ACME rather than controlled direct effects.
“Although Assumption 2 is related to and implied by Robins' no-interaction assumption given in equation ( 9), the key difference is that Assumption 2 is written in terms of the ACME rather than controlled direct effects.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningIn general, there is no simple expression for the asymptotic variance of the estimator in equation (19), so one may use a nonparametric or parametric bootstrap to compute uncertainty estimates.
“Unfortunately, in general, there is no simple expression for the asymptotic variance of this estimator.Thus, one may use a nonparametric bootstrap [or a parametric bootstrap based on the asymptotic distribution of μtm (x) and νtm (x)] to compute uncertainty estimates.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationThe standard error for the estimated ACME δ(t) = β2γ can be calculated approximately using the Delta method (Sobel, 1982) or exactly via the variance formula of Goodman (1960).
“The standard error for the estimated ACME, that is, δ(t) = β2 γ , can be calculated either approximately using the Delta method (Sobel, 1982), that is, Var( δ(t)) ≈ β 2 2 Var( γ ) + γ 2 Var( β2 ), or exactly via the variance formula of Goodman (1960)”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Sobel, 1982
Not checked in the free run.
- cites Goodman, 1960
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSobel (2008) maintains the assumption that the causal effect of the treatment is entirely through the mediator and assumes the natural direct effect is zero for all units a priori.
“However, Sobel (2008) maintains, among others, the assumption that the causal effect of the treatment is entirely through the mediator and applies the instrumental variables technique of Angrist, Imbens and Rubin (1996).That is, the natural direct effect is assumed to be zero for all units a priori, that is, ζ i (t) = 0 for all t = 0, 1 and i.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Sobel (2008)
Not checked in the free run.
- cites Angrist, Imbens and Rubin (1996)
Not checked in the free run.
May combine two claims.
InterpretationreasoningTesting β1 = 0 is unnecessary because the ACME can be nonzero even when the average total causal effect is zero.
“Thus, testing β 1 = 0 is unnecessary since the ACME can be nonzero even when the average total causal effect is zero.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenAssuming the absence of post-treatment confounders may not be credible in many applied settings.
“This is an important limitation since assuming the absence of post-treatment confounders may not be credible in many applied settings.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe proposed sequential ignorability assumption may be too strong in many applied settings.
“Like the existing identifying assumptions, the proposed sequential ignorability assumption may be too strong in many applied settings.”
- Also stated in: § 1. INTRODUCTION · hedged
“Like many identification assumptions, the proposed assumption may be too strong for the typical situations in which causal mediation analysis is employed.”
Quote in the paperNot a substantial claim- Also stated in: § 1. INTRODUCTION · hedged
Classified as probably not a substantial claim. May combine two claims.
Interpretationnone givenIn experiments where the treatment is randomized but the mediator is not, the ignorability of the treatment assignment holds but the ignorability of the mediator may not.
“For example, in experiments where the treatment is randomized but the mediator is not, the ignorability of the treatment assignment holds but the ignorability of the mediator may not.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningUnder Assumption 1 and the model defined by equations (12) and (15), the average natural direct effects are identified as ζ(t) = β3 + κ(α2 + β2t), and the average total causal effect is τ = β2γ + β3 + κ(α2 + β2).
“The average natural direct effects are identified as ζ (t) = β 3 + κ(α 2 + β 2 t), and the average total causal effect is equal to τ = β 2 γ + β 3 + κ(α 2 + β 2 ).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningWhen J = 2, equation (16) reduces to equation (17).
“Furthermore, when J = 2, this reduces to δ(t) = {Pr(M i = 1|T i = 1, X i ) -Pr(M i = 1|T i = 0, X i )} (17) • {E(Y i |M i = 1, T i = t, X i ) -E(Y i |M i = 0, T i = t, X i )}.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningEquation (11) is redundant given equations (12) and (13).
“We note that equation ( 11) is redundant given equations ( 12) and (13).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe proposed general estimation strategies enable Imai et al. (2010) to develop an easy-to-use R package, mediation, that implements these methods.
“Furthermore, the proposed general estimation strategies enable Imai et al. (2010) to develop an easyto-use R package, mediation, that implements these methods and demonstrate its use with an empirical example.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Imai et al. (2010)
Not checked in the free run.
May combine two claims.
InterpretationreasoningUnder the same assumptions as Theorem 2, the average natural direct effects are identified as ζ(0) = ζ(1) = β3, and the average total causal effect is τ = β3 + β2γ.
“The theorem implies that under the same set of assumptions, the average natural direct effects are identified as ζ (0) = ζ (1) = β 3 , where the average total causal effect is τ = β 3 + β 2 γ .”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenIn randomized experiments where the treatment is randomized, equations (4) and (10) are equivalent.
“In practice, this difference is only a technical matter because, for example, in randomized experiments where the treatment is randomized, equations ( 4) and ( 10) are equivalent.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. The quote only partly states this claim.
InterpretationreasoningTheorem 3 gives the asymptotic variance of the nonparametric estimator defined in equation (18) given the realized values of the treatment variable.
“THEOREM 3 (Asymptotic variance of the nonparametric estimator).Suppose that Assumption 1 holds.Then, the variance of the nonparametric estimator defined in equation ( 18) is asymptotically approximated by”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationWithin Rubin's framework, there exists no obvious definition for the mediation effect unless the direct effect is zero.
“Within this framework, there exists no obvious definition for the mediation effect unless the direct effect is zero (in this case, the treatment affects the outcome only through the mediator).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rubin (2004)
Not checked in the free run.
May combine two claims.
InterpretationreasoningUnder Assumption 1, in the LSEM defined by equations (11), (12) and (13), the ACME is identified and given by δ(0) = δ(1) = β2γ, where the equality between δ(0) and δ(1) is also assumed.
“THEOREM 2 (Identification under the LSEM).Consider the LSEM defined in equations (11), ( 12) and (13).Under Assumption 1, the ACME is identified and given by δ(0) = δ(1) = β 2 γ, where the equality between δ(0) and δ(1) is also assumed.”
- Also stated in: § 3.4 Implications for Linear Structural Equation Model · plain
“Thus, Assumption 1 enables the identification of the ACME under the LSEM.”
Quote in the paperSubstantial claim- Also stated in: § 3.4 Implications for Linear Structural Equation Model · plain
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThese omitted variables must causally precede T.
“Note that these omitted variables must causally precede T i .”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe ACME is zero if and only if ρ equals ρ.
“Third, the ACME is zero if and only if ρ equals ρ.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationcitationThe proposed sensitivity analysis is developed within the LSEM framework, but some extensions are possible.
“The proposed sensitivity analysis above is developed within the framework of the LSEM, but some extensions are possible.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningAlthough the ACME is nonparametrically identified under Assumption 1, this assumption may be too strong in many applied settings.
“Although the ACME is nonparametrically identified under Assumption 1, this assumption, like other existing identifying assumptions, may be too strong in many applied settings.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenOne particular concern is that subjects' pre-existing ideology affects both their attitudes toward public order issues and their tolerance for the Klan within each treatment condition.
“As we discussed in Section 2, one particular concern is that subjects' pre-existing ideology affects both their attitudes toward public order issues and their tolerance for the Klan within each treatment condition.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningUnder the LSEM, if equation (4) holds but equation (5) may not, the sharp bounds on ρ and the ACME are (-1, 1) and (-∞, ∞), respectively.
“COROLLARY 1 (Bounds on the sensitivity parameter).Consider the LSEM defined in equations (11), ( 12) and (13).Suppose that equation (4) holds but equation (5) may not.Then, the sharp, that is, best possible, bounds on the sensitivity parameter ρ and ACME are given by (-1, 1) and (-∞, ∞), respectively.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe no-interaction assumption only restricts the way the treatment effect is transmitted to the outcome and thus does not affect the estimate of the overall treatment effect.
“This makes sense since the no-interaction assumption only restricts the way the treatment effect is transmitted to the outcome and thus does not affect the estimate of the overall treatment effect.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
Classified as probably not a substantial claim.
InterpretationcitationThe influence of the unobserved pre-treatment confounder can be expressed using coefficients of determination R2*M and R2*Y, which represent the proportion of previously unexplained variance in the mediator or outcome explained by the unobserved confounder.
“We can then express the influence of the unobserved pre-treatment confounder using the following coefficients of determination: R 2 * M ≡ 1 - Var(ε i2 ) Var(ε i2 ) and R 2 * Y ≡ 1 - Var(ε i3 ) Var(ε i3 ) , which represent the proportion of previously unexplained variance (either in the mediator or in the outcome) that is explained by the unobserved confounder (see Imbens, 2003).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Imbens, 2003
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn the original analysis, Nelson, Clawson and Oxley (1997) found that subjects who viewed the Klan story with the free speech frame were significantly more tolerant of the Klan than those who saw the story with the public order frame.
“In the original analysis, Nelson, Clawson and Oxley (1997) used a LSEM similar to the one discussed in Section 3.4 and found that subjects who viewed the Klan story with the free speech frame were significantly more tolerant of the Klan than those who saw the story with the public order frame.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nelson, Clawson and Oxley (1997)
Not checked in the free run.
Classified as probably not a substantial claim.
Interpretationnone givenThe assumptions required for identifying causal mediation effects are unverifiable.
“We view sensitivity analysis as an essential part of causal mediation analysis because the assumptions required for identifying causal mediation effects are unverifiable and often are not justified in applied settings.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe proof of Theorem 2 implies that if equation (4) holds, εi2 ⊥ Ti and εi3 ⊥ Ti hold but εi2 ⊥ εi3 does not unless equation (5) also holds.
“The proof of Theorem 2 implies that if equation (4) holds, ε i2 ⊥ ⊥ T i and ε i3 ⊥ ⊥ T i hold but ε i2 ⊥ ⊥ ε i3 does not unless equation ( 5) also holds.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe relationship between ρ and the coefficients of determination is ρ2 = R2*M R2*Y = R2M R2Y / {(1 - R2M)(1 - R2Y)}, or equivalently ρ = sgn(λ2λ3) sqrt(R2*M R2*Y) = sgn(λ2λ3) sqrt(R2M R2Y / {(1 - R2M)(1 - R2Y)}).
“In either case, it is straightforward to show that the following relationship between ρ and these parameters holds, that is, ρ 2 = R 2 * M R 2 * Y = R 2 M R 2 Y /{(1 -R 2 M )(1 - R 2 Y )} or, equivalently, ρ = sgn(λ 2 λ 3 )R * M R * Y = sgn(λ 2 λ 3 ) R M R Y (1 -R 2 M )(1 -R 2 Y ) , where R * M , R * Y , R M and R Y are in [0, 1].”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe analyst can examine variation in the estimated ACME with respect to change in these parameters.
“Then, the analyst can examine variation in the estimated ACME with respect to change in these parameters.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe original researchers found evidence supporting their main hypothesis that subjects' general attitudes mediated the causal effect of the news story frame on tolerance for the Klan.
“The researchers also found evidence supporting their main hypothesis that subjects' general attitudes mediated the causal effect of the news story frame on tolerance for the Klan.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nelson, Clawson and Oxley (1997)
Not checked in the free run.
Classified as probably not a substantial claim.
Interpretationnone givenThe assumptions required for identifying causal mediation effects are often not justified in applied settings.
“We view sensitivity analysis as an essential part of causal mediation analysis because the assumptions required for identifying causal mediation effects are unverifiable and often are not justified in applied settings.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe stark difference between nonparametric and parametric sensitivity analyses illustrates the potential importance of parametric assumptions in causal mediation analysis; a significant part of identification power could be attributed to functional form assumptions as opposed to empirical evidence.
“Although the direct comparison is difficult because of different parametrization and variable coding, this stark difference illustrates the potential importance of parametric assumptions in causal mediation analysis; a significant part of identification power could in fact be attributed to such functional form assumptions as opposed to empirical evidence.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
InterpretationreasoningIf the treatment is randomized, equation (4) holds, and ρ is given with -1 < ρ < 1, then the ACME is identified and given by the formula in Theorem 4.
“THEOREM 4 (Identification with a given error correlation).Consider the LSEM defined in equations ( 11), ( 12) and (13).Suppose that equation (4) holds and the correlation between ε i2 and ε i3 , that is, ρ, is given.If we further assume -1 < ρ < 1, then the ACME is identified and given by”
Quote in the paperSubstantial claim- The authors state this as an assumption: The sensitivity parameter ρ satisfies -1 < ρ < 1.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationImai, Keele and Tingley (2009) show how to conduct sensitivity analysis with probit models when the mediator and/or the outcome are discrete.
“For example, Imai, Keele and Tingley (2009) show how to conduct sensitivity analysis with probit models when the mediator and/or the outcome are discrete.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Imai, Keele and Tingley (2009)
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenThis strategy will also work when there is an interaction term between the treatment and mediating variables as in equation (15) and/or when there are observed pre-treatment covariates X.
“This strategy will also work when there is an interaction term between the treatment and mediating variables as in equation ( 15) and/or when there are observed pre-treatment covariates X i .”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationA more straightforward and general approach to compute standard errors is to apply the iterative feasible generalized least square algorithm of seemingly unrelated regression (Zellner, 1962) and use the associated asymptotic variance formula.
“A more straightforward and general approach is to apply the iterative feasible generalized least square algorithm of the seemingly unrelated regression (Zellner, 1962), and use the associated asymptotic variance formula.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zellner, 1962
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningAnother interpretation uses R2M and R2Y, the proportion of original variance explained by the unobserved confounder.
“Another interpretation is based on the proportion of original variance that is explained by the unobserved confounder.In this case, we use the following sensitivity parameters:”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe formal definition of the concept of causal mediation had to await the later works by epidemiologists and statisticians (Robins and Greenland, 1992; Pearl, 2001; Robins, 2003).
“Indeed, the formal definition of the concept of causal mediation had to await the later works by epidemiologists and statisticians (Robins and Greenland, 1992;Pearl, 2001;Robins, 2003).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Robins and Greenland, 1992
Not checked in the free run.
- cites Pearl, 2001
Not checked in the free run.
- cites Robins, 2003
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningWhether a variable qualifies as a mediator in a given empirical study relies crucially on the investigator's belief in the theory being considered.
“whether a variable qualifies as a mediator in a given empirical study relies crucially on the investigator's belief in the theory being considered.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningCausal mediation analysis can be uncomfortably far from a completely data-oriented approach to scientific investigations.
“Thus, causal mediation analysis can be uncomfortably far from a completely data-oriented approach to scientific investigations.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenThe new identification condition for the ACME is relatively easy to interpret in substantive terms and is weaker than existing results in some situations.
“First, we provide a new identification condition for the ACME, which is relatively easy to interpret in substantive terms and also weaker than existing results in some situations.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
Premisenone givenLittle attention was paid to the conditions under which the popular LSEM estimator can be given a causal interpretation.
“While psychologists extended this LSEM framework in a number of ways, little attention was paid to the conditions under which their popular estimator can be given a causal interpretation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe progress made on the identification of causal mediation effects by these authors has led to the recent development of alternative and more general estimation strategies (e.g., Imai, Keele and Tingley, 2009; VanderWeele, 2009).
“The progress made on the identification of causal mediation effects by these authors has led to the recent development of alternative and more general estimation strategies (e.g., Imai, Keele and Tingley, 2009;VanderWeele, 2009).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Imai, Keele and Tingley, 2009
Not checked in the free run.
- cites VanderWeele, 2009
Not checked in the free run.
The authors state this as an assumption.
Sequential ignorability: the treatment is ignorable given pre-treatment covariates, and the mediator is ignorable given the observed treatment and pre-treatment covariates, with the conditional independence in equation (5) holding without conditioning on observed post-treatment confounders.
“ASSUMPTION 1 (Sequential ignorability).”
“Thus, the treatment is first assumed to be ignorable given the pre-treatment covariates, and then the mediator variable is assumed to be ignorable given the observed value of the treatment as well as the pretreatment covariates.”
“We emphasize that, unlike the standard sequential ignorability assumption in the literature (e.g., Robins, 1999), the conditional independence given in equation (5) of Assumption 1 must hold without conditioning on the observed values of posttreatment confounders.”
The authors state this as an assumption.
The potential outcome depends only on the values of the treatment and mediating variables and not on how they are realized.
“the above notation implicitly assumes that the potential outcome depends only on the values of the treatment and mediating variables and, in particular, not on how they are realized.”
The authors state this as an assumption.
The no-interaction assumption between the treatment and the ACME holds: δ(1) = δ(0).
“ASSUMPTION 2 (No-interaction between the Treatment and the ACME). δ(1) = δ(0).”
The authors state this as an assumption.
The sensitivity parameter ρ satisfies -1 < ρ < 1.
“If we further assume -1 < ρ < 1, then the ACME is identified and given by”
The authors state this as an assumption.
The error terms in equations (12) and (13) can be decomposed as εij = λj Ui + εij for j = 2, 3, where Ui is an unobserved confounder.
“This alternative version of ρ is based on the following decomposition of the error terms in equations ( 12) and ( 13): ε ij = λ j U i + ε ij for j = 2, 3, where U i is an unobserved confounder”
The authors state this as an assumption.
Sequential ignorability is assumed given Ui and Ti.
“where U i is an unobserved confounder and the sequential ignorability is assumed given U i and T i .”
The authors state this as an assumption.
Ui has to be a pre-treatment variable so that the resulting estimates can be given a causal interpretation.
“Again, note that U i has to be a pre-treatment variable so that the resulting estimates can be given a causal interpretation.”
The authors state this as an assumption.
εij is independent of Ui for j = 2, 3.
“In addition, we assume that ε ij ⊥ ⊥ U i for j = 2, 3.”
The authors state this as an assumption.
The sequential ignorability assumption (Assumption 1) holds.
“We begin by the nonparametric bounds on the ACME without assuming equation ( 5) of the sequential ignorability assumption.”
“Clearly, if and only if υ = 0, the sequential ignorability assumption is satisfied.”
The authors state this as an assumption.
There is no post-treatment variable that confounds the relationship between mediator and outcome.
“Fourth, an important limitation of our framework is that it does not allow the presence of a post-treatment variable that confounds the relationship between mediator and outcome.”
The authors state this as an assumption.
The standard LSEM (linear structural equation model) holds.
“Finally, under Assumption 1 and the LSEM, we can write E(M i |T i ) = α 2 + β 2 T i , and E(Y i |M i , T i ) = α 3 + β 3 T i + γ M i .”
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.6.1173 · Cited by 91,542 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532 · see citing works
Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models
Sobel, M. E. (1982) · Sociological Methodology · doi:10.2307/270723 · Cited by 12,810 · see citing works
An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias
Zellner, A. (1962) · Journal of the American Statistical Association · doi:10.1080/01621459.1962.10480664 · Cited by 8,138 · see citing works
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230 · see citing works
A general approach to causal mediation analysis.
Imai, K., Keele, L., & Tingley, D. (2010) · Psychological Methods · doi:10.1037/a0020761 · Cited by 4,143 · see citing works
Self-citationMediators and Moderators of Treatment Effects in Randomized Clinical Trials
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.10.877 · Cited by 2,562 · see citing works
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442 · see citing works
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173 · see citing works
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793 · see citing works
Media Framing of a Civil Liberties Conflict and Its Effect on Tolerance
Nelson, T. E., Clawson, R. A., & Oxley, Z. M. (1997) · American Political Science Review · doi:10.2307/2952075 · Cited by 1,422 · see citing works
On the Exact Variance of Products
Goodman, L. A. (1960) · Journal of the American Statistical Association · doi:10.1080/01621459.1960.10483369 · Cited by 1,386 · see citing works
Yes, but what’s the mechanism? (don’t expect an easy answer).
Bullock, J. G., Green, D. P., & Ha, S. E. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018933 · Cited by 1,063 · see citing works
An Introduction to Causal Inference
Pearl, J. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1203 · Cited by 755 · see citing works
Chmura Kraemer, H., Kiernan, M., Essex, M., & Kupfer, D. J. (2008) · Health Psychology · doi:10.1037/0278-6133.27.2(suppl.).s101 · Cited by 600 · see citing works
Marginal Structural Models for the Estimation of Direct and Indirect Effects
VanderWeele, T. J. (2009) · Epidemiology · doi:10.1097/ede.0b013e31818f69ce · Cited by 583 · see citing works
Marginal Structural Models versus Structural nested Models as Tools for Causal inference
Robins, J. M. (2000) · The IMA volumes in mathematics and its applications · doi:10.1007/978-1-4612-1284-3_2 · Cited by 557 · see citing works
Sensitivity to Exogeneity Assumptions in Program Evaluation
Imbens, G. W. (2003) · American Economic Review · doi:10.1257/000282803321946921 · Cited by 529 · see citing works
Analysis of Covariance: Its Nature and Uses
Cochran, W. G. (1957) · Biometrics · doi:10.2307/2527916 · Cited by 511 · see citing works
Bias Formulas for Sensitivity Analysis for Direct and Indirect Effects
VanderWeele, T. J. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181df191c · Cited by 435 · see citing works
Experimental Designs for Identifying Causal Mechanisms
Imai, K., Tingley, D., & Yamamoto, T. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01032.x · Cited by 408 · see citing works
Self-citationEstimation of Direct Causal Effects
Petersen, M. L., Sinisi, S. E., & van der Laan, M. J. (2006) · Epidemiology · doi:10.1097/01.ede.0000208475.99429.2d · Cited by 362 · see citing works
Direct and Indirect Causal Effects via Potential Outcomes*
Rubin, D. B. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.02-123.x · Cited by 324 · see citing works
Causal Mediation Analysis Using R
Imai, K., Keele, L. J., Tingley, D. H., & Yamamoto, T. (2009) · Lecture notes in statistics · doi:10.1007/978-1-4419-1764-5_8 · Cited by 305 · see citing works
Self-citationOn the Exact Variance of Products
Goodman, L. A. (1960) · Journal of the American Statistical Association · doi:10.2307/2281592 · Cited by 259 · see citing works
Semantics of causal DAG models and the identification of direct and indirect effects
Robins, J. M. (2003) · doi:10.1093/oso/9780198510550.003.0007 · Cited by 243 · see citing works
Opening the Black Box: a motivation for the assessment of mediation
Hafeman, D., & Schwartz, S. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn372 · Cited by 217 · see citing works
Identifiability of path-specific effects
Avin, C., Shpitser, I., & Pearl, J. (2005) · eScholarship (California Digital Library) · Cited by 215 · see citing works
Identification of Causal Parameters in Randomized Studies With Mediating Variables
Sobel, M. E. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607307239 · Cited by 202 · see citing works
Causal Mediation Analyses with Rank Preserving Models
Have, T. R. T., Joffe, M. M., Lynch, K. G., Brown, G. K., Maisto, S. A., & Beck, A. T. (2007) · Biometrics · doi:10.1111/j.1541-0420.2007.00766.x · Cited by 157 · see citing works
Mediation analysis via potential outcomes models
Albert, J. M. (2007) · Statistics in Medicine · doi:10.1002/sim.3016 · Cited by 138 · see citing works
Causal inference in randomized experiments with mediational processes.
Jo, B. (2008) · Psychological Methods · doi:10.1037/a0014207 · Cited by 137 · see citing works
Identifying Direct and Indirect Effects in a Non-Counterfactual Framework
Geneletti, S. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.00584.x · Cited by 108 · see citing works
Mediation analysis with principal stratification
Gallop, R., Small, D. S., Lin, J. Y.-C., Elliott, M. R., Joffe, M. M., & Have, T. R. T. (2009) · Statistics in Medicine · doi:10.1002/sim.3533 · Cited by 97 · see citing works
Simple relations between principal stratification and direct and indirect effects
VanderWeele, T. J. (2008) · Statistics & Probability Letters · doi:10.1016/j.spl.2008.05.029 · Cited by 92 · see citing works
The emptiness of the black box.
Skrabanek, P. (1994) · PubMed · Cited by 83 · see citing works
Bounds on natural direct effects in the presence of confounded intermediate variables
Sjölander, A. (2008) · Statistics in Medicine · doi:10.1002/sim.3493 · Cited by 77 · see citing works
Imai, K., & Yamamoto, T. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2010.00446.x · Cited by 77 · see citing works
Self-citationDefining and Estimating Intervention Effects for Groups that will Develop an Auxiliary Outcome
Joffe, M. M., Small, D., & Hsu, C.-Y. (2007) · Statistical Science · doi:10.1214/088342306000000655 · Cited by 66 · see citing works
Alternative Assumptions for the Identification of Direct and Indirect Effects
Hafeman, D., & VanderWeele, T. J. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c311b2 · Cited by 62 · see citing works
The Product and Difference Fallacies for Indirect Effects
Glynn, A. (2011) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00543.x · Cited by 54 · see citing works
Elliott, M. R., Raghunathan, T. E., & Li, Y. (2010) · Biostatistics · doi:10.1093/biostatistics/kxp060 · Cited by 53 · see citing works
Roy, J., Hogan, J. W., & Marcus, B. H. (2007) · Biostatistics · doi:10.1093/biostatistics/kxm027 · Cited by 51 · see citing works
Deaton, A. (2009) · British Academy eBooks · doi:10.5871/bacad/9780197264584.003.0006 · Cited by 39 · see citing works
Extended Instrumental Variables Estimation for Overall Effects
Joffe, M. M., Small, D. S., Have, T. T., Brunelli, S., & Feldman, H. I. (2008) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1082 · Cited by 38 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Pearl, J. (2001). Direct and indirect effects. In <i>Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence</i> (J. S. Breese and D. Koller, eds.) 411–420. Morgan Kaufman, San Francisco, CA.
- Imai, K., Keele, L., Tingley, D. and Yamamoto, T. (2010). Causal mediation analysis using R. In <i>Advances in Social Science Research Using R</i> (H. D. Vinod, ed.). <i>Lecture Notes in Statist.</i> <b>196</b> 129–154. Springer, New York. · DOI
- Imai, K., Keele, L. and Yamamoto, T. (2010). Replication data for: Identification, inference, and sensitivity analysis for causal mediation effects. Available at <a href="http://hdl.handle.net/1902.1/14412">http://hdl.handle.net/1902.1/14412</a>.
Cited by
Sorted by citations
Statistical mediation analysis with a multicategorical independent variable
Hayes, A. F., & Preacher, K. J. (2014) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12028 · Cited by 3,403 · see citing works
Valeri, L., & VanderWeele, T. J. (2013) · Psychological Methods · doi:10.1037/a0031034 · Cited by 2,132 · see citing works
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537 · see citing works
Self-citationEndogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168 · see citing works
Making sense of sensitivity: extending omitted variable bias
Cinelli, C., & Hazlett, C. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12348 · Cited by 1,088 · see citing works
The Gender-Equality Paradox in Science, Technology, Engineering, and Mathematics Education
Stoet, G., & Geary, D. C. (2018) · Psychological Science · doi:10.1177/0956797617741719 · Cited by 1,054 · see citing works
Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects
Imai, K., & Keele, L. J. (2008) · Cited by 887 · see citing works
Self-citationHeterogeneous green innovations and carbon emission performance: Evidence at China's city level
Xu, L. E., Fan, M., Yang, L., & Shao, S. (2021) · Energy Economics · doi:10.1016/j.eneco.2021.105269 · Cited by 873 · see citing works
Hainmueller, J., Mummolo, J., & Xu, Y. (2019) · Political Analysis · doi:10.1017/pan.2018.46 · Cited by 959 · see citing works
Total, Direct, and Indirect Effects in Logit and Probit Models
Breen, R., Karlson, K. B., & Holm, A. (2013) · Sociological Methods & Research · doi:10.1177/0049124113494572 · Cited by 818 · see citing works
Advances in Mediation Analysis: A Survey and Synthesis of New Developments
Preacher, K. J. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015258 · Cited by 800 · see citing works
Hicks, R., & Tingley, D. H. (2011) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1201100407 · Cited by 810 · see citing works
Eight Myths About Causality and Structural Equation Models
Bollen, K. A., & Pearl, J. (2013) · Handbooks of sociology and social research · doi:10.1007/978-94-007-6094-3_15 · Cited by 680 · see citing works
A Guideline for Reporting Mediation Analyses of Randomized Trials and Observational Studies
Lee, H., Cashin, A. G., Lamb, S. E., Hopewell, S., Vansteelandt, S., VanderWeele, T. J., MacKinnon, D. P., Mansell, G., Collins, P. G. S., Golub, R. M., et al. (2021) · JAMA · doi:10.1001/jama.2021.14075 · Cited by 559 · see citing works
Burgess, S., Daniel, R. M., Butterworth, A. S., Thompson, S. G., & the EPIC-InterAct Consortium (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyu176 · Cited by 543 · see citing works
Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects
Acharya, A. R., Blackwell, M., & Sen, M. (2016) · American Political Science Review · doi:10.1017/s0003055416000216 · Cited by 526 · see citing works
Best (but oft-forgotten) practices: mediation analysis ,
Fairchild, A. J., & McDaniel, H. L. (2017) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.117.152546 · Cited by 512 · see citing works
Causal Interpretations of Black-Box Models
Zhao, Q., & Hastie, T. J. (2019) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 465 · see citing works
A Simple Unified Approach for Estimating Natural Direct and Indirect Effects
Lange, T., Vansteelandt, S., & Bekaert, M. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr525 · Cited by 457 · see citing works
Public Opinion and the Democratic Peace
Tomz, M. R., & WEEKS, J. L. P. (2013) · American Political Science Review · doi:10.1017/s0003055413000488 · Cited by 420 · see citing works
Experimental Designs for Identifying Causal Mechanisms
Imai, K., Tingley, D., & Yamamoto, T. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01032.x · Cited by 408 · see citing works
Self-citationFrank, K. A., Maroulis, S. J., Duong, M. Q., & Kelcey, B. M. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713493129 · Cited by 406 · see citing works
On the Interpretation and Use of Mediation: Multiple Perspectives on Mediation Analysis
Agler, R. A., & de Boeck, P. A. L. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01984 · Cited by 402 · see citing works
Imai, K., & Yamamoto, T. (2013) · Political Analysis · doi:10.1093/pan/mps040 · Cited by 381 · see citing works
Self-citationThe Causal Mediation Formula—A Guide to the Assessment of Pathways and Mechanisms
Pearl, J. (2012) · Prevention Science · doi:10.1007/s11121-011-0270-1 · Cited by 389 · see citing works
Mediation analysis methods used in observational research: a scoping review and recommendations
Rijnhart, J. J. M., Lamp, S. J., Valente, M. J., MacKinnon, D. P., Twisk, J. W. R., & Heymans, M. W. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01426-3 · Cited by 352 · see citing works
Ferraro, P. J., & Hanauer, M. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1307712111 · Cited by 337 · see citing works
Causal Mediation Analysis with Multiple Mediators
Daniel, R., Stavola, B. L. D., Cousens, S. N., & Vansteelandt, S. (2014) · Biometrics · doi:10.1111/biom.12248 · Cited by 319 · see citing works
Exposure to hate speech increases prejudice through desensitization
Soral, W., Bilewicz, M., & Winiewski, M. (2018) · Aggressive Behavior · doi:10.1002/ab.21737 · Cited by 320 · see citing works
Conditions associated with protected area success in conservation and poverty reduction
Ferraro, P. J., Hanauer, M. M., & Sims, K. R. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1011529108 · Cited by 308 · see citing works
Integrating Moderation and Mediation
Sardeshmukh, S. R., & Vandenberg, R. J. (2016) · Organizational Research Methods · doi:10.1177/1094428115621609 · Cited by 301 · see citing works
Eldor, L., & Harpaz, I. (2015) · Journal of Organizational Behavior · doi:10.1002/job.2037 · Cited by 298 · see citing works
Tchetgen, E. J. T., & Shpitser, I. (2012) · The Annals of Statistics · doi:10.1214/12-aos990 · Cited by 281 · see citing works
Meaningful Mediation Analysis: Plausible Causal Inference and Informative Communication
Pieters, R. G. M. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx081 · Cited by 270 · see citing works
That’s a Lot to Process! Pitfalls of Popular Path Models
Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221095827 · Cited by 267 · see citing works
MacKinnon, D. P., & Pirlott, A. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314542878 · Cited by 257 · see citing works
Causal Models and Learning from Data
Petersen, M. L., & van der Laan, M. J. (2014) · Epidemiology · doi:10.1097/ede.0000000000000078 · Cited by 232 · see citing works
Sensemakr: Sensitivity Analysis Tools for OLS in R and Stata
Cinelli, C., Ferwerda, J., & Hazlett, C. J. (2024) · Observational Studies · doi:10.1353/obs.2024.a946583 · Cited by 225 · see citing works
Irvin, M. R., Zhi, D., Joehanes, R., Mendelson, M., Aslibekyan, S. W., Claas, S. A., Thibeault, K. S., Patel, N. M., Day, K. R., Jones, L. W., et al. (2014) · Circulation · doi:10.1161/circulationaha.114.009158 · Cited by 217 · see citing works
Long-Term Economic Distress, Cultural Backlash, and Support for Brexit
Carreras, M., Carreras, Y. İ., & Bowler, S. (2019) · Comparative Political Studies · doi:10.1177/0010414019830714 · Cited by 216 · see citing works
Nguyen, Q. C., Osypuk, T. L., Schmidt, N. M., Glymour, M. M., & Tchetgen, E. J. T. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu278 · Cited by 214 · see citing works
Caught in the Draft: The Effects of Vietnam Draft Lottery Status on Political Attitudes
Erikson, R. S., & Stoker, L. (2011) · American Political Science Review · doi:10.1017/s0003055411000141 · Cited by 213 · see citing works
Inverse odds ratio‐weighted estimation for causal mediation analysis
Tchetgen, E. J. T. (2013) · Statistics in Medicine · doi:10.1002/sim.5864 · Cited by 212 · see citing works
The Blessings of Multiple Causes
Wang, Z., & Blei, D. M. (2019) · Journal of the American Statistical Association · doi:10.1080/01621459.2019.1686987 · Cited by 225 · see citing works
Comment: understanding Simpson’s paradox
Pearl, J. (2014) · The American Statistician · doi:10.1080/00031305.2014.876829 · Cited by 206 · see citing works
A Novel Diabetes Prevention Intervention Using a Mobile App
Fukuoka, Y., Gay, C. L., Joiner, K. L., & Vittinghoff, E. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2015.01.003 · Cited by 204 · see citing works
Causal mediation analysis with double machine learning
Farbmacher, H., Huber, M., Lafférs, L., Langen, H., & Spindler, M. (2022) · Econometrics Journal · doi:10.1093/ectj/utac003 · Cited by 221 · see citing works
Name Recognition and Candidate Support
Kam, C. D., & Zechmeister, E. J. (2013) · American Journal of Political Science · doi:10.1111/ajps.12034 · Cited by 199 · see citing works
Küpers, L. K., Xu, X., Jankipersadsing, S. A., Vaez, A., Gemert, S. L. B., Scholtens, S., Nolte, I. M., Richmond, R. C., Relton, C. L., Felix, J. F., et al. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv048 · Cited by 189 · see citing works
One Vote Out of Step? The Effects of Salient Roll Call Votes in the 2010 Election
Nyhan, B. J., McGhee, E. M., Sides, J. M., Masket, S. E., & Greene, S. (2012) · American Politics Research · doi:10.1177/1532673x11433768 · Cited by 194 · see citing works
Lajevardi, N., & Oskooii, K. A. R. (2018) · The Journal of Race Ethnicity and Politics · doi:10.1017/rep.2017.37 · Cited by 154 · see citing works
Valente, M. J., & MacKinnon, D. P. (2017) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2016.1274657 · Cited by 173 · see citing works
Party Strength and Economic Growth
Bizzarro, F., Gerring, J., Knutsen, C. H., Hicken, A. D., Bernhard, M. H., Skaaning, S., Coppedge, M., & Lindberg, S. I. (2018) · World Politics · doi:10.1017/s0043887117000375 · Cited by 179 · see citing works
Lee, H., Herbert, R., & McAuley, J. H. (2019) · JAMA · doi:10.1001/jama.2018.21973 · Cited by 173 · see citing works
Heckman, J. J., & Pinto, R. R. (2014) · Econometric Reviews · doi:10.1080/07474938.2014.944466 · Cited by 172 · see citing works
Gender Stereotypes in the Classroom and Effects on Achievement
Alan, Ş., Ertaç, S., & Mumcu, I. (2018) · The Review of Economics and Statistics · doi:10.1162/rest_a_00756 · Cited by 165 · see citing works
The Case for Selecting Cases That Are Deviant or Extreme on the Independent Variable
Seawright, J. (2016) · Sociological Methods & Research · doi:10.1177/0049124116643556 · Cited by 170 · see citing works
Generalized Causal Mediation Analysis
Albert, J. M., & Nelson, S. S. (2011) · Biometrics · doi:10.1111/j.1541-0420.2010.01547.x · Cited by 156 · see citing works
On the Overuse and Misuse of Mediation Analysis: It May Be a Matter of Timing
Tate, C. U. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1062380 · Cited by 153 · see citing works
McLarnon, M. J. W., & O’Neill, T. (2018) · Organizational Research Methods · doi:10.1177/1094428118770731 · Cited by 153 · see citing works
Jiang, Z., Zhuo, L., He, Y., Fu, Y., Shen, L., Xu, F., Gou, W., Miao, Z., Shuai, M., Liang, Y., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30712-x · Cited by 156 · see citing works
University research and knowledge transfer: A dynamic view of ambidexterity in british universities
Sengupta, A., & Ray, A. (2017) · Research Policy · doi:10.1016/j.respol.2017.03.008 · Cited by 150 · see citing works
mma: An R Package for Mediation Analysis with Multiple Mediators
Yu, Q., & Ли, Б. (2017) · Journal of Open Research Software · doi:10.5334/jors.160 · Cited by 148 · see citing works
IDENTIFYING CAUSAL MECHANISMS (PRIMARILY) BASED ON INVERSE PROBABILITY WEIGHTING
Huber, M. (2013) · Journal of Applied Econometrics · doi:10.1002/jae.2341 · Cited by 155 · see citing works
MNCs, Rents, and Corruption: Evidence from China
Zhu, B. (2016) · American Journal of Political Science · doi:10.1111/ajps.12259 · Cited by 146 · see citing works
Stavola, B. L. D., Daniel, R., Ploubidis, G. B., & Micali, N. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu239 · Cited by 147 · see citing works
Causal mediation analysis in economics: Objectives, assumptions, models
Celli, V. (2021) · Journal of Economic Surveys · doi:10.1111/joes.12452 · Cited by 144 · see citing works
Huang, Y., & Pan, W. (2015) · Biometrics · doi:10.1111/biom.12421 · Cited by 143 · see citing works
Self−leadership in the context of part−time teleworking.
Müller, T., & Niessen, C. (2019) · Journal of Organizational Behavior · doi:10.1002/job.2371 · Cited by 144 · see citing works
IDENTIFYING MECHANISMS BEHIND POLICY INTERVENTIONS VIA CAUSAL MEDIATION ANALYSIS
Keele, L. J., Tingley, D. H., & Yamamoto, T. (2015) · Journal of Policy Analysis and Management · doi:10.1002/pam.21853 · Cited by 137 · see citing works
Self-citationWhy the Sky Didn't Fall: Mobilizing Anger in Reaction to Voter ID Laws
Valentino, N. A., & Neuner, F. (2017) · Political Psychology · doi:10.1111/pops.12332 · Cited by 119 · see citing works
The Unequal Consequences of Mass Incarceration for Children
Turney, K. (2017) · Demography · doi:10.1007/s13524-016-0543-1 · Cited by 135 · see citing works
Depression and Political Participation*
Ojeda, C. (2015) · Social Science Quarterly · doi:10.1111/ssqu.12173 · Cited by 181 · see citing works
Assessing Natural Direct and Indirect Effects Through Multiple Pathways
Lange, T., Rasmussen, M., & Thygesen, L. C. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kwt270 · Cited by 129 · see citing works
Wiles, N., Thomas, L., Abel, A., Barnes, M., Carroll, F., Ridgway, N., Sherlock, S., Turner, N., Button, K., Odondi, L., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18310 · Cited by 127 · see citing works
Community Health Workers Improve Linkage to Hypertension Care in Western Kenya
Vedanthan, R., Kamano, J. H., DeLong, A. K., Yebei, V. N., Binanay, C. A., Bloomfield, G. S., Chrysanthopoulou, S. A., Finkelstein, E. A., Hogan, J. W., Horowitz, C. R., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.08.003 · Cited by 126 · see citing works
Riedl, C., & Woolley, A. W. (2016) · Academy of Management Discoveries · doi:10.5465/amd.2015.0097 · Cited by 124 · see citing works
Naoi, M., & Kume, I. (2011) · International Organization · doi:10.1017/s0020818311000221 · Cited by 120 · see citing works
Fu, T., & Jian, Z. (2021) · Ecological Economics · doi:10.1016/j.ecolecon.2021.106969 · Cited by 124 · see citing works
DNA methylation links prenatal smoking exposure to later life health outcomes in offspring
Wiklund, P., Karhunen, V., Richmond, R. C., Parmar, P., Rodriguez, A., De Silva, M., Wielscher, M., Rezwan, F. I., Richardson, T. G., Veijola, J., et al. (2019) · Clinical Epigenetics · doi:10.1186/s13148-019-0683-4 · Cited by 120 · see citing works
Common methodological mistakes
Wulff, J. N., Sajons, G. B., Pogrebna, G., Lonati, S., Bastardoz, N., Banks, G. C., & Antonakis, J. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101677 · Cited by 120 · see citing works
Employment protection and labor productivity
Bjuggren, C. M. (2017) · Journal of Public Economics · doi:10.1016/j.jpubeco.2017.11.007 · Cited by 117 · see citing works
Meeker, C. R., Geynisman, D. M., Egleston, B. L., Hall, M. J., Mechanic, K. Y., Bilušić, M., Plimack, E. R., Martin, L. P., von Mehren, M., Lewis, B., et al. (2016) · Journal of Oncology Practice · doi:10.1200/jop.2016.011049 · Cited by 116 · see citing works
The Mediation Formula: A Guide to the Assessment of Causal Pathways in Nonlinear Models
Pearl, J. (2012) · Wiley series in probability and statistics · doi:10.1002/9781119945710.ch12 · Cited by 116 · see citing works
Eldor, L. (2019) · Journal of Management Studies · doi:10.1111/joms.12438 · Cited by 102 · see citing works
Compositional mediation analysis for microbiome studies
Sohn, M. B., & Li, H. (2019) · The Annals of Applied Statistics · doi:10.1214/18-aoas1210 · Cited by 113 · see citing works
Bammens, Y. P. M., & Hünermund, P. (2020) · Journal of Product Innovation Management · doi:10.1111/jpim.12550 · Cited by 120 · see citing works
Biofortification, Crop Adoption and Health Information: Impact Pathways in Mozambique and Uganda
de Brauw, A., Eozenou, P., Gilligan, D., Hotz, C. S., Kumar, N., & Meenakshi, J. V. (2018) · American Journal of Agricultural Economics · doi:10.1093/ajae/aay005 · Cited by 112 · see citing works
Weather shocks, climate change and human health
Meierrieks, D. (2020) · World Development · doi:10.1016/j.worlddev.2020.105228 · Cited by 118 · see citing works
Rueda, D., & Stegmueller, D. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108681339 · Cited by 113 · see citing works
Chaudoin, S., Milner, H. V., & Pang, X. (2014) · International Organization · doi:10.1017/s0020818314000356 · Cited by 111 · see citing works
Klein, H., Trumpff, C., Yang, H., Lee, A., Picard, M. A., Bennett, D. A., & Jager, P. L. D. (2021) · Molecular Neurodegeneration · doi:10.1186/s13024-021-00495-8 · Cited by 110 · see citing works
Cano-Gamez, E., Burnham, K. L., Goh, C., Allcock, A., Malick, Z. H., Overend, L., Kwok, A. J., Smith, D. A. B., Sengers, H. P., Antcliffe, D. B., et al. (2022) · Science Translational Medicine · doi:10.1126/scitranslmed.abq4433 · Cited by 111 · see citing works
Eldor, L., & Shoshani, A. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.06.001 · Cited by 119 · see citing works
Völker, S., Heiler, A., Pollmann, T., Claßen, T., Hornberg, C., & Kistemann, T. (2017) · Urban forestry & urban greening · doi:10.1016/j.ufug.2017.10.014 · Cited by 109 · see citing works
Recent Developments in Causal Inference and Machine Learning
Brand, J. E., Zhou, X., & Xie, Y. F. (2023) · Annual Review of Sociology · doi:10.1146/annurev-soc-030420-015345 · Cited by 124 · see citing works
Frölich, M., & Huber, M. (2017) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12232 · Cited by 108 · see citing works
Agarwal, R., Tu, W., Farjat, A. E., Farag, Y. M. K., Toto, R., Kaul, S., Lawatscheck, R., Rohwedder, K., Ruilope, L. M., Rossing, P., et al. (2023) · Annals of Internal Medicine · doi:10.7326/m23-1023 · Cited by 109 · see citing works
Hawks, Doves, and Peace: An Experimental Approach
Mattes, M., & WEEKS, J. L. P. (2018) · American Journal of Political Science · doi:10.1111/ajps.12392 · Cited by 105 · see citing works
Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures
Lavanchy, M., Reichert, P., Narayanan, J., & Savani, K. (2023) · Journal of Business Ethics · doi:10.1007/s10551-022-05320-w · Cited by 120 · see citing works
- Authors
- Imai, K., Keele, L., & Yamamoto, T.
- Affiliations
- Princeton University (US)
- ORCID
- Yamamoto, Teppei
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2010-02-01
- Volume
- 25
- Issue
- 1
- Pages
- 51-71
- ISSN
- 0883-4237 (ISSN-L)
- 2168-8745
- OpenAlex
- W2056621649
- Semantic Scholar
- 305c1929f9b5cd60aede21b30b7f6fb65b31dbd3
- Cited by
- 1,628
- References
- 45
- Citations by year
- 2026: 217 · 2025: 175 · 2024: 177 · 2023: 146 · 2022: 157 · 2021: 133 · 2020: 118 · 2019: 121 · 2018: 76 · 2017: 79 · 2016: 59 · 2015: 54 · 2014: 41 · 2013: 29 · 2012: 24
- FWCI
- 20.03
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Statistical Science (publishedVersion)
- arXiv (Cornell University) (publishedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (0918968)
- University of Pennsylvania
- University of Wisconsin-Madison
- Harvard University
- York University
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- causal mediation analysis, nonparametric identification, sequential ignorability, linear structural equation models, sensitivity analysis, unmeasured confounding, causal mechanisms, intermediate variables, randomized experiments, political psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review