Causal Inference

How to read this page: This article maps the topic from beginner to expert across six levels � Remembering, Understanding, Applying, Analyzing, Evaluating, and Creating. Scan the headings to see the full scope, then read from wherever your knowledge starts to feel uncertain. Learn more about how BloomWiki works ?

Causal inference in AI is the study and application of methods for reasoning about cause-and-effect relationships, not merely statistical correlations. Traditional machine learning excels at finding patterns — "X correlates with Y" — but causal inference asks a different and deeper question: "Does X cause Y, and if I change X, what will happen to Y?" This distinction is crucial for decision-making, policy evaluation, fairness analysis, and building AI systems that can reason reliably about interventions in the world. Causal inference bridges statistics, computer science, economics, and philosophy.

Remembering

• Causation — A relationship where one event (the cause) brings about another event (the effect). Distinct from correlation.
• Correlation — A statistical association between two variables that does not imply causation ("correlation is not causation").
• Confounding variable — A hidden variable that influences both the apparent cause and effect, creating a spurious association.
• Intervention — Actively changing the value of a variable (rather than just observing it), denoted do(X=x) in do-calculus.
• Observational data — Data collected without intervening; correlations in observational data may not reflect causal relationships.
• Randomized Controlled Trial (RCT) — The gold standard for establishing causation: randomly assign units to treatment or control, then measure outcomes.
• Counterfactual — A hypothetical: "What would have happened if X had been different?" e.g., "Would this patient have survived if they had received the drug?"
• Potential outcomes framework — A formalization of causal inference using Y(1) (outcome if treated) and Y(0) (outcome if not treated) for each unit.
• Average Treatment Effect (ATE) — The average causal effect of a treatment across a population: E[Y(1) - Y(0)].
• DAG (Directed Acyclic Graph) — A graphical model where nodes are variables and directed edges represent causal relationships; no cycles.
• Backdoor criterion — A graphical criterion for identifying which variables to condition on to block spurious correlations (confounding paths) in a causal DAG.
• Do-calculus — A set of rules (developed by Judea Pearl) for computing the effect of interventions from observational data and a causal DAG.
• Instrumental variable — A variable that affects the treatment but has no direct effect on the outcome except through the treatment; used to estimate causal effects when confounding is present.
• Causal discovery — Algorithms for inferring causal structure (the DAG) from observational data.
• Selection bias — Bias arising when the sample used for analysis is not representative of the population of interest.

Understanding

The fundamental problem of causal inference is what statistician Donald Rubin called the Fundamental Problem of Causal Inference: we can never observe both potential outcomes for the same unit at the same time. Either a patient received the drug (Y(1) observed, Y(0) unobserved) or they didn't (Y(0) observed, Y(1) unobserved). We can never know what would have happened to the same person under the alternative treatment — the counterfactual.

Judea Pearl's Ladder of Causation describes three levels of causal reasoning: 1. Association (rung 1): "What is?" — Observing and predicting correlations. Standard ML lives here. 2. Intervention (rung 2): "What if I do X?" — Reasoning about the effect of deliberate actions. Requires a causal model. 3. Counterfactual (rung 3): "What if I had done X instead?" — Imagining alternate histories. Requires a complete structural causal model.

Most ML systems operate only on rung 1. To make reliable decisions and avoid discrimination, AI systems often need rung 2 or 3.

Why this matters for AI:

• Spurious correlations: A model that classifies "pneumonia" as lower risk may have learned that pneumonia patients sent to the ICU have lower final mortality — confusing treatment effect with baseline risk.
• Fairness: Is a model discriminating based on race, or is it using variables that are correlated with race but causally related to the outcome? Causal fairness criteria give precise answers.
• Policy decisions: If we deploy an AI to recommend interventions, we must understand the causal effect of those interventions — not just their correlation with past outcomes.
• Robustness: Models that learn causal relationships rather than spurious correlations generalize better when the environment changes (distribution shift).

Applying

Estimating causal treatment effects with DoWhy:

<syntaxhighlight lang="python"> import dowhy from dowhy import CausalModel import pandas as pd import numpy as np

1. Generate synthetic data: drug → recovery, age → both drug and recovery (confounder)

np.random.seed(42) n = 1000 age = np.random.normal(50, 15, n) drug = (0.3 * age + np.random.normal(0, 10, n) > 30).astype(int) # older → more likely to receive drug recovery = 0.5 * drug - 0.02 * age + np.random.normal(0, 1, n) # drug helps, but age hurts

df = pd.DataFrame({'age': age, 'drug': drug, 'recovery': recovery})

1. Step 1: Define the causal model as a DAG

model = CausalModel(

   data=df,
   treatment="drug",
   outcome="recovery",
   common_causes=["age"]  # age is a confounder

)

1. Step 2: Identify the causal effect

identified_estimand = model.identify_effect(proceed_when_unidentifiable=True) print(identified_estimand)

1. Step 3: Estimate the causal effect (controlling for age via backdoor adjustment)

estimate = model.estimate_effect(

   identified_estimand,
   method_name="backdoor.linear_regression",
   control_value=0,
   treatment_value=1,

) print(f"Estimated ATE: {estimate.value:.3f}")

1. Should recover ~0.5 (the true causal effect)

1. Naive regression ignoring confounding:

naive_corr = df[df.drug==1]['recovery'].mean() - df[df.drug==0]['recovery'].mean() print(f"Naive (biased) correlation: {naive_corr:.3f}")

1. Will be biased because older people receive drug more but recover less

1. Step 4: Refute the estimate (robustness checks)

refutation = model.refute_estimate(estimate,

                                  method_name="random_common_cause")

print(refutation) # Good estimate: adding random confounder shouldn't change result </syntaxhighlight>

Causal inference methods by scenario

RCT available → Compute difference in means (no adjustment needed — randomization handles confounding)

Observational, confounders known → Propensity score matching, IPW, doubly-robust estimators

Observational, confounders unknown → Instrumental variables (IV), regression discontinuity

Time series, sequential treatments → G-computation, marginal structural models

Causal structure unknown → Causal discovery: PC algorithm, FCI, LiNGAM, NOTEARS

Heterogeneous effects → Causal forests, meta-learners (S, T, X-learner)

Analyzing

Causal Inference Methods Comparison

Method	Assumptions	When to Use	Python Library
Regression adjustment	No unmeasured confounding, correct functional form	Known confounders, sufficient data	statsmodels, DoWhy
Propensity score matching	No unmeasured confounding	Binary treatment, observational data	DoWhy, CausalML
Instrumental variables	Valid instrument exists	Hidden confounders, instrument available	DoWhy, linearmodels
Difference-in-differences	Parallel trends assumption	Panel data, natural experiment	CausalPy, statsmodels
Causal forest	No unmeasured confounding	Heterogeneous treatment effects	EconML, GRF (R)
Regression discontinuity	Local continuity at threshold	Sharp threshold in treatment assignment	RDD (R), DoWhy

Key pitfalls and failure modes:

• Conditioning on colliders — Incorrectly conditioning on a variable that is a common effect (not cause) of treatment and outcome opens spurious paths rather than blocking them. Using a DAG is essential to identify what to condition on.
• Positivity violation — If some subgroups never receive (or always receive) treatment, causal effects for those subgroups cannot be estimated from data. Check overlap in propensity score distributions.
• Model misspecification — Parametric methods (regression adjustment) assume a specific functional form. Use doubly-robust or non-parametric methods (causal forests) to reduce this risk.
• Weak instruments — IV estimation with a weak instrument (low correlation with treatment) produces large, unreliable estimates. Test for instrument strength (F-statistic > 10 rule of thumb).
• Extrapolation beyond support — Causal effect estimates are only reliable within the range of the observed data. Be cautious about extrapolating to new populations or intervention levels.

Evaluating

Causal inference evaluation is uniquely challenging because we can never observe the true counterfactual:

Simulation studies (synthetic data): Generate data from a known causal model where the true ATE is known. Evaluate whether each estimator recovers the true ATE. This is the standard way to compare methods.

Semi-synthetic benchmarks: Use real covariate data but simulate outcomes from a known causal model. ACIC (Atlantic Causal Inference Conference) benchmarks provide standardized challenges.

Sensitivity analysis: Test how robust the estimate is to violations of key assumptions (e.g., unmeasured confounding). E-values quantify the minimum strength of unmeasured confounding that would overturn the result.

Refutation tests (DoWhy): Specific tests designed to detect estimation problems:

• Adding a random confounder shouldn't change a good estimate
• Replacing treatment with a random variable should produce ATE ≈ 0
• Placebo treatment (observed but causally irrelevant) should produce ATE ≈ 0

Expert practitioners present causal estimates with explicit assumption documentation, sensitivity analyses, and refutation test results — not just a point estimate. An ATE that fails refutation tests or is sensitive to unmeasured confounding should be reported with appropriate uncertainty.

Creating

Designing a causal inference analysis pipeline for business decision-making:

1. Problem formulation <syntaxhighlight lang="text"> Define: What is the treatment? What is the outcome? What is the population?

   ↓

Draw the causal DAG: variables, causal paths, potential confounders

   ↓

Apply backdoor criterion: which variables block all confounding paths?

   ↓

Check identifiability: can the causal effect be estimated from available data?

   ↓

Assess data availability: are the required conditioning variables measured? </syntaxhighlight>

2. Estimation pipeline <syntaxhighlight lang="text"> Data collection: ensure confounders are measured, check positivity

   ↓

Covariate balance check: compare treatment/control distributions

   ↓

Propensity score modeling (if observational): logistic regression or GBM

   ↓

Effect estimation: doubly-robust AIPW or causal forest for heterogeneous effects

   ↓

Sensitivity analysis: E-value, Rosenbaum bounds

   ↓

Refutation tests: DoWhy refute suite

   ↓

Report: ATE ± CI, assumptions, sensitivity, subgroup effects </syntaxhighlight>

3. Causal ML in production (uplift modeling)

• Estimate heterogeneous treatment effects: which users benefit most from intervention?
• Use X-learner or causal forest to estimate CATE (Conditional ATE) per user
• Target intervention to users with highest predicted CATE
• Monitor actual vs. predicted uplift in A/B tests post-deployment
• Continuously retrain causal model as new experimental data arrives