Research map / Probabilistic and scientific modeling / Causal discovery
Decomposing Interventional Causality into Synergistic, Redundant, and Unique Components
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes an interventional partial information decomposition of the maximal average causal effect into synergistic, redundant, and unique components via Möbius inversion over the antichain redundancy lattice, illustrated on logic gates, cellular automata, a chemical network, and DistilBERT sentiment completions.
Problem
Observational information decompositions cannot capture true causal power; there is no principled way to split interventional causal effects of multiple variables into unique, redundant, and synergistic parts.
Approach
Define a redundant maximal average causal effect as the minimum MACE over antichain members, then Möbius-invert over the antichain lattice to obtain nonnegative partial causal effects for each antichain, making the decomposition interventional rather than observational.
Key results
- For OR, AND, XOR, and COPY logic gates, the decomposition separates unique, redundant, and synergistic causal power as a function of input probability p; e.g. XOR at p=1/2 is purely synergistic.
- In a chemical network, at low k3 almost all causal power is unique to X1 (k1=10 > k2=1), while at high k3 it becomes mostly synergistic.
- On DistilBERT sentiment completions, 'horribly bad' shows strong negative redundancy, 'not bad' shows positive synergy, and 'really bad' shows unique negative content for 'bad'.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Vary input probability p in the OR gate | OR gate · Logic gates | distribution of causal power | Mixed |
| Set p to one half | XOR gate · Logic gates | synergistic causal power | Helped |
| Change the initialisation from random to middle-1 | Rule 90 cellular automaton · Cellular automata | single-intervention controllability | Helped |
| Increase k3 so combinatorial synthesis dominates | Chemical reaction network · Chemical network | synergistic causal power | Helped |
| Use the completion "horribly bad" | distilbert-base-uncased-finetuned-sst-2-english · Sentiment completions | negative redundant causal effect | Helped |
| Use the completion "not bad" | distilbert-base-uncased-finetuned-sst-2-english · Sentiment completions | positive synergistic causal effect | Helped |
| Use the completion "really bad" | distilbert-base-uncased-finetuned-sst-2-english · Sentiment completions | unique negative causal effect | Helped |
Surprising findings
- Causal power in cellular automata (e.g. Rule 90) depends on the context or initialisation: redundant under one prior and synergistic under another.
- Under the all-zero context, Rule 30 and Rule 54 reduce to OR-like gates, so their causal power becomes fully redundant.
Limitations
- Number of antichains grows with the Dedekind numbers, limiting practical analysis to about five variables.
- Choice of the MMI-based redundancy measure is ambiguous and criticised for simplicity.
- Accurately estimating interventional quantities is hard, so the method requires known causal graphs or simulators.
Experimental setup
Datasets: simulated cellular automata trajectories (100 cells, 10k steps) 25 hand-written base sentences for sentiment completions
Metrics: maximal average causal effect (MACE) partial causal effects per antichain signed causal effect (CE)
Baselines: Williams and Beer I_min minimum mutual information (MMI) Shapley values Chicharro-style observational decomposition
Builds on: Partial Information Decomposition Möbius inversion theorem minimum mutual information (MMI) do-calculus
Closest papers by meaning
- Causal learning with the invariance principle (NeurIPS 2026 · similarity 0.87)
- Learning Structural Causal Models from Ordering: Identifiable Flow Models (AAAI 2025 · similarity 0.86)
- Systems with Switching Causal Relations: A Meta-Causal Perspective (ICLR 2025 · similarity 0.86)
- Causality can systematically address the monsters under the bench(marks) (NeurIPS 2026 · similarity 0.86)
- Characterization and Learning of Causal Graphs from Hard Interventions (NeurIPS 2025 · similarity 0.86)
- Learning Mixtures of Unknown Causal Interventions (NeurIPS 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
