Research map / Probabilistic and scientific modeling / Causal discovery
Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Introduces concept modulation models (CMMs), a conditional generative framework A→modulator→concept→feature, and shows via attribute potentials (log-density ratios) that feature agreement on observed attributes lifts to a latent transition and that extrapolation holds iff transported potential identities extend to unseen attributes.
Problem
Identifiability and extrapolation guarantees in conditional latent-variable models are model-specific, with separate analyses in nonlinear ICA, causal representation learning, and perturbation modeling.
Approach
Concept modulation models with structure A→modulator→concept→X; feature agreement on observed attributes lifts to a latent concept transition, expressed through attribute potentials (log-density ratios), which also control extrapolation to unseen attributes.
Key results
- Feature equivalence on observed attributes induces a latent concept transition in the intersection of valid mixing and concept transition sets.
- Agreement at unseen attributes holds exactly when attribute-potential identities extend to those attributes.
- Recovers affine identifiability for the exponential-family running example and perturbation identifiability up to orthogonal transformation under sufficient diversity.
Limitations
- Requires common-support assumption, excluding deterministic do-interventions and support-changing mechanisms.
- Extrapolation needs structural assumptions tying unseen attribute potentials to observed ones.
- Purely theoretical; no empirical validation reported.
Experimental setup
Builds on: transition-based identifiability framework nonlinear ICA with auxiliary variables iVAE
Closest papers by meaning
- Nonparametric Identification of Latent Concepts (ICML 2025 · similarity 0.87)
- Identifiable Latent Polynomial Causal Models through the Lens of Change (ICLR 2024 · similarity 0.86)
- Learning Discrete Concepts in Latent Hierarchical Models (NeurIPS 2024 · similarity 0.86)
- Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens (NeurIPS 2025 · similarity 0.86)
- Learning Linear Causal Representations from General Environments: Identifiability and Intrinsic Ambiguity (NeurIPS 2024 · similarity 0.86)
- Multi-View Causal Representation Learning with Partial Observability (ICLR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
