Research map / Continual learning / Domain and prompt-based
Gradient Regularized Contrastive Learning for Continual Domain Adaptation
Shixiang Tang, Peng Su, Dapeng Chen, Wanli Ouyang
This paper tried a common change: Add a contrastive loss
Add contrastive learning to source-only supervised training · Digits, DomainNet, and Office-Caltech target domains · classification accuracy Improved
What 1,317 accepted papers report for this change
- 1,253 improved
- 22 no clear effect
- 16 mixed
- 26 hurt
- Beyond Looking Up, Try Looking Around: Harmonizing Global Structure and Local Consistency in Optimal Transport for Short Text Clustering ICML 2026 · add contrastive learning · SearchSnippets · ACC: 56.65 -> 80.12Improved
- SleepLM: Natural-Language Intelligence for Human Sleep ICML 2026 · add contrastive objective to captioning (CoCa vs Cap) · sleep event IoU · IoU: 29.2 -> 27.4Hurt
- LIMSSR: LLM-Driven Sequence-to-Score Reasoning under Training-Time Incomplete Multimodal Observations ICML 2026 · add contrastive loss L_con · FS1000 average · Spearman correlation: 0.759 -> 0.789Improved
See this change in detailMatched by the wording of each paper's own result, read by AI from the full text. Papers report gains more often than failures, so this shows what gets published, not the chance a change works.
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Replace ADDA-based alignment with contrastive learning while retaining gradient constraints | GRA · Digits | ACC: 84.10 -> 85.34 | Improved |
| Replace ADDA-based alignment with contrastive learning while retaining gradient constraints | GRA · DomainNet | ACC: 35.84 -> 37.74 | Improved |
| Replace ADDA-based alignment with contrastive learning while retaining gradient constraints | GRA · Office-Caltech | ACC: 86.53 -> 87.23 | Improved |
| Increase memory size per domain from 256 to 2048 (ablation) | GRCL · Digits | ACC: 83.00 -> 85.41 | Improved |
| Increase memory size per domain from 256 to 2048 (ablation) | GRCL · DomainNet | ACC: 33.28 -> 37.83 | Improved |
| Increase training schedule from 120 to 240 epochs (ablation) | GRCL · Digits | ACC: 80.10 -> 85.34 | Improved |
| Increase training schedule from 120 to 240 epochs (ablation) | GRCL · DomainNet | ACC: 34.80 -> 37.74 | Improved |
| Increase training schedule from 120 to 240 epochs (ablation) | GRCL · Office-Caltech | ACC: 80.93 -> 87.23 | Improved |
| Train beyond 240 epochs, increasing the schedule to 300 (ablation) | GRCL · Digits | ACC: 85.34 -> 85.38 | No clear effect |
| Train beyond 240 epochs, increasing the schedule to 300 (ablation) | GRCL · Office-Caltech | ACC: 87.23 -> 87.28 | No clear effect |
| Add source-loss gradient regularization to contrastive learning (ablation) | Multi-task contrastive and supervised learning · Digits, DomainNet, and Office-Caltech target domains | classification accuracy | Improved |
| Add contrastive learning to source-only supervised training (ablation) | Source-only model · Digits, DomainNet, and Office-Caltech target domains | classification accuracy | Improved |
Closest papers by meaning
- Deja Vu: Continual Model Generalization for Unseen Domains (ICLR 2023 · similarity 0.89)
- Contrastive Adaptation Network for Unsupervised Domain Adaptation (CVPR 2019 · similarity 0.89)
- Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning (NeurIPS 2022 · similarity 0.88)
- Gradual Divergence for Seamless Adaptation: A Novel Domain Incremental Learning Method (ICML 2024 · similarity 0.86)
- Provable Contrastive Continual Learning (ICML 2024 · similarity 0.85)
- Learning Continually by Spectral Regularization (ICLR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
