AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

COCA: COllaborative CAusal Regularization for Audio-Visual Question Answering

Mingrui Lao, Nan Pu, Yu Liu, Kai He, Erwin M. Bakker, Michael S. Lew

AAAI 2023 · Vision-language and multimodal › Visual question answering · approach: Multimodal question answering datasets · 22 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add COCA to AVSTAVST on MUSIC-AVQA · MUSIC-AVQA testaverage accuracy: 71.52 -> 72.33Improved
Add COCA to the baselineBaseline on MUSIC-AVQA · MUSIC-AVQA testaverage accuracy: 69.61 -> 71.64Improved
Add COCA regularizationVQAT-based model on MUSIC-AVQA · MUSIC-AVQA testaverage accuracy: 69.32 -> 70.81Improved
Add COCA regularizationConvLSTM-based model on MUSIC-AVQA · MUSIC-AVQA testaverage accuracy: 68.37 -> 69.74Improved
Add counterfactual regularization for the Q→G language shortcut (ablation)Baseline AVQA model · MUSIC-AVQA testaverage accuracy: 69.61 -> 70.50Improved
Add factual regularization for Q→G (ablation)Baseline AVQA model with Q→G counterfactual regularization · MUSIC-AVQA testaverage accuracy: 70.50 -> 70.86Improved
Add counterfactual regularization for the F→G visual shortcut (ablation)Baseline AVQA model · MUSIC-AVQA testaverage accuracy: 69.61 -> 69.91Improved
Add factual regularization for F→G (ablation)Baseline AVQA model with F→G counterfactual regularization · MUSIC-AVQA testaverage accuracy: 69.91 -> 70.12Improved
Add counterfactual regularization for the S→G audio shortcut (ablation)Baseline AVQA model · MUSIC-AVQA testaverage accuracy: 69.61 -> 70.04Improved
Add factual regularization for S→G (ablation)Baseline AVQA model with S→G counterfactual regularization · MUSIC-AVQA testaverage accuracy: 70.04 -> 70.37Improved
Add counterfactual regularization for all three shortcut biases (ablation)Baseline AVQA model · MUSIC-AVQA testaverage accuracy: 69.61 -> 70.81Improved
Add factual regularization for all three shortcut biases (ablation)Multiple-shortcut counterfactual model · MUSIC-AVQA testaverage accuracy: 70.81 -> 71.21Improved

Later papers that compared with this method

21 later accepted papers report CoCA as a baseline in their results tables; 15 of them report a better number on most of the results they share with it.

13 more not listed.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy