TPAMI 2022 papers on Vision-language and multimodal
23 of the 583 papers published in TPAMI 2022 (3.9%) are on Vision-language and multimodal, compared with 2.9% at TPAMI 2021. They fall into 3 topics.
See TPAMI 2022 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Cross-modal learning · 10 papers
- HGNN + : General Hypergraph Neural Networks (625 citations)
- Unsupervised Contrastive Cross-modal Hashing (204 citations)
- Contrastive Positive Sample Propagation Along the Audio-Visual Event Line (91 citations)
- Integrating Multi-Label Contrastive Learning With Dual Adversarial Graph Neural Networks for Cross-Modal Retrieval (71 citations)
- Channel Exchanging Networks for Multimodal and Multitask Dense Image Prediction (54 citations)
- Semantic and Relation Modulation for Audio-Visual Event Localization (47 citations)
- Learning Structural Representations for Recipe Generation and Food Retrieval (35 citations)
- Mutual-Assistance Learning for Standalone Mono-Modality Survival Analysis of Human Cancers (12 citations)
- Visual Micro-Pattern Propagation (11 citations)
- Binaural SoundNet: Predicting Semantics, Depth and Motion With Binaural Sounds (10 citations)
Human and embodied modeling · 9 papers
- From Show to Tell: A Survey on Deep Learning-Based Image Captioning (450 citations)
- VLT: Vision-Language Transformer and Query Generation for Referring Segmentation (178 citations)
- Image-Text Embedding Learning via Visual and Textual Semantic Reasoning (166 citations)
- ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting (95 citations)
- Learn-Explain-Reinforce: Counterfactual Reasoning and its Guidance to Reinforce an Alzheimer's Disease Diagnosis Model (52 citations)
- IC9600: A Benchmark Dataset for Automatic Image Complexity Assessment (51 citations)
- On Distinctive Image Captioning via Comparing and Reweighting (35 citations)
- Exploring Simple and Transferable Recognition-Aware Image Processing (27 citations)
- Knowledge-Enriched Attention Network With Group-Wise Semantic for Visual Storytelling (20 citations)
Visual question answering · 4 papers
- CRIC: A VQA Dataset for Compositional Reasoning on Vision and Commonsense (42 citations)
- Learning to Answer Visual Questions From Web Videos (36 citations)
- Depth and Video Segmentation Based Visual Attention for Embodied Question Answering (27 citations)
- NAAQA: A Neural Architecture for Acoustic Question Answering (4 citations)
