AI Paper Atlas

Research map / Video / Video-language understanding

Auslan-Daily: Australian Sign Language Translation for Daily Communication and News

Xin Shen, Shaozu Yuan, Hongwei Sheng, Heming Du, Xin Yu

NeurIPS 2023 · Video › Video-language understanding · approach: Video LLMs with fine-grained understanding · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
feed multi-person clips without cropping signersGASLT (RGB) · Auslan-Daily CommunicationBLEU-4: 4.73 -> 4.23Hurt
signer detection before translation (SD+SLT, pose) (ablation)GASLT/SLT models · Auslan-Daily Communication multi-personBLEU-4: 4.23 -> 8.38Improved
signer detection before translation (SD+SLT, pose) (ablation)SLT models · Auslan-Daily News multi-personBLEU-4: 2.26 -> 2.53Improved
pose input instead of RGB (ablation)GASLT · Auslan-Daily Communication single-personBLEU-4: 4.73 -> 9.95Improved
pose input instead of RGB (ablation)SL-Luong · Auslan-Daily Communication single-personBLEU-4: 4.66 -> 9.45Improved
pose input instead of RGB (ablation)GASLT · Auslan-Daily News single-personBLEU-4: 2.56 -> 2.72No clear effect
fine-tune alignment model on Mixed instead of Communication only (test on Comm.) (ablation)SAT · Sign Language AlignmentF1@.50: 66.33 -> 64.27Hurt
fine-tune on Mixed instead of News only (test on News) (ablation)SAT · Sign Language AlignmentF1@.50: 50.08 -> 53.05Improved
fine-tune pre-trained SAT on AuslanSAT · Sign Language AlignmentF1Improved
pose-based TGCN instead of RGB I3D (ablation)TGCN · Isolated Sign Language RecognitionTop-1: 11.87 -> 14.82Improved
pose-based TGCN instead of RGB I3D (ablation)TGCN · Signer DetectionTop-1: 89.01 -> 88.35No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy