AI Paper Atlas

Research map / Video / Video-language understanding

OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding

Ming Hu, Peng Xia, Lin Wang, Siyuan Yan, Feilong Tang, zhongxing xu, Yimin Luo, Kaimin Song, Jurgen Leitner, Xuelian Cheng, Jun Cheng, Chi Liu and 2 more

ECCV 2024 · Video › Video-language understanding · approach: Event and anomaly reasoning in video · 28 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use CLIP-based video models (X-CLIP, ViFi-CLIP) instead of I3D/SlowFast/X3D/MViT V2OphNet phase classification · OphNet phase classification (All)Top-1 accuracy: 33.5 -> 68.4Improved
initialize from Kinetics-400 pretrained weights (ablation)I3D/SlowFast/X3D/MViT V2 on phase classification · OphNet phase classification (All)Top-1 accuracy: 25.7 -> 30.2 (I3D)Improved
Kinetics-400 pretraining for MViT V2 on phase classification (ablation)MViT V2 · OphNet phase classification (All)Top-1 accuracy: 27.0 -> 28.3 (All); 26.2 -> 34.2 (Cataract); 21.0 -> 23.3 (Glaucoma)Mixed
Kinetics-400 pretraining on primary surgery classification (ablation)I3D/SlowFast/X3D/MViT V2 · OphNet primary surgery classification (All)Top-1 accuracy: 29.8 -> 27.2 (I3D); 28.5 -> 35.4 (X3D)Mixed
increase CLIP model input frames from 16 to 32 (ablation)X-CLIP / ViFi-CLIP · OphNet phase and operation classificationTop-1 accuracy: 63.4 -> 62.7 (X-CLIP phase All); 66.1 -> 68.4 (ViFi-CLIP phase All)Mixed
use TriDet with SwinViviT backbone instead of ActionFormer (ablation)phase localization · OphNet phase localizationAvg. mAP: 46.4 -> 50.4Improved
use SlowFast instead of SwinViviT backbone for TriDet (ablation)TriDet · OphNet phase localizationAvg. mAP: 50.4 -> 48.6Hurt
Kinetics-400 pretraining for phase anticipation (ablation)I3D/SlowFast/MViT V2 · OphNet phase anticipationAvg. Top-1 accuracy: 47.5 -> 48.2 (MViT V2)Improved
increase observation ratio in phase anticipation (ablation)anticipation models · OphNet phase anticipationTop-1 accuracy: 27.8 -> 51.7 (0.1 -> 0.7, MViT V2*, approx per table)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy