atlas

Research map / Image generation / Autoregressive and latent generation

Integrating Global Context Contrast and Local Sensitivity for Blind Image Quality Assessment

ICML 2024 · Image generation › Autoregressive and latent generation · approach: Learning-based image quality assessment

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CSIQA, a BIQA method that combines quality-label-based contrastive learning (with easy/hard sampling and a distillation teacher) for global dataset context with a quality-aware mask attention token for local distortion sensitivity.

Problem

No-reference image quality assessment often treats samples independently and relies on semantic pre-trained features, missing cross-image quality contrast and local distortion sensitivity.

Approach

Defines contrastive positives and negatives by ground-truth quality similarity, refines them with easy/hard sampling using teacher pseudo-label errors, and adds a quality-aware (QUA) token whose attention is restricted to randomly unmasked patches to focus on local distortions.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CSIQA instead of DEIQTBIQA · LIVEPLCC: 0.982 -> 0.985Helped
Use CSIQA instead of CONTRIQUEBIQA · KADIDPLCC: 0.937 -> 0.919Hurt
Use CSIQA instead of Re-IQABIQA · LIVEFBPLCC: 0.733 -> 0.688Hurt
Use CSIQA instead of Re-IQABIQA · SPAQPLCC: 0.925 -> 0.935Helped
Add quality context contrastive learning and distillation (ablation)TIQA · CSIQPLCC: +1.8Helped
Add quality context contrastive learning and distillation (ablation)TIQA · LIVECPLCC: +2.9Helped
Add quality context contrastive learning and distillation (ablation)DEIQT · CSIQPLCC: +0.7Helped
Add quality context contrastive learning and distillation (ablation)DEIQT · LIVECSRCC: +1.8Helped
Add mask attention (ablation)CSIQA · TID2013PLCCHelped
Add easy-sample contrastive learning (ablation)CSIQA · TID2013PLCC: approximately 1.7%Helped
Add hard sampling to easy-sample contrastive learning (ablation)CSIQA · TID2013PLCC: nearly 1%Helped

Surprising findings

Limitations

Experimental setup

Datasets: LIVE CSIQ TID2013 KADID LIVEC KonIQ LIVEFB SPAQ

Benchmarks: LIVE CSIQ TID2013 KADID LIVEC KonIQ LIVEFB SPAQ

Metrics: SRCC PLCC

Baselines: BRISQUE ILNIQE BIECON MEON WaDIQaM DBCNN TIQA MetaIQA P2P-BM HyperIQA TReS MUSIQ

Builds on: InfoNCE DEIQT MUSIQ Masked autoencoders

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy