atlas

Research map / Image generation / Autoregressive and latent generation

Blind Image Quality Assessment Based on Geometric Order Learning

CVPR 2024 · Image generation › Autoregressive and latent generation · approach: Learning-based image quality assessment · 26 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes QCN, a transformer-based geometric order learning network that sorts image feature vectors and learnable score pivots in an embedding space for blind image quality assessment, estimating scores by nearest-pivot projection.

Problem

Blind image quality assessment requires estimating continuous quality scores without reference images, and existing methods do not explicitly exploit ordering relations and score differences between images at test time.

Approach

Adapts geometric order learning to BIQA with comparison transformers (CTs) that jointly update image feature tokens and learnable score pivots via masked self-attention and cross-attention, trained with order, metric, center and MAE losses; at test time the score is read off by projecting the test feature onto the nearest pivot pair, using auxiliary training images in the same batch.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use QCN instead of QPTBIQA · KonIQ10KSRCC: 0.927 -> 0.934Helped
Use QCN instead of QPTBIQA · BID, CLIVE, KonIQ10K, SPAQ, and FLIVEPCC: 0.911 -> 0.890; 0.914 -> 0.893; 0.941 -> 0.945; 0.928 -> 0.928; 0.677 -> 0.741Mixed
Use QCN instead of the strongest baselineBIQA · BID, CLIVE, KonIQ10K, SPAQ, and FLIVESRCC: 0.888 -> 0.892; 0.895 -> 0.875; 0.927 -> 0.934; 0.925 -> 0.923; 0.646 -> 0.644Mixed
Add FSU and PSU modules (ablation)QCN · KonIQ10KSRCC: 0.858 -> 0.934Helped
Add FSU module (ablation)QCN · KonIQ10KSRCC: 0.858 -> 0.930Helped
Add PSU module (ablation)QCN · KonIQ10KSRCC: 0.858 -> 0.916Helped
Add Lcenter to Lmae (ablation)QCN · KonIQ10KSRCC: 0.855 -> 0.860Helped
Add Lmetric to Lmae and Lcenter (ablation)QCN · KonIQ10KSRCC: 0.860 -> 0.929Helped
Add Lorder to Lmae, Lcenter, and Lmetric (ablation)QCN · KonIQ10KSRCC: 0.929 -> 0.934Helped
Change input image count N from 1 to 6, 12, 18, and 24 (ablation)QCN · KonIQ10KSRCC: 0.909; 0.928; 0.931; 0.935; 0.934Helped
Change CT count T from 1 to 2, 3, 4, and 5 (ablation)QCN · KonIQ10KSRCC: 0.928; 0.930; 0.934; 0.933; 0.933Mixed
Use non-uniform instead of uniform score pivot generation (ablation)QCN · KonIQ10K and SPAQSRCC: 0.929 -> 0.934; 0.914 -> 0.923Helped

Surprising findings

Limitations

Experimental setup

Datasets: BID CLIVE KonIQ10K SPAQ FLIVE ILSVRC2012

Benchmarks: BID CLIVE KonIQ10K SPAQ FLIVE

Metrics: SRCC PCC

Baselines: NIQE ILNIQE BRISQUE BMPRI CNNIQA WaDIQaM-NR PQR SFA DB-CNN HyperIQA PaQ-2-PiQ UNIQUE

Builds on: geometric order learning order learning MUSIQ-style aspect-ratio preservation Lloyd-Max quantization

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy