AI Paper Atlas

Research map / Benchmarks / SIQA

SIQA leaderboard

14 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on SIQA. Best accuracy: 83.1 (InfoSteer intervention, NeurIPS 2025).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

SIQA · accuracy

14 papers, each with its best reported number for its own method; higher is better.

#accuracy ↑MethodPaperTopic
183.1InfoSteer intervention
Gemma-2-9B
Steering Information Utility in Key-Value Memory for Language Model Post-Training
NeurIPS 2025 · Table 1
Instruction and fine-tuning
282.4LoRA-DA
LLaMA 2-7B
LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
ICML 2026 · Table 1
Optimizers
382.3gRAdamW_20,10,4
Llama-3.2-3B
A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
ICML 2025 · Table: Question answering eval
Mixture of experts
482D-LLM
LLaMA2-7B
D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models
NeurIPS 2024 · Table 1
Reasoning and chain of thought
577.46Dynamic CoT (transfer)
GPT-4o-mini and GPT-4o
Token Signature: Predicting Chain-of-Thought Gains with Token Decoding Feature in Large Language Models
ICML 2025 · Table: Cross-model transfer ef
Reasoning and chain of thought
670.68NoVo
Mistral-7B-Instruct
NoVo: Norm Voting off Hallucinations with Attention Heads in Large Language Models
ICLR 2025 · Table 2
Language, safety and interpretability
770.2S-MeZO
Mistral-7B
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
NeurIPS 2025 · Table: Accuracy of Fine-Tuning
Pruning and efficient tuning
855.47Wanda (ours)
Llama2-13B
Exploring Activation Patterns of Parameters in Language Models
AAAI 2025 · Table 1
RNNs and normalization
951.8LasF (S20-DQ20-DS1024)
LLaMA-13B
Modeling Language Tokens as Functionals of Semantic Fields
ICML 2024 · Table 2
Attention and transformers
1049.6Megalodon-7B
Megalodon
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
NeurIPS 2024 · Table 1
Attention and transformers
4 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.