AI Paper Atlas

Research map / Large language models / Retrieval and knowledge

Predictive Prefetching for Retrieval-Augmented Generation

Wuyang Zhang, Shichao Pei

ICML 2026 · Large language models › Retrieval and knowledge · approach: RAG robustness and evaluation · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add predictive asynchronous prefetchingSync-RAG · Four QA benchmarksE2E latency: 9.2s -> 5.2sImproved
add predictive asynchronous prefetchingSync-RAG · HotpotQAEM: 69.2 -> 68.7Mixed
use learned prediction instead of stale-query pipelinePipeRAG · HotpotQAEM: 66.8 -> 68.7Improved
add asynchronous architecture (ablation)Full system · HotpotQATTFT: 287ms -> 108msImproved
add retrieval predictor (ablation)Full system · HotpotQAEM: 65.1 -> 68.7Improved
add online policy-gradient adaptation (ablation)Full system · HotpotQAEM: 66.2 -> 68.7Improved
add T5 query generator (ablation)Full system · HotpotQAEM: 67.1 -> 68.7Improved
add adaptive waiting (ablation)Full system · HotpotQAEM: 66.8 -> 68.7Improved
add sufficiency check (ablation)Full system · HotpotQAEM: 67.8 -> 68.7Improved
online adaptation on top of pretraining (ablation)Retrieval Predictor · Code (RepoBench, OOD)AUROC: 0.68 -> 0.77Improved
use transformer-internal signals instead of current entropyRetrieval Predictor · entropy-crossing predictionAUROC: 0.66 -> 0.81Improved
wait 3-4 tokens before issuing query (ablation)Context Monitor · factual queriesquery relevance score: 0.65 -> 0.86Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy