AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

Particle Transformer for Jet Tagging

Huilin Qu, Congqiao Li, Sitian Qian

ICML 2022 · Architectures and efficiency › Attention and transformers · approach: Transformer neural operators for PDEs · 37 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add pairwise interaction term to attention (P-MHA) vs plain MHA (ablation)ParT · JetClassAccuracy: +1.2% accuracy (0.861 vs 0.849)Improved
add pairwise interaction term to attention (P-MHA) vs plain MHA (ablation)ParT · JetClassRej50% for t->bqq' and H->4q: background rejection reduced by 20-30% for most signals without itImproved
replace ParticleNet with ParT (P-MHA transformer)JetClass baseline comparison · JetClassAccuracy: +1.7% (0.861 vs 0.844)Improved
pre-train ParT on JetClass then fine-tune (ablation)ParT · Top quark taggingRej30%: 2766 vs 1602 from scratch; 70% over ParticleNetImproved
pre-train ParT on JetClass then fine-tune (ablation)ParT · Quark-gluon tagging (full)Rej50%: 50.6 vs 47.9 from scratchImproved
pre-train ParticleNet on JetClass then fine-tune (ablation)ParticleNet · Top quark taggingRej30%: only a small improvement over training from scratchNo clear effect
increase training set from 2M to 100M jets (ablation)ParT · JetClassAccuracy: 0.836 (2M) to 0.861 (100M), 2.5% gainImproved
increase training set from 2M to 100M jets (ablation)ParticleNet · JetClassAccuracy: 0.828 (2M) to 0.844 (100M), 1.6% gainImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy