Research map / Large language models / AI and society
PEAK: Pyramid Evaluation via Automated Knowledge Extraction
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use PEAK's automatically generated pyramid instead of a human-made pyramid P2 for scoring (ablation) | PEAK scoring · Student summaries, correlation with manual P1 scores | Pearson correlation: 0.8538 -> 0.8263 | Hurt |
| use PEAK's automatically generated pyramid instead of a human-made pyramid P2 for scoring (ablation) | PEAK scoring · Student summaries, correlation with manual P2 scores | Pearson correlation: 0.8112 -> 0.7769 | Hurt |
Closest papers by meaning
- BooookScore: A systematic exploration of book-length summarization in the era of LLMs (ICLR 2024 · similarity 0.84)
- PersonalSum: A User-Subjective Guided Personalized Summarization Dataset for Large Language Models (NeurIPS 2024 · similarity 0.83)
- Unsupervised Extractive Summarization with Learnable Length Control Strategies (AAAI 2024 · similarity 0.82)
- Learning from Failure: Improving Meeting Summarization without Good Samples (AAAI 2024 · similarity 0.82)
- Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education (AAAI 2024 · similarity 0.82)
- Language Models of Code Are Few-Shot Planners and Reasoners for Multi-Document Summarization with Attribution (AAAI 2025 · similarity 0.82)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.