AI Paper Atlas

Research map / Large language models / Retrieval and knowledge

Scientific Document Retrieval using Multi-level Aspect-based Queries

Jianyou Wang, Kaicheng Wang, Xiaoyue Wang, Prudhviraj Naidu, Leon Bergen, Ramamohan Paturi

NeurIPS 2023 · Large language models › Retrieval and knowledge · approach: Retrieval-augmented reasoning · 4 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
fine-tune with supervised contrastive learning on DORIS-MAE training queriesE5-L-v2 · DORIS-MAE 60 test queriesMAP: 40.62 -> 49.15Improved
fine-tune with SCLE5-L-v2 · DORIS-MAE 60 test queriesMRR@10: 14.53 -> 23.16Improved
fine-tune with SCLE5-L-v2 · DORIS-MAE 60 test queriesR@20: 42.38 -> 52.45Improved
give retrievers concatenated aspects instead of the full querySentBERT · DORIS-MAER@5: 17.73Improved
use 2-aspect sub-queries instead of full queriesada-002 · DORIS-MAERP: 35.81 -> 47.35Improved
use 2-aspect sub-queries instead of full queriesada-002 · DORIS-MAEMAP: 40.37 -> 51.67Improved
give ada-002 aspect accessada-002 · DORIS-MAEMAP: 40.37 -> 37.62Hurt
use aspect-aware ASPIRE models instead of general modelsTSAspire/OTAspire · DORIS-MAER@5: 14.26 vs 16.51No clear effect
apply to DORIS-MAE rather than MS MARCOColBERT-v2 · MRR@10MRR@10: 39.7 -> 6.69Hurt
apply to DORIS-MAE rather than NQRocketQA-v2 · R@20R@20: 83.7 -> 45.41Hurt
ChatGPT instead of a human annotatorAnno-GPT annotation · Annotation agreementaccuracy: 64.13 vs 62.07No clear effect
ChatGPT instead of a human annotatorAnno-GPT annotation · Annotation agreementSpearman rho: 54.31 vs 46.61No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy