atlas

Research map / Large language models / Retrieval and knowledge

Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictors

ICLR 2024 · Large language models › Retrieval and knowledge · approach: Knowledge graph reasoning with LLMs

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Rethinks query-embedding complex query answering by formalizing EFO queries, shows prior tree-form formulation is not a subset of EFO, adds a 10-formula real EFO dataset, and proposes FIT, a fuzzy-logic neural-symbolic method on pretrained link predictors.

Problem

Complex query answering on incomplete knowledge graphs is usually studied via tree-form queries under query embedding, which does not cover the full family of existential first-order (EFO) queries; prior formulations are syntactically and semantically unsound for general EFO queries.

Approach

Characterize tree-form queries, show they are not a subset of EFO, define EFO queries as multigraph query graphs, and apply fuzzy t-norm/t-conorm semantics over neural link predictor matrices with a stepwise graph-reduction inference (FIT) that is differentiable and provably faithful/perfect.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use FIT instead of QTOReal EFO query answering · FB15k-237MRR (%): 21.8 -> 23.9Helped
Use FIT instead of QTOReal EFO query answering · FB15kMRR (%): 53.4 -> 64.8Helped
Use FIT instead of QTOReal EFO query answering · NELLMRR (%): 35.3 -> 37.3Helped
Use FIT instead of CQDTree-Form positive query answering · FB15k-237MRR (%): 25.3 -> 27.4Helped
Use FIT instead of LMPNNTree-Form negative query answering · FB15k-237MRR (%): 8.5 -> 13.4Helped
Use FIT instead of CQDTree-Form positive query answering · FB15kMRR (%): 68.5 -> 72.5Helped
Use FIT instead of LMPNNTree-Form negative query answering · FB15kMRR (%): 20.9 -> 35.5Helped
Use FIT instead of CQDTree-Form positive query answering · NELLMRR (%): 31.8 -> 33.4Helped
Use FIT instead of LMPNNTree-Form negative query answering · NELLMRR (%): 8.9 -> 13.2Helped

Surprising findings

Limitations

Experimental setup

Datasets: FB15k-237 FB15k NELL BetaE query dataset

Benchmarks: Real EFO dataset (new) BetaE query dataset (tree-form, FB15k-237, FB15k, NELL)

Metrics: MRR

Baselines: BetaE LogicE ConE QTO CQD LMPNN

Builds on: BetaE CQD QTO LMPNN ConE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy