AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Can Embeddings Adequately Represent Medical Terminology? New Large-Scale Medical Term Similarity Datasets Have the Answer!

Claudia Schulz, Damir Juric

AAAI 2020 · Label-efficient and robust learning › Recognition and long-tail · approach: Multilingual language representation pretraining · 12 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Fuzzy Jaccard instead of other tested word-embedding similarity metrics (ablation)Medical word embeddings · New large-scale medical term similarity datasetsaccuracyImproved
Use pairwise word-similarity metrics rather than term-vector aggregation (ablation)Medical word embeddings · New large-scale medical term similarity datasetsaccuracyHurt
Include MeSH thesaurus information in the embeddingsMedical word embeddings · Hard Levenshtein-negative datasetsaccuracy: 58.5; 55.6; 61.4; 61.2; 64.2Improved
Evaluate on hard rather than easy term pairs, where positive and negative pairs can differ lexically in misleading waysMedical term embeddings · Levenshtein-negative datasetsaccuracy: 78.3 -> 58.5Hurt
Use contextual embeddings for hard term pairsContextual embeddings · Hard Levenshtein-negative datasetsAUCHurt
Use contextual embeddings for lexically similar easy pairsELMoPubMed · Easy Levenshtein-negative datasetsaccuracyImproved
Use random rather than Levenshtein-based negative samplingMedical word embeddings · New large-scale medical term similarity datasetsaccuracyImproved
Use small existing datasets rather than the new large-scale datasets for embedding comparisonsMedical term similarity evaluation · Existing medical similarity datasetsSpearman correlationNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy