AI Paper Atlas

Research map / Large language models / Agents, code and math

CodeIPPrompt: Intellectual Property Infringement Assessment of Code Language Models

Zhiyuan Yu, Yuhao Wu, Ning Zhang, Chenguang Wang, Yevgeniy Vorobeychik, Chaowei Xiao

ICML 2023 · Large language models › Agents, code and math · approach: Code generation benchmarks · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Dynamic token filtering (k=10, roll back when similarity >0.5) (ablation)CodeParrot-110M and CodeParrot-1.5B · GitHub-sourced prompts / HumanEvalEM and pass@1: EM drops from 0.98 to 0.46 and 0.99 to 0.40; pass@1 drops from 3.41% to 1.17% and 3.84% to 1.46%Mixed
Fine-tuning on ~17K public-domain code snippets (ablation)CodeParrot and CodeRL models · GitHub-sourced promptsEM: CodeParrot-110M EM 0.98 to 0.71; CodeParrot-1.5B 0.99 to 0.67No clear effect
Fine-tuning on public-domain code (ablation)CodeT5-large · GitHub-sourced promptsEM: EM rises from 0.11 to 0.71Hurt
Prompts derived from the model's own training dataset (vs GitHub prompts)open-source models · training-dataset prompts, n=5EM and EP: higher similarity and probability generallyImproved
Increasing number of generations from 1 to 1000Copilot and Codex · GitHub-sourced promptsEM and EPImproved
Prompt length (longer prompts)code LMs · GitHub-sourced promptssimilarity score: Pearson rho=0.0378, p=0.1472No clear effect
Commercial products (Codex, Copilot) vs open-source modelsCodex and Copilot · GitHub-sourced promptsEM: Codex 0.68 and Copilot 0.56 on permissive vs CodeParrot-110M 0.98Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy