atlas

Research map / Reinforcement learning / Visual and representation RL

Unveiling User Satisfaction and Creator Productivity Trade-Offs in Recommendation Platforms

NeurIPS 2024 · Reinforcement learning › Visual and representation RL · approach: RL with tree search for discovery · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes the Cournot Content Creation Competition (C^4) game to model how a relevance/exploration-controlled recommender affects creators' production volume, proves a unique Nash equilibrium and a user-satisfaction vs. content-volume trade-off, and optimizes per-user exploration strength via approximated gradient descent.

Problem

Recommendation algorithms on UGC platforms shape creators' production frequency, but existing creator-competition models ignore content creation volume; the trade-off between short-term user satisfaction and long-term content supply is unclear.

Approach

Model creators as choosing production quantity in a Cournot-style game where traffic is allocated by a personalized probabilistic matching (softmax over noisy relevance scores with per-user exploration strength beta); prove a unique PNE, show user satisfaction increases and content volume decreases in beta, and optimize beta via implicit-differentiation gradients with Sherman-Morrison-Woodbury ske

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
increase homogeneous matching precision by raising βC⁴ creator competition · Single-user setting (m=1)user satisfaction UHelped
increase homogeneous matching precision by raising βC⁴ creator competition · Single-user setting (m=1), β ≥ β₀content creation volume VHurt
increase homogeneous βC⁴ creator competition · Synthetic and MovieLens simulationsuser satisfaction UHelped
increase homogeneous βC⁴ creator competition · Synthetic and MovieLens simulationscontent creation volume VHurt
optimize personalized β with approximated gradient descent instead of exact matching for all usersPPM recommendation policy, λ=0.5 · Synthetic and MovieLens environmentssocial welfare Wλ: over 20%Helped
use personalized β rather than homogeneous βPPM recommendation policy, λ=0.5 · Synthetic and MovieLens environmentssocial welfare WλHelped
assign smaller β (more exploration) to less selective usersOptimized personalized PPM policy · Synthetic and MovieLens environmentssocial welfare WλHelped

Surprising findings

Limitations

Experimental setup

Datasets: MovieLens-1m

Benchmarks: synthetic clustered environment (m=1000 users, n=200 creators) MovieLens-1m simulated environment

Metrics: total user satisfaction U total content creation volume V social welfare W_lambda

Baselines: exact matching (beta=100 deterministic) homogeneous beta

Builds on: Content Creator Competition (C^3) Tullock contest Cournot competition multi-agent mirror descent

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy