Research map / Large language models / AI and society
Three Years of r/ChatGPT: Societal Impact Evaluations from Social Media Data
Jessica Dai, Sean Garcia, Emma Pierson, Benjamin Recht, Nika Haghtalab
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| launch of GPT-4o (May 13, 2024) as event in changepoint model | r/ChatGPT therapy and attachment features · r/ChatGPT 2022-2025 | post frequency: therapy 0.7% -> 3.0%; attachment 0.6% -> 3.8% | Improved |
| progress of adoption over three years | basic-use and application posts · r/ChatGPT 2022-2025 | post frequency: programming 5.0% -> 1.6% | Hurt |
| progress of adoption over three years | advanced-usage posts · r/ChatGPT 2022-2025 | post frequency: memory features 0.8% -> 3.1% | Improved |
| time shift in help requests | requests for help · r/ChatGPT | share within feature: how to use/guidance 61% -> 26%; not working as expected 17% -> 32% | Mixed |
| GPT-5 release replaced 4o | r/ChatGPT posts · Aug 7 to 14, 2025 | complaint share: 27.2% of posts carried a complaint feature | Hurt |
| use online sequential tests (PULSE) on the therapy feature | real-time monitoring · r/ChatGPT therapy feature | alert date: alert as early as October 29, 2024 | Improved |
| retrain featurization only when accuracy test rejects | PULSE · r/ChatGPT 2023-2025 | retraining events: three events: Sep 9, 2023; Apr 4, 2024; Apr 18, 2025 | Improved |
| swap SAE for k-means featurization (ablation) | feature discovery · r/ChatGPT features | 1-1 matched features: 83 matched, 6 SAE-only, 10 alt-only | No clear effect |
| swap SAE for PCA featurization (ablation) | feature discovery · r/ChatGPT features | 1-1 matched features: 76 matched, 10 SAE-only, 8 alt-only | No clear effect |
Closest papers by meaning
- WildChat: 1M ChatGPT Interaction Logs in the Wild (ICLR 2024 · similarity 0.83)
- Measuring And Improving Persuasiveness Of Large Language Models (ICLR 2025 · similarity 0.83)
- The Illusion of Empathy: How AI Chatbots Shape Conversation Perception (AAAI 2025 · similarity 0.83)
- Position: Generative AI Regulation Can Learn from Social Media Regulation (ICML 2025 · similarity 0.81)
- WildChat-50M: A Deep Dive Into the Role of Synthetic Data in Post-Training (ICML 2025 · similarity 0.81)
- Thousand Voices of Trauma: A Large-Scale Synthetic Dataset for Modeling Prolonged Exposure Therapy Conversations (NeurIPS 2025 · similarity 0.81)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
