atlas

Research map / Reinforcement learning / Visual and representation RL

Towards Effective Planning Strategies for Dynamic Opinion Networks

NeurIPS 2024 · Reinforcement learning › Visual and representation RL · approach: RL with tree search for discovery · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a ranking-algorithm-labeled GCN classifier and an RL-based deep value network planner with five reward variants to choose intervention nodes that limit misinformation spread in dynamic opinion networks.

Problem

Intervention planning to disseminate accurate information and contain misinformation in dynamic opinion networks; exhaustive label generation for node-blocking search becomes computationally intractable as networks grow, and continuous opinion/trust models are under-explored.

Approach

A brute-force ranking algorithm generates labels for training GCN classifiers that pick nodes to block, and a deep value network trained with RL (experience replay) avoids costly label generation for larger networks; five reward functions and three opinion/trust cases are compared.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use RL with GCN(10) instead of SL+GCN(25)intervention planner · Dataset v2, 50 nodes, degree 4, Case-1, action budget 1infection rate: 0.304 -> 0.1593Helped
Use GCN(10) instead of ResNet(50)RL planner · Dataset v2, 50 nodes, degree 4, Case-1, action budget 1infection rate: 0.199 -> 0.1593Helped
Add candidate-node count to the blocking-time reward (R3), forming R5RL planner · Dataset v2, 50 nodes, degree 4, Case-1, action budget 1, GCN(10)infection rate: 0.2958 -> 0.1607Helped
Use the blocking-time reward R3 instead of candidate-node reward R1RL planner · Dataset v2, 50 nodes, degree 4, Case-1, action budget 1, GCN(10)infection rate: 0.1608 -> 0.2958Hurt
Increase action budget from 1 to 3RL+R1, GCN(10) · Dataset v2, 50 nodes, degree 4, Case-1infection rate: 0.1608 -> 0.0597Helped
Use global infection-rate reward R4 instead of candidate-node reward R1RL planner · Dataset v2, 50 nodes, degree 4, Case-1, action budget 1, GCN(10)infection rate: 0.1608 -> 0.1593Helped

Surprising findings

Limitations

Experimental setup

Datasets: synthetic Watts-Strogatz networks Zachary's Karate Club Facebook Email Cora

Benchmarks: Dataset v2 (synthetic, 50 nodes, connectivity degree 4) Zachary's Karate Club Facebook Email Cora

Metrics: infection rate training MSE loss

Baselines: SL+GCN(25) RL+R0 RL+R3 ResNet(50)

Builds on: DQN DeGroot model GCN ResNet

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy