Research map / Image generation / Editing and style transfer
StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model
Zipeng Xu, Enver Sangineto, Nicu Sebe
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use CLIP similarity as an RL reward on discrete tokens instead of directly optimizing CLIP score | StyleDALLE-1 · MS-COCO, AFHQ, ImageNet-100 | CLIP similarity score: 26.11 -> 30.61 (Fauvism, COCO) | Improved |
| remove image captions from the prompt-based reward | StyleDALLE-1 · style transfer (qualitative) | visual quality | No clear effect |
| add captions to the prompt-based reward | StyleDALLE-Ru · style transfer (qualitative) | content consistency | Improved |
| down-sample discrete tokens before the NAT model | StyleDALLE · style transfer (qualitative) | style incorporation | Improved |
| use Ru-DALLE VQGAN instead of DALL-E dVAE | StyleDALLE · user study | preference (%): 15.33 -> 68.76 | Improved |
Closest papers by meaning
- Language-Driven Artistic Style Transfer (ECCV 2022 · similarity 0.91)
- Multimodal Style Transfer via Graph Cuts (ICCV 2019 · similarity 0.90)
- ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank (AAAI 2024 · similarity 0.89)
- ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation (CVPR 2024 · similarity 0.88)
- Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer (CVPR 2024 · similarity 0.88)
- CSGO: Content-Style Composition in Text-to-Image Generation (NeurIPS 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
