Block Diffusion
Systems-level papers on block-wise and hybrid diffusion–autoregressive sequence generation.
Overview
Coordinators: Benjamin Rozonoyer
- SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation
- TiDAR: Think in Diffusion, Talk in Autoregression
- Introspective Diffusion Language Models
- Fast-dLLM v2: Efficient Block-Diffusion LLM
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation
Overview of block diffusion and hybrid diffusion–autoregressive paradigms for scalable sequence generation, drawn from the NAR LMs Reading Group collection.
Discussion points:
- How do block-wise decoding strategies trade off throughput and quality?
- What is shared across SDAR, TiDAR, and Fast-dLLM v2 — and where do they diverge?
- Can introspective consistency close the gap with autoregressive models?
- How does DiffusionBlocks relate to training vs. inference-time block structure?