reading
Reading group sessions on non-autoregressive language models and related topics.
Our reading group meets regularly to survey research areas and dive into individual papers on masked diffusion, insertion models, edit-based generation, and adjacent topics.
- Paper
Towards More Flexible and Efficient Non-Autoregressive Language Models
Speakers: Dhruvesh Patel , Benjamin Rozonoyer
Insertion Based Sequence Generation with Learnable Order Dynamics
Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
A joint IESL talk on learnable insertion-order dynamics and relayed latent computation for non-autoregressive language models.
- Overview
Continuous Diffusion for Text
Coordinators: Dhruvesh Patel , Benjamin Rozonoyer
- Continuous Diffusion for Categorical Data
- SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
- CANDI: Hybrid Discrete-Continuous Diffusion Models
- The Diffusion Duality
- Continuously Augmented Discrete Diffusion Model for Categorical Generative Modeling
- ELF: Embedded Language Flows
- Self-conditioned Flow Map Language Models via Fixed-point Flows
A survey of continuous, hybrid, and flow-based diffusion models for text and categorical sequence generation.
- Overview
Recursive Reasoning
Coordinators: Benjamin Rozonoyer
- Hierarchical Reasoning Model
- Less is More: Recursive Reasoning with Tiny Networks
- Probabilistic Tiny Recursive Model
- Generative Recursive Reasoning
- Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
- Residual Context Diffusion Language Models
- VGB for Masked Diffusion Model: Efficient Test-time Scaling for Reward Satisfaction and Sample Editing
- Backpropagation through space, time and the brain
Tiny recursive reasoning models and related diffusion extensions for iterative computation.
- Overview
Speculative Decoding
Coordinators: Benjamin Rozonoyer
- Fast Inference from Transformers via Speculative Decoding
- Accelerating Large Language Model Decoding with Speculative Sampling
- Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
- EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
- EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees
- EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test
- Cascade Speculative Drafting for Even Faster LLM Inference
- Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
- Speculative Speculative Decoding
- DFlash: Block Diffusion for Flash Speculative Decoding
A tour of speculative and draft-based methods for faster autoregressive LLM inference.
- Overview
Block Diffusion
Coordinators: Benjamin Rozonoyer
- SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation
- TiDAR: Think in Diffusion, Talk in Autoregression
- Introspective Diffusion Language Models
- Fast-dLLM v2: Efficient Block-Diffusion LLM
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation
Systems-level papers on block-wise and hybrid diffusion–autoregressive sequence generation.
No sessions match the selected filters.