A Continuous Time Markov Chain Framework for Insertion Language Models accepted as a Spotlight at AISTATS 2026.