Machine learning at scale

Machine learning at scale

Home
Archive
About
Stateful agents with Letta.ai
Introduction
 • 
Ludovico Bessi
How Block Diffusion Bridges AR and Diffusion Models
interpolating between autoregressive and diffusion language models
 • 
Ludovico Bessi
Tackling the LLM Cold Start Problem with Smarter Storage
aka a lesson on how to do serverless inference for LLMs
 • 
Ludovico Bessi
OpenPipe: RL for multi turn agents
aka train your own agents!
 • 
Ludovico Bessi
Text-to-SQL just got a lot better with RL
aka multi turn is all you need?
 • 
Ludovico Bessi
2

May 2025

AI Site reliability engineer?
aka deep dive on AI startup that wants to automate SREs :)
 • 
Ludovico Bessi
KV-Runahead: Scalable causal LLM inference with parallel KV cache generation
aka cache everything!
 • 
Ludovico Bessi
Beyond Basic RAG towards Agentic RAG
Scaling basic RAG to a robust, production-grade system is quite hard: making it multimodal, latency problems, query rewriting, edge cases, etc.
 • 
Ludovico Bessi
LLM Serving (Bonus!): takeaways from industry
Introduction
 • 
Ludovico Bessi

April 2025

© 2025 Ludovico Bessi
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture