High-performance AI agents are distributed systems
A technical case study on making FixBugs faster by treating LLM agents like distributed systems: chunking, streaming, queues, token math, and concurrency limits.
K
Kirti Rathore
11 min read
Posts tagged "llm optimization"
3 articles found
Engineering approach: Startup Mode v/s Big Tech Mode
Discover why Big Tech performance engineering practices can destroy startup velocity. Learn when to optimize and when to move fast, with real examples from Figma and Stripe.
K
Kirti Rathore
7 min read
How To Build High Performance AI Agents - Insights from PyDelhi Talk
Key insights and strategies from my PyDelhi talk on building high-performance LLM agents that can process gigabytes of data and deliver results in under a minute, with lessons learned from optimizing FixBugs.
K
Kirti Rathore
2 min read