High-performance AI agents are distributed systems
A technical case study on making FixBugs faster by treating LLM agents like distributed systems: chunking, streaming, queues, token math, and concurrency limits.
K
Kirti Rathore
11 min read
Posts tagged "microservices"
2 articles found
How To Build High Performance AI Agents - Insights from PyDelhi Talk
Key insights and strategies from my PyDelhi talk on building high-performance LLM agents that can process gigabytes of data and deliver results in under a minute, with lessons learned from optimizing FixBugs.
K
Kirti Rathore
2 min read