Getting started Community Training Tutorials Documentation APIs, AI & Tools
In an agent network, most of a request's time is spent waiting on an LLM, an MCP tool, or another agent to respond. Rather than holding a thread idle during that wait, agent brokers use a non-blocking execution engine that frees the broker to make progress on other in-flight requests. Each request resumes as soon as its response arrives. As a result, a broker processes many requests concurrently rather than one at a time.



