Hover a stage, click it for detail.
01 · BACKEND FOUNDATION FastAPI, Pydantic, AsyncIO, Pytest. The service skeleton every later stage plugs into.
02 · LLM API & TOOL CALLING Structured outputs and streaming. Every tool call is schema-checked before it is allowed to run.
03 · AGENT ORCHESTRATION LangGraph state machine. Explicit transitions, so a run can be replayed and compared step by step.
04 · API & BUSINESS INTEGRATIONS REST, webhooks, OAuth 2.0, reconciliation. The layer where the agent meets the systems of record.
05 · RAG ENGINEERING Hybrid search, reciprocal rank fusion, reranking. Retrieval quality before prompt quality.
06 · RELIABILITY & RESILIENCE Circuit breakers and idempotency keys. An upstream failure degrades the run instead of cascading.
07 · SECURITY & AUTHORIZATION Deterministic RBAC and a sandboxed tool runtime. Permissions decided in code, never by the model.
08 · EVALUATION & REGRESSION Trajectory tests over golden datasets. Every prompt or model change is measured before it ships.
09 · SQL & STATE PERSISTENCE Postgres, Redis, checkpointing. Agent state survives a crash, a deploy and a restart.
10 · OBSERVABILITY Tracing and OpenTelemetry. Every run is inspectable from first tool call to final answer.
Swipe the figure sideways to reach the stages on the right.