Engineering

Session Runtime: Lower p95 Latency During Operator Bursts

Reduced p95 latency in the session/runtime path under burst traffic. No contract changes.

This release refactors internal routing and context caching in the session gateway. The primary objective was to keep latency stable under mixed-tenant burst profiles.

Across synthetic and production-like test loads, p95 latency dropped while preserving strict token validation and complete audit logging.

No API contract changes are required for integrators. Existing launch payloads and callback formats remain compatible.

Back to News