Model Traffic Proxy
Intercepts model completion requests on port 8080. Inspects prompts, compacts redundant conversational context, aligns KV-cache prefixes, and forwards to your configured model provider over TLS.
How Sabrix isolates model completions from consequential actions, binds approvals to exact parameter digests, injects credentials in-VPC, and records verifiable outcomes on a durable ledger.
POST /v1/chat/completions
→
Streaming Redaction + KV-Cache Align
POST api.stripe.com/v1/refunds
→
Policy Gate + SHA-256 Digest Verification
action_id: "act_88f2910c"
status: "AmbiguousInFlight" (HTTP 504)
policy: "HOLD_FOR_DESTINATION_EVIDENCE"
retry: "BLOCKED (Prevent duplicate charge)"
IN-VPC EXECUTION TOPOLOGY
Sabrix establishes two separate traffic paths inside your private cluster perimeter, backed by an isolated administrative ledger interface. Model reasoning passes through an L7 streaming proxy, while consequential downstream API mutations are guarded by an action execution forward proxy.
Intercepts model completion requests on port 8080. Inspects prompts, compacts redundant conversational context, aligns KV-cache prefixes, and forwards to your configured model provider over TLS.
Intercepts tool calls, MCP JSON-RPC, and HTTP APIs before execution. Actions within policy proceed automatically. Actions requiring approval pause until authorized by a matching parameter digest.
EXECUTION LIFECYCLE MECHANICS
Approvals are never broad permission grants. Human decisions bind to a canonical SHA-256 wire digest over target destination, account, and parameters. Any post-approval payload mutation immediately voids the decision.
Agents never hold downstream API keys, database passwords, or OAuth bearer tokens. Credentials remain isolated in-VPC and are injected by Sabrix only upon authorized dispatch.
Execution state is persisted through atomic record replacement with file and directory synchronization. When a downstream call times out, the outcome is recorded as AmbiguousInFlight rather than assumed failed.
Rather than blind retries, Sabrix uses supported destination checks or operator investigation to verify external evidence before deciding if another attempt is safe.
EVALUATION CONSIDERATIONS
Review your agent boundaries, approval policies, and recovery requirements with our systems engineering team.