Runtime control plane · v1

Monitor and control AI agents in production.

AI Sage is the runtime control plane for production AI agents — helping teams detect drift, stop runaway executions, enforce policies, and debug failures.

Built for teams moving AI agents from demos to real workflows.

app.trysage.cc / agents / refund-agent-prod

refund-agent-prod

production

Agent Health Overview · last 24h

Active agents
24
+2 this week
Fallback rate
2.8%
+0.9% vs 7d
Cost today
$428
−12% vs avg
P95 latency
1.8s
+220ms
Tool failures
0.4%
−0.2%
Fallback spike detected
Investigating

Fallback rate rose from 1.1% to 4.6% over 12 minutes. Correlated with prompt version v42 → v43.

Correlation timeline
last 30 min
  1. Prompt version updated v42 → v4314:02
  2. Error rate climbed past threshold (2.5%)14:09
  3. Fallback spike — incident opened14:14
  4. Agent paused by operator14:16
  5. Safe fallback enabled · traffic stable14:17
The problem

AI agents do not fail like normal software.

Traditional logs and dashboards are not enough once agents can reason, call tools, spend tokens, and take action on behalf of your users.

Agents drift silently

Prompt changes, model updates, or context shifts can alter behavior without a clear deploy failure.

confidence ↓ 14%

Agents can run away

Loops, retries, and repeated tool calls can burn tokens and budgets quickly.

tokens / run · 42k

Agents cross boundaries

Without runtime policies, agents may call the wrong tools, access the wrong data, or act outside approved limits.

tool: refund.issue · blocked

Failures are hard to explain

Multi-step traces are noisy, fragmented, and hard to reconstruct during incidents.

trace spans · 213
Core promise

Detect. Stop. Explain. Prevent.

AI Sage gives AI teams the operational layer they need after an agent goes live.

Detect

Detect drift, fallback spikes, cost anomalies, latency degradation, schema failures, and tool error patterns.

Stop

Pause an agent, force fallback, throttle traffic, or trigger spend caps before the issue spreads.

Explain

Reconstruct the full agent conversation with tool calls, prompt versions, model usage, latency, token cost, and policy decisions.

Prevent

Enforce governance policies across agents, users, workflows, and environments.

Platform

Everything your production agents need to stay under control.

max_cost_per_run$0.40
allowed_toolslookup, refund.preview
blocked_toolsrefund.issue
min_confidence0.78

Auto-Syncing Policy Engine

Define confidence thresholds, rate limits, spending caps, allowed tools, and fallback rules. Sync to live workflows and SDK-connected agents.

await sage.guard(async (ctx) => {
  const reply = await agent.run(input);
  ctx.assert.cost.below(0.4);
  return reply;
});

Active Intervention SDK

A lightweight JS/TS SDK that instruments execution, captures traces, checks policies, and blocks prohibited actions in real time.

PauseForce fallbackThrottle 50%Spend cap $200Resume

Emergency Controls

One-click controls to pause an agent, force fallback, resume traffic, or apply temporary incident restrictions.

Fallback rate · 14d
+18%

Drift & Degradation Radar

Track 7- and 30-day trends across confidence, latency, fallback rate, schema failures, tokens, and tool errors.

Prompt v42 → v43
Model gpt-4o → gpt-4o-mini
Error rate +3.4%
Incident opened

Correlation Timeline

See what changed before a failure. Correlate prompt edits, model switches, policy changes, deploy markers, and error spikes.

user · refund my order #4827
tool · order.lookup → 200ms
model · gpt-4o · 1.2k tok
policy · spend cap hit
fallback · escalated to human

Conversation Story View

Reconstruct the entire user-agent interaction across prompts, tool calls, retries, fallbacks, latency, tokens, and final responses.

Likely cause: retrieval tool skipped after prompt v43 removed the {{context}} block. Suggested fix: revert to v42 or reinsert context placeholder.

AI Root Cause Summary

Generate evidence-based failure summaries that explain the likely issue and recommend the next debugging step.

in tok
1.2M
out tok
318k
cost
$428

Cost Intelligence

Track tokens, model usage, cost per run, cost per agent, and spend velocity. Detect runaway usage early.

support@trysage.ccowner
ops-teamoperator
support-leadpause-only
team@trysage.ccread-only

Agent-Level RBAC

Control who can view, edit, pause, configure, or deploy agents across environments.

How it works

Add a control plane without rebuilding your agents.

01

Connect your agent

Install the SDK or connect an n8n workflow.

02

Define policies

Set spend limits, tool permissions, fallback rules, confidence thresholds, and environment-specific controls.

03

Monitor and intervene

Watch health metrics, investigate traces, pause agents, force fallbacks, and resolve incidents from one dashboard.

agent.tstypescript
import { AISage } from "@ai-sage/client";

const sage = new AISage({
  agentId: "refund-agent-prod",
  apiKey: process.env.AI_SAGE_API_KEY,
});

// guard a run with policies + tracing
await sage.guard(async (ctx) => {
  const reply = await agent.run(input);
  ctx.assert.cost.below(0.4);
  return reply;
});
Architecture
App / n8n workflow
AI Sage SDK
Policy check
LLM / Tools
Trace + Metrics
AI Sage Dashboard
Use cases

Built for agents that can affect real workflows.

Customer Support Agents

Prevent bad replies, escalation failures, runaway conversations, and unauthorized refund actions.

Refund & Billing Agents

Enforce spend limits, approval thresholds, audit trails, and fallback rules.

Healthcare Workflow Agents

Monitor reliability, enforce safe operating boundaries, and reconstruct decisions for auditability.

Internal Ops Agents

Control tool access, detect workflow loops, and pause unsafe automations.

n8n AI Workflows

Sync policies directly into live workflow automation and detect breakages before they spread.

Incident response

From incident to root cause in minutes.

A real failure walk-through: detect, intervene, investigate, and recover from a single workspace.

  1. Fallback rate spikes after a prompt edit.14:09
  2. AI Sage detects abnormal behavior.14:10
  3. Incident mode recommends action.14:11
  4. Operator clicks Pause Agent.14:12
  5. Correlation timeline shows prompt v43 deployed 14 min before spike.14:13
  6. Conversation Story View shows retrieval tool was skipped.14:14
  7. AI Sage suggests likely root cause.14:15
  8. Operator rolls back prompt and resumes agent.14:18
Incident #INC-2241 · refund-agent-prod
Active
Fallback rate
4.6%+3.5%
Fallback rate · 14d
+18%
Recommended action

Roll back prompt to v42.

AI Root Cause

Prompt v43 removed the {{context}} block, causing the retrieval tool to be skipped in 87% of runs. Reverting restores expected behavior.

Differentiation

More than traces. Runtime control.

Capability
Generic LLM tracing
AI Sage
Trace LLM calls
Yes
Yes
Track cost and latency
Yes
Yes
Pause live agent
Limited
Built in
Force fallback
Limited
Built in
Runtime policy enforcement
Limited
Built in
Agent-level spend caps
Limited
Built in
Config-to-failure correlation
Partial
Built in
Incident response workflow
Limited
Core workflow
Security & trust

Designed for production environments.

Redaction controls

Mask sensitive fields before traces leave your runtime.

Audit logs

Every policy change, prompt change, emergency action, and access event is recorded.

Environment controls

Separate development, staging, and production agents.

Role-based access

Give teams the exact level of access they need.

Configurable fail behavior

Fail-closed for sensitive workflows or fail-open with alerts for availability-sensitive ones.

Retention controls

Configure trace retention by environment and risk level.

Operational metrics

Track the signals that matter.

Active agents
0
Total executions
0
Cost today
$0
Cost prevented
$0
Fallback rate
0.0%
P95 latency
0.0s
Tool failure rate
0.0%
Schema failures
0.0%
Incidents detected
0
Incidents resolved
0
Policy violations blocked
0
Agents under SLA
0%
Pricing

Start small. Scale into production.

Developer

For testing and early agent projects.

Free
  • 1 agent
  • Basic traces
  • Cost tracking
  • Local / dev environment
  • Community support
Start free
Most popular
Team

For teams running production agents.

$99/month
  • Up to 5 agents
  • Runtime policies
  • Pause agent
  • Force fallback
  • Drift alerts
  • Conversation story view
  • 30-day retention
Start Team Trial
Growth

For teams operating multiple agents.

$599/month
  • Up to 25 agents
  • Advanced policies
  • Correlation timeline
  • AI root cause summaries
  • Semantic search
  • Audit logs
  • Slack alerts
  • 90-day retention
Book Demo

Need SSO, VPC, custom retention, or self-hosting? Talk to sales →

FAQ

Common questions.

Give your AI agents a control plane before they reach production.

Detect failures, stop runaway behavior, enforce policies, and debug incidents from one modern platform.

Built for teams that need AI agents to be reliable, governable, and safe.