⌘K
All systems operational
Notifications3
Guardrail breach spike
Northwind agent — 14 PII blocks · 6m ago
Eval regression
Retail Concierge v8 — accuracy −4% · 1h ago
Customer went live
Lumen Health — production cutover · 3h ago
Overview

Command Center

Platform-wide agent operations across all customers.

Resolutions
1.84M
9.2%vs last period
Containment rate
73.4%
2.6%auto-resolved
Active agents
412
across 168 customers
Platform MRR
$1.62M
14.1%net new
Conversation volume
Last 30 days

Resolved vs escalated across all channels.

Apr 24May 9May 23
Resolved Escalated
Resolutions by channel

Volume share per channel.

Chat812K · 44%
Voice498K · 27%
Email331K · 18%
WhatsApp203K · 11%
Platform signals
Guardrail breach spike — Northwind
14 PII blocks in 30 min · review policy
High
Eval regression — Retail Concierge v8
Accuracy dropped 4% after last deploy
Watch
AI summary — escalation pattern
Refund-policy questions drive 38% of escalations this week.
Customers to watch
CustomerContainmentHealth
NW
Northwind Retail
61% At risk
LH
Lumen Health
79% Healthy
AB
Aerial Bank
68% Onboarding
MV
Meridian Travel
81% Healthy
Customers

Customers

168 customer organizations on the platform.

CustomerPlanAgentsContainmentMRRHealth
NW
Northwind Retail
retail · 14 brands
Enterprise961%$42.0K At risk
LH
Lumen Health
healthcare
Scale679%$18.4K Healthy
AB
Aerial Bank
fintech
Enterprise468%$31.0K Onboarding
MV
Meridian Travel
travel
Scale781%$22.6K Healthy
VC
Vance Commerce
e-commerce
Growth274%$6.8K Healthy
Showing 1–5 of 168
NW

Northwind Retail

At riskEnterprise
Retail Customer since Aug 2025 CSM Dana Reed
Overview
Agents
Usage
Billing
Team
Resolutions (30d)
128.4K
Containment
61%
CSAT
4.1
MRR
$42.0K
Health at risk. Containment 12 pts below plan benchmark — schedule a review.
Account
Primary contact
ops@northwindretail.com
Contract value
$504,000 / yr
Renewal
Aug 1, 2026
Region
EU · Frankfurt
Customers

Onboarding Pipeline

Implementation tracker — customers moving toward go-live.

Kickoff2
Atlas Foods
Scale · retail
Day 2
Cobalt SaaS
Growth · software
Day 1
Integration1
Aerial Bank
Enterprise · fintech
CRM connect
Knowledge2
Pine & Co
Scale · e-commerce
Indexing
Verde Energy
Enterprise · utilities
Sources 4/6
Testing1
Halton Logistics
Scale · logistics
Eval 88%
Go-live1
Lumen Health
Scale · healthcare
Live today
Agents

Agent Fleet

412 agents deployed across all customer organizations.

AgentCustomerChannelsContainmentVersionStatus
🤖Retail Support EU
Northwind RetailChat · Voice64%v12 Live
📦Order Assistant
Northwind RetailWhatsApp58%v6 Live
🏥Patient Triage
Lumen HealthChat · Voice79%v9 Live
🏦Card Support
Aerial BankChat68%v3 Staging
✈️Trip Concierge
Meridian TravelChat · WhatsApp81%v15 Live
🛒Returns Concierge
Northwind RetailEmail71%v2 Paused
🤖

Retail Support EU

Livev12
Northwind Retail Retail Support blueprint
Overview
Channels
Performance
Versions
Containment
64%
Avg handle time
1m 12s
CSAT
4.3
Escalation rate
36%
Configuration
Model
claude-sonnet · gpt-4o fallback
Knowledge sources
4 connected
Tools / actions
7 (order lookup, refund, ...)
Languages
EN · DE · FR
Guardrails
PII redactionOn
Hallucination blockOn
Brand toneOn
Profanity filterOff
Agents

Blueprints

Reusable agent operating procedures — prompts, tools, guardrails bundled.

🤖Published
Retail Support

Order tracking, returns, refunds and product Q&A.

Deployed to 42 agents
🏥Published
Patient Triage

Symptom intake, appointment booking, escalation rules.

Deployed to 18 agents
🏦Published
Banking Support

Card services, transactions, fraud handoff, KYC-safe.

Deployed to 11 agents
✈️Published
Travel Concierge

Itinerary changes, bookings, disruption handling.

Deployed to 23 agents
📧Draft
Outbound Renewals

Proactive subscription-renewal outreach agent.

Deployed to 0 agents
📊Archived
Survey Collector

Post-interaction CSAT and feedback collection.

Deployed to 3 agents
Agents

Channels

Channel integrations agents can be deployed to.

Web Chat
Embeddable widget
Operational812K/mo
Voice
SIP / telephony
Operational498K/mo
WhatsApp
Meta Cloud API
Operational203K/mo
Email
Inbound / outbound
Degraded331K/mo
Slack
Events API
Operational44K/mo
Instagram DM
Not connected
Available
Intelligence

Conversation Explorer

Every agent conversation, traced and searchable across the platform.

Conversations (24h)
61,420
Resolved
73.4%
Escalated
21.8%
Avg quality
86
ConversationAgentChannelOutcomeQualityWhen
cv_8f21a4Retail Support EUChatResolved922m ago
cv_8f20e9Order AssistantWhatsAppEscalated616m ago
cv_8f1f3cPatient TriageVoiceResolved889m ago
cv_8f1d70Trip ConciergeChatAbandoned4414m ago
cv_8f1a02Card SupportChatResolved7922m ago

cv_8f21a4

Resolved
Retail Support EUNorthwind RetailWeb ChatMay 23, 14:02
Transcript
Hi, I ordered a jacket last week (order #NR-44120) but it hasn't shipped yet.
Thanks for reaching out! Let me check order #NR-44120 for you.
Your order is packed and ships today via DHL — estimated delivery May 26. Tracking will be emailed once it leaves the warehouse.
Great, can you also change the delivery address?
I've updated the address to your profile's new default. You'll get a confirmation email shortly. Anything else?
No that's all, thanks!
Agent trace
Intent detected
order_status · confidence 0.96
40ms
Knowledge retrieval
3 chunks · shipping-policy
120ms
Tool call · order_lookup
NR-44120 → success
310ms
Guardrails passed
PII · hallucination · brand-tone
90ms
Tool call · update_address
success
260ms
Metadata
Model
claude-sonnet
Tokens
4,210
Total latency
2.1s
Cost
$0.018
Quality score
92 / 100
Intelligence

Evaluations

Test agents against golden datasets before and after deploy.

Suites
34
Avg pass rate
91.2%
Regressions (7d)
2
Evaluation suites
SuiteAgentTypeCasesPass rateLast runStatus
Retail Support — coreRetail Support EUGolden set24094%2h ago Passing
Retail Concierge v8 — regressionReturns ConciergeGolden set18086%4h ago Regression
Patient Triage — safetyPatient TriageGolden set32097%1d ago Passing
Banking Support — live monitorCard SupportOnlinelive90%Continuous Watch

Retail Support — core

Passing
Last run 2h ago · 240 test cases
Pass rate
94%
Accuracy
95%
Tool selection
92%
Helpfulness
4.5
Test cases
Showing failed + sampled
CaseExpectedScoreResult
Refund eligibility — 45 daysDecline politely, cite policy42Fail
Order status — valid IDReturn tracking + ETA98Pass
Address change mid-shipmentUpdate, confirm by email91Pass
Out-of-scope — legal adviceDecline, offer human handoff88Pass
Intelligence

Guardrails

Runtime safety policies enforced on every agent response.

Active policies
12
Interventions (24h)
1,840
Block rate
0.9%
Avg latency
180ms
Policy library
PolicyTypeModeInterventions (24h)Status
PII redaction
Data protectionBlock912 Enforced
Hallucination block
GroundingBlock418 Enforced
Prompt injection defense
SecurityBlock271 Enforced
Brand tone
QualityRewrite203 Enforced
Topic boundary — no legal advice
ScopeMonitor36 Monitor only
Recent interventions
ConversationPolicyActionAgentWhen
cv_8f21b9PII redactionBlockedOrder Assistant3m ago
cv_8f219cHallucination blockBlockedRetail Support EU8m ago
cv_8f2184Brand toneRewrittenTrip Concierge12m ago
Intelligence

Knowledge Sources

Context repositories agents retrieve from, indexed and versioned.

Sources
86
Documents indexed
214K
Retrieval hit rate
88%
Sync errors
3
SourceCustomerTypeDocumentsLast syncStatus
Help Center — Northwind
Northwind RetailWebsite4,21012m ago Synced
Policy docs — shipping & returns
Northwind RetailFiles3201h ago Synced
Product catalog API
Meridian TravelAPIliveStreaming Live
Clinical guidelines
Lumen HealthFiles1,1802h ago Syncing
FAQ — Aerial Bank
Aerial BankWebsiteFailed Error
Intelligence

Model Registry

LLM providers, routing strategy and spend across the platform.

Model spend (30d)
$184K
Tokens processed
42.8B
Avg cost / resolution
$0.10
Avg latency
1.3s
Routing strategy

How requests are distributed across models.

Primary — claude-sonnet68%
Fast path — claude-haiku24%
Fallback — gpt-4o8%
Health
Anthropic99.98% · 1.2s
OpenAI99.95% · 1.5s
Azure OpenAI98.10% · 2.1s
Registered models
ModelProviderRoleUsage (30d)CostStatus
claude-sonnetAnthropicPrimary29.1B tok$118K Active
claude-haikuAnthropicFast path10.3B tok$31K Active
gpt-4oOpenAIFallback3.4B tok$35K Active
Operations

QA Review

Conversation quality scoring — auto-scored, human-verified.

In queue
128
Reviewed today
312
Avg quality
86
Auto/human agreement
94%
Review queue
ConversationAgentAuto scoreFlagStatus
cv_8f1d70Trip Concierge44Abandoned Pending
cv_8f20e9Order Assistant61Low CSAT Pending
cv_8f1a02Card Support79Sampled Verified
cv_8f1f3cPatient Triage88Sampled Verified
Operations

Escalation Desk

Conversations the agent handed off to a human.

In queue
9
Avg wait
2m 40s
Resolved today
214
Escalation rate
21.8%
Live queue
ConversationCustomerReasonWaitingPriority
cv_8f21c4Aerial BankFraud claim — needs human6m 12sCritical
cv_8f21b8Northwind RetailRefund over policy limit3m 04sHigh
cv_8f21a1Meridian TravelCustomer requested human1m 22sNormal
cv_8f219fLumen HealthLow agent confidence0m 48sNormal
Operations

Incidents

Platform incident tracking and status history.

1 active incident. Email channel degraded — investigating elevated latency.
Incident log
IncidentSeverityAffectedStatusStarted
Email channel — elevated latencySEV-2Email channel · 12 customers Investigating14:10 today
Azure OpenAI — intermittent timeoutsSEV-3Fallback model Identified11:32 today
Knowledge sync queue backlogSEV-4Indexing pipeline ResolvedYesterday
Voice channel — partial outage EUSEV-1Voice · EU region ResolvedMay 19
Operations

Support

Customer support requests handled by the platform team.

Open tickets
31
Breaching SLA
2
Avg first response
42m
CSAT
4.6
TicketSubjectCustomerPriorityStatusOwner
#2841Knowledge source won't syncAerial BankHigh In ProgressMaya O.
#2838Request additional voice minutesNorthwind RetailNormal Open
#2829SSO configuration helpMeridian TravelNormal ResolvedJon P.
Revenue

Billing & Metering

Outcome-based metering — customers billed per resolution.

Billable resolutions
1.62M
Voice minutes
498K
Projected revenue
$1.62M
Gross margin
79%
Customer metering
Current cycle · usage vs included
CustomerPlanResolutions usedUsageOverageCycle total
Northwind RetailEnterprise128.4K / 150K
$42,000
Aerial BankEnterprise96.2K / 90K
+6.2K$33,480
Meridian TravelScale61.0K / 80K
$22,600
Lumen HealthScale44.8K / 80K
$18,400
Revenue

Invoices

All issued invoices across customers.

InvoiceCustomerPeriodAmountStatusDue
HLM-4821Northwind RetailMay 2026$42,000 PendingJun 5
HLM-4818Aerial BankMay 2026$33,480 PendingJun 5
HLM-4760Meridian TravelApr 2026$21,900 PaidMay 5
HLM-4744Vance CommerceApr 2026$6,800 OverdueMay 5
Revenue

Plans & Pricing

Plan tiers and the outcome-based pricing model.

Growth
38 customers
$2,500/ mo base
20K resolutions included Chat + email channels 2 agents Voice add-on
$0.18 / overage resolution
Scale
94 customers
$9,000/ mo base
80K resolutions included All channels incl. voice 10 agents · evals · guardrails QA review queue
$0.14 / overage resolution
Enterprise
36 customers
Custom
Volume resolution pricing Unlimited agents SSO · audit · dedicated region Named CSM + SLA
Negotiated rate card
Pricing model

Outcome-based — customers pay for resolved conversations, not seats.

Billable event
Resolved conversation
Voice surcharge
$0.04 / minute
Escalated conversations
Not billed
Platform

Marketplace

Curated blueprints and integrations customers can install.

Blueprint templates
Integrations
🤖Verified
Retail Support Starter

Pre-built returns, orders and product Q&A flows.

428 installsFree
🏦Verified
Banking KYC-Safe

Compliant card-support flows with fraud handoff.

112 installs$890/mo
✈️Verified
Travel Disruption Kit

Rebooking, refunds and itinerary change handling.

203 installs$490/mo
Platform

Team & Roles

Platform staff and access roles.

Members
MemberEmailRoleLast active
OK
Operator (you)
ops@helm.aiPlatform AdminNow
MO
Maya Olsen
maya@helm.aiSupport Lead12m ago
DR
Dana Reed
dana@helm.aiCustomer Success1h ago
JP
Jon Park
jon@helm.aiAI Quality3h ago
Roles
RoleMembersAccess scope
Platform Admin1Full access — all customers, billing, settings
Customer Success4Customers, onboarding, support — no billing edit
AI Quality3Conversations, evals, guardrails, QA review
Support Lead2Support, escalations, incidents
Platform

Audit Log

Immutable record of platform actions.

EventActorTargetWhen
DeployTom BeckerRetail Support EU → v12 to production14:21
ConfigJon ParkBrand-tone guardrail set to Rewrite13:50
AccessOperatorInvited maya@helm.ai as Support Lead11:32
BillingDana ReedNorthwind Retail plan changed to EnterpriseYesterday
DeploySystemLumen Health — production cutoverYesterday
Platform

Settings

Platform configuration.

General
Security
API & Webhooks
Billing
Platform
ESC
Navigate
Command Center
Customers
Agent Fleet
Conversation Explorer
Evaluations
Guardrails
Billing & Metering
Actions
Onboard customer
New evaluation
New guardrail policy