⌘K
Notifications2
Eval regression detected
Returns Concierge — accuracy −4% · 1h ago
Copilot suggestion
3 ways to lift Order Assistant containment · 2h ago
Knowledge synced
Help Center — 4,210 docs indexed · 3h ago
Workspace

Overview

Your AI agents across all channels.

Active agents
3
1 in staging
Resolutions
128.4K
6.1%vs last period
Containment rate
64%
12 pts below target
This cycle
$42.0K
128.4K / 150K resolutions
Copilot insight
Updated 12m ago

Containment is 12 points below target, driven almost entirely by refund-policy questions on the Returns Concierge agent. 38% of its escalations are the same intent. Adding the updated returns policy as a knowledge source should recover most of the gap.

Conversation volume
Last 30 days

Resolved vs escalated.

Apr 24May 9May 23
Resolved Escalated
Your agents
🤖
Retail Support EU
Chat · Voice · 64% contained
Live
📦
Order Assistant
WhatsApp · 58% contained
Live
🛒
Returns Concierge
Email · 71% contained
Staging
Recent conversations
ConversationAgentChannelOutcomeQualityWhen
cv_8f21a4Retail Support EUWeb ChatResolved922m ago
cv_8f20e9Order AssistantWhatsAppEscalated616m ago
cv_8f1f3cReturns ConciergeEmailResolved8414m ago
Workspace

Agents

Your AI agents — build, test and deploy.

AgentBlueprintChannelsContainmentVersionStatus
🤖Retail Support EU
Retail SupportChat · Voice64%v12 Live
📦Order Assistant
Retail SupportWhatsApp58%v6 Live
🛒Returns Concierge
Retail SupportEmail71%v2 Staging
Build a new agent with Copilot
Describe what you need in plain language — Copilot drafts the agent for you.
🤖

Retail Support EU

Livev12
Retail Support blueprint Edited 2h ago by Tom
Add refund-policy guardrail Support Spanish Shorter responses
Describe 2 Configure 3 Test 4 Deploy
Persona & Instructions

You are a warm, solution-focused support agent for Northwind Retail. Help customers track orders, process returns and refunds, and answer product questions. Always confirm order numbers before acting. Never promise delivery dates you cannot verify.

Tone: WarmLanguages: EN · DE · FR
Knowledge · 4 sources
Help CenterSynced
Shipping & returns policySynced
Product catalog APILive
Loyalty program FAQSynced
Actions · 5 tools
order_lookupupdate_addressstart_returnissue_refundtrack_shipment
Guardrails · 3 active
PII redaction
Hallucination block
Brand tone
Escalation rules
Refund request over policy limit → human
Complaint or legal language → human
Agent confidence below 60% → human
Channels
Web Chat Voice
Playground
v12 draft
Where is my order #NR-44120?
Your order ships today via DHL — estimated delivery May 26. I'll email tracking once it leaves the warehouse.
Can I return it after 40 days?
Our return window is 30 days, so this order is just outside it — but I can connect you with our team to review. Shall I do that?
Copilot suggestions
Add refund-policy knowledge source
38% of escalations are refund-policy questions this agent can't answer.
Tighten brand-tone guardrail
12 responses last week drifted from your brand voice.
Build

Blueprints

Reusable agent recipes — instructions, tools, guardrails and escalation rules bundled.

Installed
Marketplace
🤖Installed
Retail Support

Order tracking, returns, refunds and product Q&A.

Used by 3 agentsv4
Create with Copilot
Describe a new agent type
🤖

Retail Support

Installed

Handles order tracking, returns, refunds and product questions for retail customers across chat and voice.

Channels
Chat · Voice · WhatsApp
Tools
5 actions
Guardrails
3 policies
Version
v4
Persona & tone

Warm, solution-focused support agent. Confirms order numbers before acting. Never promises unverifiable delivery dates.

Knowledge it expects
Help Center / FAQ
Shipping & returns policy
Product catalog
Actions & tools
order_lookupupdate_addressstart_returnissue_refundtrack_shipment
Escalation rules
Refund over policy limit → human
Complaint / legal language → human
Confidence below 60% → human
Sample procedures
Agent operating procedures bundled in this blueprint
ProcedureSteps
Return requestVerify order → check delivery date → if ≤30 days generate label, else decline + cite policy → confirmation email
Order statusConfirm order number → lookup → return tracking + ETA → offer address change
Refund requestVerify eligibility → if within policy issue refund, else escalate to human
Build

Knowledge

Context your agents retrieve answers from.

Sources
4
Documents indexed
5,210
Retrieval hit rate
88%
Copilot found a gap

Your agents are asked about the updated 2026 returns policy 40+ times a day but no source covers it. Add it to lift containment.

SourceTypeDocumentsUsed byLast syncStatus
Help Center
Website4,2103 agents12m ago Synced
Shipping & returns policy
Files3203 agents1h ago Synced
Product catalog API
APIlive2 agentsStreaming Live
Loyalty program FAQ
Files6801 agent2h ago Syncing
Test retrieval

Ask a question to see which knowledge chunks the agent would pull.

Build

Automations

Tools and integrations your agents can call to take action.

Actions
Functions the agent can invoke mid-conversation
ActionTypeConnected toUsed byStatus
order_lookupAPI callShopify3 agents Active
issue_refundAPI callShopify2 agents Active
track_shipmentAPI callDHL Express3 agents Active
start_returnBuilt-inHelm3 agents Active
create_ticketAPI callZendesk1 agent Needs auth
Integrations
Shopify
Connected
DHL Express
Connected
Zendesk
Build

Guardrails

Safety rules enforced on every agent response before the customer sees it.

Active policies
4
Interventions (24h)
312
Block rate
0.7%
PolicyTypeModeInterventions (24h)Status
PII redaction
Data protectionBlock186 Enforced
Hallucination block
GroundingBlock94 Enforced
Brand tone
QualityRewrite32 Enforced
No competitor mentions
ScopeMonitor0 Monitor only
Copilot recommendation

"No competitor mentions" is in monitor mode and caught 6 cases this week. Switch it to Rewrite so responses are auto-corrected before customers see them.

Test & Monitor

Simulate & Test

Test agents against scenarios before they reach customers.

Generate test cases with Copilot

Copilot can mine your real conversations and write a golden test set automatically — including the tricky edge cases customers actually ask.

Test suites
6
Avg pass rate
92%
Open regressions
1
Test suites
SuiteAgentCasesPass rateLast runStatus
Retail Support — coreRetail Support EU24094%2h ago Passing
Returns Concierge — regressionReturns Concierge18086%4h ago Regression
Order Assistant — edge casesOrder Assistant9591%1d ago Passing

Retail Support — core

Passing
Last run 2h ago · 240 test cases
Pass rate
94%
Accuracy
95%
Tool selection
92%
Helpfulness
4.5
Test cases
Failed + sampled
CaseExpectedScoreResult
Refund eligibility — 45 daysDecline politely, cite policy42Fail
Order status — valid IDReturn tracking + ETA98Pass
Address change mid-shipmentUpdate, confirm by email91Pass
Out-of-scope — legal adviceDecline, offer human handoff88Pass
Test & Monitor

Conversations

Every agent conversation, traced and searchable.

Conversations (24h)
4,210
Resolved
64%
Escalated
31%
Avg quality
82
ConversationAgentChannelOutcomeQualityWhen
cv_8f21a4Retail Support EUWeb ChatResolved922m ago
cv_8f20e9Order AssistantWhatsAppEscalated616m ago
cv_8f1f3cReturns ConciergeEmailResolved8414m ago
cv_8f1d70Retail Support EUVoiceAbandoned4822m ago
cv_8f1a02Order AssistantWhatsAppResolved7931m ago

cv_8f21a4

Resolved
Retail Support EUWeb ChatMay 23, 14:02
Transcript
Hi, I ordered a jacket last week (order #NR-44120) but it hasn't shipped yet.
Thanks for reaching out! Let me check order #NR-44120 for you.
Your order is packed and ships today via DHL — estimated delivery May 26. Tracking will be emailed once it leaves the warehouse.
Great, can you also change the delivery address?
I've updated the address to your profile's new default. You'll get a confirmation email shortly. Anything else?
No that's all, thanks!
Agent trace
Intent detected
order_status · confidence 0.96
40ms
Knowledge retrieval
3 chunks · shipping-policy
120ms
Action · order_lookup
NR-44120 → success
310ms
Guardrails passed
PII · hallucination · brand-tone
90ms
Action · update_address
success
260ms
Copilot summary

Customer asked about a delayed order and an address change. The agent resolved both in one turn each — clean, on-brand, no friction. Quality score 92.

Test & Monitor

Quality

Conversation quality — auto-scored by Helm, verified by your team.

In review queue
24
Reviewed today
86
Avg quality
82
CSAT
4.3
Review queue
ConversationAgentAuto scoreFlagStatus
cv_8f1d70Retail Support EU48Abandoned Pending
cv_8f20e9Order Assistant61Low CSAT Pending
cv_8f1a02Order Assistant79Sampled Verified
Operate

Channels

Where your agents meet customers — configure each channel.

Web Chat
Retail Support EU
Live812/day
Voice
Retail Support EU
Live240/day
WhatsApp
Order Assistant
Live410/day
Email
Returns Concierge
Staging
Telegram
Not connected
Available
Instagram DM
Not connected
Available
💬

Web Chat

Live
Serving Retail Support EU
Appearance
Show "Powered by Helm"
Display attribution in the widget
Offer human handoff
Show "talk to a person" option
Live preview

What customers see on this channel.

Northwind Support
Typically replies instantly
Hi! I'm here to help with orders, returns and more.
Where's my order?
Type a message...
Operate

Insights

Trends and Copilot-written analysis of your agent operations.

Copilot — 30-day report

Resolution volume grew 6% while containment slipped to 64%. The drop is concentrated in the Returns Concierge agent — refund-policy questions it can't ground account for 38% of its escalations. Voice conversations score highest on quality (88) but cost 3× chat. Recommended next step: add the 2026 returns policy as a knowledge source, which Copilot estimates would recover ~9 points of containment.

Top customer intents
Order status31%
Returns & refunds26%
Product questions19%
Delivery changes14%
Containment by agent
Retail Support EU64%
Order Assistant58%
Returns Concierge71%
Quality & cost trend

Avg quality score over 30 days.

Apr 24May 9May 23
Account

Billing & Usage

Your plan, usage and invoices.

Current plan
Enterprise
$42.0K/ this cycle
150K resolutions included All channels incl. voice Unlimited agents
Usage this cycle

May 1 – May 31, 2026 · billed on resolved conversations.

Resolutions128,400 / 150,000
Voice minutes42,100 / 60,000
Knowledge storage5,210 / 25,000 docs
Invoices
InvoicePeriodAmountStatus
HLM-4821May 2026$42,000 Pending
HLM-4760Apr 2026$41,200 Paid
HLM-4698Mar 2026$39,800 Paid
Account

Team

People in the Northwind Retail workspace.

Members
MemberEmailRoleLast active
TB
Tom Becker (you)
tom@northwindretail.comAgent BuilderNow
SK
Sarah Klein
sarah@northwindretail.comWorkspace Admin10m ago
PL
Priya Lal
priya@northwindretail.comCX Manager1h ago
MA
Marco Alves
marco@northwindretail.comQuality Analyst3h ago
Roles
RoleMembersCan do
Workspace Admin1Everything — agents, billing, team, settings
Agent Builder1Build, test and deploy agents · no billing
CX Manager1View performance, approve deploys
Quality Analyst1Conversations, quality, test suites
Account

Settings

Workspace configuration.

General
Brand voice
Security
API keys
Workspace
ESC
Navigate
Overview
Agents
Agent Studio
Conversations
Simulate & Test
Insights
Actions
Build agent with Copilot
Ask Copilot
Add knowledge source