Back to blog
Tutorial

How to Build an AI Customer Support Agent in 2025 (Step-by-Step)

A practical guide to launching an AI support agent trained on your docs — from knowledge setup to widget deployment and human handoff.

January 15, 20268 min read

Customer expectations haven't slowed down — but headcount has. Support teams in 2025 are expected to resolve more tickets, across more channels, with fewer people. AI agents trained on your own documentation offer a practical path: automate repetitive questions while keeping humans focused on high-judgment work.

This guide walks through building a production-ready AI support agent on Mozo, from zero to embedded widget. No ML background required.

What you'll build

By the end of this tutorial, you'll have:

  • An AI agent trained on your help docs and website
  • A tested system prompt tuned for your brand voice
  • An embeddable chat widget on your site
  • Lead capture for questions the agent can't resolve
  • Analytics to measure deflection and escalation

Estimated time: 45–60 minutes for a first version.

Step 1: Audit your knowledge sources

Before uploading anything, list what your team already uses to answer tickets:

  • Help center articles (Intercom, Zendesk, Notion, etc.)
  • FAQ pages on your marketing site
  • Internal policy docs (shipping, returns, billing)
  • Onboarding guides and product changelogs

Prioritize by volume. Pull the top 20 questions from your ticket system (or ask your team). These become your evaluation set — the questions you'll use to test the agent before launch.

Start narrow

Launch with one product area or one language. A focused agent outperforms a "know everything" bot trained on messy, overlapping docs.

Step 2: Create your agent

Sign up for Mozo and create a new agent from the dashboard:

  1. Go to Dashboard → Agents → New Agent
  2. Name it clearly (e.g., "Acme Support Bot")
  3. Choose a model — GPT-4 Turbo or Claude 3 Sonnet work well for support; use GPT-3.5 Turbo or Claude Haiku if you're on the free plan and need lower latency
  4. Write a system prompt that defines tone, boundaries, and escalation rules

Example system prompt skeleton:

You are Acme's customer support agent. Answer using ONLY the provided context.

Rules:
- Be concise and friendly. Use the customer's name if provided.
- If you don't know the answer, say so and offer to connect them with the team.
- Never invent pricing, refund policies, or shipping dates.
- For billing disputes or account security issues, collect email and escalate immediately.

See the Agent Builder docs for all configuration options.

Step 3: Train on your content

Mozo supports four training source types. Use at least two for best results:

Upload files

PDF, DOCX, CSV, and TXT files work out of the box. Export your help center as PDF or upload raw docs. Mozo chunks and embeds the content automatically.

Crawl your website

Point the crawler at your docs subdomain or FAQ path. Set include/exclude patterns so you don't ingest blog posts or legal pages irrelevant to support.

https://docs.yourcompany.com/
Exclude: /blog, /changelog, /careers

Pro and Business plans include weekly auto-retrain so your agent stays current when docs change.

Add Q&A pairs

For high-volume questions, write explicit question-answer pairs. These override retrieval when matched closely — ideal for pricing, SLA, and return policy questions where exact wording matters.

Paste text snippets

Quick additions for one-off policies or temporary notices (e.g., holiday shipping delays).

After adding sources, click Process and wait for embedding to complete. Check the training dashboard for chunk counts and any processing errors.

Step 4: Test in the playground

Open Playground and run your evaluation set — those top 20 questions from Step 1.

For each answer, score:

  • Accurate? Does it match your official policy?
  • Complete? Would a customer need to ask a follow-up?
  • On-brand? Tone and formatting acceptable?

Iterate on:

  • Missing Q&A pairs for questions that fail
  • System prompt tweaks for tone and escalation
  • Excluding noisy crawled pages that confuse retrieval

Don't skip this step

Launching without playground testing is the #1 reason teams lose trust in AI support. 30 minutes of testing saves weeks of customer frustration.

Step 5: Configure lead capture and escalation

Not every question should be answered by AI. Set up lead capture for:

  • Sales inquiries ("I want a demo")
  • Unresolved questions (agent says "I'll connect you with the team")
  • Account-specific issues requiring human verification

Configure fields: name, email, and a free-text "How can we help?" field. Leads appear in your dashboard with the full conversation context attached.

Step 6: Deploy the widget

Mozo offers two deployment surfaces:

  • Embed widget — a floating chat bubble on any page (Embed Widget guide)
  • Hosted page — a full-page chat at /chat/{agentId} with no code required

For most support use cases, start with the embed widget on your help center and contact page.

Copy the script tag from Dashboard → Embed and paste before </body>. Customize colors, position, and welcome message to match your brand.

Configure security settings — allowed domains, rate limits, and optional authentication for internal agents.

Step 7: Measure and improve

After launch, monitor these metrics weekly:

MetricTargetAction if off-track
Resolution rate> 60%Add Q&A pairs for top failed topics
Escalation rate< 30%Improve training data or tighten prompt
CSAT / thumbs> 80% positiveReview negative conversations
Lead capture volumeSteadyTune escalation triggers

Use Analytics and Conversations to find patterns. Export conversations where the agent failed and turn them into new training data.

Common mistakes to avoid

  1. Training on everything. More data ≠ better answers. Curate ruthlessly.
  2. No escalation path. Customers who can't reach a human churn faster than customers who never tried AI.
  3. Set and forget. Docs change. Enable auto-retrain or schedule monthly reviews.
  4. Wrong model for the job. Use capable models for complex policy questions; lighter models for simple FAQs to control costs.

Next steps

Your first agent won't be perfect. Ship it, measure it, and improve it — that's how support teams in 2025 are doing more with less.

Continue reading

Comparison

Chatbase vs Mozo: An Honest Comparison

Compare Chatbase and Mozo on pricing, training, actions, analytics, and deployment — so you can pick the right AI agent platform for your team.

Your customers are waiting for a faster answer.

Join 10,000+ businesses using AI to resolve support tickets, qualify leads, and delight customers — automatically.

No credit card required · Cancel anytime · Setup in under 10 minutes