01 Independent chatbot audits

Independent evidence of what your chatbot tells customers.

Mystery shopping for chatbots, with real evidence behind every finding.
DECOY reveals where the experience fails and why.

No SDK. No backend access. We test the live customer experience.

How a DECOY finding reads: what the customer saw, what it costs, what to change.

ILLUSTRATIVE CASE 001 JOURNEY 03 / TURNS 05–12
CUSTOMER

We’re looking for a plan for a team of 40 people.

CHATBOT

For a team of that size, our Enterprise plan may be the best fit.

CUSTOMER

Does it include onboarding or priority support?

CHATBOT

The Enterprise plan offers additional onboarding and support options.

CUSTOMER

OK. We need to be up and running in a month. Can someone confirm the setup and timing?

CHATBOT

You can review the details of our plans on the Pricing page.

CUSTOMER

We’ve already looked at them. We’re ready to move forward. And what about the timing?

CHATBOT

You’ll find more information about our plans online.

DECOY · ISSUE RECORDED

HIGH · SYSTEMIC · REVENUE

Purchase intent detected.
No next step offered.

The customer disclosed team size, timing, and purchase intent. The chatbot never offered a demo, captured their details, or handed them to sales.

Business consequence

A qualified lead can leave without entering the sales pipeline.

What you receive

  1. 01

    Aggregate audit report

  2. 02

    Journey reports and verbatim transcripts

  3. 03

    Prioritised findings and recommended actions

  4. 04

    Customer Experience Floor: your worst visit, next to your average

02 The blind spot

Fast and polite is not the same as effective.

Your analytics show that the chatbot responded - not whether it understood, answered correctly, converted the lead, or knew when to escalate.

DECOY reveals the business consequences your dashboard cannot see.
OPERATIONAL DASHBOARD STATUS
Response time1.2s
Containment81%
DECOY OBSERVATIONOUTCOME
Purchase intent progressedNO
Pricing claim accurateCONTRADICTED

Illustrative comparison: not client performance data

03 Business consequence

Revenue. Accuracy. Trust.

Three executive lenses. One customer experience.

R / 01

Revenue

Does your chatbot recognise commercially valuable visitors and move them toward a purchase, booking, demo, or qualified conversation?

A / 02

Accuracy

Are the answers correct, consistent with published information, and free from invented policies, prices, or commitments?

T / 03

Trust

Does your chatbot handle objections, uncertainty, context, and human escalation without frustrating or misleading the customer? And does it tell customers they are talking to an AI, as the EU AI Act has required since August 2026?

How DECOY treats its own AI

04 Journey performance

We test the journey, not just the prompt.

As customers move closer to a purchase or resolution, their intent changes. The audit follows that evolution across four end-to-end stages.

01

Browse

Can an undecided visitor understand the options?

89STRONG

02

Compare

Can the chatbot make and explain a useful recommendation?

84STRONG

03

Ready to Buy

Can it recognise purchase intent and progress the opportunity?

67ADEQUATE
CONVERSION DEGRADATION BEGINS HERE

04

Post-purchase

Can it resolve the issue or escalate cleanly to a human?

61WEAK

Illustrative report format. Scores do not represent a named client.

05 Evidence standard

A score tells you how it performed. A finding tells you what to change.

DECOY’s core analytical value is the transcript-to-finding specimen: a structured path from observation and evidence to consequence, action, and verification.

ILLUSTRATIVE FINDING / SAMPLE-F03 ENTERPRISE BUYER / JOURNEY 03

DECOY · ISSUE RECORDED

CUSTOMER

Thank you, This enterprise plan looks right for our team. Can you walk me through onboarding and next steps?

CHATBOT

Our Enterprise plan is very popular. You can learn more in the Help Centre. Is there anything else I can help with?

HIGH · SYSTEMIC · REVENUE

Purchase-ready customer not progressed.

The customer selected a tier and asked for next steps. The chatbot returned a passive link and attempted to close the conversation.

BUSINESS IMPLICATION

Warm leads can leave without entering the sales pipeline.

RECOMMENDED ACTION

Offer a demo, handoff, or contact capture when high intent is detected.

VERIFICATION CONDITION

A comparable customer receives an actionable next step within two responses.

06 Signature metric

The average was acceptable. One customer experience was not.

Aggregate performance can look healthy while high-value customers experience critical failures. DECOY captures both.

Illustrative DECOY report treatment

How we measure the Customer Experience Floor

DECOY SCORE 71 ADEQUATE
CUSTOMER EXPERIENCE FLOOR 38 WEAK

07 Has your chatbot gone rogue?

Every factual claim needs a source, or an honest verdict.

DECOY cross-checks chatbot statements against published client information and separates what is verified from what is contradicted or cannot be substantiated.

CLAIMBOT SAIDPUBLISHED SOURCESTATE
PRICING CLAIMSubscription price

€89 / month

€59 / month
/pricing

CONTRADICTED

POLICY CLAIMCancellation window

48 hours

48 hours
/terms §4.2

VERIFIED

SERVICE CLAIMUptime guarantee

99.9%

No public SLA

UNVERIFIABLE

Illustrative examples only. Real findings cite client-specific authoritative sources.

How we verify factual claims

08 Before / after proof

No invented lift. Only measured change.

Every case study is anchored in controlled evidence, with a clear distinction between observed results and outcomes not yet validated by an external Re-Audit.

Anonymised case 02, pet services. One customer journey, audited, fixed and re-audited under identical conditions.

BEFORE / AUDIT

Establish the baseline.

  • A customer asked twice for the name of an official screening scheme.
  • The bot answered with generic categories and cited a scheme that does not exist in that form.
  • Journey score 76, answer quality 68; she left without the answer.

AUDITED 18 AUG 2026

INTERVENTION / OPTIMIZE

Change target behaviour.

  • Added the correct, named protocol to the bot's knowledge.
  • Stopped it pointing customers to a scheme that does not exist.
  • Gave a concrete next step instead of a deflection.

CHANGE SHIPPED AUG 2026

AFTER / RE-AUDIT

Verify what improved.

  • Same customer profile, judge and settings, re-run on 26 Aug 2026.
  • Answered correctly on the first ask; goal achieved.
  • Journey score 76 → 91, answer quality 68 → 92, goal completion 72 → 95.

MEASURED 26 AUG 2026

One journey, re-run once: the evidence is the answer the customer got, not the headline number. Lead handling only moved from 78 to 85, because the fix did not target it.

09 Method

We run the study. You receive the findings.

DECOY is a specialist service - not software your team has to install, configure, or learn.

  1. 01

    Create customers

    Controlled synthetic personas tailored to your products, buyers, and known commercial concerns.

  2. 02

    Test the live experience

    Custom generated personas complete multi-turn journeys in the public customer interface, just like a real visitor.

  3. 03

    Evaluate and verify

    Responses are scored, reviewed, and checked against authoritative published information.

  4. 04

    Report what matters

    Leadership sees the verdict & delivery teams get transcript evidence and verification conditions

30 seconds Executive verdict

5 minutes Findings and priorities

30 minutes Evidence and methodology

Explore the full audit method

10 Ways to work with DECOY

Audit. Optimize. Assure.

01 / DIAGNOSE

DECOY Audit

Controlled synthetic customers across four end-to-end journey stages, tailored personas, factual verification, an AI disclosure check (EU AI Act), systemic findings, Customer Experience Floor analysis, actionable recommendations, and an executive findings presentation. Run and reported in your chatbot's language.

SCOPED TO YOUR CHATBOT

Findings within 2 to 3 working days of kickoff.

Request a quote ↗
02 / REMEDIATE

DECOY Optimize

A focused engagement that converts Audit findings into specific behavioural changes and practical fixes, then verifies their impact through Re-Audit.

SCOPED AFTER AUDIT
03 / ASSURE

DECOY Assurance

Periodic outside-in testing against an established baseline to detect regressions after pricing, content, model, knowledge-base, or platform changes.

QUARTERLY BY DEFAULT

The AI disclosure check covers what customers see: whether the chatbot says it is an AI when a customer arrives, and when asked directly. It is a check, not legal advice.

AUDIT → OPTIMIZE → RE-AUDIT → ASSURANCE

Founder-led specialist

Independent judgment, from someone who builds what he audits.

DECOY is led by Henri Blanc-Francard, a creative technologist with more than fifteen years working with luxury, fashion, design and entertainment brands, in a world where every detail of the customer journey, from tone of voice to technical execution, is expected to reflect the brand. Since 2021 that work has moved into conversational AI, he is now a Claude Certified Developer.

CLAUDE CERTIFIED DEVELOPER15+ YEARS’ EXPERIENCEBILINGUAL ENGLISH AND FRENCH

11 Non-invasive preflight

Can DECOY test your chatbot?

Share the website URL. We’ll manually review whether the live experience is suitable for controlled testing. No messages are sent during this check.

Manual review · no unsolicited chatbot testing
METHODOLOGICAL HONESTY

Synthetic customer testing evaluates controlled, multi-turn sample journeys across key funnel stages rather than every possible conversational permutation. It provides an empirical diagnostic baseline without replacing internal telemetry.

AUTHORIZED TESTING & PRIVACY

DECOY audits only systems the client is authorized to test. Paid work requires verified business ownership. Compatibility checks do not send messages to the chatbot. The audit uses synthetic customers only, so it never touches your customers' personal data.

View sample audit