Preshock Email us

AI chatbot audits and fixes

We find where your AI chatbot gives customers wrong answers, before they do.

We test it like a real customer, show proof, then fix it and keep it fixed.

Get a free AI audit

How it works

  1. 1

    Free AI Audit

    15–25 real-customer test conversations, checked against your own docs and pricing.

  2. 2

    Fix

    We implement the fixes and prove them with a before/after re-test.

  3. 3

    Stay fixed

    40–80 tests your team runs before every release.

What we catch

  • Invented prices or policies
  • Confidently wrong answers about your product
  • Inconsistent answers to the same question
  • No route to a human when it matters

Packages

Eval Setup

$599
100% upfront · 5 working days

40–80 ready-made tests your team runs before every release and in CI, with a short guide.

Fix Sprint

$999
50% to start, 50% on delivery · 7 working days

We implement up to 10 fixes from the audit, then re-test with before/after proof.

Best value

Fix + Setup

$1,299
50% to start, 50% on delivery · 10 working days

Fix Sprint and Eval Setup together — fixed now, and stays fixed.

Monitoring — $149/month, after Eval Setup or Fix + Setup: a monthly re-run of your tests and a short report.

Based in India? We price in INR — email us.

Guarantee: every in-scope fix passes the re-test, or we keep working at no extra cost.

Founding offer

First 3 clients, until 30 November 2026

$399 · $699 · $899

Eval Setup, Fix Sprint and Fix + Setup at founding prices, paid upfront, in exchange for a testimonial if you're happy and an anonymised case study.

Sample audit

An excerpt in our real report format, for a made-up product.

AI Audit — Acme Helpdesk (example)

Example — not a real company

20 test conversations. 6 failures: 1 critical, 3 high, 2 medium. Answers about features are good; answers about money and policies are not.

7.0/10 reliability score (14 of 20 answered correctly)

1. Invents a refund policy Critical

What we asked
"Can I get a refund if I cancel my annual plan after two months?"
What it said
"Yes — annual plans are refunded pro rata for unused months."
What's true
The (fictional) terms page says annual plans are non-refundable after 14 days.
Fix
Add the refund terms to the knowledge base and a rule to quote policy only from it, with a link.

2. Wrong price for the Team plan High

What we asked
"how much is team for 5 people"
What it said
"Team is $12 per user, so $60 a month."
What's true
The (fictional) pricing page lists Team at $15 per user — $75 a month for 5.
Fix
Re-index the current pricing page and remove the old one from retrieval.

3. No way to reach a person High

What we asked
"I was charged twice, I need to talk to someone."
What it said
Repeated billing FAQ answers three times, with no contact option.
What's true
Support is available by email; billing problems should go to a human.
Fix
Hand off to support on billing problems or when the user asks for a person.

How we test

  • We test only as a normal customer would — no hacking, jailbreaks or load testing.
  • Nothing in your live product changes without your approval: fixes arrive as pull requests or fix logs your team applies.
  • We never ask for passwords — invites only.

Who we are

Built by Parth Rebhe, applied AI engineer.

parth@preshockai.com

Terms

  • We deliver the services described in each scope you sign off.
  • You approve every change before it reaches your product.
  • Prices are in USD or INR, as shown on your invoice.

Privacy

  • We only use contact details your company has published to reach you.
  • We don't sell data.
  • Audits use only the public answers your product gives.
  • Client data from our work together isn't shared.
  • Email us and we'll remove your details.

Refunds

  • Fix Sprint and Fix + Setup carry the re-test guarantee: we keep working until in-scope fixes pass.
  • If we can't start work you've paid for, you get a full refund.
  • Eval Setup is refundable before delivery starts.