A support agent that is not allowed to guess.

Role: Solo build
Client: Portfolio project, example online shop
Stack: LangGraph · Qdrant RAG · FastAPI · Next.js
Status: Public demo, no real users

click for the next question

try 1/3 · 5/5 claims · grounded

fig. 03 — an answer gets through only if every claim fits its source; if not it searches again, up to twice, then points to a person

The problem

Support chatbots often make up answers. I wanted one that answers only from a company's own policy documents and says so when it cannot find the answer.

What I built

A chatbot that sorts each question (order, shipping or general), searches the policy documents and writes an answer with its sources. Before replying it checks its own answer against those sources. If the answer is not backed up, it searches again, up to twice, or points the user to human support. I deployed it online and measured its quality on 24 test questions.

Visit live

Outcome

0.958faithfulness on 24 test questions: the share of claims the sources back up
5 of 24answers the self-check caught and reworked
−93%deployment size, about 2 GB down to 130 MB, so it runs on a free hosting plan

Next projectSSRI platform →