Dashboard

• The goal: route tickets without sending every one to an expensive LLM.
• Jev, a small decision model, sorts every ticket first. Only the ones it isn't sure about — confidence < 0.5 — or that contain PII go to Claude Haiku.
• Every number below comes from one run in which both models classified the same real banking queries.
• Each query has a known intent, mapped to one of the five departments; a model is right when its pick matches.
• The last section checks whether Jev's confidence actually tracks its accuracy.

Loading…