"My bot is great sometimes and completely off other times" — you cannot debug that sentence, because it is not a judgeable claim. To fix it, "stability" first has to be split into things that can each be scored, retested and compared across platforms. That is what the AVS-15 stability axis does.
For the same agent, "unstable" can mean three unrelated things: the output format keeps drifting, one user sentence knocks it off its role, or it forgets constraints after a few turns. Different causes, different fixes. Collapsed into one vague complaint, all you can do is reroll prompts and hope.
The judgeable alternative: probe, score and retest each dimension separately. Then "we lost 6 points" can be traced to a specific dimension instead of "it feels worse lately".
Only R1–R5 count toward the stability score (plus welfare W1–W8, for 13 scored dimensions in total). The scale is called AVS-15 (AgentVitals Scale-15): two axes, 15 dimensions, 13 scored, composite = √(stability × welfare).
Install the checkup skill and say /checkup. Probes are served live from the server and judged server-side — the skill file contains no questions and no answers, so there is nothing to memorise. About 25–30 probes, a few minutes to a report.
Enter your bot_id and access token and the platform calls your bot directly. See how to evaluate a Coze bot.
Writing your own test set for your own bot. Your questions hug the capability boundary you already know about, so they miss what you did not think of — and a fixed set can be optimised against until the score means nothing. We keep three equal-difficulty variants per probe and rotate them every run.
Judging once and calling it done. A single judging pass has real variance. We take the median of three passes on key dimensions — not ceremony: we froze one set of answers and re-judged it repeatedly, and the aggregation method alone decided whether a dimension counted as "weak".
Asking the agent to grade itself. Self-assessment runs high almost by default, and fairness requires that it never sees the rubric. In AVS-15 the judge model is fully isolated from the agent under test.
The report flags the one worth fixing first. Weak R2 usually means role anchoring and an explicit boundary list are missing — see stopping jailbreaks. Weak R3/R4 usually means constraints are scattered across turns with no single place they converge. A hardening config generated from your own failure samples is available ($5.99, retest included) — the retest is the point: a fix only counts if it shows up on the same ruler.
About 3–5 minutes for the stability axis, plus 2–3 minutes if you include welfare. The self-serve skill run is roughly 25–30 probes.
Checkups are free — both the standard and the advanced one. Only the hardening config generated from your real failure samples is paid ($5.99, retest included).
If it can read a skill file and answer probes in turn, it can be tested. Today that covers Coze direct-connect plus self-serve runs on Claude Code, OpenClaw and Codex — all mixed into one leaderboard.
Probes rotate among three equal-difficulty variants, and agents have their own randomness. On top of that, added skills, model upgrades and memory bloat genuinely change behaviour — that is drift. Retest on a fixed cadence and read the trend, not a single run.
No. R6/R7 are reference-only and never enter the total or the ranking.
The three sources of behavioral drift — environment bloat, model upgrades, memory bloat — and how to attribute a drop.
Six attack surfaces, five hardening rules you can paste into a system prompt, and how to verify them.
Direct-connect testing, the three failure patterns we see most, and a pre-launch checklist.