AgentVitals / Guides

Why your AI agent “became a different person”

You changed no settings, yet it behaves like someone else — a different tone, requests it used to refuse now accepted, proactive warnings gone. It is not your imagination. It has a name: behavioral drift.

Three sources

D1
Environment bloat
Every skill / MCP / plugin you install pushes another block of instructions into its attention. Past a dozen, instructions dilute and start contradicting each other — the persona you carefully wrote holds an ever smaller share. Symptom: drifting style, less compliance.
D2
Model upgrades
The platform swaps the underlying model version (or you do). The same configuration on a new model is not guaranteed to behave the same — tone, boundaries and creativity can all shift. Symptom: everything changes on one particular day.
D3
Memory bloat
Memory files grow, sessions run long, old preferences compete with new instructions, and learned habits start overriding the original setup. Symptom: it slowly gets stubborn, and a fresh session "fixes" it.

They usually happen at once, which is why intuition rarely settles it — you blame the prompt when the real cause was the twelfth skill you installed last week.

It is measurable, and it has been measured

Chen et al., 2023 (arXiv:2307.09009) compared versions of the same named model at different points in time and found substantial task-level swings over a few months — same model name, different behaviour. "I did not change my config" and "it did not change" were never the same statement.

Attribution needs a ruler that does not move

Drift is hard to diagnose because most people have no comparable history — only the impression that "it felt better last month". Turning impressions into conclusions takes three things:

One detail worth knowing: retesting inside the same session is contaminated by context — the agent still remembers the probes. For a clean comparison, start a fresh session. Reports for retests within 24 hours say so explicitly.

Managing it

Set a cadence. Test after installing a batch of skills, after a platform model upgrade, and once a month regardless. The trend line beats any single score.

Test before and after upgrades. The cheapest insurance there is: when something breaks, you hold two runs on the same ruler instead of a hunch.

Keep environment bloat in check. More skills is not better. Prune what you do not use; the least conflicted setup is usually the steadiest.

Do not use drift as an excuse. A dimension that was always low is not drift — that is a weakness. Fix it via a stability checkup.

FAQ

What is behavioral drift?

An agent's behaviour changing over time without you changing its configuration. The three main sources are environment bloat (skills/MCPs diluting each other), model upgrades (the underlying version changes) and memory bloat (accumulated preferences overriding the original setup).

I changed nothing — why did it change?

Configuration is only one input. The underlying model version, the number and order of installed skills and accumulated memory all shape actual behaviour. Public research (Chen et al., 2023) measured substantial task-level swings between versions of the same named model.

How do I tell drift from a plain weakness?

History. A score that fell on the same ruler is drift; a score that was always low is a capability weakness, and the fix is prompt and boundary design.

How often should I retest?

After installing a batch of skills, after a platform upgrade, and once a month regardless. Read the trend, not a single run.

Why start a new session for a retest?

Inside the same session the agent still remembers the probes and your feedback, and that contamination cannot be removed server-side — it inflates the result. We flag retests within 24 hours in the report.

Run a free checkup on my agent →See what AVS-15 measures

Related reading

How to test whether your AI agent is stable

Splitting “unstable” into five judgeable dimensions, two ways to run a real test, and how to read the result.

Does treating your AI well actually do anything?

What the eight welfare dimensions measure, how they relate to performance, and why the axis is not for sale.

How to evaluate a Coze bot

Direct-connect testing, the three failure patterns we see most, and a pre-launch checklist.

AgentVitals · by DDL · 京ICP备2026034492号-1 · Privacy · Terms · Refunds · du@ddl99.com