← AI Ops Analyst

Chapter 6 · 80 min · free

Anomalies vs. incidents

Wednesday, 9:15am. The board review is tomorrow. After three days you've earned the dashboard back: the enterprise-churn filter is gone, churn reconciles to raw, the triage agent only suggests now. So when you open the morning view, every line is one you trust — which is exactly why two of them stop you cold. Overnight, signups spiked 9x: a green wall of new businesses, the kind of number a CEO screenshots into the deck. And at the bottom of the same screen, payment_error_rate has crept from 0.4% to 0.9% over six days — a line so gentle nobody's mentioned it. One of these is a vanity spike that will embarrass you on Thursday if you put it in front of the board. The other is the canary in the coal mine. By Thursday morning you need to know, with cohorts and a root cause, which is which — and how to tell the difference before the next spike lands.

You'll walk out able to

  1. Separate a real anomaly from normal seasonal or weekly variation before you alarm anyone
  2. Use cohorts to tell whether a spike is one bad batch or a broad shift
  3. Recognize a slow creep as the canary it is, instead of waiting for the cliff
  4. Trace a metric move to a single root cause instead of stopping at a correlation
  5. Tune an alerting agent so it pages on incidents and stays quiet on anomalies
Your first task

The 9x signup spike

9:18am. Signups overnight: 8,900 against a 7-day average of ~1,000. The growth lead is already drafting a Slack post: 'biggest signup day in company history.' The CEO wants it on tomorrow's deck. Before a single screenshot leaves your hands, you ask yourself what would actually tell you whether 9x is a win or an artifact.

What you'll answer

9x overnight is far outside normal. What's the first thing you check to decide whether it's a real win or an anomaly to discount?

Free · no card · we save your progress

Save your progress & earn the certificate

You've seen the opening — keep going free. 6 tasks · auto-graded · finish in 80 min and the certificate is yours. Free forever · no card.

No password. To sign in on your phone, request an emailed code on the sign-in page.

Already started? Sign in with an emailed code instead.