Early-warning response
Use early warnings with a response
The evaluated population
The cohort contains 21,000 active credit accounts, of which 1,365 have the defined synthetic outcome: Synthetic material credit deterioration. The outcome is known by construction here. In production, label uncertainty and selection must be recorded separately.
Figure data and text version
| Outcome | Count |
|---|---|
| Synthetic material credit deterioration | 1,365 |
| Other labeled outcomes | 19,635 |
An early-warning signal is useful only when it leads to a proportionate and timely action. Precision, missed cases, and the effect of the intervention are different measures.
Evaluate mature outcomes and connect warnings to a defined review and response process.
All amounts, rates, capacity limits, and outcomes in this case are synthetic. The three conditions are separate assumptions for comparison. A better result in the response condition is not measured proof that the proposed control causes that improvement. The figures expose the calculation and its limits; a real deployment needs its own evidence.
Read the result
The rule flags 1,410 of 21,000 active credit accounts. Of those flags, 1,174 meet the synthetic target, giving 83.26% precision. It misses 191 target events. Under the stated cost assumptions, residual loss and operating friction total $433,300. The important result is the connection between the population, action, capacity, and outcome—not one isolated score.
Model inputs and calculated values
Inputs below are the case-specific values. Each figure states the condition-specific assumptions and units used in its calculation. Calculated values are rounded for display.
| Input | Value |
|---|---|
| population | 21,000 |
| prevalence | 0.065 |
| severity | 2,100 |
| reviewCost | 22 |
| Calculated value | Result |
|---|---|
| population | 21,000 |
| positive | 1,365 |
| negative | 19,635 |
| tp | 1,174 |
| fp | 236 |
| fn | 191 |
| tn | 19,399 |
| loss | 401,100 |
| severity | 2,100 |
| precision | 83.26 |
| recall | 86.01 |
Four outcomes of the rule
The rule flags 1,174 synthetic positives and 236 negatives. It misses 191 positives. A flagged item is a decision to intervene; it is not proof of fraud, a legal prohibition, or any other real-world conclusion.
Figure data and text version
| Known outcome | Flagged | Not flagged |
|---|---|---|
| Synthetic material credit deterioration | 1,174 | 191 |
| Other outcome | 236 | 19,399 |
Three rates with different denominators
Precision is 83.26%, recall is 86.01%, and the false-positive rate is 1.2%. Changing the denominator changes the meaning. This record keeps each numerator attached to the population from which it came.
Figure data and text version
| Metric | Numerator | Denominator | Result |
|---|---|---|---|
| Precision | 1,174 | 1,410 | 83.26% |
| Recall | 1,174 | 1,365 | 86.01% |
| False-positive rate | 236 | 19,635 | 1.2% |
Precision changes with prevalence
This sensitivity plot holds recall at 86% and false-positive rate at 1.2%, then changes prevalence. It is an algebraic comparison, not a forecast. Even unchanged detection quality can produce a very different review queue when the base rate changes. Horizontal positions are the labeled observations or scenarios; equal spacing does not imply equal numerical increments.
Figure data and text version
| Assumed prevalence | Precision % |
|---|---|
| 0.1% | 6.69 |
| 0.5% | 26.48 |
| 1% | 41.99 |
| 2% | 59.39 |
| 5% | 79.04 |
| 10% | 88.84 |
The threshold trade-off
Six illustrative score bands use a stated pair of detection rates. Lower sensitivity can reduce false alarms but miss more target events. These points do not come from a trained model and do not establish the best operating threshold. Horizontal positions are the labeled observations or scenarios; equal spacing does not imply equal numerical increments.
Figure data and text version
| Score band | True positives | False positives |
|---|---|---|
| Band 1 | 1,338 | 2,945 |
| Band 2 | 1,283 | 1,571 |
| Band 3 | 1,174 | 687 |
| Band 4 | 983 | 236 |
| Band 5 | 682 | 79 |
| Band 6 | 341 | 20 |
A transparent loss-and-friction calculation
At $2100 severity per missed synthetic positive, residual loss is $401,100. Review costs $31,020; lost contribution on false alarms is $1,180. The calculation assumes intervention prevents all flagged-positive loss and each false alarm loses the stated contribution. Relax those assumptions before applying it to a real policy.
Figure data and text version
| Cost component | USD |
|---|---|
| Missed-positive loss | 401,100 |
| Review cost | 31,020 |
| False-alarm contribution | 1,180 |
Observed outcomes mature over time
The final synthetic positive count is 1,365. Earlier observations reveal only a stated fraction. Comparing a day-1 cohort with a day-30 cohort would confuse label age with control quality. This curve models observation delay only; it does not change the final outcome. Horizontal positions are the labeled observations or scenarios; equal spacing does not imply equal numerical increments.
Figure data and text version
| Days after event | Observed positives |
|---|---|
| 1 | 246 |
| 3 | 478 |
| 7 | 819 |
| 14 | 1,119 |
| 30 | 1,365 |
Review demand and available capacity
The flag count is 1,410. The comparison capacity is an illustrative 840 reviews per cohort window. A mathematical rule can be coherent while its resulting workload exceeds the operating team’s capacity. Capacity is not permission to ignore an applicable mandatory control.
Figure data and text version
| Queue measure | Items |
|---|---|
| Flagged for review | 1,410 |
| Available capacity | 840 |
| Excess demand | 570 |
A feature is an observation with provenance
This evidence contract supports use early warnings with a response. A value needs its event time, arrival time, scope, and source. Keeping unavailable evidence distinct from a measured zero prevents an outage from becoming a falsely reassuring feature.
Figure data and text version
| Field | Example | Meaning |
|---|---|---|
| entity_ref | Early-warning response | Subject of this case |
| event_time | 2026-09-18T09:00:00Z | When the event occurred |
| received_time | 2026-09-18T09:00:02Z | When the system learned it |
| signal_status | repaired | Evidence quality, not an outcome |
| label_definition | Synthetic material credit deterioration | The target used in these calculations |
Missing evidence changes the observed population
The cells show an explicitly constructed completeness profile for three signal groups. The stress condition removes more history and device evidence. Missingness does not prove the target outcome; it changes what the decision process knows.
Figure data and text version
| Signal group | Available | Missing |
|---|---|---|
| Identity evidence | 20,895 | 105 |
| Activity history | 20,685 | 315 |
| Context signal | 20,370 | 630 |
Evidence, score, and action remain separate
The policy can use use early warnings with a response only within its approved scope. The action record must retain which evidence was available, which model or rule ran, and which action was actually applied. The final action can differ from the score recommendation when a separate constraint applies.
Figure data and text version
| Stage | Record |
|---|---|
| Observe | Early-warning response: evidence as of the decision time |
| Evaluate | Rule flags 1,410 of 21,000 active credit accounts |
| Apply | Record action, reason, owner, and expiry |
| Reconcile | Join the action to later outcomes without overwriting history |
What the result cannot establish
Observed classifications do not reveal every counterfactual. The synthetic labels make arithmetic possible, but production decline data is selected by prior policy. Keep measured outcomes, assumed prevention, and unknown alternatives separate when reporting impact.
Figure data and text version
| Claim | Evidence in this case | Limit |
|---|---|---|
| Detected target | 1174 known synthetic positives flagged | Production labels may be delayed or wrong |
| Prevented loss | Assumed 2,465,400 USD | Requires an intervention-effect assumption |
| Customer impact | 236 synthetic negatives flagged | Not every flag causes abandonment |
| Unobserved alternative | Outcome without the action | Needs a valid evaluation design |
Connect the result to the system
Evaluate mature outcomes and connect warnings to a defined review and response process.
Check the population, evidence, permitted action, and actual effect together. A balanced calculation can still use the wrong population; a successful response can still leave an unknown financial outcome. The case’s numerical result applies only to its stated assumptions.
Sources and further reading
The chapter sources support the concepts and scope. They do not prescribe the synthetic model rates.