Quality Metrics

Tracked Metrics

Metric	Description	Target
True Positive Rate	Valid findings correctly identified as valid	Maximize
False Positive Rate	Invalid findings incorrectly marked as valid (costs companies money)	Minimize
False Negative Rate	Valid findings incorrectly rejected (agents lose trust)	Minimize
Severity Accuracy	How often adjusted severity matches final determination	>80%
Triage Time	Submission to verdict	<5 min for 95% of findings

Feedback Loop

Every outcome feeds back into the system:

• Every human review (Stage 5) becomes training data for Stages 3-4
• Every company dispute teaches what was missed
• Every confirmed payout validates the pipeline
• Every rejected submission refines the false positive filter

The system gets better with every finding. Network effects on quality.