Enabling Coverage Tracking
Understanding Coverage
Sub-Categories
Each policy category is broken down into testable sub-categories. For example: Category: Refund Policy- Time-based eligibility (30-day window rules)
- Amount thresholds (refund limits)
- Method restrictions (cash vs. credit)
- Exception handling (final sale items)
Coverage Status
| Status | Icon | Description |
|---|---|---|
| Covered | 80%+ of expected scenarios | |
| Partial | ~ | 30-80% of expected scenarios |
| Uncovered | Less than 30% of expected scenarios |
Viewing Coverage
Console Output
WithRichReporter (default), coverage is displayed automatically:
Programmatic Access
Improving Coverage
During HITL Session
In an interactive session, use coverage commands:Programmatic Coverage Improvement
Coverage Report Export
Coverage Strategies
Balanced Coverage
Generate scenarios evenly across all sub-categories:Priority-Based Coverage
Focus on high-priority sub-categories:Type-Balanced Coverage
Ensure each sub-category has all scenario types:Best Practices
- Target 80%+ overall coverage for production datasets
- Check type distribution - ensure positive, negative, and edge cases
- Review uncovered areas - they may indicate policy gaps
- Iterate on coverage - generate small batches and review
- Export coverage reports - track coverage over time
Coverage Thresholds
Default thresholds:| Threshold | Value |
|---|---|
| Covered | ≥ 80% |
| Partial | ≥ 30% |
| Uncovered | < 30% |
| Min scenarios per sub-category | 2 |