Decision Analytics
Participant leadership profiles, decision quality metrics, confidence trends, category performance, and team alignment analysis from exercise data.
Decision Analytics transforms raw exercise decision data into actionable insights about individual and team performance. It evaluates how participants make decisions under pressure and identifies patterns that affect incident response effectiveness.
Participant Leadership Profiles
Each participant receives a leadership profile computed from their exercise decisions. The profile evaluates:
- Decisiveness — Speed of decision-making relative to inject urgency
- Accuracy — Alignment of decisions with expected responses
- Confidence calibration — Whether confidence ratings match actual decision quality
- Consistency — Decision quality stability across different incident phases
- Collaboration — Degree to which decisions account for team input
Profiles are presented as radar charts with scores across these five dimensions.
Decision Quality Metrics
For each decision submitted during an exercise, the analytics engine computes:
| Metric | Description | |---|---| | Quality Score | 0-100 rating based on alignment with expected response | | Confidence Delta | Gap between stated confidence and actual quality | | Response Time | Seconds between inject delivery and decision submission | | Category Alignment | Whether the decision addresses the correct incident phase |
Confidence Trends
Confidence trends track how participant confidence changes throughout the exercise. Common patterns include:
- Overconfidence decay — Participants start confident and become less sure as complexity increases
- Recovery arc — Initial uncertainty followed by growing confidence as the team finds its rhythm
- Flat line — Consistent confidence regardless of scenario complexity (may indicate disengagement)
These trends are visualized as line charts overlaid with inject severity markers.
Category Performance
Performance is broken down by inject category to identify which incident response phases are strongest and weakest for each participant:
- Detection and analysis decisions
- Escalation judgment calls
- Containment strategy choices
- Communications and notification decisions
- Recovery prioritization
- Legal and regulatory compliance decisions
Team Alignment
Team alignment measures how well participants coordinate their decisions. High alignment means the team converges on consistent approaches; low alignment reveals communication gaps or role confusion. The alignment score considers:
- Decision consistency across team members for the same inject
- Complementary role coverage (are all perspectives represented)
- Escalation chain coherence (do subordinate decisions align with leadership direction)
Using the Analytics
Decision analytics appear in the Ops Portal after an exercise completes. They feed into the AAR editor, providing data-backed observations about participant performance. The Executive AAR deliverable includes a summary of leadership profiles and team alignment findings.