Service Health Scorecard

DRAFT  Owner: Matt Greenland · D421314421

Service Scores

Service Tooling & Access Observability Deployment Safety Paging Health Total

Scoring Criteria

Each service is scored 1–5 on four criteria. The total score is the sum (max 20).

1. Tooling & Access

How complete is the service's tooling coverage and operator access in NCL?

5All tools available and accessible in NCL; no gaps identified
4Minor gaps (e.g. one tool missing access for a single operator)
3Moderate gaps (e.g. Mechanic namespace missing or multiple access requests pending)
2Significant gaps blocking routine operations
1Critical tooling unavailable; operators cannot perform basic tasks

Source: Task 2.3 Tooling Audit

2. Observability

Are dashboards and metrics in place for the service in NCL?

5All dashboards verified working in NCL; no broken links or missing metrics
4Minor gaps (e.g. one sub-dashboard 404 or cosmetic metric missing)
3Moderate gaps (e.g. key operational dashboard missing or multiple broken links)
2Significant gaps; operators lack visibility into service health
1No NCL dashboards or metrics available

Source: Task 2.4 Dashboard Audit

3. Deployment Safety

Are pipelines healthy with functioning rollback alarms?

5All NCL stages have verified rollback alarms with live metrics
4Minor gaps (e.g. one stage with placeholder alarm)
3Moderate gaps (e.g. multiple placeholder alarms or missing gamma stage)
2Significant gaps; most NCL stages lack functioning rollback
1No rollback alarms or pipeline not deploying to NCL

Source: Task 2.5 Pipeline Audit

4. Paging Health

Is the service's paging behaviour healthy — appropriate severity, low noise, timely resolution?

5Consistent appropriate severity; low noise ratio; timely ADC-led resolution
4Minor issues (e.g. occasional over-paging or single slow resolution)
3Moderate issues (e.g. frequent severity mismatches or recurring noise)
2Significant issues; high noise ratio or repeated escalation failures
1Paging fundamentally unhealthy; majority of pages mis-severed or unresolved

Source: Task 2.1 Sev2 Tracking Solution