Skip to main content
Viewing as:◈ Tayo · Infra on-callShift · Apr 14 – Apr 20Pager · ActiveWAT · 3:14 PM
§ Network Operations Center · Ìwẹrẹ Care

Uptime is a discipline,
not a number.

Seven services are operational. One — Starlink at Ughelli Hub — is degraded and Tayo is on the phone with SpaceX support. Six hub tablets have checked in within the last 15 seconds. Battery levels across the network average 78%. The lights stay on so that the elder keeps her appointment.

PARTIAL DEGRADATION · 1 SERVICE
Uptime · 30d
99.8%
Incidents · 30d
8 resolved
Avg MTTR
1h 44m
§ 01 · Service status

Eight services, live state.

1 degraded · 7 operational
Probes every 60s
Starlink · hub uplink
degraded

Ughelli p95 latency 412 ms

Telehealth platform
operational

WebRTC relay · 100% sessions established

Payments · Stripe
operational

0 failed charges · 30d

SMS · Twilio
operational

99.98% delivery · 30d

WhatsApp Business API
operational

Template approval queue clear

Video · daily.co
operational

Avg call quality 4.7/5

Pharmacy API
operational

RX round-trip < 80 ms

Lab API
operational

Results webhook firing

§ 02 · Active incidents

What we are working right now.

1 active · P2
Latest updates below
P2

Starlink degradation · Ughelli Hub

INC-2026-0412
3:09 PM WAT
Called Starlink support. Reference #SX-4412. They see elevated sky-obstruction on our tracker — investigating.
2:48 PM WAT
Mitigation: routed Ughelli consults to Effurun hub for next 2 hours. 6 appointments moved, patients notified.
2:32 PM WAT
Confirmed p95 at 412 ms (baseline 38 ms). Video sessions degrading. Moving to P2.
2:15 PM WAT
Alert triggered by NOC latency probe. On-call Tayo paged.
§ 03 · Last 30 days

Incident timeline.

1 active · 5 resolved · 1 planned
Auto-archived after close
IDSevTitleOpenedResolvedMTTR
INC-2026-0412P2Ughelli Starlink degradationApr 17 · 2:15 PM WATongoing
INC-2026-0408P3Effurun printer offlineApr 14 · 6:20 AM WATApr 15 · 3:10 PM WAT32h 50m
INC-2026-0401P2Payments webhook delay · StripeApr 08 · 11:30 AM CTApr 08 · 12:04 PM CT34m
INC-2026-0388P3WhatsApp template rejection · appealApr 03 · 2:10 PM WATApr 05 · 10:00 AM WAT43h 50m
INC-2026-0374P1Warri Central tablet crash loopMar 28 · 7:40 AM WATMar 28 · 9:12 AM WAT1h 32m
INC-2026-0365P4Planned: DB maintenance windowMar 22 · 2:00 AM CTMar 22 · 2:45 AM CT45m · planned
§ 04 · Hub connectivity

Six hubs, live pings.

1 hub degraded
Hub directory →
HubLatencyLast seenBatteryStatus
Warri Central Hub
32 ms
2s ago
🔋 82%
online
Sapele Hub
41 ms
4s ago
🔋 78%
online
Effurun Hub
39 ms
3s ago
🔋 84%
online
Omadino Hub
44 ms
5s ago
🔋 71%
online
Ughelli Hub
412 ms
12s ago
🔋 66%
degraded
Uvwie Hub
35 ms
2s ago
🔋 88%
online
§ 05 · Error rate · 30d

Incidents per day.

8 events total
Ascii chart · daily bin
§ NOC_chart_v1 · incidents_per_day · 2026-03-20 → 2026-04-17
Mar 202██
Mar 211
Mar 224████
Mar 230·
Mar 241
Mar 250·
Mar 263███
Mar 272██
Mar 288████████
Mar 291
Mar 300·
Mar 311
Apr 012██
Apr 020·
Apr 032██
Apr 041
Apr 050·
Apr 061
Apr 070·
Apr 083███
Apr 091
Apr 100·
Apr 111
Apr 120·
Apr 131
Apr 142██
Apr 150·
Apr 161
Apr 172██
◈ Each █ represents 1 incident · threshold > 3/day triggers war-room
§ 06 · On-call

Who carries the pager tonight.

Rotates weekly · Mon 09:00 WAT
PagerDuty-backed
§ Primary on-call
Tayo AdebayoLagos · infra lead
Apr 14 – Apr 20
☎ +234 803 ••• 4412
§ Secondary on-call
Ifeanyi ObiAbuja · supply + kit
Apr 14 – Apr 20
☎ +234 805 ••• 8841
§ Escalation · HQ
Otse E.Dallas · ops lead
24/7 · executive
☎ +1 214 ••• 0099
§ Vendor · Starlink
SpaceX Business SupportVendor channel
24/7 · case portal
portal · SX-support
§ 07 · Runbooks

Known failures, pre-scripted.

5 runbooks · reviewed quarterly
Suggest a runbook →
§ Power

Hub · grid power failure

Solar + battery auto-switch within 200 ms. Battery runs ~8 hr @ 70% load. NOC probe pings every 60s; if missed, text hub manager and begin fuel-gen dispatch.

Open full runbook →
§ Network

Hub · Starlink outage

Failover to 4G modem (included in kit). Bandwidth drops 10x — prioritise voice, disable video. Re-point dish after 30 min if no recovery.

Open full runbook →
§ Vendor

API · external provider down

Circuit breaker opens after 5 failures. User messaging: 'Service degraded — we'll retry automatically.' Incident auto-opened at P3; escalate to P2 after 30 min.

Open full runbook →
§ Clinical

Tablet · EHR unresponsive

Hard reboot (hold power 10s). If loop persists, reset to factory image via MDM. Nurse falls back to paper intake + scan at shift end. Ships replacement kit in 48 hr.

Open full runbook →
§ Supply

Drug · controlled substance mismatch

Pause dispense. Pharmacist + HQ co-sign required before escalation to NDLEA. Audit log exported within 24 hr.

Open full runbook →

The best incident is the one that never became one.

The NOC exists so that Nurse Mary does not notice Starlink degraded, an elder patient does not miss his televisit, and the diaspora daughter in Dallas does not wake up to a failure email. When something breaks — and it will — we've already written the page about how to fix it.