Incident with Issues and Webhooks
This summary is created by Generative AI and may differ from the actual content.
Overview
Incident on 2026-05-04 where increased latency on Issues, timeouts, and elevated 500 errors on Webhooks were observed, affecting multiple GitHub services. The degradation was traced to a scheduled workload that saturated the connection pool of the primary host of a critical datastore. Mitigation involved pausing the job and implementing measures to prevent recurrence.
Impact
Degraded performance and availability across Issues, Webhooks, Codespaces, Pull Requests, Actions, Packages, Pages, and Git Operations. Users experienced increased latency, request timeouts, and HTTP 500 errors.
Trigger
A scheduled workload drove high utilization on the primary host of a critical datastore, saturating its connection pool.
Detection
At 15:37:17 UTC monitoring detected increased latency on Issues and elevated 500 errors on Webhooks, prompting investigation.
Resolution
The scheduled job was paused at 16:40:05 UTC, which mitigated the degradation. Additional measures were put in place to prevent recurrence.
Root Cause
The scheduled workload caused connection‑pool saturation on the primary datastore host, leading to the observed latency, timeouts, and errors.