Disruption with some GitHub services

Severity: MinorCategory: ScalabilityService: GitHub
This summary is created by Generative AI and may differ from the actual content.
Overview
On February 25th, 2025, between 14:25 UTC and 16:44 UTC email and web notifications experienced delivery delays.
Impact
At the peak of the incident the delay resulted in ~10% of all notifications taking over 10 minutes to be delivered, with the remaining ~90% being delivered within 5-10 minutes. There were also delivery delays for a small number of webhooks, with delays of up-to 2.5 minutes to be delivered.
Trigger
Increased load during peak hours
Detection
GitHub was investigating delays in web and email notifications impacting all customers.
Resolution
GitHub mitigated the incident by scaling out the service to meet the demand.
Root Cause
Insufficient capacity in worker pools as a result of increased load during peak hours.
;