Incident with Actions - Larger hosted runners
This summary is created by Generative AI and may differ from the actual content.
Overview
On October 23, 2025, between 15:54 UTC and 19:20 UTC, GitHub Actions larger hosted runners experienced degraded performance. This resulted in 1.4% of overall workflow runs and 29% of larger hosted runner jobs failing to start or timing out within 5 minutes. The incident was caused by database performance degradation, triggered by routine database changes that exposed a bug in the underlying database platform. Mitigation involved scaling up the database and reducing load. Similar database changes have been paused, and work is ongoing with partners to resolve the underlying bug.
Impact
1.4% of overall workflow runs and 29% of larger hosted runner jobs failed to start or timed out within 5 minutes.
Trigger
Routine database changes caused a load profile that triggered a bug in the underlying database platform used for larger runners.
Detection
The incident was detected through reports of degraded performance for Actions, leading to an investigation that began at 16:33 UTC.
Resolution
Impact was mitigated through a combination of scaling up the database and reducing load. Similar database changes have been paused until the underlying bug is resolved, and work is ongoing with partners to address the bug.
Root Cause
Database performance degradation, triggered by routine database changes causing a load profile that exposed a bug in the underlying database platform used for larger runners. The full set of contributing factors is still under investigation.