Incident with Actions and Packages
This summary is created by Generative AI and may differ from the actual content.
Overview
On February 26, 2025, between 14:51 UTC and 17:19 UTC, GitHub Packages experienced a service degradation, leading to billing-related failures when uploading and downloading Packages. During this period, the billing usage and budget pages were also inaccessible. The incident occurred due to an error in newly introduced code, which caused containers to get into a bad state, ultimately leading to billing API calls failing with 503 errors. In response to this incident, improvements are planned: enhancing error handling, improving the resiliency of our billing API calls, and improving change rollout practices.
Impact
Service degradation leading to billing-related failures when uploading and downloading Packages. Billing usage and budget pages were also inaccessible. Actions workflow run failures.
Trigger
Error in newly introduced code caused containers to get into a bad state.
Detection
Observed billing API calls failing with 503 errors.
Resolution
Mitigated the issue by rolling back the contributing change.
Root Cause
Error in newly introduced code, which caused containers to get into a bad state, ultimately leading to billing API calls failing with 503 errors.