Incident with Packages
This summary is created by Generative AI and may differ from the actual content.
Overview
On November 3, 2025, between 14:10 UTC and 19:20 UTC, GitHub Packages experienced degraded performance, leading to failures for Nuget package download requests. The incident was caused by an unexpected change in usage patterns impacting the rate limiting infrastructure. Mitigation involved scaling services and refining the rate limiting implementation. Future actions include enhancing resilience, improving capacity planning, and implementing better monitoring.
Impact
GitHub Packages experienced degraded performance, resulting in failures for 0.5% of Nuget package download requests. During the incident, increased failure rates of up to 15% for GitHub Packages downloads were observed, with users encountering 5xx errors.
Trigger
The incident was triggered by an unexpected change in usage patterns that affected the rate limiting infrastructure within the Packages service.
Detection
The incident was initially detected through reports of degraded performance for Packages. Subsequent investigations revealed increased failure rates of up to 15% for GitHub Packages downloads, with users experiencing 5xx errors.
Resolution
The issue was resolved by scaling up services and refining the rate limiting implementation to ensure more consistent and reliable service for all users.
Root Cause
The root cause was an unexpected change in usage patterns that impacted the rate limiting infrastructure of the Packages service, leading to degraded performance.