Incident with Packages
This summary is created by Generative AI and may differ from the actual content.
Overview
GitHub Packages experienced a service degradation, leading to failures uploading and downloading packages, along with increased latency for all requests to GitHub Packages registry.
Impact
At peak impact, about 14% of uploads and downloads failed, and all Packages requests were delayed by an average of 7 seconds.
Trigger
rollout of a database configuration change
Detection
We are investigating reports of degraded performance for Packages
Resolution
We mitigated the incident by rolling back the contributing change and failing over the database. In response to this incident, we are tuning database configurations and resolving a source of deadlocks. We are also redistributing certain workloads to read replicas to reduce latency and enhance overall database performance.
Root Cause
The incident was caused by the rollout of a database configuration change that resulted in a degradation in database performance.