git operations over ssh seeing increased latency on github.com
This summary is created by Generative AI and may differ from the actual content.
Overview
Git operations over SSH on github.com experienced increased latency and failed requests, with failure rates up to 15%, from Oct 22, 2025 15:00 UTC to Oct 24, 2025 14:30 UTC. This was caused by resource exhaustion on backend SSH servers. The incident was resolved by increasing available resources for SSH connections, and future prevention involves improving observability and dynamic scalability.
Impact
Users performing git operations via SSH on github.com experienced increased latency and failed requests, with failure rates ranging from 1.5% to a peak of 15%. The incident lasted for approximately 47.5 hours. Git operations over HTTP were unaffected.
Trigger
The incident was triggered by resource exhaustion on the backend SSH servers.
Detection
The issue was detected and an investigation was initiated by Oct 24, 2025, 09:31 UTC.
Resolution
The incident was resolved by increasing the available resources for SSH connections on the backend servers.
Root Cause
The root cause was resource exhaustion on the backend SSH servers, highlighting a need for improved observability and dynamic scalability of the backend to prevent similar issues in the future.