Team synchronization is experiencing delays for non enterprise managed users
This summary is created by Generative AI and may differ from the actual content.
Overview
Team Synchronization service experienced a significant degradation, preventing over 209,000 organization teams from syncing their identity provider (IdP) groups.
Impact
Over 209,000 organization teams were prevented from syncing their identity provider (IdP) groups, resulting in significant delays.
Trigger
A buildup of synchronization requests, resulting in elevated Redis key usage and high CPU consumption on the underlying Redis cluster.
Detection
Investigation of reports of impacted performance for some GitHub services.
Resolution
Proactively paused all team synchronization requests, flushed the affected Redis keys and queues, and scaled up infrastructure resources to improve the ability to process the high volume of synchronization requests.
Root Cause
A buildup of synchronization requests, resulting in elevated Redis key usage and high CPU consumption on the underlying Redis cluster, likely due to reaching a scaling limit.