500 errors for https://www.PagerDuty.com

Severity: Minor
Category: Misconfiguration
Service: PagerDuty

This summary is created by Generative AI and may differ from the actual content.

Overview

On October 19, 2022, the marketing website (https://www.pagerduty.com) was unreachable from 01:31 UTC to 02:16 UTC due to a server configuration update that caused 500 responses for incoming requests. This affected only the marketing website, not the PagerDuty application.

Impact

Visitors were unable to log in to the PagerDuty application through the marketing website or create new trials during the outage.

Trigger

A settings update on one of the providers' caching services during the deployment of the marketing website.

Detection

The issue was detected when the marketing website became unreachable, and users were temporarily redirected to a staging instance.

Resolution

The newly required setting was enabled, resolving the issue. The route was updated to the correct endpoint, allowing traffic to flow correctly to the production instance.

Root Cause

An update made by the web host provider triggered by the normal deployment process, which caused the issue. The web host provider is working to provide feedback to address the problem, and internal opportunities have been identified to refine the deployment pipeline.