starslingdev - Webhook APIs and UI Degraded – Incident details

All systems operational

Webhook APIs and UI Degraded

Resolved
Degraded performance
Started about 2 months agoLasted 19 minutes

Affected

Third Party: GitHub → Webhooks

Operational from 1:13 AM to 1:13 AM, Degraded performance from 1:13 AM to 1:27 AM, Operational from 1:27 AM to 1:32 AM

Updates
  • Resolved
    UTC
    Resolved

    On May 28, 2026, between 00:54 UTC and 01:19 UTC, some users experienced errors when interacting with the Webhooks API, including webhook delivery history and configuration endpoints. On average, the error rate was 0.28% and peaked at 0.45%. This was due to a bug that caused a single Kubernetes pod to enter a CrashLoopBackOff after receiving a 500 with an empty response body from Cosmos DB.

    We mitigated the incident by restarting the service. To prevent future incidents, we are pushing a change to handle this response scenario from Cosmos DB appropriately.

  • Monitoring
    UTC
    Monitoring

    The degradation affecting Webhooks has been mitigated. We are monitoring to ensure stability.

  • Investigating
    UTC
    Investigating

    We are investigating reports of degraded performance for Webhooks