No impact incident
Buildkite: Buildkite response to the eMudhra certificate compromise
Oct 20, 2026, 22:13 UTC
started
22:38 UTC
resolved October 21, 2026
24 h 25 min
duration
Current status of Buildkite: Operational — live Buildkite status
Timeline
- Oct 20, 2026, 22:13 UTCinvestigatingThe private keys for eight certificates issued by eMudhra, an external certificate authority, have been compromised. Software that still trusts these certificates may accept fraudulent HTTPS certificates. We’re updating the services that power Buildkite and preparing new CLI and Agent releases, which we expect to ship shortly. We’re also tracking fixes to the libraries and trust stores we depend on and will apply them as they become available. We’ll update this page with the new versions and any action customers need to take. Mozilla has published background on the compromise.
- Oct 20, 2026, 23:25 UTCmonitoringWe're continuing to monitor the situation, and are making releases to many of our components that run in customer infrastructure. At time of writing, we've released versions that distrust the affected eMudhra certificates for: - Buildkite agent: https://github.com/buildkite/agent: - v4.7.0: https://github.com/buildkite/agent/releases/tag/v4.7.0 - v3.138.2: https://github.com/buildkite/agent/releases/tag/v3.138.2 - Buildkite CLI: https://github.com/buildkite/cli/releases/tag/v3.64.2 - bktec: https://github.com/buildkite/test-engine-client/releases/tag/v3.3.1 We recommend updating to these versions to prevent exposure to the affected certificate providers. We will continue to issue updates for the other binaries we distribute, and are updating any internal services that are affected.
- Oct 21, 2026, 05:07 UTCmonitoringWe’ve finished updating the services that power Buildkite so they no longer trust the affected eMudhra certificates. No action is needed from customers for Buildkite hosted services. For components that run in customer infrastructure, we still recommend upgrading to the releases listed in our previous update (Buildkite agent v4.7.0 / v3.138.2, Buildkite CLI v3.64.2, and bktec v3.3.1). We’re continuing to release updates for the other binaries we distribute and will post them here as they ship.
- Oct 21, 2026, 22:38 UTCresolvedAll services that power Buildkite have been updated to distrust the affected certificates, and updated releases are available for the components we distribute that run in customer infrastructure: Buildkite agent: v4.7.0 and v3.138.2 Buildkite CLI: v3.64.2 bktec: v3.3.1 elastic-ci-stack-for-aws: v7.8.0 agent-stack-k8s: v0.52.0 We recommend updating to these versions to prevent exposure to the affected certificate providers.
Updates as published by Buildkite (original).
Other services with incidents at the same time
- LiveKit 23:09 UTC · Increased join latency in US East and US Central
- ActiveCampaign 22:11 UTC · Delayed processing for automations and messages
- WiscNet 22:11 UTC · [2306265] Village of Bellevue - DOWN
- Supabase 21:59 UTC · Projects stuck in restarting state
- Instructure 21:44 UTC · Edit discussion page error when Checkpoints disabled
- Sourcegraph 21:43 UTC · Sourcegraph.com public code search issues
- CivicPlus 21:41 UTC · Service Degradation - CivicPlus Payments
- Grafana Cloud 21:36 UTC · DB issues in prod-sa-east-1
- UVic IT 21:28 UTC · BC time-zone change may affect calendar meetings
- InterServer 21:27 UTC · Upcoming PHP Security update
- Signicat 21:26 UTC · Incident on 3rd party service - Finnish Bank eIDs S-pankki
- Rice University 21:17 UTC · Sign-in Prompt Error for Windows
More Buildkite incidents
- October 24, 2026 Elevated error rates
- October 22, 2026 Delays with Hosted Agents jobs
- October 20, 2026 Delayed notifications
- October 19, 2026 Delayed Hosted Agents instance creation
- October 6, 2026 Degraded checkout performance with Hosted Agents
- October 1, 2026 Small number of incoming GitHub Webhook failing