Major incident

balena.io: Elevated API Errors

May 5, 2026, 18:12 UTC
started
21:03 UTC
resolved
2 h 51 min
duration

Affected: API, Application Builder, Delta Image Downloads

Current status of balena.io: Operational — live balena.io status

Timeline

  1. May 5, 2026, 18:12 UTC
    investigating
    We're experiencing an elevated level of API errors and are currently looking into the issue.
  2. May 5, 2026, 18:19 UTC
    identified
    The issue has been identified and a fix is being implemented.
  3. May 5, 2026, 18:43 UTC
    monitoring
    A fix has been implemented and we are monitoring the results.
  4. May 5, 2026, 21:03 UTC
    resolved
    This incident has been resolved.
  5. May 5, 2026, 21:18 UTC
    postmortem
    A vulnerability mitigation update required replacing compute cluster nodes, which, when applied, rolled back due to a timeout. This caused some workloads \(API, delta, builder\) to become temporarily unavailable and triggering some undesired secondary effects, including ungracefully terminating a few long lived instances servicing VPN connections. While the rest of the services came back reasonably quickly within a minute or so, it too around one and a quarter hours to re-establish VPN tunnels. A scheduled maintenance will be posted later to perform this update during a planned outage window.

Updates as published by balena.io (original).

Other services with incidents at the same time

More balena.io incidents