Major incident

Phrase: Degraded Performance of Phrase (EU & US) starting on July 16, 2026 17:24 CEST

Jul 16, 2026, 15:47 UTC
started
12:07 UTC
resolved July 20, 2026
3 days 20 h
duration

Affected: Identity management - IDM (EU), Identity management - IDM (US)

Current status of Phrase: Operational — live Phrase status

Timeline

  1. Jul 16, 2026, 15:47 UTC
    investigating
    We are currently investigating an issue affecting our Metrics service that may result in duplicated metrics consumption for some customers. Our team is actively working to identify the affected components and determine the root cause. We will provide further updates as more information becomes available.
  2. Jul 16, 2026, 16:29 UTC
    identified
    We have identified the root cause as instability on a specific broker, which is causing repeated consumer group rebalancing in our Metrics service and leading to duplicate processing of metric updates. This may result in some customers experiencing incorrect consumption calculations or unexpected account blocking. We continue working on a fix.
  3. Jul 16, 2026, 17:31 UTC
    monitoring
    We have stopped the progression of the issue and are now working to identify the full scope of impact, including which organizations are affected or blocked. Affected accounts will be prioritized for resolution through a deduplication process, though this will take some time to complete.
  4. Jul 16, 2026, 19:04 UTC
    identified
    We have successfully deduplicated metrics consumption for all blocked organizations. We are continuing work to develop per-organization deduplication tooling to ensure accurate billing cycle data, with the full team scaling these fixes tomorrow morning.
  5. Jul 17, 2026, 13:02 UTC
    monitoring
    We continue to make progress resolving the duplicated metrics consumption issue first identified on July 16. The root cause has been identified and addressed. Since our last update, our team has corrected the duplicated data for all previously blocked accounts. We are now working through a remaining set of affected accounts and expect this cleanup to continue over the coming days. No further duplication is occurring, this work addresses historical data only.
  6. Jul 20, 2026, 12:07 UTC
    resolved
    This incident has been resolved.

Updates as published by Phrase (original).

Other services with incidents at the same time

More Phrase incidents