Major incident

iPaper: Partial outage of flipbooks

Affected: Viewer, Admin, Backend API, Pop-ups

Current status of iPaper: Operational — live iPaper status

Timeline

1. Sep 5, 2026, 14:06 UTC
   identified
   The issue has been identified and a fix is being implemented.
2. Sep 5, 2026, 14:14 UTC
   monitoring
   A fix has been implemented and we are monitoring the results.
3. Sep 5, 2026, 14:49 UTC
   resolved
   This incident has been resolved.
4. Sep 7, 2026, 05:37 UTC
   postmortem
   ## Summary Due to an ongoing issue with our VXLAN where the IPsec protocol sometimes desynchronizes causing nodes to loose communication one way, we saw all servers having issues communicating properly with other internal services. ## Impact Caused some app-servers to be unable to serve admin, viewer, api and popups ## Cause We have an underlying issue with our provider where very small networking glitches can cause the VXLAN IPsec protocol to get out of sync, which causes communications issues between nodes in our cluster. ## Resolution While we can manually reset this and recover, which we did in this instance, we are still working with our vendors for a permanent fix. To mitigate this, we are adding even more infrastructure and capacity to prevent more downtime.

Updates as published by iPaper (original).