Incidents reported on status page for Fragment https://status.onfragment.com/ https://d1lppblt9t2x15.cloudfront.net/logos/ea04bf57aa7fca91db8e2a02f7f5f463.png https://status.onfragment.com/ en https://status.onfragment.com/incident/723197 Fri, 12 Sep 2025 13:59:00 -0000 https://status.onfragment.com/incident/723197#66f31b960c4b0a62ac8af06cb909e7fc34f147e1284b706152aa071620c68f41 The API was not available during 2 time chunks chunk 1: from 12:34:33pm to 12:35:08pm (35 seconds) chunk 2: from 12:35:46pm to 12:36:42 (56 seconds) The first chunk was the result of an unexpectedly large analytics query from one of our customers combined with an improper thread management at the server level (blocking other queries). The second chunk was a consequence of the accumulation of requests during the first chunk that overloaded the replicas once they started processing requests again. This triggered a restart + scale up event. The whole process took 56 seconds after which situation went back to normal At 13:51pm, a fix has been deployed to prevent large queries from blocking the server. https://status.onfragment.com/ Fri, 12 Sep 2025 12:36:41 +0000 https://status.onfragment.com/#cc3f30024bc9d381c9b0b80e6caad224c63b2b153b1d795aede3003ca624b928 api.onfragment.com recovered https://status.onfragment.com/ Fri, 12 Sep 2025 12:34:52 +0000 https://status.onfragment.com/#cc3f30024bc9d381c9b0b80e6caad224c63b2b153b1d795aede3003ca624b928 api.onfragment.com went down https://status.onfragment.com/ Thu, 28 Aug 2025 12:07:28 +0000 https://status.onfragment.com/#055f80745ff25587da6b2ce2f38c45dd2357d1d4c176ae7e1a3fc2bc7448f50e api.onfragment.com recovered https://status.onfragment.com/ Thu, 28 Aug 2025 12:06:28 +0000 https://status.onfragment.com/#055f80745ff25587da6b2ce2f38c45dd2357d1d4c176ae7e1a3fc2bc7448f50e api.onfragment.com went down https://status.onfragment.com/ Wed, 27 Aug 2025 07:35:43 +0000 https://status.onfragment.com/#dc1ec9022380067a268e78bd562ed24bcc02306a711bf0864160f1856ef88238 api.onfragment.com recovered https://status.onfragment.com/ Wed, 27 Aug 2025 07:33:43 +0000 https://status.onfragment.com/#dc1ec9022380067a268e78bd562ed24bcc02306a711bf0864160f1856ef88238 api.onfragment.com went down https://status.onfragment.com/ Wed, 06 Aug 2025 13:04:47 +0000 https://status.onfragment.com/#f9a704ce769f9e1bf764a7d9bdc29c00468c1b828cea277a8850cd888b9b9288 api.onfragment.com recovered https://status.onfragment.com/ Wed, 06 Aug 2025 13:04:18 +0000 https://status.onfragment.com/#f9a704ce769f9e1bf764a7d9bdc29c00468c1b828cea277a8850cd888b9b9288 api.onfragment.com went down https://status.onfragment.com/ Tue, 05 Aug 2025 13:14:30 +0000 https://status.onfragment.com/#9536a76164dbd12505f3b85524ca14bd13cbd399f43fca57a909ea051c2a9eff api.onfragment.com recovered https://status.onfragment.com/ Tue, 05 Aug 2025 13:13:31 +0000 https://status.onfragment.com/#9536a76164dbd12505f3b85524ca14bd13cbd399f43fca57a909ea051c2a9eff api.onfragment.com went down https://status.onfragment.com/ Mon, 04 Aug 2025 13:38:02 +0000 https://status.onfragment.com/#56d5e1a42f2a1b781c614698739a60bd2973967446eee0391a64b3e002875284 api.onfragment.com recovered https://status.onfragment.com/ Mon, 04 Aug 2025 13:37:20 +0000 https://status.onfragment.com/#56d5e1a42f2a1b781c614698739a60bd2973967446eee0391a64b3e002875284 api.onfragment.com went down https://status.onfragment.com/ Mon, 04 Aug 2025 13:21:06 +0000 https://status.onfragment.com/#44d8e0818df06ae402981ef6bbc1eb63e91399a057835b553952452dde694072 api.onfragment.com recovered https://status.onfragment.com/ Mon, 04 Aug 2025 13:20:41 +0000 https://status.onfragment.com/#44d8e0818df06ae402981ef6bbc1eb63e91399a057835b553952452dde694072 api.onfragment.com went down https://status.onfragment.com/ Mon, 04 Aug 2025 12:53:09 +0000 https://status.onfragment.com/#46b87c9f11dc39afe82a680df711763ac0b6e9e03216fb4e71f0c417ab710052 api.onfragment.com recovered https://status.onfragment.com/ Mon, 04 Aug 2025 12:52:36 +0000 https://status.onfragment.com/#46b87c9f11dc39afe82a680df711763ac0b6e9e03216fb4e71f0c417ab710052 api.onfragment.com went down https://status.onfragment.com/incident/614124 Sun, 06 Jul 2025 04:10:04 -0000 https://status.onfragment.com/incident/614124#62cbd95a92de1368330b34a6b9ef0d9e787354f4de80b7942346f47db99a934c Maintenance completed https://status.onfragment.com/ Sun, 06 Jul 2025 04:01:38 +0000 https://status.onfragment.com/#d64a2f9efc18d1ef2130c96427c6f8108beb025645fcb830aad9a9346b8243e1 api.onfragment.com recovered https://status.onfragment.com/ Sun, 06 Jul 2025 04:00:08 +0000 https://status.onfragment.com/#d64a2f9efc18d1ef2130c96427c6f8108beb025645fcb830aad9a9346b8243e1 api.onfragment.com went down https://status.onfragment.com/incident/614124 Sun, 06 Jul 2025 04:00:04 -0000 https://status.onfragment.com/incident/614124#a623fd2defe4da7013c817d0693878176704a45776748c58c204695e0fba4a06 Our cloud provider will be performing some maintenance on our DB. We expect a few minutes of downtime https://status.onfragment.com/ Tue, 24 Jun 2025 10:04:07 +0000 https://status.onfragment.com/#6266daba6ea95f778874984b218d743d9144ed49ed65406f24481c3e4458a7e2 api.onfragment.com recovered https://status.onfragment.com/ Tue, 24 Jun 2025 10:02:39 +0000 https://status.onfragment.com/#6266daba6ea95f778874984b218d743d9144ed49ed65406f24481c3e4458a7e2 api.onfragment.com went down https://status.onfragment.com/ Mon, 23 Jun 2025 14:08:27 +0000 https://status.onfragment.com/#017022a989f107ffddf053c6f60f10573033468fc168d8beafc4cc1003ea84f0 api.onfragment.com recovered https://status.onfragment.com/ Mon, 23 Jun 2025 14:07:28 +0000 https://status.onfragment.com/#017022a989f107ffddf053c6f60f10573033468fc168d8beafc4cc1003ea84f0 api.onfragment.com went down https://status.onfragment.com/incident/604418 Sun, 22 Jun 2025 04:10:00 -0000 https://status.onfragment.com/incident/604418#1de3b00d6561c3ddfc2721181d6caacf8ac6855b63f8ab11b7e16a8a565f1b24 Maintenance completed https://status.onfragment.com/ Sun, 22 Jun 2025 04:05:59 +0000 https://status.onfragment.com/#1305bc993b3ff54c30a5eb8c435313a14e45607fb3c07c061f24cb6769251377 api.onfragment.com recovered https://status.onfragment.com/ Sun, 22 Jun 2025 04:00:57 +0000 https://status.onfragment.com/#1305bc993b3ff54c30a5eb8c435313a14e45607fb3c07c061f24cb6769251377 api.onfragment.com went down https://status.onfragment.com/incident/604418 Sun, 22 Jun 2025 04:00:00 -0000 https://status.onfragment.com/incident/604418#83f7fecf4709c75387bfd0b5f2409e3d82c2ed0e4fd562208609a3c26b004620 Our cloud provider will be performing some maintenance on our DB. We expect a few minutes of downtime. https://status.onfragment.com/incident/598162 Fri, 06 Jun 2025 11:58:00 -0000 https://status.onfragment.com/incident/598162#f42d12e47373fae281c087a00d9e441bd6b54b200fde32ac4448661b3b30d3f5 All task inserts and updates were rejected during 11:55:57 to 11:58:02 UTC due to a incorrect migration. https://status.onfragment.com/incident/598162 Fri, 06 Jun 2025 11:56:00 -0000 https://status.onfragment.com/incident/598162#a2bb05ef46f5e9f30f46bc846b88df1eb2c83b328e7d2d8201c09c13d24e54b8 All task inserts and updates were rejected during 11:55:57 to 11:58:02 UTC due to a incorrect migration. https://status.onfragment.com/incident/596888 Thu, 05 Jun 2025 14:27:00 -0000 https://status.onfragment.com/incident/596888#79983c23e6d959579e1f0329e9e136e2bad8ad1bbf61fa680f31cac52f201b3e Migration is over -- we have seen very little impact on production. https://status.onfragment.com/incident/596888 Wed, 04 Jun 2025 11:40:00 -0000 https://status.onfragment.com/incident/596888#93b8eba035eacee8e440868a3db7aa1cfb4bd92f8ab68e344458490e2d659d23 A migration is in progress. You might see slower requests than usual. We're monitoring the migration to limit the impact. https://status.onfragment.com/incident/595581 Mon, 02 Jun 2025 13:51:00 -0000 https://status.onfragment.com/incident/595581#286b758548f15ecf5faa59f874a8438857f6ca756b47ce47b08e8a2fd6f8e5d0 We're no longer seeing dropped requests. We identified heavy load of an un-optimized dashboard query. We will migrate this query to a newer, faster query. https://status.onfragment.com/incident/595581 Mon, 02 Jun 2025 13:37:00 -0000 https://status.onfragment.com/incident/595581#5decde78b598ea41622c247caececb18c48b4007003cc283db00cb58691d7294 We're seing some dropped requests. We're investigating. https://status.onfragment.com/incident/556707 Mon, 05 May 2025 13:10:00 -0000 https://status.onfragment.com/incident/556707#cf95d46d0d73e6149da111868c920819b85b9cc2bd381c41b2871d942558b215 We reduced the load by 3x on a problematic client, hoping this would help mitigate the circumstantial issue in the future. https://status.onfragment.com/incident/556707 Mon, 05 May 2025 10:21:00 -0000 https://status.onfragment.com/incident/556707#692a49f5cafccd1db3596bdd01423d82e43e1d704e20958fb8e297fa820f363c Issue seem to come from increased usage of our reporting dashboards, we're making scaling adjustements. https://status.onfragment.com/incident/556707 Mon, 05 May 2025 08:39:00 -0000 https://status.onfragment.com/incident/556707#9715235762a5f59af2e6a203609684417058746f0184fa4717497534e6a0bad2 We're seeing some dropped requests, we're investigating. https://status.onfragment.com/incident/553806 Tue, 29 Apr 2025 14:27:00 -0000 https://status.onfragment.com/incident/553806#a14ecf10d90c32dccf943b725f132a309577158ad33835989be853771caff804 We have identified the root cause and implemented a fix. https://status.onfragment.com/incident/553806 Tue, 29 Apr 2025 13:21:00 -0000 https://status.onfragment.com/incident/553806#1414a52324db0a2f47c38014404ad5635fe60d52312875229e4bc8f9b2645110 The API has been dropping requests intermittently from 3:13pm to 3:15pm. We're investigating https://status.onfragment.com/incident/549063 Tue, 22 Apr 2025 14:49:00 -0000 https://status.onfragment.com/incident/549063#35e8b40829c9ac58c136ff578d3f984f9f690de2582a13fd0de7c08e098c4711 We haven't been able to isolate a root cause and it looks like random traffic congestion due to slightly increased load. We'll continue monitoring such spikes and make scaling adjustments if such issues happen again. https://status.onfragment.com/incident/549063 Tue, 22 Apr 2025 13:40:00 -0000 https://status.onfragment.com/incident/549063#58aaf00153b96bccf164e0ee9aa79fd7d36ab4b1a1ea7c38010071f8c204dab7 We've seen a spike of 503 errors at 2:35pm CET. We're investigating https://status.onfragment.com/incident/544870 Mon, 14 Apr 2025 08:39:00 -0000 https://status.onfragment.com/incident/544870#71eebccbd5f8384fa1edc25882591ee112918209f8919cbe07cdce390c887497 The fix has been deployed. We'll keep monitoring. https://status.onfragment.com/incident/544870 Mon, 14 Apr 2025 08:28:00 -0000 https://status.onfragment.com/incident/544870#e1c8fd31a32ac741a3c91cc100f82b2460ac99b6702ab3b096e1e22e4bdb8e62 We have confirmed the root cause and a fix is under way https://status.onfragment.com/incident/544870 Mon, 14 Apr 2025 08:17:00 -0000 https://status.onfragment.com/incident/544870#8ff1c4dc821b15ba25d7990356538564e66dce5f176962b6bd791c4fadd77f8c We're seeing random 503 errors. We've identified a potential root cause and are working on addressing the issue