Incidents reported on status page for intel471 https://status.intel471.com/ https://d1lppblt9t2x15.cloudfront.net/logos/40bd357f802d0a55a1e6337361bc363e.webp https://status.intel471.com/ en https://status.intel471.com/incident/373577 Thu, 23 May 2024 09:16:00 -0000 https://status.intel471.com/incident/373577#f6f4a82a61c190c0e82b523da7c34060d7ee98f4ddf33db5898c995cbab93d2c The Issue with ingestion of new data into Titan affecting all data sources have now been resolved. https://status.intel471.com/incident/373577 Thu, 23 May 2024 09:16:00 -0000 https://status.intel471.com/incident/373577#f6f4a82a61c190c0e82b523da7c34060d7ee98f4ddf33db5898c995cbab93d2c The Issue with ingestion of new data into Titan affecting all data sources have now been resolved. https://status.intel471.com/incident/373577 Thu, 23 May 2024 08:19:00 -0000 https://status.intel471.com/incident/373577#6b5d95834537d7b87bb87b01547c66ba5c65c13fac4966474653ab5fc4b8f09b We are investigating a issue with ingestion of new data into Titan affecting all data sources. Current data in Portal and API is available but no new data is being ingested. Watchers and alerts may also affected and alerts may not be generated. This issue appears to have started at around 01:00UTC on the 23rd May 2024. https://status.intel471.com/incident/373577 Thu, 23 May 2024 08:19:00 -0000 https://status.intel471.com/incident/373577#6b5d95834537d7b87bb87b01547c66ba5c65c13fac4966474653ab5fc4b8f09b We are investigating a issue with ingestion of new data into Titan affecting all data sources. Current data in Portal and API is available but no new data is being ingested. Watchers and alerts may also affected and alerts may not be generated. This issue appears to have started at around 01:00UTC on the 23rd May 2024. https://status.intel471.com/incident/369311 Tue, 14 May 2024 18:00:00 -0000 https://status.intel471.com/incident/369311#da9301c9c27ad99562326054007e9b0ce3bcc98f8de6490980c97926d4f05ef4 Titan Portal, API and DAL services have been resolved. A issue with the host of the main gateway has been resolved by a restart and will continue to be investigated. https://status.intel471.com/incident/369311 Tue, 14 May 2024 18:00:00 -0000 https://status.intel471.com/incident/369311#da9301c9c27ad99562326054007e9b0ce3bcc98f8de6490980c97926d4f05ef4 Titan Portal, API and DAL services have been resolved. A issue with the host of the main gateway has been resolved by a restart and will continue to be investigated. https://status.intel471.com/incident/369311 Tue, 14 May 2024 17:41:00 -0000 https://status.intel471.com/incident/369311#2524ddd738a846e3412e554960a74523a71c4f2de00dd9356ae949715f7cbcde We are aware of a issue affecting Titan Portal, Titan API and all services located in DAL and are investigating. https://status.intel471.com/incident/369311 Tue, 14 May 2024 17:41:00 -0000 https://status.intel471.com/incident/369311#2524ddd738a846e3412e554960a74523a71c4f2de00dd9356ae949715f7cbcde We are aware of a issue affecting Titan Portal, Titan API and all services located in DAL and are investigating. https://status.intel471.com/incident/365493 Tue, 07 May 2024 18:01:00 -0000 https://status.intel471.com/incident/365493#c7745946f905feeca7925342f346a3a854ce61d7f76bdea4b08bb5e6dadf19b1 . https://status.intel471.com/incident/365493 Tue, 07 May 2024 18:01:00 -0000 https://status.intel471.com/incident/365493#c7745946f905feeca7925342f346a3a854ce61d7f76bdea4b08bb5e6dadf19b1 . https://status.intel471.com/incident/365493 Mon, 06 May 2024 11:54:00 -0000 https://status.intel471.com/incident/365493#f55cfb2777947b3445f8c2a2e22ad0ab917f6f6b873a2ca44eaba23eb094b284 Issues with Titan Portal and API have now been resolved. Issues with Forums Data Acquisition and Rhea are continuing. https://status.intel471.com/incident/365493 Mon, 06 May 2024 11:54:00 -0000 https://status.intel471.com/incident/365493#f55cfb2777947b3445f8c2a2e22ad0ab917f6f6b873a2ca44eaba23eb094b284 Issues with Titan Portal and API have now been resolved. Issues with Forums Data Acquisition and Rhea are continuing. https://status.intel471.com/incident/365493 Mon, 06 May 2024 11:36:00 -0000 https://status.intel471.com/incident/365493#eb2bd1f0500d8ed4aff3634a0e2144b2b58579b16f934dd73426527610dfdbed We are aware of a outage of Titan Portal and API and are investigating in addition to continuing issues affecting Data Acquisition, Rhea and various internal tools including the DAL Docker Registry, Resfleet and Vault. Titan Portal and API are unavailable and no new data is being ingested for Forums. Ingestion for Data Leak blogs is unaffected. https://status.intel471.com/incident/365493 Mon, 06 May 2024 11:36:00 -0000 https://status.intel471.com/incident/365493#eb2bd1f0500d8ed4aff3634a0e2144b2b58579b16f934dd73426527610dfdbed We are aware of a outage of Titan Portal and API and are investigating in addition to continuing issues affecting Data Acquisition, Rhea and various internal tools including the DAL Docker Registry, Resfleet and Vault. Titan Portal and API are unavailable and no new data is being ingested for Forums. Ingestion for Data Leak blogs is unaffected. https://status.intel471.com/incident/365493 Mon, 06 May 2024 11:04:00 -0000 https://status.intel471.com/incident/365493#3154a9ddade3a31ce38068fa208c72869730214d2ec8a4100398183883a33593 We are aware of a outage of the Titan API and are investigating in addition to continuing issues affecting Data Acquisition, Rhea and various internal tools including the DAL Docker Registry, Resfleet and Vault. The Titan API is unavailable and no new data is being ingested for Forums. Ingestion for Data Leak blogs is unaffected. https://status.intel471.com/incident/330791 Fri, 23 Feb 2024 17:57:00 -0000 https://status.intel471.com/incident/330791#a00b0d2da843cfd5b0bd23b4f00edbbd4e55a56a5128af724adf85a75173fa5f There issue with Titan API has been resolved. Titan Portal was unaffected. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/330791 Fri, 23 Feb 2024 03:36:00 -0000 https://status.intel471.com/incident/330791#5240b82567196c445bce41a6bc954f2bb2c8eba8c9afce089e4586abb6804742 There is a ongoing issue with Titan API that has been escalated to the application team. The majority of requests to the Titan API are failing with 504 gateway timeout. Titan Portal is unaffected. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/330791 Fri, 23 Feb 2024 02:10:00 -0000 https://status.intel471.com/incident/330791#ed154a27a86fcabcab3ec1d38d84dca9c5078a7a3604f2526cc1ea36ec24bba3 We are investigating a issue with Titan API being unavailable. Portal appears to be unaffected. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 18:11:00 -0000 https://status.intel471.com/incident/330085#57b284cf4665020ba7238bb4a63654dc8d56c931f4b36d8b212aa93187370e3f The issue with Titan Portal and API now looks resolved with our internal monitoring showing healthy states. We will continue to monitor the situation with the upstream vendor Cloudflare. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 18:11:00 -0000 https://status.intel471.com/incident/330085#57b284cf4665020ba7238bb4a63654dc8d56c931f4b36d8b212aa93187370e3f The issue with Titan Portal and API now looks resolved with our internal monitoring showing healthy states. We will continue to monitor the situation with the upstream vendor Cloudflare. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 17:53:00 -0000 https://status.intel471.com/incident/330085#6c66361b0dc0b43213021f8f5671c38ea9e6eead293cbaa4f11744ee451d4006 There are still ongoing issues with Titan API and Portal related to a Cloudflare outage, we are monitoring the situation and will provide updates when known. Please send any questions to tmoran@intel471.com https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 17:53:00 -0000 https://status.intel471.com/incident/330085#6c66361b0dc0b43213021f8f5671c38ea9e6eead293cbaa4f11744ee451d4006 There are still ongoing issues with Titan API and Portal related to a Cloudflare outage, we are monitoring the situation and will provide updates when known. Please send any questions to tmoran@intel471.com https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 17:40:00 -0000 https://status.intel471.com/incident/330085#d1494ed535b0bc5cc0e205946a68119e24c6a69441d2f0f4566ab57ae44a24f6 We are investigating intermittent issues with the Titan Portal and API. There is currently no ETA to resolution. Please contact tmoran@intel471.com with any questions https://status.intel471.com/incident/330085 Wed, 21 Feb 2024 17:40:00 -0000 https://status.intel471.com/incident/330085#d1494ed535b0bc5cc0e205946a68119e24c6a69441d2f0f4566ab57ae44a24f6 We are investigating intermittent issues with the Titan Portal and API. There is currently no ETA to resolution. Please contact tmoran@intel471.com with any questions https://status.intel471.com/incident/299955 Wed, 13 Dec 2023 19:20:00 -0000 https://status.intel471.com/incident/299955#2b367cae62c4460da1efeb4f7f1b4e0b6cc6212fcfa4163334c53277a77ffdae The issue with the Titan API has been resolved, Titan Portal was unaffected. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/299955 Wed, 13 Dec 2023 15:13:00 -0000 https://status.intel471.com/incident/299955#0944ab1e87ee92593e6583e7e9f64170936c35d3a55c17d8d3ba12881e32438c We have a continuing outage of the Titan API, Titan Portal is still available and is unaffected by this. A urgent fix has been developed and is currently being tested with no current ETA to resolution. Please send any questions to #dev_production_incidents Sent by: tmoran@intel471.com https://status.intel471.com/incident/299955 Wed, 13 Dec 2023 12:34:00 -0000 https://status.intel471.com/incident/299955#dc3287fcfaa14e90567a22ddc9129e1b5cfe9b6ba61a33fa0ab358d73938acb6 We have a continuing outage of the Titan API, Titan Portal is still available and is unaffected by this. A issue on the application side is being investigated and a urgent fix being developed with no current ETA. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/299955 Wed, 13 Dec 2023 11:25:00 -0000 https://status.intel471.com/incident/299955#6f5f8f5a360bb2a2565e171bc2255df435d7795f7c5ea457456fcbb287e23c90 We are aware of a outage with Titan API, Titan Portal is still available. This is being investigated with no current ETA. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 10:42:00 -0000 https://status.intel471.com/incident/290646#92a4feca395e17d7107f22b33d101d5c6bfeb238d33114f8bc10dfd9f5e1586d Issues with Titan Portal and API have now been resolved. Please send any questions to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 10:42:00 -0000 https://status.intel471.com/incident/290646#92a4feca395e17d7107f22b33d101d5c6bfeb238d33114f8bc10dfd9f5e1586d Issues with Titan Portal and API have now been resolved. Please send any questions to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 10:29:00 -0000 https://status.intel471.com/incident/290646#fef8affb99c7531c21d16844871081e8d78fa3f98f2486dbeb2888866a8fa976 We are continuing to investigate intermittent issues with Titan Portal. Elasticsearch has been stabilised however Malware Dashboard and RFIs in Titan are still timing out with no current ETA to resolution. Please send any questions or problems with other pages to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 10:29:00 -0000 https://status.intel471.com/incident/290646#fef8affb99c7531c21d16844871081e8d78fa3f98f2486dbeb2888866a8fa976 We are continuing to investigate intermittent issues with Titan Portal. Elasticsearch has been stabilised however Malware Dashboard and RFIs in Titan are still timing out with no current ETA to resolution. Please send any questions or problems with other pages to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 09:23:00 -0000 https://status.intel471.com/incident/290646#a67c04df15f9c04543e9d7fca3e41762c0769cf41f9efce104222c6b3e112be5 We are currently investigating intermittent issues with Titan Portal and Titan API due to instability in Elasticsearch with no current ETA to a resolution. This may cause pages in Titan to not load or return timeouts. A refresh may or may not fix the problem. Please send any questions to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/290646 Wed, 22 Nov 2023 09:23:00 -0000 https://status.intel471.com/incident/290646#a67c04df15f9c04543e9d7fca3e41762c0769cf41f9efce104222c6b3e112be5 We are currently investigating intermittent issues with Titan Portal and Titan API due to instability in Elasticsearch with no current ETA to a resolution. This may cause pages in Titan to not load or return timeouts. A refresh may or may not fix the problem. Please send any questions to #dev_production_incidents Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:37:00 -0000 https://status.intel471.com/incident/280018#ed0cab4ba9657cc119c3f3b0e02594aa65f0b071d2bd391be0803273d9dedc75 Cloudflare has applied a fix and all services including Titan are now available. We are continuing to monitor the situation to confirm this is resolved. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:37:00 -0000 https://status.intel471.com/incident/280018#ed0cab4ba9657cc119c3f3b0e02594aa65f0b071d2bd391be0803273d9dedc75 Cloudflare has applied a fix and all services including Titan are now available. We are continuing to monitor the situation to confirm this is resolved. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:19:00 -0000 https://status.intel471.com/incident/280018#c73f479412eb4d3073df08c0e26372cb86d96763af4e26699c2546835fd9c0f8 There is currently a total outage with Titan and various other services due to a Cloudflare Outage, They are aware of the issue and we are working to escalate it with them. Further updates will be provided when known. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:19:00 -0000 https://status.intel471.com/incident/280018#c73f479412eb4d3073df08c0e26372cb86d96763af4e26699c2546835fd9c0f8 There is currently a total outage with Titan and various other services due to a Cloudflare Outage, They are aware of the issue and we are working to escalate it with them. Further updates will be provided when known. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:08:00 -0000 https://status.intel471.com/incident/280018#e595f1919de18ed1e2698894f002b13a82735ae0d8e8d7906df9847f2be4b3f0 There is currently a issue with Titan and various other services such as ATLAS, where they are not loading past Cloudflare, initial indications are a issue with Cloudflare but we are investigating Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/280018 Mon, 30 Oct 2023 20:08:00 -0000 https://status.intel471.com/incident/280018#e595f1919de18ed1e2698894f002b13a82735ae0d8e8d7906df9847f2be4b3f0 There is currently a issue with Titan and various other services such as ATLAS, where they are not loading past Cloudflare, initial indications are a issue with Cloudflare but we are investigating Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/252286 Wed, 30 Aug 2023 07:00:00 -0000 https://status.intel471.com/incident/252286#17ac438d65d90a636e27077f97e4e7b7e8cc99e65c0c127e889551e6fb9ca86c Maintenance completed https://status.intel471.com/incident/252286 Wed, 30 Aug 2023 07:00:00 -0000 https://status.intel471.com/incident/252286#17ac438d65d90a636e27077f97e4e7b7e8cc99e65c0c127e889551e6fb9ca86c Maintenance completed https://status.intel471.com/incident/252286 Wed, 30 Aug 2023 06:00:00 -0000 https://status.intel471.com/incident/252286#bfd6343f1a0d6a3b45ce99c3c4821c046aaa4968f320e5616c0020b88af1d2d1 Whilst there is a risk no impact or downtime is expected on services in the Dallas DC including Titan, we will monitor to confirm this during the window. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/252286 Wed, 30 Aug 2023 06:00:00 -0000 https://status.intel471.com/incident/252286#bfd6343f1a0d6a3b45ce99c3c4821c046aaa4968f320e5616c0020b88af1d2d1 Whilst there is a risk no impact or downtime is expected on services in the Dallas DC including Titan, we will monitor to confirm this during the window. Please send any questions to #dev_production_incidents. Sent by: tmoran@intel471.com https://status.intel471.com/incident/216697 Tue, 06 Jun 2023 17:06:00 -0000 https://status.intel471.com/incident/216697#e269a6a4ed73966075d121becf51fc6a0079c0ad47a25e4c42d6c3ab67be7e7e The intermittent issue affecting emails from Titan including MFA emails has been resolved. The root cause was down to the provider depreciating certain SSL protocols. An update to the mailer application was made to resolve this. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com https://status.intel471.com/incident/216697 Tue, 06 Jun 2023 10:22:00 -0000 https://status.intel471.com/incident/216697#6c132f34da9406f7137824f84fa464858d1aeb51613266830149014d17abb37d We are aware of an intermittent issue affecting emails from Titan including MFA emails not being sent. This appears to be down to an issue communicating with our Primary email provider Sendgrid. Most emails are being sent from the Secondary provider Mailgun. Please contact #dev_production_incidents for any questions Message Sent By: tmoran@intel471.com