Current Status
| iq1.cloudsphere.com | Upgrade Scheduled |
Notifications
23rd Sep 2024 - Planned Maintenance (IQ1) - Completed
IQ1 maintenance window: 23rd Sep 2024 4:30UTC for approx. 2 hours
We will be performing an upgrade of our IQ1 Kubernetes technology. During this scheduled maintenance window, scanning data ingestion will be halted and data updates will be blocked. We will notify you during the works if there are any additional delays.
3rd July 2024 - Security Advisory - regreSSHion, CVE-2024-6387 (Update)
3rd July 2024 11:30UTC
A manual upgrade for any currently installed iQCloud appliance installation is being provided to all customers via email. All versions of the appliance (Cloud and direct OVA images) are being upgraded and will be available for download imminently.
3rd July 2024 16:00UTC Update
2th July 2024 - Security Advisory - regreSSHion, CVE-2024-6387 (Initial Notification)
2nd July 2024 13:00UTC for approx. 30 mins
We are aware of the announcement of the recent regression of that has been introduced into specific versions of the SSH Daemon (CVE-2024-6387). We are in the process of issuing instructions to all our customers to ensure that this security problem is removed.
2th July 2024 - Security upgrade (IQ1) - Completed
IQ1 maintenance window: 2nd July 2024 12:00UTC for approx. 30 mins
We will be performing an upgrade of our back-end security technology. During this scheduled maintenance window, there will be short UI downtime experienced and login failures. Once completed, all users will receive an email requesting that 2FA login credentials be established. This upgrade will allow the use of OTP in addition to the normal username/password login approach. The new security configuration requires the use of a Security Authenticator app (e.g. Microsoft Authenticator or Google Authenticator).
2th July 2024 - Planned Maintenance (IQ1) - Completed
IQ1 maintenance window: 2nd July 2024 4:30UTC for approx. 6 hour
We will be performing an upgrade of our IQ1 Kubernetes technology. During this scheduled maintenance window, there will be periodic UI downtime experienced and login failures. We will notify you during the works if there are any additional delays.
6th June 2024 - Planned Maintenance (IQ1) - Completed
IQ1 maintenance window: 6th June 2024 4:30UTC for approx. 6 hour
We will be performing an upgrade of our IQ1 Kubernetes technology. During this scheduled maintenance window, there will be periodic downtime experienced and login failures. We will notify you during the works if there are any additional delays.
8th April 2024 - Planned Maintenance (IQ1) - Completed
IQ1 maintenance window: 8th April 2024 4:30UTC for approx. 6 hour
We will be performing an upgrade of our IQ1 Kubernetes technology. During this scheduled maintenance window, there will be periodic downtime experienced and login failures. We will notify you during the works if there are any additional delays.
3rd April 2024 - UI/REST-API data retrieval operations unavailable (IQ2) - Completed
Identified: 3rd April 2024 17:30UTC
A problem has been identified with the CAM UI (data retrieval background services). Customers will be able to log into the UI but Explorer results will not be displayed (servers, services etc.). All counts will be displayed as 0 results. This is due to the fact that the data retrieval API is not available. The customer data is still available is not retrievable by the standard APIs/UI. We will provide updates as they become available.
Update: 3rd April 2024 19:05UTC
The root cause has been identified and the problem resolved. The problem is being placed under review to ensure no re-occurrence.
26th March 2024 - Backlog (IQ2) - Completed
Identified: 26th March 2024 9:30UTC
Customer have reported slow/no upgrades to the scan information associated their tenants. The problem has been rectified but their are backlogs of scan messages that remain to be ingested into the system. This resolution is still under review.
26th March 2024 20:30UTC
Most tenants will now have returned to normal operation. We are continuing to review the congestion problem to ensure return to normal operation.
26th March 2024 - Backlog (IQ2) - Completed
Identified: 26th March 2024 9:30UTC
Customer have reported slow/no upgrades to the scan information associated their tenants. The problem has been rectified but their are backlogs of scan messages that remain to be ingested into the system. This resolution is still under review.
26th March 2024 20:30UTC
Most tenants will now have retuned to normal operation. We are continuing to review the congestion problem to ensure return to normal operation.
26th March 2024 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: 26th March 2024 4:30UTC for approx. 6 hour
We will be performing an upgrade of our IQ2 Kubernetes technology. During this scheduled maintenance window, there will be periodic downtime experienced and login failures. We will notify you during the works if there are any additional delays.
20th March 2024 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: 20th March 2024 4:30UTC for approx. 2 hour
We will be performing migration of our IQ2 K8ssandra Cluster. During this scheduled maintenance window, there will be periodic downtime experienced and login failures. We will notify you during the works if there are any additional delays.
1st March 2024 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: 1st March 2024 16:00UTC for approx. 1 hour
Backend DB requires a rebuild. This will cause a temporary outage of the CloudSphere consoles with an inability to retrieve report elements. We will notify you during the works if there are any additional delays.
26th July 2023 - Planned Maintenance (IQ1) - Completed
IQ1 maintenance window: Wednesday 26th July 04:30UTC for approx. 6 hours
We are performing an upgrade on our IQ1 domain infrastructure. During this scheduled maintenance window, there will be periodic downtime experienced. We will notify you during the works if there are any additional delays.
All other domains are unaffected at this time.
24th July 2023 - Planned Maintenance (IQ3) - Completed
IQ3 maintenance window: Monday 24th July 04:30UTC for approx. 5 hours
We are performing an upgrade on our IQ3 domain infrastructure. During this scheduled maintenance window, there will be periodic downtime experienced. We will notify you during the works if there are any additional delays.
All other domains are unaffected at this time.
20th July 2023 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: Thursday 20th July 03:30UTC for approx. 2 hours
We are performing an upgrade on our IQ2 domain infrastructure. During this scheduled maintenance window, there will be periodic downtime experienced. We will notify you during the works if there are any additional delays.
All other domains are unaffected at this time.
7th June 2023 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: Wednesday 7th June 03:30UTC for approx. 6 hours
We are performing an upgrade on our IQ2 domain infrastructure. During this scheduled maintenance window, there will be periodic downtime experienced. We will notify you during the works if there are any additional delays.
All other domains are unaffected at this time.
11th May 2023 - Planned Maintenance (IQ2) - Completed
IQ2 maintenance window: Thursday May 11th 16:00UTC for 1 hour.
Some certificates issued by Azure used to manage the Kubernetes cluster need to be re-issued. This will require creation of new certs and then the recreation of all the Kubernetes workers. This may involve a small amount of downtime (of up to 30 minutes) during the rollout of new workers.
5th May 2023 - Defunct Reports Mechanism (All Domains) - Completed
The old reporting functionality within CAM based on exporting Excel reports has been deprecated for more than 6 months and has been replaced by the Interactive Console functionality. This deprecated functionality is now being actively removed from the CAM product.
No downtime is expected while this modification is being made.
12 April 2023 - Planned Maintenance (IQ3) - Completed
Starting at approximately 3.30am (UTC) on the 12 April 2023, planned maintenance on the IQ3 CAM platform will be carried out. The maintenance is expected to last 30 minutes.
All other domains are unaffected at this time.
Update: 03.45 UTC on 12 April 2023, the maintenance was completed.
20 March 2023 - Scanning Operations unavailable (IQ2) - Resolved
Starting at approximately 2pm on the 19 March 2023, customers identified that appliances were marked as being down on IQ2. The root cause analysis has identified that this loss of scanning operations is related to a SAAS communication router failing. This degradation in service is being addressed by the in-house teams.
The ETA for return to working functionality is approx 11.30am 20/Mar/2023. Additional notifications will be provided in due course.
All other domains are unaffected at this time.
Update: 11:30 UTC on 20 March 2023, this problem has now been resolved. All appliances should now have return to the 'UP' state.
16 March 2023 - Consoles unavailable - Resolved
Starting at approximately 16:30 UTC on 16 March 2023, customer identified that Consoles are no longer available from the CAM UI. This means that costs analysis and other console based operations, for example, scan remediation information are not available. This degradation in service is being addressed by the in-house teams. Additional notifications will be provided in due course.
All domains are affected at this time.
Update: 11:00 UTC on 20 March 2023, this problem continues to exist with a loss of the Dashboard functionality in the SAAS product. A resolution is currently in progress and an update on this status will be provide at 2pm today.
Update: 13:00 UTC on 21 March 2023, this problem has been resolved and a modified versions of the Consoles have ben pushed to production. Access to the consoles has been restored to all customers. This problem will be remain under review today to ensure no additional problems.
15 March 2023 - IQ2 Console Reporting degradation - Resolved
Starting at approximately 11:30 UTC on 15 March 2023, iQ2 experienced an degradation on the Console reporting. This was reflected in the User Interface as Full Economic Assessments report generation timing out. This may affects all tenants across the IQ2 domain. This degradation in service is being addressed by the in-house SRE team. Additional notifications will be provided in due course.
The other domains are unaffected at this time.
Update: 12:30 UTC on 16 March 2023, root cause analysis has been identified as an overloading problem condition when executing queries against the metrics DB in the product. This has the potential that customers will continue to see timeouts when reviewing cost information (which potentially may be out of date).
Update: 13:30 UTC on 21 March 2023, this problem continues to persist in the IQ2 deployment. A number of updates in the collection of metrics have already been rolled-out to customer deployments. Work in this area is continuing. Continue to be aware that this has the potential that customers will continue to see timeouts when reviewing cost information (which potentially may be out of date).
07 March 2023 - IQ2 Outage - Resolved
Starting at approximately 00:30 UTC on 07 March 2023, iQ2 experienced an outage that was reflected in the User Interface as appliances being reported as down and scanning related operations being unavailable. This affects all tenants across the IQ2 domain. This outage is being addressed by the in-house SRE team. Additional notifications will be provided in due course.
The other domains are unaffected at this time.
Update: 10:30 UTC on 07 March 2023, root cause analysis has identified the reason for the outage. SRE team rectifying.
Update: 10:55 UTC on 07 March 2023, SRE team rectified problem and service resuming. Stability of Service will remain under review.
Update: 13:45 UTC on 07 March 2023, Service is stable. Stability of Service will remain under review.
Update: 23:45 UTC on 07 March 2023, Service review complete; IQ2 status is Operational.
07 March 2923 - IQ1 Maintenance Scheduled - Cancelled
Starting at approximately 04:30 UTC on 07 March 2023, IQ1 domain will be down for scheduled maintenance and upgrade. This maintenance period is expected to last for 5 hrs. Additional notifications will be provided in due course.
The other domains are unaffected.
Update: 07 Mar 2023, maintenance has been rescheduled.
28 February 2023 - IQ2 Visibility of Metrics on CAM UI - Resolved
Starting at approximately 09:30 UTC on 28 February 2023, CAM UI metrics are no longer being disabled. This loss of feature was caused by the shutting-down of a specific REST API related to metrics display in the UI. This affects all tenants across the IQ2 domain. This reason for this reduction in service is being addressed by the in-house SRE team. Additional notifications will be provided in due course.
The other domains are unaffected at this time.
Update: 01 Mar 2023, reduction in service is still in affect.
Update: 02 Mar 2023, reduction in service is still in affect.
Update: 03 Mar 2023, normal service resumed.
27 February 2023 - IQ2 Outage
Starting at approximately 12:30 UTC on 27 February 2023, iQ2 experienced an outage that was reflect in the User Interface as an inability to login or failure to retrieve CAM data. This affects all tenants across the IQ2 domain. This outage is being addressed by the in-house SRE team. Additional notifications will be provided in due course.
The other domains are unaffected at this time.
Update: at approximately 13:40 UTC on 27 February 2023, service was restored to normal operation. Service will remain under review to confirm normal operation.
Update: at approximately 17:00 UTC on 27 February 2023 review completed.
08 November 2022 - IQ3 Maintenance Window
Starting at approximately 08:00 UTC on 08 November 2022, iQ3 (UK Domain) will be placed in maintenance mode for internal upgrade operations. The maintenance windows is expected to close at 12:00pm UTC (4 hours duration). During this time the iQ3 domain will not be available to customers.
The other domains will remain unaffected during this window.
30 Aug 2022 - Loss of Service
Starting at approximately 06:00 UTC on 30 Aug 2022, a Microsoft upgrade involving Ubuntu 18.4 deployments triggered a bug in this version lead to DNS resolution errors. Reports of this issue are confined to this single Ubuntu version. Microsoft reported this bug and a potential fix have been highlighted on the Canonical / Ubuntu website.
Due to this issue, there is downstream impact to other Azure services. A large portion of impact has been to Azure Kubernetes Service (AKS) in multiple regions, and other Azure services reliant on AKS. Apart CloudSphere deployments are AKS-based this impacted the CloudSphere solution.
Resolution by Microsoft was estimated to take 4 hours to complete testing and rollout to AKS resources, which will also mitigate some Azure services reliant on AKS