Update - We have verified long-term fixes: OCPBUGS-43821 (4.14), OCPBUGS-43856 (4.13), and OCPBUGS-43872 (4.12). Until those are available for updates, SRE recommends customers enable the Backup and DR API (backupdr.googleapis.com) in your Google Cloud Platform account, if not already enabled, as a preliminary mitigation. Please see https://access.redhat.com/solutions/7092988 for details. We will update this incident once cluster updates are available for OpenShift Dedicated.
Oct 30, 2024 - 17:50 EDT
Update - We are continuing to investigate this issue.
Oct 25, 2024 - 17:02 EDT
Update - We are continuing to investigate this issue.
Oct 25, 2024 - 16:42 EDT
Investigating - We've identified an error impacting cluster provisioning of OpenShift Dedicated clusters on GCP for versions 4.14 and below. While the issue is investigated, SRE recommends customers enable the Backup and DR API (backupdr.googleapis.com) in your Google Cloud Platform account, if not already enabled, as a preliminary mitigation. Please see https://access.redhat.com/solutions/7092988 for details.
Oct 25, 2024 - 16:40 EDT
Red Hat Ansible Lightspeed with IBM watsonx Code Assistant Operational
Ansible Lightspeed Operational
Container Registries Operational
Registry Account Management Operational
registry.redhat.io Operational
registry.access.redhat.com Operational
registry.connect.redhat.com Operational
Repositories Operational
maven.repository.redhat.com Operational
npm.registry.redhat.com Operational
repository.jboss.org Operational
access.redhat.com Operational
Community Operational
Downloads Operational
Homepage Operational
Jboss Network ? Operational
Knowledgebase Operational
Labs Operational
Product Life Cycles Operational
Search Operational
SFTP Operational
SSO Authentication Operational
Start Operational
Subscription Management API Operational
Subscription Management Frontend Operational
Support Cases Operational
api.openshift.com Operational
OpenShift Update Service ? Operational
Assisted Installer Service Operational
bugzilla.redhat.com Operational
Homepage Operational
catalog.redhat.com Operational
Catalog App Operational
Container API Operational
Search Operational
cloud.redhat.com Operational
Homepage Operational
Search Operational
SSO Authentication Operational
Experts Operational
connect.redhat.com Operational
Container Factory - Partner Certification Workflow Operational
Partner Acceleration Desk Operational
Partner Account Management Operational
Partner Program Content Operational
Partner Subscriptions Operational
Partner Training Portal Operational
Red Hat Content Center Operational
Search Operational
SSO Authentication Operational
rhcert.connect.redhat.com Operational
console.redhat.com Operational
Ansible Automation Platform - Automation Analytics Operational
Ansible Automation Platform - Automation Hub Operational
Cost Management Operational
Insights - Advisor Operational
Insights - Compliance Operational
Insights - Drift Operational
Insights - Edge Operational
Insights - Historical System Profiles Operational
Insights - Malware Detection Operational
Insights - Notifications Operational
Insights - Patch Operational
Insights - Policies Operational
Insights - Remediations Operational
Insights - Resource Optimization Operational
Insights - System Baseline Operational
Insights - Vulnerability Operational
Insights - Image Builder Operational
Inventory Operational
OpenShift Cluster Manager Operational
RBAC Operational
Red Hat Insights - Sources Operational
Red Hat Advanced Cluster Security Cloud Service Operational
Red Hat OpenShift Data Science Operational
Red Hat Trusted Application Pipeline - Api Operational
Red Hat Trusted Application Pipeline - Build Pipelines Operational
Red Hat Trusted Application Pipeline - Component Onboarding Operational
Red Hat Trusted Application Pipeline - Component Promotion Operational
Red Hat Trusted Application Pipeline - Console Operational
Red Hat Trusted Application Pipeline - Continuous Deployment Operational
Red Hat Trusted Application Pipeline - Java Build Service Operational
Red Hat Trusted Application Pipeline - Release Pipelines Operational
Red Hat Trusted Application Pipeline - Secrets Management Operational
Red Hat Trusted Application Pipeline - Test Pipelines Operational
Subscription Watch Operational
Uploads Operational
content.redhat.com Operational
Homepage Operational
developers.redhat.com Operational
Downloads Operational
Search Operational
SSO Authentication Operational
Web Page Content Operational
docs.redhat.com Operational
Content Operational
Homepage Operational
Product Hub Operational
Product Index Operational
Search Operational
intelligence.redhat.com Operational
API Operational
Homepage Operational
issues.redhat.com Operational
Bugzilla Plugin Operational
issues.redhat.com - Profile Operational
issues.redhat.com - Projects Operational
jboss.org Operational
Homepage Operational
partners.connect.redhat.com Operational
Partner Relationship Management Operational
SSO Operational
Quay.io Operational
API Operational
Build System Operational
Registry Operational
Frontend Operational
Security Scanning Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
The OpenShift Cluster Manager will undergo maintenance work to make infrastructure improvements. The maintenance will start on Sunday, November 10 at 07:00 UTC and may last up to 15 min. During that time no services should be impacted and no downtime should occur.
Posted on Oct 30, 2024 - 04:36 EDT
Past Incidents
Nov 3, 2024

No incidents reported today.

Nov 2, 2024
Resolved - This incident has been resolved.
Nov 2, 12:25 EDT
Update - We are continuing to investigate this issue.
Nov 2, 12:25 EDT
Investigating - We are currently investigating this issue.
Nov 2, 06:46 EDT
Nov 1, 2024
Resolved - This incident has been resolved.
Nov 1, 09:17 EDT
Monitoring - A fix has been implemented and we no longer observing increased failures.
Oct 31, 15:26 EDT
Update - We are continuing to work on a fix for this issue. Builds that have failed should be run again since the failures are intermittent.
Oct 25, 16:43 EDT
Identified - The issue has been identified and a fix is being implemented.
Oct 23, 18:26 EDT
Update - We continue to investigate the root cause, but builds we can confirm builds are intermittently working.
Oct 23, 11:21 EDT
Investigating - We are currently investigating an issue where builds are showing an error related to "Preparing build node."
Oct 23, 10:00 EDT
Oct 31, 2024
Oct 30, 2024

Unresolved incident: Partial Outage for Openshift Cluster Manager.

Oct 29, 2024

No incidents reported.

Oct 28, 2024

No incidents reported.

Oct 27, 2024

No incidents reported.

Oct 26, 2024

No incidents reported.

Oct 25, 2024
Oct 24, 2024

No incidents reported.

Oct 23, 2024
Oct 22, 2024
Resolved - This incident has been resolved.
Oct 22, 16:39 EDT
Update - We are continuing to monitor for any further issues.
Oct 22, 16:31 EDT
Monitoring - We have implemented a fix and are seeing error rates decrease. We are continuing to monitor the situation.
Oct 22, 16:29 EDT
Update - We are continuing to investigate this issue.
Oct 22, 15:23 EDT
Investigating - We are currently investigating an issue with the OpenShift Update Service.
Oct 22, 15:21 EDT
Resolved - This incident has been resolved.
Oct 22, 09:21 EDT
Identified - The issue has been identified and a fix is being implemented.
Oct 22, 08:59 EDT
Investigating - We are currently investigating this issue.
Oct 22, 08:09 EDT
Resolved - This incident has been resolved.
Oct 22, 07:07 EDT
Investigating - We are currently investigating this issue.
Oct 22, 06:29 EDT
Oct 21, 2024
Resolved - The build system has been restored. We will be working to add additional alerting and monitoring in the coming days.
Oct 21, 13:48 EDT
Investigating - We are currently investigating an issue where builds are showing an error related to "Preparing build node."
Oct 21, 11:31 EDT
Oct 20, 2024
Completed - The scheduled maintenance has been completed.
Oct 20, 07:15 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 20, 05:00 EDT
Scheduled - Backend maintenance is scheduled for 20 October, 2024 5am-7:15am EDT / 9am-11:15am UTC. During this time Support Cases will be inaccessible, which means customers will not be able to view, create or edit cases. To create support cases during the maintenance window, use techsupport@redhat.com or in critical circumstances, contact Support via phone: https://access.redhat.com/support/contact/technicalSupport .
Sep 6, 13:02 EDT