IT service updates
Planned disruption for OHS course content on Learn.UQ (Blackboard)
Reduced service delivery during period
ITS advises that the UQ Workplace Inductions and Training (OHSB0000N_0000_00000) course will not be available during Tuesday night while it is being updated. While this work is being carried out, student access to courses will be normal. For academics only, if you update your course during this time then the automatic email notification will not be sent to students.
Service affected: Blackboard Learn
Start: 3 Oct 2023, 9:00 PM
End: 3 Oct 2023, 10:00 PM
Login to request notification
Database Maintenance for Confluence
Resolved
Need to perform underlying application and database configuration changes.
Confluence will be unavailable while these changes are being made.
Confluence will be unavailable while these changes are being made.
Resolution: 27 Sep 2023, 8:00 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 27 Sep 2023, 7:00 PM
End: 27 Sep 2023, 8:00 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-27+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-27+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 27 Sep 2023, 5:30 PM
Automatic resolution.
Service affected: SI-net
Start: 27 Sep 2023, 5:00 PM
End: 27 Sep 2023, 5:30 PM
Login to request notification
Weekly Production Migration for UniFi
Resolved
ENTSS Migrator will be migrating new codes changed to Production for both SI-net and UniFi applications. Refer to the latest weekly migration minutes for the list approved changes:
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-20+Weekly+Production+Changes+-+Migration+Meeting
In order to seek for approval to migrate changes to Production, it is required that the required member of the team that made the changes to be present at the weekly migration meeting to present their changes. The attendees ( consists of ENTSS staff and EAPS staff ) will review these before making the decision to approve or pre-approval ( conditional to completion of UAT testin...g ). Refer to the above hyperlink for the attendees who would reviewed and approved the changes to production.
As such this service view will not have any Peer Reviews nor Approval as that would have been completed as outlined above.
The Team Change Manager willl contain the Migrator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Additional information:
SI-net CAB Pre-Approved Changes (#7317)
https://sharepoint.uq.edu.au/its/ITGovernance/Lists/PreApproved%20Change%20List/DispForm.aspx?ID=45&Source=https%3A%2F%2Fsharepoint%2Euq%2Eedu%2Eau%2Fits%2FITGovernance%2FLists%2FPreApproved%2520Change%2520List%2FAllItems%2Easpx%23InplviewHashc5ffa001%2D2eb0%2D4be2%2D987f%2Dc20e677aea89%3D&ContentTypeId=0x0100D236C02FEDCD4E48B359619FB9CFDF4E
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-20+Weekly+Production+Changes+-+Migration+Meeting
In order to seek for approval to migrate changes to Production, it is required that the required member of the team that made the changes to be present at the weekly migration meeting to present their changes. The attendees ( consists of ENTSS staff and EAPS staff ) will review these before making the decision to approve or pre-approval ( conditional to completion of UAT testin...g ). Refer to the above hyperlink for the attendees who would reviewed and approved the changes to production.
As such this service view will not have any Peer Reviews nor Approval as that would have been completed as outlined above.
The Team Change Manager willl contain the Migrator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Additional information:
SI-net CAB Pre-Approved Changes (#7317)
https://sharepoint.uq.edu.au/its/ITGovernance/Lists/PreApproved%20Change%20List/DispForm.aspx?ID=45&Source=https%3A%2F%2Fsharepoint%2Euq%2Eedu%2Eau%2Fits%2FITGovernance%2FLists%2FPreApproved%2520Change%2520List%2FAllItems%2Easpx%23InplviewHashc5ffa001%2D2eb0%2D4be2%2D987f%2Dc20e677aea89%3D&ContentTypeId=0x0100D236C02FEDCD4E48B359619FB9CFDF4E
Read more
Resolution: 27 Sep 2023, 5:30 PM
Automatic resolution.
Service affected: UniFi
Start: 27 Sep 2023, 5:00 PM
End: 27 Sep 2023, 5:30 PM
Login to request notification
Upgrade Library PaperCut to 22.1.4
Resolved
The Library PaperCut application server will be upgraded to 22.1.4 to bring it up to the latest version.
Users will not be able to release print jobs from Library printers for 30-60 minutes while the upgrade is taking place.
Users will not be able to release print jobs from Library printers for 30-60 minutes while the upgrade is taking place.
Resolution: 26 Sep 2023, 9:30 PM
Automatic resolution.
Service affected: Library PaperCut
Start: 26 Sep 2023, 7:00 PM
End: 26 Sep 2023, 9:30 PM
Login to request notification
Upgrade Library ZENworks Configuration Management to 23.3
Resolved
The Library ZENworks Configuration Management service will be upgraded to 23.3.
Application installation through ZCM on Library workstations will be unavailable while the servers are being upgraded.
Application installation through ZCM on Library workstations will be unavailable while the servers are being upgraded.
Resolution: 26 Sep 2023, 9:30 PM
Automatic resolution.
Service affected: Library ZENworks Configuration Management
Start: 26 Sep 2023, 5:00 PM
End: 26 Sep 2023, 9:30 PM
Login to request notification
Remove duplicate service entries in OSF vCenter
Resolved
Remove duplicate service entries in OSF vCenter
Resolution: 25 Sep 2023, 2:30 PM
Automatic resolution.
Service affected: VMware GPN & OSF
Start: 25 Sep 2023, 8:30 AM
End: 25 Sep 2023, 2:30 PM
Login to request notification
Agg Project - Gatton group 5
Resolved
A number of buildings will be offline today. Network remains available in the Library and other locations. For further information, please call the Project Manager on 0458 585 405.
Resolution: 24 Sep 2023, 10:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 24 Sep 2023, 10:00 AM
End: 24 Sep 2023, 10:00 PM
Login to request notification
upgrade NGDC Serverfarm Load Balancers (F5)
Resolved
upgrade NGDC Serverfarm Load Balancers (F5) as part of periodic maintenance
Resolution: 23 Sep 2023, 5:00 PM
Automatic resolution.
Service affected: NGDC Serverfarm Load Balancer
Start: 23 Sep 2023, 7:00 AM
End: 23 Sep 2023, 5:00 PM
Login to request notification
CMG 2023 SLPP Project - Program Interruption, Withdrawal or Resumption (PIWR) Project (SI-net changes)
Resolved
Program Interruption, Withdrawal or Resumption (PIWR) Project introduces new functionality into SI-net and UniTask, and includes end-to-end integration and data flows between the two applications (both directions) and hence includes Integration Services. This change covers the SI-net changes. The UniTask changes can be found in CR#13028.
Resolution: 21 Sep 2023, 7:30 AM
Automatic resolution.
Service affected: SI-net
Start: 21 Sep 2023, 7:00 AM
End: 21 Sep 2023, 7:30 AM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-20+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-20+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 20 Sep 2023, 5:30 PM
Automatic resolution.
Service affected: SI-net
Start: 20 Sep 2023, 5:00 PM
End: 20 Sep 2023, 5:30 PM
Login to request notification
DC1 Switch back to Mains/UPS power supply
Resolved
DC1 is currently being powered from generator due to major failure with the UPS/Breaker switch. This is an emergencu bypass situation.
A replacement UPS has been installed, batteries charged and tested, and power supply to DC1 will be switched back to come from Mains/UPS.
No outage expected during this change.
A replacement UPS has been installed, batteries charged and tested, and power supply to DC1 will be switched back to come from Mains/UPS.
No outage expected during this change.
Resolution: 18 Sep 2023, 9:01 PM
Automatic resolution.
Service affected: Data Centre
Start: 18 Sep 2023, 9:00 PM
End: 18 Sep 2023, 9:01 PM
Login to request notification
DNS Outage
Resolved
Due to a DNS outage with resolvers, DNS resolution is failing for all services.
This has been restored, and exact root cause is under investigation
This has been restored, and exact root cause is under investigation
Resolution: 18 Sep 2023, 10:45 AM
DNS Services restored.
Exact cause is under investigation
Resolution: 18 Sep 2023, 10:45 AM
Automatic resolution.
Service affected: DNS & DHCP Servers
Start: 18 Sep 2023, 10:05 AM
End: 18 Sep 2023, 10:45 AM
Login to request notification
Agg Project - Gatton group 9
Resolved
There will be no network in buildings 8117, 8117a, 8416, 8419 and DAF during this outage. Please avoid the area. For further information, please call the Project Manager on 0458 585 405.
Resolution: 17 Sep 2023, 10:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 17 Sep 2023, 10:00 AM
End: 17 Sep 2023, 10:00 PM
Login to request notification
Power loss to DC1
Resolved
St Lucia DataCentre 1 has lost power due to a fault at the mains power board.
Services impacted include DNS, RDM, Carrier services, and other services.
NextGen Datacentre are not impacted.
Investigations currently underway by Electricians
Services impacted include DNS, RDM, Carrier services, and other services.
NextGen Datacentre are not impacted.
Investigations currently underway by Electricians
Update: 17 Sep 2023, 1:28 AM
RDM online just prior to midnight.
All services restored
Update: 16 Sep 2023, 11:06 PM
Power restored at 6:10pm.
Multiple failed switches after power restored, still in the process of being replaced.
Access to RDM offline, but in the finalprocess of being restored.
Resolution: 16 Sep 2023, 6:20 PM
Automatic resolution.
Service affected: Data Centre
Start: 16 Sep 2023, 3:00 PM
End: 16 Sep 2023, 6:20 PM
Login to request notification
RDM Shares offline
Resolved
underlying samba hosts offline
Resolution: 18 Sep 2023, 9:06 AM
back after power outage
Service affected: UQRDM Storage Service
Start: 16 Sep 2023, 11:53 AM
End: 18 Sep 2023, 9:06 AM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-13+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-09-13+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 14 Sep 2023, 7:30 AM
Automatic resolution.
Service affected: SI-net
Start: 14 Sep 2023, 7:00 AM
End: 14 Sep 2023, 7:30 AM
Login to request notification
Provisioning Shares
Resolved
Share provisioning is delayed due to an inability to add relevant permissions to the shares
Resolution: 16 Sep 2023, 11:53 AM
rewrote script to add permissions
Service affected: UQRDM Storage Provisioning API
Start: 11 Sep 2023, 8:00 AM
End: 16 Sep 2023, 11:53 AM
Login to request notification
Agg Project - Herston Public Health building
Resolved
There will be no network services in the Public Health building today. Please avoid the area as emergency phones will be offline. For further information, please call the Project Manager, Keryn Masters 0458 585 405.
Resolution: 10 Sep 2023, 9:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 10 Sep 2023, 10:00 AM
End: 10 Sep 2023, 9:00 PM
Login to request notification
Aurion and MyAurion down for maintenance
Resolved
Aurion and MyAurion will be unavailable from 5 PM to 6 PM due to system maintenance.
Resolution: 7 Sep 2023, 6:00 PM
All services restarted
Service affected: Aurion
Start: 7 Sep 2023, 5:00 PM
End: 7 Sep 2023, 6:00 PM
Login to request notification
Example Service Status
Resolved
A test of the serviceview external status page.
Resolution: 7 Sep 2023, 2:13 PM
End of testing
Service affected: Status Page
Start: 7 Sep 2023, 1:13 PM
End: 7 Sep 2023, 2:13 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
Weekly release of system updates.
Resolution: 6 Sep 2023, 6:00 PM
Automatic resolution.
Service affected: SI-net
Start: 6 Sep 2023, 5:45 PM
End: 6 Sep 2023, 6:00 PM
Login to request notification
Scratch filesystem on bunya unavailable - job failures
Resolved
RCC are aware of an issue with the high performance storage sub-system that provides access to /home /scratch and /sw and $TMPDIR.
Clients may experience:
* very slow response to commands,
* stale filehandle error messages
* job failures in certain circumstances
RCC staff are working with the backline vendor to resolve the issue as soon as possible and return all nodes to regular operations.
Once normal operations resume, clients should be encouraged to check the status of their jobs and re-submit if required.
Clients may experience:
* very slow response to commands,
* stale filehandle error messages
* job failures in certain circumstances
RCC staff are working with the backline vendor to resolve the issue as soon as possible and return all nodes to regular operations.
Once normal operations resume, clients should be encouraged to check the status of their jobs and re-submit if required.
Resolution: 4 Sep 2023, 2:38 PM
A vendor supplied patch has been applied to the storage service. Bunya is now stable and jobs are running.
Update: 4 Sep 2023, 11:57 AM
Job queues on Bunya have been *re-enabled* and a work-around is now running in place to mitigate the bug that has triggered the failures over the weekend.
A further update will be provided once a full patch has been provided by the vendor.
Service affected: Bunya HPC
Start: 4 Sep 2023, 12:25 AM
End: 4 Sep 2023, 2:38 PM
Login to request notification
VM Provisioning Unavailable via vpnext
Resolved
VM provisioning processes are failing. ITS Engineers are investigating.
Resolution: 27 Sep 2023, 9:35 AM
VM provisioning is available
Update: 15 Sep 2023, 12:05 PM
Investigations are ongoing with VMware support
Service affected: VPNext
Start: 1 Sep 2023, 4:45 PM
End: 27 Sep 2023, 9:35 AM
Login to request notification
/scratch filesystem on bunya unavailable - job failures
Resolved
RCC are aware of an issue with the high performance storage sub-system that provides access to /home /scratch and /sw and $TMPDIR.
Clients may experience:
* very slow response to commands,
* stale filehandle error messages
* job failures in certain circumstances
RCC staff are working with the backline vendor to resolve the issue as soon as possible and return all nodes to regular operations.
Once normal operations resume, clients should be encouraged to check the status of their jobs and re-submit if required.
Clients may experience:
* very slow response to commands,
* stale filehandle error messages
* job failures in certain circumstances
RCC staff are working with the backline vendor to resolve the issue as soon as possible and return all nodes to regular operations.
Once normal operations resume, clients should be encouraged to check the status of their jobs and re-submit if required.
Resolution: 2 Sep 2023, 3:32 AM
Scratch filesystems have been restored.
Service affected: Bunya HPC
Start: 1 Sep 2023, 3:54 PM
End: 2 Sep 2023, 3:32 AM
Login to request notification
Exhange Online data sync
Resolved
Forward data sync from AzureAD to Exchange online working. Meaning any on-prem exchange changes (user accounts, distribution lists, etc) are not syncd to exchange online.
Microsoft is aware of this issue. MS advisory EX667944
Microsoft is aware of this issue. MS advisory EX667944
Resolution: 5 Sep 2023, 12:38 PM
Microsoft has restored data sync between Azure AD and Exchange Online
Update: 5 Sep 2023, 9:08 AM
The sync issues from yesterday (4/9/23) appear to now be resolved but we are continuing to monitor and investigate if there are still issues.
Service affected: Exchange Mail and Calendaring
Start: 1 Sep 2023, 1:46 PM
End: 5 Sep 2023, 12:38 PM
Login to request notification
Workday unavailable
Resolved
Workday is currently not available, investigation in progress.
Workday Support is investigating
Workday Support is investigating
Resolution: 31 Aug 2023, 4:11 PM
Automatic resolution.
Service affected: Workday - Human Capital Management System
Start: 31 Aug 2023, 3:11 PM
End: 31 Aug 2023, 4:11 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-30+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-30+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 31 Aug 2023, 8:00 AM
Automatic resolution.
Service affected: SI-net
Start: 31 Aug 2023, 6:00 AM
End: 31 Aug 2023, 8:00 AM
Login to request notification
Service CRM Unscheduled Outage
Resolved
Oracle have advised they are experiencing issues in their data centre. Engineers are actively engaged and focused on resolving the issue as quickly as possible.
Resolution: 31 Aug 2023, 3:26 PM
Oracle Engineers restored database, connectivity and functions.
Root Cause Analysis to be provided by Oracle
Update: 31 Aug 2023, 3:25 PM
All functions including Chat portal now restored
Update: 31 Aug 2023, 11:56 AM
Latest update from Oracle - still recovering functionalities on Customer Portal (e.g. Chat and Web Forms).
Resolution expected at 13:00
Update: 31 Aug 2023, 10:35 AM
Users are able to login and process enquiries.
Email ingestion still processing.
Customer Portal (Chat and Web forms) still coming online.
Update: 31 Aug 2023, 8:42 AM
Oracle advise they have 50-60 engineers working on this.
Services are still rebooting slowly.
Expect to be back up around 09:00 AEST
Service affected: Oracle Service Cloud a.k.a Service CRM
Start: 30 Aug 2023, 9:40 PM
End: 31 Aug 2023, 3:26 PM
Login to request notification
Disruption to PeopleSoft non-Production environments
Resolved
The Enterprise Applications Environment and Release team is aware of an issue that may be impacting SI-net/UniFi non-Production environments since late last night. Full scope/impact is yet to be confirmed.
Investigation is underway and ongoing.
Please contact Hine Laban for more information.
Investigation is underway and ongoing.
Please contact Hine Laban for more information.
Resolution: 30 Aug 2023, 1:00 PM
Automatic resolution.
Service affected: UniFi
Start: 28 Aug 2023, 8:00 PM
End: 30 Aug 2023, 1:00 PM
Login to request notification
Disruption to PeopleSoft non-Prod environments
Resolved
The Enterprise Applications Environment and Release team is aware of an issue that may be impacting SI-net/UniFi environments since late last night.
Investigation is underway and ongoing.
Please contact Hine Laban for more information.
Investigation is underway and ongoing.
Please contact Hine Laban for more information.
Resolution: 30 Aug 2023, 1:00 PM
Automatic resolution.
Service affected: SI-net
Start: 28 Aug 2023, 8:00 PM
End: 30 Aug 2023, 1:00 PM
Login to request notification
HAZARD WORKS ONLY - Relocation of Virtual machines - Prentice Nutanix cluster to Prentice vSAN cluster
Resolved
Migrate Development Resource Pool virtual machines on the Prentice Nutanix cluster to the Prentice vSAN cluster in in batches between 28-Aug-2023 and 15-Sep-2023 outside business hours - 17:00 to 23:00
Resolution: 15 Sep 2023, 11:00 PM
Automatic resolution.
Service affected: VMware PRN DC
Start: 28 Aug 2023, 5:00 PM
End: 15 Sep 2023, 11:00 PM
Login to request notification
HAZARD WORKS ONLY - Relocation of Virtual machines - CCR Nutanix cluster to CCR vSAN cluster
Resolved
Migrate Development Resource Pool virtual machines on the CCR Nutanix cluster to CCR vSAN cluster in batches between 28-Aug-2023 and 15-Sep-2023 outside business hours - 17:00 to 23:00
Resolution: 15 Sep 2023, 11:00 PM
Automatic resolution.
Service affected: VMware NextGEN CCR DC
Start: 28 Aug 2023, 5:00 PM
End: 15 Sep 2023, 11:00 PM
Login to request notification
Agg Project - Herston OHC
Resolved
There will be no network services available in OHC today. Emergency call points and duress alarms not affected. Please avoid the area. For further information, please call the Project Manager, Keryn Masters on 0458 585 405.
Resolution: 27 Aug 2023, 9:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 27 Aug 2023, 10:00 AM
End: 27 Aug 2023, 9:00 PM
Login to request notification
Q3 2023 UniFi CVE patching
Resolved
To ensure our systems remain secure and compliant, UQ must apply patches on UniFi.
Oracle has released their quarterly security vulnerability patches: https://www.oracle.com/security-alerts/cpujan2023.html.
Oracle has released their quarterly security vulnerability patches: https://www.oracle.com/security-alerts/cpujan2023.html.
Resolution: 27 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: UniFi
Start: 27 Aug 2023, 7:00 AM
End: 27 Aug 2023, 5:00 PM
Login to request notification
Increase MySQL RDS Storage for Confluence
Resolved
RDS Storage for the ITS Confluence service needs to be increased.
When the ITS Confluence RDS instance was first created, storage autoscaling wasnt available.
We need to increase the underlying MySQL RDS Storage and turn on storage autoscaling for Confluence.
When the ITS Confluence RDS instance was first created, storage autoscaling wasnt available.
We need to increase the underlying MySQL RDS Storage and turn on storage autoscaling for Confluence.
Resolution: 25 Aug 2023, 6:30 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 25 Aug 2023, 5:00 PM
End: 25 Aug 2023, 6:30 PM
Login to request notification
Linux Routine OS Patching - Conman1 host
Resolved
Linux Routine OS Patching - conman1
(Please refer Impact Section for further info)
(Please refer Impact Section for further info)
Resolution: 25 Aug 2023, 9:10 AM
Automatic resolution.
Service affected: Oracle Development DB Hosting
Start: 25 Aug 2023, 9:00 AM
End: 25 Aug 2023, 9:10 AM
Login to request notification
AWS RDS Instance Class Change for Confluence
Resolved
The AWS RDS Instance class needs to be changed for Confluence.
The current one is being retired by AWS.
The current one is being retired by AWS.
Resolution: 24 Aug 2023, 8:00 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 24 Aug 2023, 7:00 PM
End: 24 Aug 2023, 8:00 PM
Login to request notification
Linux Routine OS Patching - Conman1
Resolved
Linux Routine OS Patching - conman1
(Please refer Impact Section for further info)
(Please refer Impact Section for further info)
Resolution: 24 Aug 2023, 9:10 AM
Automatic resolution.
Service affected: Oracle Development DB Hosting
Start: 24 Aug 2023, 9:00 AM
End: 24 Aug 2023, 9:10 AM
Login to request notification
Connection manager is unavailable after OS patching
Resolved
Both conman01 and conman02 are unavailable at the moment.
The DBA team are looking into the cause
The DBA team are looking into the cause
Resolution: 24 Aug 2023, 11:43 AM
A stale VPN rule in the configuration files caused the service to break on reboot of the OS
Once this stale rule was removed, the service started without issues.
Resolution: 24 Aug 2023, 11:43 AM
Automatic resolution.
Update: 24 Aug 2023, 11:43 AM
A stale VPN rule in the configuration files caused the service to break on reboot of the OS
Service affected: Oracle Connection Manager
Start: 24 Aug 2023, 9:00 AM
End: 24 Aug 2023, 11:43 AM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-23+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-23+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 23 Aug 2023, 5:30 PM
Automatic resolution.
Service affected: SI-net
Start: 23 Aug 2023, 5:00 PM
End: 23 Aug 2023, 5:30 PM
Login to request notification
Weekly Production Migration for UniFi
Resolved
ENTSS Migrator will be migrating new codes changed to Production for both SI-net and UniFi applications. Refer to the latest weekly migration minutes for the list approved changes:
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-23+Weekly+Production+Changes+-+Migration+Meeting
In order to seek for approval to migrate changes to Production, it is required that the required member of the team that made the changes to be present at the weekly migration meeting to present their changes. The attendees ( consists of ENTSS staff and EAPS staff ) will review these before making the decision to approve or pre-approval ( conditional to completion of UAT testin...g ). Refer to the above hyperlink for the attendees who would reviewed and approved the changes to production.
As such this service view will not have any Peer Reviews nor Approval as that would have been completed as outlined above.
The Team Change Manager willl contain the Migrator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Additional information:
SI-net CAB Pre-Approved Changes (#7317)
https://sharepoint.uq.edu.au/its/ITGovernance/Lists/PreApproved%20Change%20List/DispForm.aspx?ID=45&Source=https%3A%2F%2Fsharepoint%2Euq%2Eedu%2Eau%2Fits%2FITGovernance%2FLists%2FPreApproved%2520Change%2520List%2FAllItems%2Easpx%23InplviewHashc5ffa001%2D2eb0%2D4be2%2D987f%2Dc20e677aea89%3D&ContentTypeId=0x0100D236C02FEDCD4E48B359619FB9CFDF4E
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-23+Weekly+Production+Changes+-+Migration+Meeting
In order to seek for approval to migrate changes to Production, it is required that the required member of the team that made the changes to be present at the weekly migration meeting to present their changes. The attendees ( consists of ENTSS staff and EAPS staff ) will review these before making the decision to approve or pre-approval ( conditional to completion of UAT testin...g ). Refer to the above hyperlink for the attendees who would reviewed and approved the changes to production.
As such this service view will not have any Peer Reviews nor Approval as that would have been completed as outlined above.
The Team Change Manager willl contain the Migrator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Additional information:
SI-net CAB Pre-Approved Changes (#7317)
https://sharepoint.uq.edu.au/its/ITGovernance/Lists/PreApproved%20Change%20List/DispForm.aspx?ID=45&Source=https%3A%2F%2Fsharepoint%2Euq%2Eedu%2Eau%2Fits%2FITGovernance%2FLists%2FPreApproved%2520Change%2520List%2FAllItems%2Easpx%23InplviewHashc5ffa001%2D2eb0%2D4be2%2D987f%2Dc20e677aea89%3D&ContentTypeId=0x0100D236C02FEDCD4E48B359619FB9CFDF4E
Read more
Resolution: 23 Aug 2023, 5:30 PM
Automatic resolution.
Service affected: UniFi
Start: 23 Aug 2023, 5:00 PM
End: 23 Aug 2023, 5:30 PM
Login to request notification
Linux Routine OS Patching - connection manager hosts
Resolved
Linux Routine OS Patching - cloud-conman , conman2
Cloud-conman is load balanced, hence no impact.
For any individual connections during this window, would need to access via : conman1.compute.dc.uq.edu.au
Cloud-conman is load balanced, hence no impact.
For any individual connections during this window, would need to access via : conman1.compute.dc.uq.edu.au
Resolution: 23 Aug 2023, 9:10 AM
Automatic resolution.
Service affected: Oracle Development DB Hosting
Start: 23 Aug 2023, 9:00 AM
End: 23 Aug 2023, 9:10 AM
Login to request notification
CCR NGDC Firewall failover test
Resolved
CCR NGDC Firewall failover test
Resolution: 22 Aug 2023, 11:00 PM
Automatic resolution.
Service affected: Firewalls
Start: 22 Aug 2023, 9:00 PM
End: 22 Aug 2023, 11:00 PM
Login to request notification
UQ Digital Workspace VM provisioning outage
Resolved
All staff and student VM pools are currently unavailable, ITS is investigating this incident now.
Resolution: 22 Aug 2023, 10:30 AM
Resolution: 22 Aug 2023, 10:30 AM
Automatic resolution.
Service affected: UQ Digital Workspace
Start: 22 Aug 2023, 7:30 AM
End: 22 Aug 2023, 10:30 AM
Login to request notification
Agg Project - Herston Health Science
Resolved
There will be no network service in Herston Health Science today. Emergency lift phones and duress alarms not impacted. For further information, please call the Project Manager, Keryn Masters on 0458 585 405.
Resolution: 20 Aug 2023, 9:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 20 Aug 2023, 10:00 AM
End: 20 Aug 2023, 9:00 PM
Login to request notification
SCCM 2303 Upgrade
Resolved
Scheduled SCCM upgrade from version 2211 to 2303. SCCM services and Software Centre will be unavailable during this time.
Resolution: 17 Aug 2023, 9:30 PM
Automatic resolution.
Service affected: System Center Configuration Manager
Start: 17 Aug 2023, 6:30 PM
End: 17 Aug 2023, 9:30 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-15+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-15+Weekly+Production+Changes+-+Migration+Meeting
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Mig...rator name to migrate the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 17 Aug 2023, 6:30 AM
Automatic resolution.
Service affected: SI-net
Start: 17 Aug 2023, 6:00 AM
End: 17 Aug 2023, 6:30 AM
Login to request notification
UQ International Admissions Enquiries mailbox full
Resolved
Recoverable deleted Items is full for uqiedapp.
DisplayName : UQ International Admissions Enquiries
MailboxGuid : e5db1a86-54e0-4fc3-a810-95bba93bcb56
DeletedItemCount : 146488
ItemCount : 17782
TotalDeletedItemSize : 100 GB (107,375,175,391 bytes)
TotalItemSize : 4.505 GB (4,836,940,372 bytes)
Request sent to AA to purge recoverable items
DisplayName : UQ International Admissions Enquiries
MailboxGuid : e5db1a86-54e0-4fc3-a810-95bba93bcb56
DeletedItemCount : 146488
ItemCount : 17782
TotalDeletedItemSize : 100 GB (107,375,175,391 bytes)
TotalItemSize : 4.505 GB (4,836,940,372 bytes)
Request sent to AA to purge recoverable items
Update: 17 Aug 2023, 4:00 PM
The mailbox deleted items for applicationstatus@uq.edu.au reached 100GB preventing the mailbox from receiving any further mail.
The deleted items for the mailbox is now being purged by App Admin. 10GB has been cleaned up and normal functionality should have resumed for this mailbox.
The Mailbox has been removed from retention policy and the Microsoft cleanuup assistance will be running to clean up the mailbox items. It can take a couple of hours or days for Microsoft to clean up the mailbox.
AA are busy on another CR and have requested I resolve this.
Resolution: 17 Aug 2023, 4:09 PM
Mailbox has been excluded from retention policy and the Microsoft Mailbox Assistant will clean up the deleted items over the coming days. There is space available now.
Service affected: Exchange Mail and Calendaring
Start: 15 Aug 2023, 7:12 PM
End: 17 Aug 2023, 4:18 PM
Login to request notification
Bunya HPC nodes in drain state, pending reboots
Resolved
A configuration issue resulting in failure of some MPI workloads and jobs requesting large $TMPDIR has been detected. As a result, a supercomputer wide drain cycle is required to rectify the issue. This will mean that all jobs currently running will go through to completion and new jobs submitted will not start until nodes are available again to the scheduler. Once the drain and reboot cycle is complete, services will return to normal, gracefully.
Resolution: 22 Aug 2023, 7:51 AM
All nodes have been returned to the queue after their drain/reboot/reconfigure and re-enable cycle. The queues are functioning normally at full capability.
Update: 22 Aug 2023, 7:51 AM
All nodes were returned to the queue as the drain/reboot/re-enable cycle took place. The queues are now functioning normally.
Update: 15 Aug 2023, 7:39 AM
Nodes are continuing to drain as others return to service allowing users to schedule jobs as per normal operations, once more. A further update will be provided when all nodes have been returned to general schedule-able state.
Service affected: Bunya HPC
Start: 14 Aug 2023, 11:18 AM
End: 22 Aug 2023, 7:51 AM
Login to request notification
Agg Project - Prince Charles Hospital - Part 3
Resolved
ITS are competing the network upgrades at Prince Charles. There will be no UQ network services during this outage. This will not impact QH Eduroam. For further information, please contact the Project Manager, Keryn Masters on 0458 585 405.
Resolution: 13 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 13 Aug 2023, 10:00 AM
End: 13 Aug 2023, 5:00 PM
Login to request notification
Update MySQL RDS for Confluence
Resolved
Need to Update underlying MySQL RDS used by Confluence.
Confluence will be unavailable while the MySQL RDS is being updated.
Confluence will be unavailable while the MySQL RDS is being updated.
Resolution: 11 Aug 2023, 8:00 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 11 Aug 2023, 7:00 PM
End: 11 Aug 2023, 8:00 PM
Login to request notification
Scheduled maintenance extended
Resolved
Scheduled maintenance for RCC/QRISCloud network changes is currently underway and taking longer than the one hour that was anticipated. RCC staff are working to restore service.
This will impact access to older, less frequently accessed HPC-enabled RDM collections (QXXXX) on R drive, Wiener and Delta. Bunya HPC has no access to Q collection data during this maintenance.
This will impact access to older, less frequently accessed HPC-enabled RDM collections (QXXXX) on R drive, Wiener and Delta. Bunya HPC has no access to Q collection data during this maintenance.
Resolution: 10 Aug 2023, 8:51 PM
Automatic resolution.
Service affected: RCC/QCIF Hierarchical Storage Management Polaris
Start: 10 Aug 2023, 7:51 PM
End: 10 Aug 2023, 8:51 PM
Login to request notification
Update MySQL RDS for Jira
Resolved
Need to Update underlying MySQL RDS used by Jira.
Jira will be unavailable while the MySQL RDS is being updated.
Jira will be unavailable while the MySQL RDS is being updated.
Resolution: 10 Aug 2023, 8:00 PM
Automatic resolution.
Service affected: ITS Jira
Start: 10 Aug 2023, 7:00 PM
End: 10 Aug 2023, 8:00 PM
Login to request notification
Reboot of Confluence Hosts to Apply Latest OS Patches
Resolved
A reboot of the Confluence Servers is required to install some outstanding OS patches.
Resolution: 10 Aug 2023, 7:30 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 10 Aug 2023, 6:00 PM
End: 10 Aug 2023, 7:30 PM
Login to request notification
Telstra outage affecting mobile voice calls
Resolved
Telstra technicians are investigating an issue thats affecting making calls over 4G for some customers in New South Wales, ACT and Queensland.
Calls to Triple Zero, as well as receiving calls, SMS and mobile data arent affected.
Please be advised that this issue is not related to the recent UQ mobile plan changes and cut-overs that UQ has been undergoing with Telstra and our customers.
For more information, please visit: https://www.telstra.com.au/outages
Calls to Triple Zero, as well as receiving calls, SMS and mobile data arent affected.
Please be advised that this issue is not related to the recent UQ mobile plan changes and cut-overs that UQ has been undergoing with Telstra and our customers.
For more information, please visit: https://www.telstra.com.au/outages
Resolution: 10 Aug 2023, 9:54 AM
Restoration of mobile voice calls:
A server issue that was stopping some customers in New South Wales, Queensland and the ACT from making mobile calls over 4G this morning has been fixed.
Update: 10 Aug 2023, 9:55 AM
Telstra advised a Server issue that caused the outage has now been resolved.
ITS tests show the service is now working fully again.
Update: 10 Aug 2023, 9:55 AM
Restoration of mobile voice calls:
A server issue that was stopping some customers in New South Wales, Queensland and the ACT from making mobile calls over 4G this morning has been fixed.
Service affected: Telstra Mobile
Start: 10 Aug 2023, 9:22 AM
End: 10 Aug 2023, 9:54 AM
Login to request notification
Hazardous Works - Hardware expansion (NAS02)
Resolved
This CR will add an additional 4 nodes to the Isilon cluster to increase throughput and capacity.
This work will be conducted by EMC technicians.
This work will be conducted by EMC technicians.
Resolution: 11 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: nas02 Group & Home File Shares
Start: 10 Aug 2023, 9:00 AM
End: 11 Aug 2023, 5:00 PM
Login to request notification
Reboot of Jira Hosts to Apply Latest OS Patches
Resolved
A reboot of the Jira Servers is required to install some outstanding OS patches.
Resolution: 9 Aug 2023, 7:30 PM
Automatic resolution.
Service affected: ITS Jira
Start: 9 Aug 2023, 6:00 PM
End: 9 Aug 2023, 7:30 PM
Login to request notification
On Premise Exchange Mail Services - Windows OS Patching
Resolved
As part of ongoing and proactive OS patching maintenance, some Exchange services will experience brief service interruptions (mail flow may be queued for a minute whilst an active cluster node performs a service failover to the passive node). There may be a slight mail delay (usually less than a minute). However users should not notice or be affected by the patching.
Resolution: 9 Aug 2023, 3:00 PM
Automatic resolution.
Service affected: Exchange Mail and Calendaring
Start: 9 Aug 2023, 2:00 PM
End: 9 Aug 2023, 3:00 PM
Login to request notification
DNS resolver RNS1 move to NGDC
Resolved
DNS resolver rns1.uq.edu.au (tachyon.soe.uq.edu.au) and network 130.102.128.0/26 are to be moved to CCR NGDC.
Resolution: 8 Aug 2023, 11:59 PM
Automatic resolution.
Service affected: DNS & DHCP Servers
Start: 8 Aug 2023, 9:00 PM
End: 8 Aug 2023, 11:59 PM
Login to request notification
Hazardous Works - Hardware expansion (NAS01)
Resolved
This CR will add an additional 4 nodes to the Isilon cluster to increase throughput and capacity.
This work will be conducted by EMC technicians.
This work will be conducted by EMC technicians.
Resolution: 9 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: nas01 NFS File Storage
Start: 8 Aug 2023, 9:00 AM
End: 9 Aug 2023, 5:00 PM
Login to request notification
UniFi issue affecting requisition submission and journals
Resolved
UniFi issue affecting requisition submission/save and journals
There is currently an issue affecting multiple UniFi processes, one of which is requisition submission and save. A combination error displays when it should not.
Journal processing is also being affected.
ITS is investigating these issues as a priority. We apologise for the inconvenience this may cause until resolved. Updates will be communicated in due course. If you have any questions please contact Finance Client Support Services.
There is currently an issue affecting multiple UniFi processes, one of which is requisition submission and save. A combination error displays when it should not.
Journal processing is also being affected.
ITS is investigating these issues as a priority. We apologise for the inconvenience this may cause until resolved. Updates will be communicated in due course. If you have any questions please contact Finance Client Support Services.
Resolution: 8 Aug 2023, 4:15 PM
Service affected: UniFi
Start: 8 Aug 2023, 8:00 AM
End: 8 Aug 2023, 4:15 PM
Login to request notification
Increase MySQL RDS Storage for Confluence
Resolved
RDS Storage needs to be increased.
When this RDS instance was first created storage autoscaling wasnt available.
We need to increase the underlying MySQL RDS Storage and turn on storage autoscaling for Confluence.
When this RDS instance was first created storage autoscaling wasnt available.
We need to increase the underlying MySQL RDS Storage and turn on storage autoscaling for Confluence.
Resolution: 7 Aug 2023, 7:30 PM
Automatic resolution.
Service affected: ITS Confluence
Start: 7 Aug 2023, 6:00 PM
End: 7 Aug 2023, 7:30 PM
Login to request notification
Student GPU Outage
Resolved
Student enabled GPU desktops and applications are currently experiencing outages within Azure. Engineers are currently investigating.
Resolution: 7 Aug 2023, 4:27 PM
Issue was resolved with agents uplifted on the GPU farms for compatibility with the Azure platform.
Service affected: UQ Digital Workspace
Start: 7 Aug 2023, 8:50 AM
End: 7 Aug 2023, 4:27 PM
Login to request notification
Agg Project - Redcliffe Hospital
Resolved
There will be no UQ network service at Redcliffe today while the network is being upgraded. For further, please call the Project Manager, Keryn Masters on 0458 585 405.
Resolution: 6 Aug 2023, 6:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 6 Aug 2023, 11:00 AM
End: 6 Aug 2023, 6:00 PM
Login to request notification
Jira service currently unavailable
Resolved
An unscheduled service outage is currently affecting the ITS Jira service. Administrators are currently investigating the issue.
Resolution: 4 Aug 2023, 4:49 PM
Jira services were returned to normal at approximately 4.25pm, after the restarting of the service's AWS EC2 instances. Some minor performance issues may persist throughout the evening while an online reindex is completed as part of the recovery process.
Service affected: ITS Jira
Start: 4 Aug 2023, 3:45 PM
End: 4 Aug 2023, 4:49 PM
Login to request notification
UQRDM Cloud page load
Resolved
File recalls causing additional load on NFS servers affecting the front end performance of UQRDM cloud
Resolution: 8 Aug 2023, 11:20 AM
moved non-nextcloud mount to different pool
RCC recalled small files to limit delay on front end
Update: 4 Aug 2023, 3:00 PM
Service affected: UQRDM Cloud
Start: 4 Aug 2023, 3:00 PM
End: 8 Aug 2023, 11:20 AM
Login to request notification
Upgrade Palo Border and Inter VRF firewalls from 10.1.4-h4 to 10.2.4-h2
Resolved
Upgrade Palo Border and Inter VRF firewalls from 10.1.4-h4 to 10.2.4-h2
Resolution: 4 Aug 2023, 1:00 AM
Automatic resolution.
Service affected: Firewalls
Start: 3 Aug 2023, 9:00 PM
End: 4 Aug 2023, 4:10 AM
Login to request notification
Cohesity upgrade causing GUI user login issue
Resolved
Cohesity upgrade to 6.8.1_u4 is causing GUI login issue for delegated users authenticated by AD group membership.
Ticket has been logged with the vendor and the investigation is underway.
Ticket has been logged with the vendor and the investigation is underway.
Resolution: 27 Sep 2023, 9:35 AM
A fix has been provided by the vendor and applied.
Update: 17 Aug 2023, 3:55 PM
Work is ongoing with Cohesity support to resolve user access issues
Service affected: Backup
Start: 3 Aug 2023, 3:00 PM
End: 27 Sep 2023, 9:35 AM
Login to request notification
Cohesity Data Protection Version Upgrade - PRN Cluster
Resolved
Apply version upgrade - 6.8.1_u4_release-20230623_c4fcba54
Resolution: 3 Aug 2023, 3:00 PM
Automatic resolution.
Service affected: Backup
Start: 3 Aug 2023, 8:00 AM
End: 3 Aug 2023, 3:00 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-01+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-08-01+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 3 Aug 2023, 7:30 AM
Automatic resolution.
Service affected: SI-net
Start: 3 Aug 2023, 7:00 AM
End: 3 Aug 2023, 7:30 AM
Login to request notification
Cohesity Data Protection Version Upgrade - CCR Cluster
Resolved
Apply version upgrade - 6.8.1_u4_release-20230623_c4fcba54
Resolution: 2 Aug 2023, 3:00 PM
Automatic resolution.
Service affected: Backup
Start: 2 Aug 2023, 8:00 AM
End: 2 Aug 2023, 3:00 PM
Login to request notification
Agg Project - Prince Charles Hospital
Resolved
ITS are upgrading the network router, full network outage. This will not impact QH Eduroam. For further information, please contact the Project Manager, Keryn Masters, 0458 585 405.
Resolution: 30 Jul 2023, 6:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 30 Jul 2023, 10:00 AM
End: 30 Jul 2023, 6:00 PM
Login to request notification
UQ Engage - Release 3 Marketing Cloud Deployment
Resolved
The UQ Engage Project is nearing the engage of its final release and engagement with the solution partner Simplus. Deployment of additional Salesforce functionality as part of the third release is required, within the Phase 1 UQ Engage program of work.
This change will follow the successful deployment of the Release 3 CRM Platform, in change #12723.
The UQ Marketing Automation Team will be working on deploying the latest version of Marketing Cloud to Release 3.
These features will be tested against the CRM functionality. This will take the system offline from the 30/07/2023 to 01/08/2023.
This change will follow the successful deployment of the Release 3 CRM Platform, in change #12723.
The UQ Marketing Automation Team will be working on deploying the latest version of Marketing Cloud to Release 3.
These features will be tested against the CRM functionality. This will take the system offline from the 30/07/2023 to 01/08/2023.
Update: 2 Aug 2023, 10:18 AM
Marketing Cloud deployed successfully.
Outage noted on events. Server side issue with Salesforce rectified with Engineering / account manager escalation.
Testing with business. Passed.
Currently in operations. No problems noted.
Resolution: 1 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: UQ Engage
Start: 30 Jul 2023, 8:00 AM
End: 1 Aug 2023, 5:00 PM
Login to request notification
UQ Engage - Release 3 Data Migration
Resolved
The UQ Engage Project is nearing the engage of its final release and engagement with the solution partner Simplus. Development for Release 3 has successfully passed and received approval on.
- System Integration Testing.
- Regression Testing
- Security Testing
- Data Reconciliation Testing
- User Acceptance Testing.
Deployment of additional Salesforce functionality as part of the third release is required, within the Phase 1 UQ Engage program of work. Data Migration activity will occur after sign off.
The vendor Simplus will be working with UQ to ensure this is successful.
- System Integration Testing.
- Regression Testing
- Security Testing
- Data Reconciliation Testing
- User Acceptance Testing.
Deployment of additional Salesforce functionality as part of the third release is required, within the Phase 1 UQ Engage program of work. Data Migration activity will occur after sign off.
The vendor Simplus will be working with UQ to ensure this is successful.
Resolution: 4 Aug 2023, 5:00 PM
Automatic resolution.
Service affected: UQ Engage
Start: 30 Jul 2023, 8:00 AM
End: 4 Aug 2023, 5:00 PM
Login to request notification
Newtork Outage at Entox Coopers Plains site
Resolved
Service provider AARNet carries out fiber maintenance work on the link connecting Entox Coopers Plains site network to St Lucia. During the planned maintenance work, there will be an outage on the data network. Site staff will not be able to access the Internet or services hosted in UQ data centers.
Resolution: 30 Jul 2023, 6:00 PM
Automatic resolution.
Service affected: Networks
Start: 30 Jul 2023, 6:00 AM
End: 30 Jul 2023, 6:00 PM
Login to request notification
Palo CCR NGDC Firewalls Upgrade
Resolved
Palo CCR NGDC firewalls will be upgraded from 10.1.6-h6 to 10.2.4-h2
Resolution: 29 Jul 2023, 5:00 PM
Service affected: NGDC Serverfarm Firewall
Start: 29 Jul 2023, 7:00 AM
End: 29 Jul 2023, 5:00 PM
Login to request notification
UQ Engage - Release 3 Salesforce Deployment
Resolved
The UQ Engage Project is nearing the engage of its final release and engagement with the solution partner Simplus. Development for Release 3 has successfully passed and received approval on.
- System Integration Testing.
- Regression Testing
- Security Testing
- Data Reconciliation Testing
- User Acceptance Testing.
Deployment of additional Salesforce functionality as part of the third release is required, within the Phase 1 UQ Engage program of work.
The vendor Simplus will be working with UQ to ensure this is successful.
- System Integration Testing.
- Regression Testing
- Security Testing
- Data Reconciliation Testing
- User Acceptance Testing.
Deployment of additional Salesforce functionality as part of the third release is required, within the Phase 1 UQ Engage program of work.
The vendor Simplus will be working with UQ to ensure this is successful.
Resolution: 29 Jul 2023, 11:59 PM
Release 3 CRM is successfully deployed.
Production Validation Testing has passed.
System is back online and validated.
Update: 29 Jul 2023, 6:54 PM
Release 3 CRM is successfully deployed.
Production Validation Testing has passed.
System is back online and validated.
Service affected: UQ Engage
Start: 29 Jul 2023, 7:00 AM
End: 29 Jul 2023, 11:59 PM
Login to request notification
InPlace Service Performance
Resolved
InPlace is currently experiencing a performance degradation which may prevent people login in, experience system slowness and impact send messages. ITS are currently investigating with the vendor the cause.
Resolution: 25 Jul 2023, 4:38 PM
Service returned to normal after a reboot. Service provided experience high load on the server which they have identified and are working on a fix.
Service affected: InPlace
Start: 25 Jul 2023, 2:04 PM
End: 25 Jul 2023, 4:38 PM
Login to request notification
SI-net - Correct TCSI reporting data
Resolved
Emergency TCSI script change to be run in production for TCSI government reporting
The script has two parts:
1. loading the correct transactional data into the End-user engagement table for HDR students. This is required before we can report the End-user engagement data for TCSI which is required by 31st July 2023. Can only be done after the business had corrected the data in production.
2. production bug fix - Commonwealth Scholarships transactional data. Bug was introduced by script attached to CS001959 which failed on release date 12th July 2023 6pm. The script still committed 17 rows with invalid dates on the last added/updated date timestamps and this is causing a... PBI import to error. Developers last day was 12th July and was offboarded from UQ at 4:30pm.
The script only affects the TCSI reporting and transactional tables so there will be no impact for student programs or enrolments.
The script has two parts:
1. loading the correct transactional data into the End-user engagement table for HDR students. This is required before we can report the End-user engagement data for TCSI which is required by 31st July 2023. Can only be done after the business had corrected the data in production.
2. production bug fix - Commonwealth Scholarships transactional data. Bug was introduced by script attached to CS001959 which failed on release date 12th July 2023 6pm. The script still committed 17 rows with invalid dates on the last added/updated date timestamps and this is causing a... PBI import to error. Developers last day was 12th July and was offboarded from UQ at 4:30pm.
The script only affects the TCSI reporting and transactional tables so there will be no impact for student programs or enrolments.
Read more
Resolution: 20 Jul 2023, 12:30 PM
Automatic resolution.
Service affected: SI-net
Start: 20 Jul 2023, 12:00 PM
End: 20 Jul 2023, 12:30 PM
Login to request notification
Student GPU outage
Resolved
Student enabled GPU desktops and applications are currently experiencing outages within Azure.
Engineers are currently investigating.
Engineers are currently investigating.
Resolution: 25 Jul 2023, 6:43 AM
Issue was resolved with new agents uplifted on the GPU farms for compatibility with the Azure platfrom.
Service affected: UQ Digital Workspace
Start: 18 Jul 2023, 8:16 AM
End: 25 Jul 2023, 6:43 AM
Login to request notification
Database locks
Resolved
Application seeing database locking, put into maintenance mode to limit capacity gfor data corruption until resolution
Resolution: 17 Jul 2023, 2:50 PM
additional drive capacity added to DB server
Service affected: UQRDM Cloud
Start: 16 Jul 2023, 1:00 AM
End: 17 Jul 2023, 2:50 PM
Login to request notification
Exadata Platinum patching - plover-cluster
Resolved
Patch the CCR Exadata with the latest quarterly Oracle Critical Patch Updates (APR 2023 CPU).
Resolution: 15 Jul 2023, 8:00 PM
Automatic resolution.
Service affected: Oracle Production DB Hosting
Start: 15 Jul 2023, 8:00 AM
End: 15 Jul 2023, 8:00 PM
Login to request notification
SI-net System Maintenance
Resolved
SI-net is offline for security enhancements and general system maintenance.
Resolution: 15 Jul 2023, 8:00 PM
Automatic resolution.
Service affected: SI-net
Start: 15 Jul 2023, 6:00 AM
End: 15 Jul 2023, 8:00 PM
Login to request notification
Upgrade Palo NGDC firewalls
Resolved
Upgrade Datacentre firewalls to recommended supported version
Resolution: 14 Jul 2023, 2:00 AM
Automatic resolution.
Service affected: NGDC Serverfarm Firewall
Start: 13 Jul 2023, 9:00 PM
End: 14 Jul 2023, 2:00 AM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-07-10+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-07-10+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 12 Jul 2023, 5:30 PM
Automatic resolution.
Service affected: SI-net
Start: 12 Jul 2023, 5:00 PM
End: 12 Jul 2023, 5:30 PM
Login to request notification
On Premise Exchange Mail Services - Windows OS Patching
Resolved
As part of ongoing and proactive OS patching maintenance, some Exchange services will experience brief service interruptions (mail flow may be queued for a minute whilst an active cluster node performs a service failover to the passive node). There may be a slight mail delay (usually less than a minute). However users should not notice or be affected by the patching.
Resolution: 12 Jul 2023, 4:00 PM
Automatic resolution.
Service affected: Exchange Mail and Calendaring
Start: 12 Jul 2023, 3:00 PM
End: 12 Jul 2023, 4:00 PM
Login to request notification
UQRDM Cloud page load
Resolved
Long running recalls from backend storage is affecting the front end performance of UQRDM cloud
Resolution: 16 Jul 2023, 5:10 AM
restarted servers
Service affected: UQRDM Cloud
Start: 12 Jul 2023, 2:00 PM
End: 16 Jul 2023, 5:10 AM
Login to request notification
Agg project - Zelman Cowan (0051 and 0051a)
Resolved
There will be no network service in Zelman Cowan and the Collaborative Design Lab during the network upgrade. Please avoid the area as alarms and CCTV will be offline. For further information, please contact the Project Manager on 0458 585 405.
Resolution: 9 Jul 2023, 9:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 9 Jul 2023, 10:00 AM
End: 9 Jul 2023, 9:00 PM
Login to request notification
Q2 2023 UniFi Oracle CVE patching (PeopleTools)
Resolved
To ensure our systems remain secure and compliant, UQ must apply PeopleTools patches on UniFi.
Oracle has released their quarterly security vulnerability patches: https://www.oracle.com/security-alerts/cpujan2023.html.
Oracle has released their quarterly security vulnerability patches: https://www.oracle.com/security-alerts/cpujan2023.html.
Resolution: 9 Jul 2023, 5:00 PM
Automatic resolution.
Service affected: UniFi
Start: 9 Jul 2023, 7:00 AM
End: 9 Jul 2023, 5:00 PM
Login to request notification
Exadata Platinum patching - magpie-cluster
Resolved
Dear Stakeholder
The Oracle Production DB Hosting service will be undergoing scheduled maintenance
Scheduled start: Sat, 8 Jul 2023 08:00
Scheduled end: Sat, 8 Oct 2023 17:00
Patch the Prentice Exadata with the latest quarterly Oracle Critical Patch Updates (CPU).
There is no expected impact on service delivery.
More information can found at the following address: https://serviceview.its.uq.edu.au/index.php?AP=change_request_ap&ACT=view_all&dialog=edit&change_request_id=12627
The Oracle Production DB Hosting service will be undergoing scheduled maintenance
Scheduled start: Sat, 8 Jul 2023 08:00
Scheduled end: Sat, 8 Oct 2023 17:00
Patch the Prentice Exadata with the latest quarterly Oracle Critical Patch Updates (CPU).
There is no expected impact on service delivery.
More information can found at the following address: https://serviceview.its.uq.edu.au/index.php?AP=change_request_ap&ACT=view_all&dialog=edit&change_request_id=12627
Resolution: 8 Jul 2023, 5:00 PM
Automatic resolution.
Service affected: Oracle Production DB Hosting
Start: 8 Jul 2023, 8:00 AM
End: 8 Jul 2023, 5:00 PM
Login to request notification
Switch 47a-243R-as02 Migration
Resolved
1x Cisco 9300 (47a-243R-as02) Migration to new 9407 (47a-243R-as03) - WAPs and CCTV
Resolution: 7 Jul 2023, 4:00 PM
Automatic resolution.
Service affected: Networks
Start: 7 Jul 2023, 3:00 PM
End: 7 Jul 2023, 4:00 PM
Login to request notification
UQ Digital Workspace Unstable
Resolved
Issues have been detected in the UQ Digital Workspace platform.
These include,
- No external internet access.
- Intermittent network drop outs to internal resources.
- Issues logging in.
- Drop outs to the VMware Horizon Client and web client.
The CSP and VMware are investigating along with ITS engineers
These include,
- No external internet access.
- Intermittent network drop outs to internal resources.
- Issues logging in.
- Drop outs to the VMware Horizon Client and web client.
The CSP and VMware are investigating along with ITS engineers
Resolution: 7 Jul 2023, 9:14 AM
A technical incident arose wherein a Palo firewall deployed on the Azure platform encountered operational challenges, consequently resulting in the disruption of network traffic.
Service affected: UQ Digital Workspace
Start: 7 Jul 2023, 8:11 AM
End: 7 Jul 2023, 9:14 AM
Login to request notification
Xetta - Azure Migration
Resolved
Migration of Xetta infrastructure to Azure
Resolution: 6 Jul 2023, 6:30 AM
Automatic resolution.
Service affected: Xetta
Start: 6 Jul 2023, 6:00 AM
End: 6 Jul 2023, 6:30 AM
Login to request notification
Ad-hoc Production Data Change for SI-net
Resolved
The career link script is a 2023 semester 1 graduations procedure that must be executed to support the conferral process. The said script creates career links in bulk for PGCW students with the status of Eligible or Final in the current graduation event. These links enable AHEGS to display all the courses that have led to awarding of a degree for a student. From a workflow perspective, this BPC is run after grade release and prior to conferrals.
Note that this data change is isolated and should have no direct impact on graduations processes/system functions. No outage is required either.
This change is required at around 9am on the 3rd of July, once the business pr...ovides the go-ahead.
Note that this data change is isolated and should have no direct impact on graduations processes/system functions. No outage is required either.
This change is required at around 9am on the 3rd of July, once the business pr...ovides the go-ahead.
Read more
Resolution: 3 Jul 2023, 10:00 AM
Automatic resolution.
Service affected: SI-net
Start: 3 Jul 2023, 9:00 AM
End: 3 Jul 2023, 10:00 AM
Login to request notification
UQ Auth experiencing high load
Resolved
UQ Auth is currently experiencing high load which is causing delays in processing authentication requests and possible timeouts. Engineers are investigating.
Resolution: 28 Jun 2023, 9:00 AM
Automatic resolution.
Resolution: 28 Jun 2023, 9:00 AM
Automatic resolution.
Resolution: 28 Jun 2023, 9:00 AM
Service affected: UQ Authenticate
Start: 28 Jun 2023, 8:45 AM
End: 28 Jun 2023, 9:43 AM
Login to request notification
Upgrading Network Switches in Building 14 and Building 17 to IOS-XE version 17.6.5
Resolved
Network switch IOS will be updated. This will impact services as follow -
Network access of Building 14 will be affected from 08:00 AM to 02:00 PM on 25th June
Network access of Building 17 will be affected from 2:00 PM to 08:00 PM on 25th June.
Network access of Building 14 will be affected from 08:00 AM to 02:00 PM on 25th June
Network access of Building 17 will be affected from 2:00 PM to 08:00 PM on 25th June.
Resolution: 25 Jun 2023, 8:00 PM
Automatic resolution.
Service affected: Building Networks
Start: 25 Jun 2023, 8:00 AM
End: 25 Jun 2023, 8:00 PM
Login to request notification
UQ LearnX to UQ Extend production name change
Resolved
In late 2022, the University was made aware that the continued use of the LearnX nomenclature would put the University in breach of trademark law. In response to this, in partnership with Marketing and Communication, ITaLI set about selecting a new name for the platform.
As a result of comprehensive market research, and with final approval from the Deputy Vice-Chancellor (Academic) on advice from Marketing and Communication, ITaLI and Legal Services, the new name for UQs secondary learning management system (LMS) will be UQ Extend. Not only is this new name a better reflection of the UQ brand, it encapsulates the Universitys strategic commitment to being a leading, premier prov...ider of high-quality postgraduate and lifelong learning opportunities. The UQ Extend platform will be an important enabler in the fulfilment of this commitment, and it is important that its name reflects this purpose.
Users of the platform may experience brief, short-lived connectivity issues during this service renaming maintenance window.
As a result of comprehensive market research, and with final approval from the Deputy Vice-Chancellor (Academic) on advice from Marketing and Communication, ITaLI and Legal Services, the new name for UQs secondary learning management system (LMS) will be UQ Extend. Not only is this new name a better reflection of the UQ brand, it encapsulates the Universitys strategic commitment to being a leading, premier prov...ider of high-quality postgraduate and lifelong learning opportunities. The UQ Extend platform will be an important enabler in the fulfilment of this commitment, and it is important that its name reflects this purpose.
Users of the platform may experience brief, short-lived connectivity issues during this service renaming maintenance window.
Read more
Resolution: 25 Jun 2023, 2:00 AM
Automatic resolution.
Service affected: UQ Extend
Start: 24 Jun 2023, 6:00 PM
End: 25 Jun 2023, 2:00 AM
Login to request notification
PaperCut upgrade to 22.1.1
Resolved
PaperCut printing services will be upgraded to the latest version (22.1.1) to provide hardened security for the service.
Resolution: 22 Jun 2023, 8:00 PM
Automatic resolution.
Service affected: Papercut Printing Services
Start: 22 Jun 2023, 6:00 PM
End: 22 Jun 2023, 8:00 PM
Login to request notification
Weekly Production Migration for SI-net
Resolved
ENTSS Migrator will be migrating new codes changes to Production for SI-net applications
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-06-20+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
https://confluence.its.uq.edu.au/confluence/display/ESS/2023-06-20+Weekly+Production+Changes
If the change is simple enough then email approval will be sufficient. The email distribution should include Tech Masters, Functional Masters, Change Owner ( Func and Tech) and Manager to assess the impact before granting the Pre/approval.
If the change does not require an outage then seek the line manager for approval.
Refer to https://confluence.its.uq.edu.au/confluence/x/p220Dg
The Team Change Manager willl contain the Migrator name to migrat...e the changes into Production.
This service view will be marked to complete as soon as the migration completes.
Read more
Resolution: 22 Jun 2023, 7:30 AM
Automatic resolution.
Service affected: SI-net
Start: 22 Jun 2023, 7:00 AM
End: 22 Jun 2023, 7:30 AM
Login to request notification
Xetta - Cloudflare routing
Resolved
Cloudflare routing changing and BOS URL update.
Resolution: 22 Jun 2023, 7:20 AM
Automatic resolution.
Service affected: Xetta
Start: 22 Jun 2023, 7:00 AM
End: 22 Jun 2023, 7:20 AM
Login to request notification