System News

Filtered by: Unscheduled Outages | General | (Remove Filters)

• Blue Waters System Reboot in Progress

  Created by: jenos 2021-12-20 10:57:57 (Channels: unscheduledoutages)

   

  The Blue Waters compute system is being rebooted this morning due to an issue with its high speed network that was causing most jobs to stall or fail.  Login node, filesystem, and data mover components are not expected to be interrupted by this operation.

  Thank you for your patience while the issue is resolved.  Estimated return to service for the compute portion is 5pm CT today.

  Watch the Blue Waters portal blog for updates as well as a mail notification upon completion.

  Questions?  Mail help+bw@ncsa.illinois.edu.

  
  Read Less

    The Blue Waters compute system is being rebooted this morning due to an issue with its high speed network that was causing most jobs to stall or fail.  Login node, filesystem, and data mover components are not expected to be interrupted by this operation. Thank you for your patience while the issue...
  Read More

• Blue Waters returned to service

  Created by: jenos 2021-09-28 09:05:33 (Channels: unscheduledoutages)

  Blue Waters has been returned to service as of 9:00AM CT. Running jobs may have experienced I/O suspension if dependent upon the part of the scratch filesystem that was unavailable between 7AM-9AM this morning, or potentially no interruption at all if not. The job scheduler has been resumed.

  Please report any issues to help+bw@ncsa.illinois.edu 

  Blue Waters Admins

  
  Read Less

  Blue Waters has been returned to service as of 9:00AM CT. Running jobs may have experienced I/O suspension if dependent upon the part of the scratch filesystem that was unavailable between 7AM-9AM this morning, or potentially no interruption at all if not. The job scheduler has been resumed. Please report any...
  Read More

• Blue Waters System Outage

  Created by: kingda 2021-09-28 07:58:43 (Channels: unscheduledoutages)

  The Blue Waters Scratch filesystem is partially unavailable due to a power issue.  Login nodes are still accessible, but the scheduler is paused.  Please check the Blue Waters system blog for updates as recovery progresses.

  Thank you for your patience as this is resolved.

  Blue Waters Admins

• Blue Waters returned to service

  Created by: jenos 2021-09-21 11:55:53 (Channels: unscheduledoutages)

  Blue Waters has been returned to service as of 11:15AM CT. Most running jobs survived the event, but may have experienced extreme communication speed reduction or even failure in some cases during the event. Existing login sessions were not interrupted, but new login session attempts may have seen intermittent failure during the event.

  Please report any issues to help+bw@ncsa.illinois.edu 

  Blue Waters Admins

  
  Read Less

  Blue Waters has been returned to service as of 11:15AM CT. Most running jobs survived the event, but may have experienced extreme communication speed reduction or even failure in some cases during the event. Existing login sessions were not interrupted, but new login session attempts may have seen intermittent failure...
  Read More

• Blue Waters System Outage

  Created by: jenos 2021-09-21 10:25:10 (Channels: unscheduledoutages)

  The Blue Waters compute resource is currently unavailable due to a power issue.  Login nodes and filesystems are still accessible.  Please check the Blue Waters system blog for updates as recovery progresses.

  Thank you for your patience as this is resolved.

  Blue Waters Admins

• Blue Waters scheduler and login issues

  Created by: kingda 2021-09-21 08:07:18 (Channels: unscheduledoutages)

  The Blue Waters Scheduler and h2ologin3 is currently offline due to a power issue. While this issue persists, jobs cannot be submitted and will not start. Scheduling commands will not be available. No jobs should be lost. Administrators are investigating and will post updates to the system blog.

  Blue Waters Admins

   

• Blue Waters returned to service

  Created by: jenos 2021-08-25 18:47:14 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been returned to service as of 6:45 pm CT after a compute subsystem reboot to correct a problem with the high speed network. 

  In addition, h2ologin1 has been returned to the service rotation addressed by the [bw|h2ologin].ncsa.illinois.edu hostnames. 

  We appreciate your patience while we addressed these matters.

  The Blue Waters Team

• Blue Waters System Reboot in Progress

  Created by: jenos 2021-08-25 15:46:14 (Channels: unscheduledoutages)

  Update:

  Return to service is now estimated at 6pm CT.

  ---

  The Blue Waters compute system is being rebooted this morning due to an issue with its high speed network that was causing most jobs to fail.  Login node, filesystem, and data mover components are not expected to be interrupted by this operation.  The job scheduler will see a brief interruption for system updates that will overlap with the reboot.

  Thank you for your patience while the issue is resolved.  Estimated return to service for the compute portion is 2pm CT today.

  Watch the Blue Waters portal blog for updates as well as a mail notification upon completion.

  Questions?  Mail help+bw@ncsa.illinois.edu.

  
  Read Less

  Update: Return to service is now estimated at 6pm CT. The Blue Waters compute system is being rebooted this morning due to an issue with its high speed network that was causing most jobs to fail.  Login node, filesystem, and data mover components are not expected to be interrupted by this operation. ...
  Read More

• Blue Waters Notice: portal maintenance

  Created by: gbauer 2021-03-10 10:55:09 (Channels: general)

  The Blue Waters portal will be rebooted Friday morning, March 12th, at 8:30 am to update software and database. The reboot is expected to take less than 5 minutes.

  No changes to the content of the portal are expected.

• Blue Waters filesystem issue resolved

  Created by: jenos 2021-03-10 01:36:08 (Channels: unscheduledoutages)

  The Blue Waters scratch filesystem has been serviced and resumed responsiveness by 01:30 AM on 3/10/2021. System impact from this issue may have been observed as early as 05:00 PM on 3/09/2021.  Thank you for being patient while this issue was resolved.

  Blue Waters Admins

   

• Blue Waters filesystem issue

  Created by: jenos 2021-03-10 00:02:29 (Channels: unscheduledoutages)

  The Blue Waters /scratch filesystem is currently encountering an issue causing it to be slow or unresponsive.  While this issue persists, login sessions may hang, and jobs may stop making progress or fail. Administrators are investigating and will post updates to the system blog.

  Blue Waters Admins

   

• Blue Waters Notice: shifter service issue

  Created by: gbauer 2021-02-12 09:06:33 (Channels: unscheduledoutages)

  The issue has been resolved.

  -----

  The shifter container service on Blue Waters is currently experiencing issues when pulling some new images through the shifter gateway.

  Jobs that use currently pulled images should run as expected

  We are looking into the issue and will update the blog periodically., 

  We apologize for the inconvenience.

  -Blue Waters

• Blue Waters Announcement: Winter Holiday service availability

  Created by: gbauer 2020-12-17 12:52:56 (Channels: general)

  Blue Waters partners;

  NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Wednesday December 23, 2019, and will resume normal business hours on Monday, January 4th, 2020. Staff will monitor Blue Waters and periodically check service requests during this time, and respond to issues in a timely manner depending on the nature of the issue.

  For projects that have expired at the end of the year or that have consumed their allocation before then. the noalloc queue is available for those projects. Use the directive #PBS -q noalloc in job scripts to submit to the noalloc queue. For more informatiob see  https://bluewaters.ncsa.illinois.edu/queues-and-scheduling-policies.

  System utilization sometimes drops over the holidays. Check https://bluewaters.ncsa.illinois.edu/machine-status for utilization and backfill opportunities. 

  Please send comments or concerns to help+bw@ncsa.illinois.edu.

  Season's Greetings from the Blue Waters team!

  
  Read Less

  Blue Waters partners; NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Wednesday December 23, 2019, and will resume normal business hours on Monday, January 4th, 2020. Staff will monitor Blue Waters and periodically check service requests during this time, and respond to issues in a timely...
  Read More

• H2ologin4 had a system issue that required a reboot to resolve.

  Created by: tbouvet 2020-12-16 15:23:51 (Channels: unscheduledoutages|systemnotices)

  H2ologin4 was rebooted to resolve a system issue that it was experiencing today. We apologize for any inconvenience this may have caused.

• Intermittent Login Issues

  Created by: kingda 2020-12-09 15:54:08 (Channels: unscheduledoutages)

  The Blue Waters login nodes were having issues that were identified and resolved. The issues started at 12:15pm CST and ended at 3:30pm CST. 

  Questions?  Mail help+bw@ncsa.illinois.edu.

• Blue Waters Filesystem Issue Resolved

  Created by: mshow 2020-12-02 20:01:29 (Channels: unscheduledoutages)

  The Blue Waters file system slowness issue has been resolved without a system interruption. The period where jobs or login nodes may have experienced slow filesystem symptoms spanned from 2:44 PM CST 12/2 to 7:55 PM CST 12/2.

  Questions?  Mail help+bw@ncsa.illinois.edu.

• Blue Waters Filesystem Issue

  Created by: mshow 2020-12-02 17:18:56 (Channels: unscheduledoutages)

  The Blue Waters file system is experiencing an issue causing extreme slowness. Admins are investigating the issue and will update the portal blog with any updates prior to resolution. There is no estimated time for return to service yet.

  Questions?  Mail help+bw@ncsa.illinois.edu.

• Blue Waters Filesystem Issue Resolved

  Created by: jenos 2020-11-25 10:05:56 (Channels: unscheduledoutages)

  The Blue Waters file system slowness issue has been resolved without a system interruption. The period where jobs or login nodes may have experienced slow filesystem symptoms spanned from 9:49 PM CST 11/24 to 6:00 AM CST 11/25.

  Questions?  Mail help+bw@ncsa.illinois.edu.

• Blue Waters Filesystem Issue

  Created by: jenos 2020-11-25 02:01:49 (Channels: unscheduledoutages)

  The Blue Waters file system is experiencing an issue causing extreme slowness. Admins are investigating the issue and will update the portal blog with any updates prior to resolution. There is no estimated time for return to service yet.

  Questions?  Mail help+bw@ncsa.illinois.edu.

• Blue Waters returned to service

  Created by: jenos 2020-11-24 17:37:19 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been returned to service as of 5:35 pm CT after a full system reboot to correct the problem with system boot infrastructure. All previously running jobs were lost.

  The Blue Waters Team

• Blue Waters System Reboot in Progress

  Created by: bbode 2020-11-24 11:14:49 (Channels: unscheduledoutages)

  The Blue Waters compute system is being rebooted this morning due to an issue with its primary boot infrastructure.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.  

  Thank you for your patience while the issue is resolved.  Estimated return to service for the compute portion is 6pm CT today.

  Watch the Blue Waters portal blog for updates as well as a mail notification upon completion.

  Questions?  Mail help+bw@ncsa.illinois.edu.

  
  Read Less

  The Blue Waters compute system is being rebooted this morning due to an issue with its primary boot infrastructure.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.   Thank you for your patience while the issue is resolved.  Estimated return to service for...
  Read More

• Blue Waters returned to service

  Created by: mshow 2020-10-15 18:35:37 (Channels: unscheduledoutages)

  Blue Waters has been returned to service as of 6:30pm CT after a full system reboot to correct the problem on the high-speed network. All previously running jobs were lost.

  The Blue Waters Team

• Blue Waters System Reboot in Progress

  Created by: bbode 2020-10-15 09:49:04 (Channels: unscheduledoutages)

  The Blue Waters compute system is being rebooted this morning due to an HSN issue.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.  During the reboot a set of accumulated security related software updates will be applied. Those updates are not expected to impact users. The Shifter update planned for the 21st will be applied during this downtime as well.

  Thank you for your patience while the issue is resolved.  Estimated return to service for the compute portion is 4pm CT today.

  Watch the Blue Waters portal blog for updates as well as a mail notification upon completion.

  Questions?  Mail help+bw@ncsa.illinois.edu.

  
  Read Less

  The Blue Waters compute system is being rebooted this morning due to an HSN issue.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.  During the reboot a set of accumulated security related software updates will be applied. Those updates are not...
  Read More

• Blue Waters returned to service

  Created by: jenos 2020-05-22 14:07:30 (Channels: unscheduledoutages)

  Blue Waters has been returned to service as of 2:00pm CT after a full system reboot to correct the problem on the high-speed network. All previously running jobs were lost.

  The Blue Waters Team

• Blue Waters System Reboot in Progress

  Created by: jenos 2020-05-22 09:05:09 (Channels: unscheduledoutages)

  The Blue Waters compute system is being rebooted this morning due to an unexpected complication with hardware and cooling maintenance.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.  Thank you for your patience while the issue is resolved.  Estimated return to service for the compute portion is 1pm CT today.

  Watch the Blue Waters portal blog for updates as well as a mail notification upon completion.

  Questions?  Mail help+bw@ncsa.illinois.edu.

  
  Read Less

  The Blue Waters compute system is being rebooted this morning due to an unexpected complication with hardware and cooling maintenance.  Login node, scheduler, filesystem, and data mover components are not expected to be interrupted by this operation.  Thank you for your patience while the issue is resolved.  Estimated return to...
  Read More

• Blue Waters returned to service

  Created by: kingda 2020-03-29 18:41:43 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been returned to service after a full system reboot to correct a problem on the high-speed network. All previously running jobs were lost.

  The Blue Waters Team

• Blue Waters Unscheduled Outage

  Created by: jenos 2020-03-29 13:01:11 (Channels: unscheduledoutages)

  Blue Waters is experiencing an issue with the high-speed network that began at 12:02 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd

  Current return to service estimate (optimal): 7:00pm CT

  We appreciate your patience while this is resolved.

   

  
  Read Less

  Blue Waters is experiencing an issue with the high-speed network that began at 12:02 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Interim updates will be posted on...
  Read More

• Blue Waters returned to service

  Created by: bbode 2020-03-16 16:07:00 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been returned to service after a full system reboot to correct a problem on the high-speed network. All previously running jobs were lost.

  The Blue Waters Team

• Blue Waters Announcement: Winter Holiday service availability

  Created by: gbauer 2019-12-23 10:34:28 (Channels: general)

  Blue Waters partners;

  NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Monday December 23, 2019, and will resume normal business hours on Thursday, January 2nd, 2020. Staff will monitor Blue Waters and the service request system during this period, and respond to issues in a timely manner depending on the nature of the issue.

  Please send comments or concerns to help+bw@ncsa.illinois.edu.

  Season's Greetings from the Blue Waters team!

  
  Read Less

  Blue Waters partners; NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Monday December 23, 2019, and will resume normal business hours on Thursday, January 2nd, 2020. Staff will monitor Blue Waters and the service request system during this period, and respond to issues in a timely...
  Read More

• BlueWaters returned to service

  Created by: mshow 2019-12-22 23:32:00 (Channels: mandatory|unscheduledoutages)

  After a full system reboot and checkout, the system hs been retrned to full service operations

• BlueWaters system reboot

  Created by: mshow 2019-12-22 13:55:58 (Channels: unscheduledoutages|systemnotices)

  While the filesystem issue has been resolved, a full system reboot will be required before returning to production status. It is our expectation that the system will return later this evening.

  BW Admin Team

• Blue Waters: UPDATE Scheduler Remains Paused

  Created by: tbouvet 2019-12-22 08:21:11 (Channels: unscheduledoutages|systemnotices)

  UPDATE: Scheduler Remains Paused as we continue to restore the scratch file system to service.

  The Blue Waters scheduler is currently paused due to a meda data server issue with the scratch file system. We are actively working the issue and new logins will likely hang without completion.

  Status updates will be posted to the blog on the Blue Waters portal.

  https://bluewaters.ncsa.illinois.edu/message-of-the-day

  The Blue Waters team.

  
  Read Less

  UPDATE: Scheduler Remains Paused as we continue to restore the scratch file system to service. The Blue Waters scheduler is currently paused due to a meda data server issue with the scratch file system. We are actively working the issue and new logins will likely hang without completion. Status updates will be...
  Read More

• Blue Waters: Scheduler paused because of a scratch file system issue.

  Created by: tbouvet 2019-12-21 20:06:21 (Channels: unscheduledoutages|systemnotices)

  The Blue Waters scheduler is currently paused due to a meda data server issue with the scratch file system. We are actively working the issue and new logins will likely hang without completion.

  Status updates will be posted to the blog on the Blue Waters portal.

  The Blue Waters team.

• Blue Waters Returned to Service

  Created by: tbouvet 2019-12-21 19:13:07 (Channels: unscheduledoutages|systemnotices)

  Blue Waters returned to service 12/21/2019 at 7:00PM following today's file system issue.

  Please email help+bw@ncsa.illinois.edu to report any issues.

   

• Blue Waters: Scheduler paused due to file system issue

  Created by: bbode 2019-12-21 13:08:13 (Channels: unscheduledoutages|systemnotices)

  The Blue Waters scheduler is currently paused due to two down storage targets in the scratch file system. Staff are currently working to resolve the issue. 

  Status updates will be posted to the blog on the Blue Waters portal.

  The Blue Waters team.

• Blue Waters Operations Transitioning

  Created by: jenos 2019-12-19 19:03:08 (Channels: mandatory|systemnotices|general|policychange)

  Hello Blue Waters partners,

  Today marks the conclusion of regular NSF Blue Waters operations and allocations.  Allocations ending today will be granted the normal 90 day grace period to transfer data off Blue Waters storage systems. After today, jobs remaining in the queue will be permitted to run but job submission will be disabled for expired projects.

  As Blue Waters transitions to support changing workflow needs for the NGA phase of operations, several policies and processes will be adjusted. Though they are detailed in the summary page linked below, additional notices will be issued near key timeframes.

  Transition summary: https://bluewaters.ncsa.illinois.edu/transition

  If you have questions about any changes, please submit a service request as normal to help+bw@ncsa.illinois.edu, but keep in mind that the upcoming holiday period may not have typical business hour response.

  As a final note, the Blue Waters staff has thoroughly enjoyed the challenges, innovations, enthusiasm, and breakthrough science experienced over the last seven years with everyone involved. Best of luck in the next stage of your research!

  
  Read Less

  Hello Blue Waters partners, Today marks the conclusion of regular NSF Blue Waters operations and allocations.  Allocations ending today will be granted the normal 90 day grace period to transfer data off Blue Waters storage systems. After today, jobs remaining in the queue will be permitted to run but job submission...
  Read More

• Blue Waters Operations transition - Portal login change

  Created by: bbode 2019-12-03 15:02:16 (Channels: general|policychange)

  Hello Blue Waters partners,

     In seven days, on December 10th, the authentication method for the Blue Waters user portal will be changed from the current RSA PIN+tokencode to NCSA Duo. This change will mean that existing Blue Waters users will no longer be able to login to the portal. Most portal functions such as documentation and usage information are available without logging in, but functions such as adding/removing users will be impacted. This is being done to support the transition to the NGA phase of operations when all projects will utilize NCSA Duo for authencation. Please note that RSA based two-factor logins will continue to function on the current login and data mover (Globus) nodes until 3/31/2020.

  If you need contiued login portal access please open a ticket via help+bw@ncsa.illinois.edu with your reason for continued access. All new projects for 2020 will be receiving information on obtaining Duo tokens as part of the project setup process that will happen between Dec. 10th and 19th.

   

  Thank you, 

  The Blue Waters team.    

  
  Read Less

  Hello Blue Waters partners,    In seven days, on December 10th, the authentication method for the Blue Waters user portal will be changed from the current RSA PIN+tokencode to NCSA Duo. This change will mean that existing Blue Waters users will no longer be able to login to the portal. Most...
  Read More

• Blue Waters Returned to Service

  Created by: bbode 2019-11-28 22:36:06 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been rebooted and returned to service at 10:35PM following an issue with the high-speed network earlier this afternoon. All running jobs were lost due to the outage.

  Please email help+bw@ncsa.illinois.edu to report any issues.

• Blue Waters: HSN issues full reboot in progress

  Created by: bbode 2019-11-28 17:59:37 (Channels: unscheduledoutages|systemnotices)

  An issue with the high-speed network on Blue Waters has forced a full system reboot. We currently anticipate a return to service of 11PM CST. 

  Status updates will be posted to the blog on the Blue Waters portal.

  The Blue Waters team.

• Nearline Tape Library Has Returned To Service

  Created by: briandi 2019-11-14 17:19:54 (Channels: unscheduledoutages|systemnotices)

  The NCSA_Nearline storage subsystem issue on Blue Waters was resolved and the system returned to normal operations at 3:30 pm.

   

• Nearline Tape Library Emergency System Maintenance

  Created by: briandi 2019-11-14 12:06:32 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users,

  Blue Waters is experiencing an issue on a subset of the HPSS storage subsystem (ncsa#Nearline) that began early this morning. System support staff are evaluating and attempting to restore it to normal service. The rest of Blue Waters subsystems remain in normal operation.

  Some transfers in and out of the system may be affected.

  Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd

   

  
  Read Less

  Blue Waters Users, Blue Waters is experiencing an issue on a subset of the HPSS storage subsystem (ncsa#Nearline) that began early this morning. System support staff are evaluating and attempting to restore it to normal service. The rest of Blue Waters subsystems remain in normal operation. Some transfers in and out of...
  Read More

• Blue Waters Returned to Service

  Created by: kingda 2019-10-01 20:46:38 (Channels: scheduledoutages|unscheduledoutages|systemnotices)

  Blue Waters returned to service at 8:45PM following today's scheduler maintenance. 

  Please email help+bw@ncsa.illinois.edu to report any issues.

• Scheduled systems testing period extended to 8PM Central

  Created by: jenos 2019-10-01 16:54:57 (Channels: scheduledoutages|unscheduledoutages|systemnotices)

  Update: This testing period will be extended to 8PM due to unanticipated system-related delays.

  ---

  A scheduled systems testing period will take place on Tuesday, October 1st from 7AM to 5PM 8PM Central, necessitating a shutdown of the job scheduler. Compute nodes will not be available during the test period. Login nodes and file systems will remain accessible.

  
  Read Less

  Update: This testing period will be extended to 8PM due to unanticipated system-related delays. A scheduled systems testing period will take place on Tuesday, October 1st from 7AM to 5PM 8PM Central, necessitating a shutdown of the job scheduler. Compute nodes will not be available during the test period. Login nodes and file...
  Read More

• Blue Waters outage

  Created by: mshow 2019-10-01 10:15:54 (Channels: unscheduledoutages|systemnotices)

  Multiple cabinets have failed within the Blue Waters system. The failed area will be bypassed and operations will continue. 

• Blue Waters: NPCF Power Issue Update

  Created by: tbouvet 2019-07-06 03:45:32 (Channels: unscheduledoutages|systemnotices)

  Blue Waters: NPCF Power Issue 7/5/2019 3PM

  All Blue Waters Resources are available except for the compute nodes. Blue Waters Computes are being rebooted and all running jobs were lost. No RTS eta yet.

• Blue Waters Returned to Service

  Created by: bbode 2019-07-05 17:57:32 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has been rebooted and returned to service at 5:55PM following a power interuption earlier this afternoon. All running jobs were lost due to the outage.

  Please email help+bw@ncsa.illinois.edu to report any issues.

• Blue Waters: NPCF Power Issue, Scheduler paused expect full reboot

  Created by: tbouvet 2019-07-05 13:32:15 (Channels: unscheduledoutages|systemnotices)

  A power outage at the building housing the Blue Waters system has caused a service interruption; the Login Nodes, Network, Storage, Compute Nodes, and Near-line Storage may be unavailable. It is unknown at this time when a return to service can be expected. Watch the Blue Waters portal blog for updates.

• Blue Waters: Nearline Tape Library Has Returned To Service

  Created by: tbouvet 2019-05-31 12:58:05 (Channels: unscheduledoutages|systemnotices)

  The Nearline subsystem reboot completed at 11:30AM today.

  All existing transfers should resume as Nearline was returned to service.

• Nearline Tape Library System Reboot

  Created by: bbode 2019-05-31 09:28:04 (Channels: unscheduledoutages|systemnotices)

  The Nearline subsystem is currently undergoing an emergancy reboot to clear multiple issues. It is expected to return to service by 1PM today.

  All existing transfers will resume once Nearline returns to service.

• Blue Waters Has Returned to Service

  Created by: tbouvet 2019-05-16 17:15:55 (Channels: unscheduledoutages|systemnotices)

  The storage issue on Blue Waters projects file system has been resolved and the system returned to normal operations at "5:07" PM CT. Any teams who were impacted by the file system issue have been contacted individually. The scheduler has resumed normal operations.

  Thank you for your patience while this was repaired.

   

  
  Read Less

  The storage issue on Blue Waters projects file system has been resolved and the system returned to normal operations at "5:07" PM CT. Any teams who were impacted by the file system issue have been contacted individually. The scheduler has resumed normal operations. Thank you for your patience while this was...
  Read More

• Blue Waters Project File System Update

  Created by: tbouvet 2019-05-16 09:29:40 (Channels: unscheduledoutages|systemnotices)

  We are in the process of running a file system check and repair of a small portion of the projects file system. When that is complete we will access the results and take appropriate action. Update: File system repair continues and is expected to last until late this afternoon (5/16).

  If you have jobs that do not use the projects file system please email help+bw@ncsa.illinois.edu to let us know and we can release your jobs to run.

  
  Read Less

  We are in the process of running a file system check and repair of a small portion of the projects file system. When that is complete we will access the results and take appropriate action. Update: File system repair continues and is expected to last until late this afternoon (5/16). If...
  Read More

• Blue Waters Project File System Issue

  Created by: tbouvet 2019-05-15 15:20:25 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users,

  Blue Waters is currently experiencing a storage server issue for a portion of the projects filesystem. As a result, all I/O transactions targeting the affected storage server will block. A single storage server supplies a small fraction of the file system data and all remaining storage servers continue normal operation. The rest of Blue Waters including the other filesystems are operating normally. We have paused the scheduler while we investigate the issue. Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd
   

  
  Read Less

  Blue Waters Users, Blue Waters is currently experiencing a storage server issue for a portion of the projects filesystem. As a result, all I/O transactions targeting the affected storage server will block. A single storage server supplies a small fraction of the file system data and all remaining storage servers continue normal operation....
  Read More

• Blue Waters OSS Return to Service

  Created by: squaire3 2019-05-12 12:33:07 (Channels: unscheduledoutages|systemnotices)

  The storage issue on Blue Waters was resolved and the system returned to normal operations at 12:30 PM CT. Scheduler has also been resumed.

• Blue Waters OSS Failover

  Created by: squaire3 2019-05-12 09:18:53 (Channels: unscheduledoutages|systemnotices)

  Blue Waters is currently experiencing a storage server failover on the OSS file system that began at 8:08 AM CT. As a result, all I/O transactions targeting the affected storage server will block until the failover completes on all clients. A single storage server supplies a small fraction of the file system data and all remaining storage servers continue normal operation. The rest of Blue Waters including the other filesystems are operating normally. Recovery from this type event (without complications) is expected to take less than two hours. The scheduler will be paused during this time.

  
  Read Less

  Blue Waters is currently experiencing a storage server failover on the OSS file system that began at 8:08 AM CT. As a result, all I/O transactions targeting the affected storage server will block until the failover completes on all clients. A single storage server supplies a small fraction of the...
  Read More

• Nearline Tape Library System Maintenance

  Created by: glasgow 2019-04-29 16:55:33 (Channels: unscheduledoutages|systemnotices)

  Nearline maintenance work is complete and the service has returned to full operations as of:

  1600hrs, April 29th, 2019

  ---

  Nearline is undergoing emergency service on one tape library. The work is related to fallout from last week's hardware service and is expected to take approximately 10 hours to complete. Some files may not be accessible during that time.

  Start time: 0945hrs to ~ 2000hrs, April 29, 2019

  
  Read Less

  Nearline maintenance work is complete and the service has returned to full operations as of: 1600hrs, April 29th, 2019 --- Nearline is undergoing emergency service on one tape library. The work is related to fallout from last week's hardware service and is expected to take approximately 10 hours to complete. Some files may...
  Read More

• Nearline Tape Library System Maintenance

  Created by: glasgow 2019-04-29 09:42:49 (Channels: unscheduledoutages|systemnotices)

  Nearline is undergoing emergency service on one tape library. The work is related to fallout from last week's hardware service and is expected to take approximately 10 hours to complete. Some files may not be accessible during that time.

  Start time: 0945hrs to ~ 2000hrs, April 29, 2019

• Blue Waters Return to Service

  Created by: squaire3 2019-04-12 15:41:38 (Channels: unscheduledoutages|systemnotices)

  The high-speed network issue on Blue Waters was resolved and the system returned to normal operations at 3:34 PM CT. Scheduler has also been resumed.

• Blue Waters Scheduler Paused - HSN Issue

  Created by: squaire3 2019-04-12 15:02:55 (Channels: unscheduledoutages|systemnotices)

  Blue Waters is experiencing an issue on the high-speed network that began at 2:10 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Logins have been occationally hanging due to this issue.

  We are expecting the issue to be resolved shortly.

  
  Read Less

  Blue Waters is experiencing an issue on the high-speed network that began at 2:10 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Logins have been occationally hanging...
  Read More

• Nearline Endpoint Paused for Storage Maintenance

  Created by: glasgow 2019-04-08 23:14:20 (Channels: unscheduledoutages|systemnotices)

  The Nearline endpoint has now been returned to normal operations. 

  The Blue Water's Nearline endpoint will be paused beginning at 1700hrs CDT. New and current user actions/requests will be paused and will resume normal activity when the endpoint is released. No user action is necessary. This maintenance window will be used to conduct resource management operations that have been deferred due to heavy system load. The system will return to normal service no-later-than 2300hrs (5PM-11PM, April 8th, 2019).

  
  Read Less

  The Nearline endpoint has now been returned to normal operations.  The Blue Water's Nearline endpoint will be paused beginning at 1700hrs CDT. New and current user actions/requests will be paused and will resume normal activity when the endpoint is released. No user action is necessary. This maintenance...
  Read More

• Nearline Endpoint Paused for Storage Maintenance

  Created by: glasgow 2019-04-08 16:27:20 (Channels: unscheduledoutages|systemnotices)

  The Blue Water's Nearline endpoint will be paused beginning at 1700hrs CDT. New and current user actions/requests will be paused and will resume normal activity when the endpoint is released. No user action is necessary. This maintenance window will be used to conduct resource management operations that have been deferred due to heavy system load. The system will return to normal service no-later-than 2300hrs (5PM-11PM, April 8th, 2019).

  
  Read Less

  The Blue Water's Nearline endpoint will be paused beginning at 1700hrs CDT. New and current user actions/requests will be paused and will resume normal activity when the endpoint is released. No user action is necessary. This maintenance window will be used to conduct resource management operations that have been deferred...
  Read More

• Blue Waters Returned to Service

  Created by: tbouvet 2019-04-07 15:14:36 (Channels: unscheduledoutages|systemnotices)

  Blue WAters Users,

  The storage server issue on the scratch file system is resolved. I/O transactions initiated during the outage should have resumed when the Lustre target returned. Blue Waters has resumed normal operations.

• Blue Waters Scheduler is paused 9:30 AM

  Created by: tbouvet 2019-04-07 10:30:00 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users,

  Blue Waters is currently experiencing a storage server issue for a small portion of the scratch filesystem. As a result, all I/O transactions targeting the affected storage server will block. A single storage server supplies a small fraction of the file system data and all remaining storage servers continue normal operation. The rest of Blue Waters including the other filesystems are operating normally. We have paused the scheduler while we investigate the issue. Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd

  
  Read Less

  Blue Waters Users, Blue Waters is currently experiencing a storage server issue for a small portion of the scratch filesystem. As a result, all I/O transactions targeting the affected storage server will block. A single storage server supplies a small fraction of the file system data and all remaining storage servers continue normal...
  Read More

• BlueWaters cabinet failure

  Created by: mshow 2019-03-23 16:44:36 (Channels: unscheduledoutages|systemnotices)

  The cabinet has been restored.

• BlueWaters repair complete

  Created by: mshow 2019-03-23 05:13:22 (Channels: unscheduledoutages|systemnotices)

  The cabinet has been restored

• BlueWaters cabinet failure

  Created by: mshow 2019-03-23 03:46:37 (Channels: unscheduledoutages|systemnotices)

  A cabinet has shutdown resulting in job loss and an incomplete network configuration. It is unknown at this time when a return to service can be expected for that cabinet. Watch the Blue Waters portal blog for updates.

• Blue Waters returned to service

  Created by: mshow 2019-02-24 03:41:58 (Channels: mandatory|unscheduledoutages|systemnotices)

  The high-speed network issue on Blue Waters was resolved and the system returned to normal operations at 3:30 AM CT.

• Blue Waters High Speed Network issue

  Created by: mshow 2019-02-23 23:43:19 (Channels: unscheduledoutages|systemnotices)

  Blue Waters is experiencing an issue on the high-speed network that began at 9:48 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd

  
  Read Less

  Blue Waters is experiencing an issue on the high-speed network that began at 9:48 PM CT. System support staff are evaluating and attempting to restore normal service. Job scheduling is paused until the issue is resolved. The file systems and data transfer services are operating normally. Interim updates will be posted on...
  Read More

• Reminder: Next Blue Waters User Call TODAY, Monday, February 18th at 1PM Central

  Created by: gbauer 2019-02-18 08:33:00 (Channels: bestpractices|general)

  Join us for the next Blue Waters User call TODAY, Monday, February 18th at 1PM Central. As always we value your input. Please join us.

  We will discuss on the call: 

  1. Nearline and Data Best Practices
  2. Recent Events
  3. Recent Changes.
  4. Outstanding Issues.
  5. Utilization, Usage, and other metrics.
  6. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  Join us for the next Blue Waters User call TODAY, Monday, February 18th at 1PM Central. As always we value your input. Please join us. We will discuss on the call:  Nearline and Data Best Practices Recent Events Recent Changes. Outstanding Issues. Utilization, Usage, and other metrics. Upcoming Opportunities.  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting...
  Read More

• Blue Waters Notice: System returned to service

  Created by: jenos 2019-02-06 15:31:27 (Channels: unscheduledoutages)

  Blue Waters Users:

  The reboot is complete and the system has returned to service as of 3:14pm CT. Tomorrow's near-line storage maintenance will proceed as planned.

  We apologize for any inconvenience.

   

• Blue Waters Unplanned Reboot

  Created by: bbode 2019-02-06 10:00:16 (Channels: unscheduledoutages)

  Blue Waters Users,

  We experienced an issue that has the high speed network in an unrecoverable state. We have to reboot the system to recover and all running jobs will be lost. The login nodes and endpoints (ncsa#Nearline ncsa#BlueWaters) will remain available during the reboot. The current estimate for return to service is 5PM CST. Watch the Blue Waters portal blog for updates.

  
  Read Less

  Blue Waters Users, We experienced an issue that has the high speed network in an unrecoverable state. We have to reboot the system to recover and all running jobs will be lost. The login nodes and endpoints (ncsa#Nearline ncsa#BlueWaters) will remain available during the reboot. The current estimate for return to...
  Read More

• Blue Waters Notice: System returned to service

  Created by: tbouvet 2019-01-12 13:09:15 (Channels: scheduledoutages|unscheduledoutages)

  Blue Waters Users:

  The reboot is complete and the system has returned to service.

  We apologize for any inconvenience.

   

• Blue Waters Notice: Unplanned Reboot

  Created by: tbouvet 2019-01-12 09:58:18 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users,

  We experienced an issue that has the high speed network in an unrecoverable state. We have to reboot the system to recover and all running jobs will be lost. The login nodes and endpoints (ncsa#Nearline ncsa#BlueWaters) will remain available during the reboot. The current estimate for return to service would be this afternoon. Watch the Blue Waters portal blog for updates.

   

  
  Read Less

  Blue Waters Users, We experienced an issue that has the high speed network in an unrecoverable state. We have to reboot the system to recover and all running jobs will be lost. The login nodes and endpoints (ncsa#Nearline ncsa#BlueWaters) will remain available during the reboot. The current estimate for return to...
  Read More

• Blue Waters Notice: Nearline System (HPSS) return to service

  Created by: tbouvet 2019-01-10 15:24:20 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users:

  The ncsa#Nearline endpoint is available and has returned to service at 3PM CT. We apologize for any inconvenience.

  -Blue Waters

• Blue Waters Notice: Nearline System (HPSS) remains unavailable.

  Created by: tbouvet 2019-01-10 09:38:30 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users:

  The ncsa#Nearline endpoint is paused pending repairs suffered to systems during the data center power failure on 1/09/19. We apologize for any inconvenience.

  Please check back for an update on the situtation.

  -Blue Waters

   

• Blue Waters Notice: System has returned to service

  Created by: jenos 2019-01-10 09:37:52 (Channels: unscheduledoutages|systemnotices)

   

  Blue Waters Users:

  The power outage at the NPCF building has been resolved.  All Blue Waters services are now available with the exception of the Nearline storage system, which will take a bit longer to recover.  The job scheduler has been resumed and login nodes have access re-enabled.  There will be another notification when the Nearline storage comes back online. We apologize for any inconvenience.

   

  
  Read Less

    Blue Waters Users: The power outage at the NPCF building has been resolved.  All Blue Waters services are now available with the exception of the Nearline storage system, which will take a bit longer to recover.  The job scheduler has been resumed and login nodes have access re-enabled.  There will be...
  Read More

• Blue Waters Notice: Power disruption

  Created by: jenos 2019-01-09 16:21:59 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users:

  ---

  Update 4:20pm:

  All systems up except Nearline.  Access remains restricted while performance tests complete.

  ---

  A power outage at the building housing the Blue Waters system has caused a service interruption; all running jobs were consequently terminated.  All Blue Waters subsystems have been affected and are currently out of service. The job scheduler is currently paused.  There is no current estimate for return to service, but best case return time would be this evening. Watch the Blue Waters portal blog for updates.

  
  Read Less

  Blue Waters Users: Update 4:20pm: All systems up except Nearline.  Access remains restricted while performance tests complete. A power outage at the building housing the Blue Waters system has caused a service interruption; all running jobs were consequently terminated.  All Blue Waters subsystems have been affected and are currently out of...
  Read More

• Blue Waters Notice: System returned to service

  Created by: jenos 2018-12-27 23:43:11 (Channels: unscheduledoutages|systemnotices)

  Blue Waters Users:

  The power outage at the Blue Waters building has been resolved and the compute nodes have been restarted. The Blue Waters system has been returned to normal operations at 11:40 PM CT. We apologize for any inconvenience.

   

• Blue Waters Announcement: Winter Holiday services

  Created by: gbauer 2018-12-21 09:21:34 (Channels: systemnotices|general)

  Blue Waters partners;

  NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Friday December 21, 2018, and will resume normal business hours on Wednesday, January 2nd, 2019. On-call staff will monitor Blue Waters and the service request system during this period, and respond to issues in a timely manner depending on the nature of the issue. Requests that require review by the project office such as reservations, quota increases or purge exemptions will be considered on Wednesday, January 2nd, 2019.

  Please send comments or concerns to help+bw@ncsa.illinois.edu.

  Enjoy the special job discount period that ends 1/2/2019: 50% charge discount on all queues, all jobs in projects that have consumed at least 25% of their current allocation.

  Season's Greetings from the Blue Waters team!

  
  Read Less

  Blue Waters partners; NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Friday December 21, 2018, and will resume normal business hours on Wednesday, January 2nd, 2019. On-call staff will monitor Blue Waters and the service request system during this period, and respond to issues in a...
  Read More

• Blue Waters Return to Service

  Created by: tbouvet 2018-11-14 18:35:11 (Channels: unscheduledoutages)

  The meta data server failover on the Home file system completed at 6:23 PM CT. I/O transactions initiated during the failover should have resumed normal operation when failover completed. Blue Waters has resumed normal operations.

• Blue Waters File System Issue

  Created by: tbouvet 2018-11-14 17:45:36 (Channels: unscheduledoutages)

  Blue Waters is currently experiencing a meta data server failover on the home file system that began at 5:30 PM CT. As a result, all I/O transactions for the home filesystem will block until the failover completes on all clients. The rest of Blue Waters including the other filesystems are operating normally, but job scheduling has been paused. Recovery from this type event (without complications) usually takes less than 1 hour.

  
  Read Less

  Blue Waters is currently experiencing a meta data server failover on the home file system that began at 5:30 PM CT. As a result, all I/O transactions for the home filesystem will block until the failover completes on all clients. The rest of Blue Waters including the other filesystems are operating...
  Read More

• Blue Waters Return to Service

  Created by: tbouvet 2018-11-14 11:32:42 (Channels: unscheduledoutages)

  The meta data server failover on the Home file system completed at 11:26 AM CT. The file system issue start at 10:45 AM. I/O transactions initiated during the failover should have resumed normal operation when failover completed. Blue Waters has resumed normal operations.

• Blue Waters File System Issue

  Created by: tbouvet 2018-11-14 11:19:47 (Channels: unscheduledoutages)

  Blue Waters is currently experiencing a meta data server failover on the home file system that began at 11:15 AM CT. As a result, all I/O transactions for the home filesystem will block until the failover completes on all clients. The rest of Blue Waters including the other filesystems are operating normally, but job scheduling has been paused. Recovery from this type event (without complications) usually takes less than 1 hour.

  
  Read Less

  Blue Waters is currently experiencing a meta data server failover on the home file system that began at 11:15 AM CT. As a result, all I/O transactions for the home filesystem will block until the failover completes on all clients. The rest of Blue Waters including the other filesystems are operating...
  Read More

• Blue Waters Announcement: Ongoing Blue Waters Job Discounts

  Created by: gbauer 2018-11-12 21:44:41 (Channels: systemnotices|general|policychange)

  This is a reminder that the first period of job discounts ends on Thursday, November 15th. The second period starts on the 16th but with different criteria. Get your jobs submitted soon.

  Stop by the NCSA booth and say hi if you are at SC18.

  > The Blue Waters project is happy to announce two job discount periods as our way of saying thank you for another successful year of computing and the your help creating our 2017-2018 annual report.  

  > There are two discount periods:

  1. Nov 1 - Nov 15: 50% charge discount on all queues, all jobs completing during this period
  2. Nov 16 - Jan 2: 50% charge discount on all queues, all jobs completing during this period for projects that have consumed at least 25% of their current allocation.

  Please submit questions and comments to help+bw@ncsa.illinois.edu.

   

  
  Read Less

  This is a reminder that the first period of job discounts ends on Thursday, November 15th. The second period starts on the 16th but with different criteria. Get your jobs submitted soon. Stop by the NCSA booth and say hi if you are at SC18. > The Blue Waters project is happy to...
  Read More

• BlueWaters returned to service

  Created by: mshow 2018-11-05 06:18:32 (Channels: unscheduledoutages)

  The system has been returned to full service operation after a brief unscheduled outage.

• BlueWaters system issue

  Created by: mshow 2018-11-05 01:21:18 (Channels: unscheduledoutages|general)

  The system has experienced  a fault that will require a full system shutdown/reboot. This will take several hours before the system is returned to full operations. 

• Blue Waters Discount Update

  Created by: jenos 2018-11-02 17:22:33 (Channels: systemnotices|general|policychange)

  The previously announced discounts have not changed; however, they have not been activated yet to be reflected in current charges. This is expected to be activated next week, but will be retroactively applied to the original start date of Nov 1, 2018.

   

• Blue Waters Announcement: Blue Friday Job Discounts start today!

  Created by: jenos 2018-11-01 12:34:44 (Channels: systemnotices|general|policychange)

  The Blue Waters project is happy to announce two job discount periods as our way of saying thank you for another successful year of computing and the your help creating our 2017-2018 annual report.  

  There are two discount periods:

  1. Nov 1 - Nov 15: 50% charge discount on all queues, all jobs completing during this period
  2. Nov 16 - Jan 2: 50% charge discount on all queues, all jobs completing during this period for projects that have consumed at least 25% of their current allocation.

  Please submit questions and comments to help+bw@ncsa.illinois.edu.

   

  
  Read Less

  The Blue Waters project is happy to announce two job discount periods as our way of saying thank you for another successful year of computing and the your help creating our 2017-2018 annual report.   There are two discount periods: Nov 1 - Nov 15: 50% charge discount on all queues, all jobs completing during...
  Read More

• Blue Waters Operations Extended Until Dec 19, 2019

  Created by: wkramer 2018-10-17 09:52:24 (Channels: general)

  I am very please to announce the NSF approved extending the full service operational period for Blue Waters until at least December 19, 2019. 

  News about allocation opportunities will be coming in the future. 

  Sincerely

  Bill Kramer

  Blue Waters PI

• Final Call for Blue Waters Illinois Allocations

  Created by: gbauer 2018-10-12 15:28:39 (Channels: general)

  Apologies in advance if you get this more than once.

  Final Call for Blue Waters Illinois Allocations Illinois faculty and researchers will have a final opportunity to apply for allocations on the University of Illinois’ Blue Waters supercomputer, which is planned to end service in December 2019* . Proposals for general allocations are due October 26th.  An information session will be held on Wednesday, October 17th at 10:00 a.m. in NCSA room 1040 to address proposal information and questions. The meeting will also be a forum to discuss Illinois researchers’ future needs for computing resources, regardless of whether they use Blue Waters or not. Details can be found at: https://bluewaters.ncsa.illinois.edu/illinois-allocations. *Contingent on pending approval of a project extension from the National Science Foundation (NSF). ABOUT BLUE WATERS Blue Waters is one of the most powerful supercomputers in the world. Located at the University of Illinois, it can complete more than 1 quadrillion calculations per second on a sustained basis and more than 13 times that at peak speed. The peak speed is almost 3 million times faster than the average laptop. Blue Waters is supported by the National Science Foundation and the University of Illinois; NCSA manages the Blue Waters project and provides expertise to help scientists and engineers take full advantage of the system for their research. ABOUT NCSA The National Center for Supercomputing Applica tions (NCSA) at the University of Illinois at Urbana-Champaign provides supercomputing and advanced digital resources for the nation's science enterprise. At NCSA, University of Illinois faculty, staff, students, and collaborators from around the globe use advanced digital resources to address research grand challenges for the benefit of science and society. NCSA has been advancing one-third of the Fortune 50® for more than 30 years by bringing industry, res earchers, and students together to solve grand challenges at rapid speed and scale. Blue Waters is supported by the National Science Foundation through awards ACI-0725070 and ACI-1238993.
  	National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign. ©2018 Board of Trustees of the University of Illinois. All rights reserved. Web privacy notice.

  
  Read Less

  Apologies in advance if you get this more than once.         Final Call for Blue Waters...
  Read More

• Reminder: Next Blue Waters User Call, Monday, September 17th at 1PM Central

  Created by: gbauer 2018-09-16 19:24:27 (Channels: general)

  Join us for the next Blue Waters User call, Monday, September 17th at 1PM Central. We value your input. Please join us.

  We will discuss on the call: 

  1. Recent Events
  2. Recent and Future Changes.
     1. Moving to recent Programming Environment update. See PE Update page for details.
     2. New PGI compiler.
     3. bwpy 2.0 update
  3. Outstanding Issues.
  4. Utilization, Usage, and other metrics.
  5. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  Join us for the next Blue Waters User call, Monday, September 17th at 1PM Central. We value your input. Please join us. We will discuss on the call:  Recent Events Recent and Future Changes. Moving to recent Programming Environment update. See PE Update page for details. New PGI compiler. bwpy 2.0 update Outstanding Issues. Utilization, Usage, and other metrics. Upcoming...
  Read More

• Reminder: Next Blue Waters User Call TODAY, Monday, August 20th at 1PM Central

  Created by: gbauer 2018-08-20 08:45:18 (Channels: bestpractices|general)

  Join us for the next Blue Waters User call TODAY, Monday, August 20th at 1PM Central. We value your input. Please join us.

  We will discuss on the call: 

  1. Recent Events
  2. Recent Changes.
  3. Outstanding Issues.
  4. Utilization, Usage, and other metrics.
  5. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  Join us for the next Blue Waters User call TODAY, Monday, August 20th at 1PM Central. We value your input. Please join us. We will discuss on the call:  Recent Events Recent Changes. Outstanding Issues. Utilization, Usage, and other metrics. Upcoming Opportunities.  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts.  Join from PC, Mac, Linux, iOS...
  Read More

• Rescheduled: Next Blue Waters User Call Tuesday, July 17th at 1PM Central

  Created by: gbauer 2018-07-15 21:50:26 (Channels: general|softwareupdate)

  The July User Call has been rescheduled for Tuesday, July 17th at 1PM Central in order to better communicate the changes that will take place during the maintenance on Monday, July 16th; at which time CUDA 9.1 and a new Programming Environment will be installed.

  During the rescheduled call we will discuss: 

  1. Recent Events
  2. Recent Changes
     1. CUDA 9.1 
     2. New Programming Environment
  3. Utilization, Usage, and other metrics.
  4. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  The July User Call has been rescheduled for Tuesday, July 17th at 1PM Central in order to better communicate the changes that will take place during the maintenance on Monday, July 16th; at which time CUDA 9.1 and a new Programming Environment will be installed. During the rescheduled call we will discuss:  Recent Events Recent Changes CUDA...
  Read More

• Blue Waters Partial Scratch Outage

  Created by: tbouvet 2018-06-23 21:31:02 (Channels: unscheduledoutages|systemnotices)

  Blue Waters experienced a newtork switch failure that resulted in a partial outage of the scratch filesystem (ost168-179) from 7:44 PM CT to 7:59 PM CT. Jobs that ended during this time may have been impacted. I/O transactions targeting the affected storage server should block until the ost targets returned on all clients. Note: this brief outage was for a small portion of the scratch filesystem.

  
  Read Less

  Blue Waters experienced a newtork switch failure that resulted in a partial outage of the scratch filesystem (ost168-179) from 7:44 PM CT to 7:59 PM CT. Jobs that ended during this time may have been impacted. I/O transactions targeting the affected storage server should block until the ost targets returned...
  Read More

• Reminder: Next Blue Waters User Call Monday, June 18th at 1PM Central

  Created by: gbauer 2018-06-15 10:40:09 (Channels: bestpractices|general)

  Please join us for the next Blue Waters User call on Monday, June 18th at 1PM Central.

  We will discuss on the call: 

  1. Recent Events
  2. Upcoming Changes.
     1. Globus Web Application 
     2. CUDA 9.1 (getting closer)
  3. Utilization, Usage, and other metrics.
  4. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  Please join us for the next Blue Waters User call on Monday, June 18th at 1PM Central. We will discuss on the call:  Recent Events Upcoming Changes. Globus Web Application  CUDA 9.1 (getting closer) Utilization, Usage, and other metrics. Upcoming Opportunities.  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts.  Join from PC, Mac, Linux, iOS or Android:...
  Read More

• Blue Waters returned to full service

  Created by: mshow 2018-06-12 10:23:37 (Channels: mandatory|unscheduledoutages|systemnotices)

  Blue Waters has returned to full service after recovery from a power event.

• Blue Waters system power interruption

  Created by: mshow 2018-06-12 04:56:14 (Channels: mandatory|unscheduledoutages|systemnotices)

  Thunderstorms have resulted in a power interruption of the BlueWaters System. This outage imacts both the compute nodes and all  filesystems. Therefore, a full reboot will be necessary.Return to service is estimated to be approximately 10 am Centeral time.

  BW Admin

• Blue Waters has Returned to Service

  Created by: tbouvet 2018-06-07 14:27:12 (Channels: unscheduledoutages|systemnotices)

  Blue Waters has returned to full service at 2:14 PM CT. The issue encountered required a full system reboot to resolve. All running jobs were lost so please resubmit your jobs from latest checkpoint file if your job exited prematurely.   

• Blue Waters System Issue

  Created by: tbouvet 2018-06-07 10:12:41 (Channels: unscheduledoutages)

  Blue Waters is experiencing a full system issue that began at 6:30 AM CT. System support staff are evaluating and attempting to restore normal service but may require a full system reboot. Job scheduling is paused until the issue is resolved. Interim updates will be posted on the Blue Waters Message of the Day: https://bluewaters.ncsa.illinois.edu/motd

  UPDATE: 10AM
  Full System Reboot in progress. All running jobs were lost and will require a re-submission from latest checkpoint file. Lustre Filesystems, GO endpoints BlueWaters and Nearline will remain up, Login nodes will remain accessible.  

  
  Read Less

  Blue Waters is experiencing a full system issue that began at 6:30 AM CT. System support staff are evaluating and attempting to restore normal service but may require a full system reboot. Job scheduling is paused until the issue is resolved. Interim updates will be posted on the Blue Waters...
  Read More

• Reminder: Next Blue Waters User Call Monday, May 21st at 1PM Central

  Created by: gbauer 2018-05-18 13:15:27 (Channels: bestpractices|general)

  Please join us for the next Blue Waters User call on Monday, May 21st at 1PM Central.

  We will discuss on the call: 

  1. Recent and Upcoming Events.
     1. Shifter
  2. Recent and Upcoming Changes.
     1. CUDA 9.1?
     2. Singularity
     3. Globus CLI
  3. Utilization, Usage, and other metrics.
  4. Upcoming Opportunities. 

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

  Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/250788601

  Or iPhone one-tap :

      US: +16699006833,,250788601#  or +16465588656,,250788601# 

  Or Telephone:

      Dial(for higher quality, dial a number based on your current location)

          US: +1 669 900 6833  or +1 646 558 8656 

      Meeting ID: 250 788 601

      International numbers available: https://zoom.us/zoomconference?m=8NTXBpyVyQT5nZx0AwfuY8UYmKzDUNuq

  
  Read Less

  Please join us for the next Blue Waters User call on Monday, May 21st at 1PM Central. We will discuss on the call:  Recent and Upcoming Events. Shifter Recent and Upcoming Changes. CUDA 9.1? Singularity Globus CLI Utilization, Usage, and other metrics. Upcoming Opportunities.  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts.  Join from PC, Mac, Linux, iOS or Android:...
  Read More

• Blue Waters Notice: the Blue Waters portal maintenance is complete.

  Created by: gbauer 2018-03-05 13:15:43 (Channels: general)

  Blue Waters partners;

  The maintenance on the Blue Waters portal is complete.

  The maintenance addressed issues of stability and performance.

  We apologize for any inconvenience.

  Please report any issues with the Blue Waters portal to help+bw@ncsa.illinois.edu.

  -Blue Waters Project

  https://bluewaters.ncsa.illinois.edu/

• Blue Waters Announcement: Winter Holiday services

  Created by: gbauer 2017-12-21 15:49:34 (Channels: systemnotices|general)

  Blue Waters partners;

  NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Friday December 22, 2017, and will resume normal business hours on Tuesday, January 2nd, 2018. On-call staff will monitor Blue Waters and the service request system during this period and respond to issues in a timely manner depending on the nature of the issue. Requests that require review by the project office such as reservations, quota increases or purge exemptions will be considered on Tueday, January 2rd 2018.

   

  Please send comments or concerns to help+bw@ncsa.illinois.edu.

   

  Enjoy the special job discount period and happy holidays from the Blue Waters team!

   

   

  
  Read Less

  Blue Waters partners; NCSA staff will observe the University of Illinois Winter break schedule starting 5pm Friday December 22, 2017, and will resume normal business hours on Tuesday, January 2nd, 2018. On-call staff will monitor Blue Waters and the service request system during this period and respond to issues in a...
  Read More

• Blue Waters User Call: October 16th at 1PM Central

  Created by: gbauer 2017-11-17 19:07:47 (Channels: general)

  Blue Waters Partners;

   

  Please join us for the next Blue Waters User call this Monday, October 16th at 1PM Central. During this call, we will review any changes to the system, events and opportunities.  Your feedback is important to us.

   

  We will also discuss on the call: 

  • New email subscription system
  • Recent or Coming Changes to Blue Waters 
  • Usage, Utilization and other Items
  • Upcoming Opportunities

  Slides will be posted to https://bluewaters.ncsa.illinois.edu/past-webinars before the meeting starts. 

   

   

  
  Read Less

  Blue Waters Partners;   Please join us for the next Blue Waters User call this Monday, October 16th at 1PM Central. During this call, we will review any changes to the system, events and opportunities.  Your feedback is important to us.   We will also discuss on the call:  New email subscription system Recent or Coming Changes...
  Read More