| Service | Incident status | Start Date | End Date |
|---|---|---|---|
| Nibi | Closed |
Emergency power outage affecting compute/gpu nodes
An emergency power outage TODAY will affect all Nibi compute nodes (including GPU).
This means all jobs will be killed at 4pm, and you'll need to resubmit any such jobs. Currently queued jobs will be started when the cluster returns to service.
Login nodes should not be affected.
We do not have a firm estimate of how long the outage will last - perhaps an hour, but there will be some time required after that to ensure that nodes are operating correctly before allowing them to run jobs again.
Updated by Mark Hahn on