Incident description

Created by Adam Spencer on

Title

Scheduler problem - Problème d'ordonnanceur

Summary

Resolved -

The job scheduler is misbehaving, which may impair the ability to start new jobs. We are investigating. / L'ordonnanceur a un problème, ce qui peut empêcher de démarrer de nouvelles tâches. Nous investiguons actuellement ce qui se passe.

Fixed.  See note about some PMIx job failures(only new jobs since around 18:00 PST to 18:25 PST)

No other issues were found.

We're troubleshooting scheduling issues, submissions continue to function but Partitions are in a Down state, so no new jobs will Start.  This is due to a PMIx issue, some PMIx jobs will have failed as COMPLETED shortly after they started.

Updated by Adam Spencer on