Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

SGE configuration resulting in memory blocked jobs in H-series nodes

Aperta
#21 0 commenti 0 reazioni 1 assegnatario Vedi su GitHub

@mvrequa ci sta già lavorando.

Dal 3/8/2021.

Valutazione

Questa issue non è ancora stata valutata.

Descrizione

Cyclecloud version: 8.1.0-1275
OS Image: HPC:CentOS8.1
Problem: Issues with Infiniband connectivity

I was running a small cluster in cyclecloud 7 and recently I updated to cyclecloud 8, the cluster has several node arrays, some non H-series and other H-series for MPI heavy calculations. I noticed that there seems to be a different behaviour in the Infiniband connectivity between 7 and 8. I have tracked part of the problem to the SGE configuration.

The SGE configuration provided in cyclecloud 8.1.0-1275 with the HPC:CentOS8.1 has the variable execd_params set to none. This can result in problems when trying to execute MPI jobs in H-series nodes with Infiniband.
The jobs would fail reporting that the the process cannot allocate the necessary memory, this issue can be manually fixed by setting execd_params H_MEMORYLOCKED=unlimited.
I have tested this using several MPI heavy programs such as VASP and QE , which were running in non H-series nodes without problem, but when trying to run in H-series would consistently fail. After the change of execd_params the programs would run.

However, something I noticed from updating to cyclecloud8 from cyclecloud7 is that running MPI jobs in non H-series jobs using inter node communication seems to no longer be possible.

Lingua principale
Python
Stelle
7
Fork
18
Merge medio
2g 13h
PR unite (30g)
7

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di Azure/cyclecloud-gridengine

Tutte le issue di Azure/cyclecloud-gridengine

Issue simili

Altre issue su Python

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.