skypilot-org/skypilot

[Spot] An option for keeping failed spot job for a while before termination

Open

Aperta il 11 set 2022

Vedi su GitHub
 (4 commenti) (0 reazioni) (0 assegnatari)Python (4859 star) (311 fork)batch import
P1feature-requesthelp wanted

Descrizione

When something wrong happens with the spot job, it would be nice to be able to log into the spot cluster to take a look at the problem. As proposed by @lhqing, having an option like --keep-minutes-after-error 60 for the spot launch can be useful for debugging.

Guida contributor

Tech stack
python
Dominio
clouddevops
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
2
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-3 hours
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
fresh
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
PythonSkyPilot CLI basics
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
70
Direzione di ricerca
The issue requests a keep minutes after error flag for spot jobs. Look at the spot job launch code in the SkyPilot repository, specifically the spot module (e.g., sky/spot/). Check existing command line argument parsing in sky/cli.py or similar. Implement the flag to delay termination after failure, likely modifying the spot job termination logic. Verify the proposal in the issue comments for additional context.