pytorch/serve

Handle invalid input intelligently ！

Open

Aperta il 12 lug 2023

Vedi su GitHub
 (7 commenti) (0 reazioni) (0 assegnatari)Java (3844 star) (790 fork)batch import
debugginggood first issuetriaged

Descrizione

🚀 The feature

Given a custom service that expects JSON as input, If the input is invalid JSON such as { "image": "I missed a quote} it will return { "code": 500, "type": "InternalServerException", "message": "Worker died." } and reload model. Is something can do to verify the accuracy of input to avoid such direct returns and model reload when it cannot be modified input?

Motivation, pitch

Is something can do to verify the accuracy of input to avoid such direct returns and model reload when it cannot be modified input?

Alternatives

No response

Additional context

No response

Guida contributor

Tech stack
pythonjavarest api
Dominio
backendapimachine learning
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
3
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-3 hours
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
fresh
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
mostly clear
Prerequisiti
Familiarity with PyTorch ServeBasic understanding of JSON parsing
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
65
Direzione di ricerca
Investigate the input validation pipeline in PyTorch Serve. Look at the request handler code in `frontend/server/src/main/java/org/pytorch/serve/http/InferenceRequestHandler.java` and the worker process in `backend/python/worker.py`. The issue suggests adding pre validation of JSON input before passing to the model worker. Consider implementing a JSON schema validation step in the frontend to catch invalid JSON early and return a 400 error instead of a 500. Check if there are existing input validation utilities in the codebase that can be leveraged or extended.