pytorch/serve

Handle invalid input intelligently ！

Open

#2,459 创建于 2023年7月12日

在 GitHub 查看
 (7 评论) (0 反应) (0 负责人)Java (3,844 star) (790 fork)batch import
debugginggood first issuetriaged

描述

🚀 The feature

Given a custom service that expects JSON as input, If the input is invalid JSON such as { "image": "I missed a quote} it will return { "code": 500, "type": "InternalServerException", "message": "Worker died." } and reload model. Is something can do to verify the accuracy of input to avoid such direct returns and model reload when it cannot be modified input?

Motivation, pitch

Is something can do to verify the accuracy of input to avoid such direct returns and model reload when it cannot be modified input?

Alternatives

No response

Additional context

No response

贡献者指南

技术栈
pythonjavarest api
领域
backendapimachine learning
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-3 hours
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
fresh
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
Familiarity with PyTorch ServeBasic understanding of JSON parsing
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
65
研究方向
Investigate the input validation pipeline in PyTorch Serve. Look at the request handler code in `frontend/server/src/main/java/org/pytorch/serve/http/InferenceRequestHandler.java` and the worker process in `backend/python/worker.py`. The issue suggests adding pre validation of JSON input before passing to the model worker. Consider implementing a JSON schema validation step in the frontend to catch invalid JSON early and return a 400 error instead of a 500. Check if there are existing input validation utilities in the codebase that can be leveraged or extended.
Handle invalid input intelligently ！ · pytorch/serve#2459 | Good First Issue