huggingface/candle

Support Meta Nougat model

Open

#1,070 创建于 2023年10月10日

在 GitHub 查看
 (15 评论) (4 反应) (0 负责人)Rust (19,476 star) (1,440 fork)batch import
help wanted

描述

Hi, it would be really fantastic if there was example code to host Nougat inference on candle! Is there any chance of this being supported? The documentation doesn't seem too far off what is provided for say running a BERT model inference session https://huggingface.co/docs/transformers/main/model_doc/nougat.

贡献者指南

技术栈
rust
领域
machine learningai
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
4
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
3-5 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
active
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
Rustcandle frameworkNougat model architectureHuggingFace Transformers
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
25
研究方向
Review existing model implementations in candle (e.g., BERT, LLAMA) to understand the pattern. Study the Nougat model architecture and its HuggingFace implementation to identify required components. Implement the model in candle, focusing on inference only as requested. Add example code in the examples directory, similar to existing ones. Refer to issue comments for additional context or maintainer guidance.