bigscience-workshop/petals

The prompt tuning example (prompt-tuning-sst2) don't work

Open

#241 创建于 2023年1月29日

在 GitHub 查看
 (14 评论) (0 反应) (1 负责人)Python (424 fork)batch import
help wanted

仓库指标

Star
 (8,248 star)
PR 合并指标
 (30 天内没有已合并 PR)

描述

Hi, I have tried to run the notebook example you have published (without editing) in colab but it doesn't work... I get the following error:

RuntimeError                              Traceback (most recent call last)
[<ipython-input-12-7f7d7fa267e9>](https://localhost:8080/#) in <module>
     17 
     18         model.train()
---> 19         outputs = model(**batch)
     20         loss = outputs.loss
     21         loss.backward()

3 frames
[/usr/local/lib/python3.8/dist-packages/torch/nn/modules/linear.py](https://localhost:8080/#) in forward(self, input)
    112 
    113     def forward(self, input: Tensor) -> Tensor:
--> 114         return F.linear(input, self.weight, self.bias)
    115 
    116     def extra_repr(self) -> str:

RuntimeError: expected scalar type Half but found Float

It is probably about the transformers version out of date but petals 1.1.1 requires transformers==4.25.1

贡献者指南