Lightning-AI/lightning-thunder

Support `torch.where(condition)` with thunder.jit

开放

#124 创建于 2024年4月3日

 (12 条评论) (0 个反应) (0 位负责人)Python (114 个派生)github user discovery
enhancementhelp wantedoperators

仓库指标

星标
 (1,460 个星标)
PR 合并指标
 (30 天内没有已合并 PR)

描述

🚀 Feature

Motivation

Mixtral uses it: https://github.com/mistralai/mistral-src/blob/8598cf582091a596671be31990448e0620017851/moe_one_file_ref.py#L215

Minimal Repro

import thunder

def fn(cond):
    return torch.where(cond)

thunder.jit(fn)(torch.randn(3) > 0)

Pitch

Support image from https://pytorch.org/docs/stable/generated/torch.where.html

Additional context

We already support torch.where(condition, input, other): https://github.com/search?q=repo%3ALightning-AI%2Flightning-thunder+%22def+where%22&type=code

cc @apaz-cli

贡献者指南