facebookresearch/xformers

Provide an easy way to debug mem-eff issues

Open

#632 创建于 2023年1月10日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Python (6,903 star) (473 fork)batch import
good first issue

描述

🚀 Feature

We should be able to: (1) Understand which op is used for FW/BW (via additional logging enabled with an env variable?) (2) Possibly disable some ops entirely with env variable (like CUDA_VISIBLE_DEVICES but something like XFORMERS_MEMEFF_FW_OPERATORS=...)

贡献者指南

技术栈
pythonpytorch
领域
performancemachine learning
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
half day
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
PythonPyTorchEnvironment variables
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
35
研究方向
Review the xformers codebase, particularly the modules related to memory efficient operations (e.g., xformers/ops/). Examine existing environment variable usage patterns. Consider adding logging to track which ops are used, and a mechanism to disable specific ops via an env variable, similar to CUDA VISIBLE DEVICES. The implementation should be in the core module.