huggingface/accelerate
Barebones dataloader to allow for any type of iterable dataloader-like object to be used. Should just handle device placement
クローズ
#2,975 opened on 2024/07/29
good first issue
Repository metrics
- Stars
- (5,805 個のスター)
- PR merge metrics
- (平均マージ 16d 17h) (30d で 23 merged PRs)
説明
Make a simplistic version of the DispatchDataLoader which allows for users to easily pass in any Iterable type of object and call it's __iter__. Likely situation to make sure Accelerator knows what's up during prepare is to add an option to the DataLoaderConfiguration for custom_classes which accepts types for us to do isinstance() on