pytorch/ignite

Are there any ways to filter out or ignore a batch in engine?

Open

#996 创建于 2020年4月30日

在 GitHub 查看
 (7 评论) (1 反应) (0 负责人)Python (602 fork)batch import
enhancementhelp wanted

仓库指标

Star
 (4,313 star)
PR 合并指标
 (平均合并 18天 23小时) (30 天内合并 19 个 PR)

描述

❓ Questions/Help/Support

I'm really new to the ML area and I'm trying to train a network with a dataset that when sampling batches, it can create batches with really large sizes (the sampling method is just torch's weightedSampling). Though the batch size is fixed the data size in the batch will be really large sometimes. It seems pretty complicated to define a customized sampler, and the way I originally did was just ignore that batch when the data size in the batch is too large. Now, I'm trying to use ignite as the framework to train the network, I don't know how to do this. I think it might relate to event_filter? But it seems to be triggered by event, so are there any ways to pass in a batch instead?

Thanks so much for your time!

贡献者指南