More robust testing for AlphaDropout · FluxML/Flux.jl#1851

(6 comments) (0 reactions) (0 assignees)Julia (4,725 stars) (619 forks)batch import

good first issuehelp wantedtesting

説明

We currently borrow from https://github.com/pytorch/pytorch/blob/v1.10.0/test/cpp/api/modules.cpp#L1337-L1338, but some sort of goodness-of-fit test would be more robust than a simple range. Sampling the layer outputs should have a negligible impact on test runtime.

技術スタック: なし
領域: testingmachine learning
Issue 種別: test
難度: 3
推定時間: 1-3 hours
活動状況: stale
明確さ: mostly clear
前提条件: Julia basicsFlux libraryStatistical testing
初心者向け度: 70
調査方針: Examine the existing AlphaDropout test in Flux.jl's test suite, likely in test/layers.jl or similar. The issue suggests replacing the simple range check with a goodness of fit test, such as a chi squared test, to verify the dropout distribution. Review the PyTorch reference (test/cpp/api/modules.cpp lines 1337-1338) for inspiration, but adapt to Julia's testing framework. Consider implementing a statistical test that checks whether the output distribution matches the expected AlphaDropout distribution.