waylonflinn/weblas

Unit Test Float Encode Exhaustively

Open

#11 opened on Dec 16, 2015

View on GitHub
 (2 comments) (0 reactions) (0 assignees)JavaScript (56 forks)batch import
correctnesshelp wanted

Repository metrics

Stars
 (701 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

The floating point encode step is a tricky bit to get right. Issue #10 shows that numerical stability issues can make a big difference in some edge cases.

Encoding each unique floating point value as an element of a 4098 square matrix should require only a few hundred of these matrices. This should be doable in a reasonable amount of time.

References

Contributor guide