waylonflinn/weblas

Unit Test Float Encode Exhaustively

Open

#11 opened on Dec 16, 2015

View on GitHub
 (2 comments) (0 reactions) (0 assignees)JavaScript (701 stars) (56 forks)batch import
correctnesshelp wanted

Description

The floating point encode step is a tricky bit to get right. Issue #10 shows that numerical stability issues can make a big difference in some edge cases.

Encoding each unique floating point value as an element of a 4098 square matrix should require only a few hundred of these matrices. This should be doable in a reasonable amount of time.

References

Contributor guide

Unit Test Float Encode Exhaustively · waylonflinn/weblas#11 | Good First Issue