huggingface/ratchet

Operation testing suite

Aperta

#235 aperta il 5 lug 2024

 (4 commenti) (1 reazione) (0 assegnatari)Rust (44 fork)auto 404
help wanted

Metriche repository

Star
 (768 stelle)
Metriche merge PR
 (Metriche PR in attesa)

Descrizione

As more and more browsers ship WebGPU, there may be minor discrepancies between implementations. This may cause us significant delays and issues if not addressed.

So, what we need is a test suite like no other. It must fuzz all functionality in all possible deployment settings.

Browser: Chrome, Safari, Firefox, OS: Windows, Macos, Linux

This gives us 7 combinations we need to fuzz all functionality on.

We do not currently do operation tests in the browser because they rely on pytorch for ground truth - this must be resolved by using pre-generated ground truth data (or some other great idea).

This will be done in conjunction with our property based testing, which runs locally and is ground truthed against pytorch.

Guida contributor