huggingface/ratchet

Operation testing suite

Ouverte

#235 ouverte le 5 juil. 2024

 (4 commentaires) (1 réaction) (0 personne assignée)Rust (44 forks)auto 404
help wanted

Métriques du dépôt

Stars
 (768 étoiles)
Métriques de merge PR
 (Aucune PR mergée en 30 j)

Description

As more and more browsers ship WebGPU, there may be minor discrepancies between implementations. This may cause us significant delays and issues if not addressed.

So, what we need is a test suite like no other. It must fuzz all functionality in all possible deployment settings.

Browser: Chrome, Safari, Firefox, OS: Windows, Macos, Linux

This gives us 7 combinations we need to fuzz all functionality on.

We do not currently do operation tests in the browser because they rely on pytorch for ground truth - this must be resolved by using pre-generated ground truth data (or some other great idea).

This will be done in conjunction with our property based testing, which runs locally and is ground truthed against pytorch.

Guide contributeur