NVIDIA/DALI

Training hangs on specific video

Open

#4 316 ouverte le 6 oct. 2022

Voir sur GitHub
 (6 commentaires) (0 réactions) (1 assigné)C++ (670 forks)auto 404
Videohelp wanted

Métriques du dépôt

Stars
 (5 722 stars)
Métriques de merge PR
 (Métriques PR en attente)

Description

Hi,

I am adding this issue because my training hangs when specific video is in the dataset. I am using old version of DALI (0.10) because code I want to reproduce use it. Videos created with exactly the same code work well, only this one makes problems. I am attaching video file causing problems (stroller_2.mp4) and very similar video which is ok (stroller_1.mp4). In the new version of DALI it seems to work. Unfortunately I prefer to not update DALI cause it can affect reproducibility. Do you have maybe some idea why this particular file can cause problems and how could I fix it?

stroller_1.mp4 https://user-images.githubusercontent.com/17530823/194344261-45b4e882-2000-4f64-a362-6c15e60af288.mp4

stroller_2.mp4 https://user-images.githubusercontent.com/17530823/194344435-6ffa8990-5568-45e6-9e9d-2d7f3f3ca714.mp4

For any case I have repeated process of creating video file with ffmpeg but it didn't help. Both videos were made based on frames from one sequence from DAVIS dataset, one of them based on odd frames, and second based on even frames. Additionally video created based on all the frames does not cause any problems.

Guide contributeur