facebookresearch/HolisticTraceAnalysis
How to plot timeline with the label added by torch.profiler.record_function?
オープン
#99 opened on 2024/01/24
help wantedneeds triagequestion
Repository metrics
- Stars
- (535 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
What is your question?
I want to plot the timeline of training GPT with pipeline parallelism. I use torch.profiler.record_function to label some functions , such as forward_step and backward_step of each micro_batch. I want to plot these functions for all ranks into one image, how can I do it? If using the example code (https://github.com/facebookresearch/HolisticTraceAnalysis/blob/main/examples/plot_timeline.ipynb), I get an image with kernels rather than record_function.