facebookresearch/HolisticTraceAnalysis
How to plot timeline with the label added by torch.profiler.record_function?
開放
#99 建立於 2024年1月24日
help wantedneeds triagequestion
倉庫指標
- 星標
- (535 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
What is your question?
I want to plot the timeline of training GPT with pipeline parallelism. I use torch.profiler.record_function to label some functions , such as forward_step and backward_step of each micro_batch. I want to plot these functions for all ranks into one image, how can I do it? If using the example code (https://github.com/facebookresearch/HolisticTraceAnalysis/blob/main/examples/plot_timeline.ipynb), I get an image with kernels rather than record_function.