facebookresearch/HolisticTraceAnalysis
How to plot timeline with the label added by torch.profiler.record_function?
开放
#99 创建于 2024年1月24日
help wantedneeds triagequestion
仓库指标
- 星标
- (535 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
What is your question?
I want to plot the timeline of training GPT with pipeline parallelism. I use torch.profiler.record_function to label some functions , such as forward_step and backward_step of each micro_batch. I want to plot these functions for all ranks into one image, how can I do it? If using the example code (https://github.com/facebookresearch/HolisticTraceAnalysis/blob/main/examples/plot_timeline.ipynb), I get an image with kernels rather than record_function.