Improving computational time in LDASeqModel · piskvorky/gensim#1545

(9 评论) (1 反应) (0 负责人)Python (15,144 star) (4,349 fork)batch import

Hacktoberfestdifficulty mediumfeaturegood first issueperformance

描述

Hi,

I was training a LDASeqModel on ~40k documents through 20 years (20 time slices in my case) and after 2 days of computation, still didn't finish.

I realized that only LDAModel is used in this class. Shouldn't be better to use LDAMulticore since it can also handle the case of single core ?

Thanks

技术栈: python
领域: datamachine learningperformance
议题类型: performance
难度: 3
预计时间: 1-3 hours
活动状态: stale
清晰度: clear
前置要求: Pythongensim
新手友好度: 50
研究方向: Investigate the LDASeqModel class in gensim's source code to identify where LDAModel is used and assess the feasibility of replacing it with LDAMulticore. Check the LDAMulticore implementation to ensure it supports the same interface. Consider any potential side effects, such as changes in behavior or dependencies. Reference the issue comments for any maintainer feedback.