Improving computational time in LDASeqModel · piskvorky/gensim#1545

(9 comments) (1 reaction) (0 assignees)Python (15,144 stars) (4,349 forks)batch import

Hacktoberfestdifficulty mediumfeaturegood first issueperformance

説明

Hi,

I was training a LDASeqModel on ~40k documents through 20 years (20 time slices in my case) and after 2 days of computation, still didn't finish.

I realized that only LDAModel is used in this class. Shouldn't be better to use LDAMulticore since it can also handle the case of single core ?

Thanks

技術スタック: python
領域: datamachine learningperformance
Issue 種別: performance
難度: 3
推定時間: 1-3 hours
活動状況: stale
明確さ: clear
前提条件: Pythongensim
初心者向け度: 50
調査方針: Investigate the LDASeqModel class in gensim's source code to identify where LDAModel is used and assess the feasibility of replacing it with LDAMulticore. Check the LDAMulticore implementation to ensure it supports the same interface. Consider any potential side effects, such as changes in behavior or dependencies. Reference the issue comments for any maintainer feedback.