piskvorky/gensim

Document how to get complete document distribution from LDA

Open

#2489 opened on May 10, 2019

View on GitHub
 (5 comments) (0 reactions) (0 assignees)Python (15,144 stars) (4,349 forks)batch import
Hacktoberfestdifficulty easydocumentationgood first issue

Description

Document how to to get full document distribution from LDA, that would help in those cases where you are implementing your own distance algorithm and you need full distribution. Personally I set minimum_probability=0.0 but there might be other ways.

Contributor guide

Tech stack
python
Domain
documentation
Issue type
documentation
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
PythongensimLDA
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70
Research direction
Investigate the LdaModel class in gensim's source code to understand how document topic distributions are computed and how the minimum probability parameter affects output. Review the current documentation for get document topics. Update the documentation to explain that setting minimum probability=0.0 returns the full distribution, and consider mentioning alternative methods like using the gamma array. Check the issue comments for additional user suggestions. Provide code examples showing both approaches.