Add (optional) data persistence
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 28/100
Research direction
Start by tracing the scraper and command-line entry point to see what comment and video-link data are currently available. The issue leaves the selected fields, database structure, and deduplication behavior undecided. Done means optional SQLite persistence records selected scraped comments and the bot's subreddit video links while the default operation remains lightweight.
Written by the indexing model from the issue text.
Description
Since the bot is scraping /r/all anyway, would be nice to build a dataset to play with later. The bot should store select information from all the comments it scrapes in a SQLite database. Also, the bot should store information about itself: in particular, what video links it's collecting from each subreddit. Would be interesting to see which videos are popular in which subreddits. Not sure whether or not the deduplication is something I care about or not here.
Data persistence should be turned on via command line argument: default bot operation should be as lightweight as possible.
- Dominant language
- Python
- Stars
- 26
- Forks
- 5
- PR merge metrics
- No merged PRs in 30d
Getting set up
We have not checked this project's setup files yet. Start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from dmarx/VideoLinkBot
-
Add logging supportOpenenhancement
Difficulty 4/5 3-5 days Newbie friendliness 30/100
dmarx/VideoLinkBot#38 ·
-
"by request" botOpendream
Difficulty 5/5 Over a week Newbie friendliness 25/100
dmarx/VideoLinkBot#37 ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 45/100
dmarx/VideoLinkBot#36 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
dmarx/VideoLinkBot#34 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
dmarx/VideoLinkBot#33 ·
All issues in dmarx/VideoLinkBot
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
BasedHardware/omi#20271 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 92/100
openai/openai-cookbook#3153 ·
Maintainers usually reply within 1 day
-
cvss-severity:high devguard l3montree-cybersecurity/devguard/devguard pkg:golang/github.com/l3montree-dev/devguard risk:low state:open
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
l3montree-dev/devguard#3146 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
bug confirmed issue
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
open-webui/open-webui#31849 · 2 comments ·
Maintainers usually reply within 1 day