medialab/minet

View on GitHub

A webmining CLI tool & library for python.

Stars: 374
Forks: 27
Open beginner issues: 0
Indexed issues: 113

Dominant language: Python
License: GPL-3.0
Last GitHub push: Sep 8, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

113 open issues indexed

minet.exe fetch breaks on output of minet.exe hyphe dump Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

medialab/minet#1038 · 1 comment · Opened Apr 14, 2026
Youtube minet captions is broken Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

medialab/minet#1035 · Opened Feb 10, 2026
Use Bluesky normalizer options Open

medialab/minet#1032 · 1 assignee · Opened Jan 28, 2026
Adding `minet bsky post-thread` Open

enhancement

medialab/minet#1031 · 1 comment · 1 assignee · Opened Jan 7, 2026
instagram user-posts stop to collect at 50 for each account Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

medialab/minet#1027 · Opened Dec 9, 2025
MacOs bin within zipped releases is not executable Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

medialab/minet#1026 · Opened Dec 9, 2025
Investigate new api addition yt Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#1024 · Opened Dec 2, 2025
Erreur dans le moissonnage des commentaires instagram Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#1020 · 3 comments · Opened Oct 16, 2025
Add GDPR-related documentation Open

documentation

Difficulty 4/5 3-5 days Newbie friendliness 25/100

medialab/minet#1016 · Opened Sep 3, 2025
Explore potential alternative routes for TikTok? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#1013 · Opened Jun 25, 2025
Explore potential alternative routes for Instagram? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#1012 · 1 comment · Opened Jun 25, 2025
Blocage de la collecte des commentaires Instagram après environ 140 commentaires Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

medialab/minet#1011 · 9 comments · Opened Jun 17, 2025
Introducing "behavior" when fetching a url Open

discussion enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#1010 · 6 comments · Opened Jun 3, 2025
twitter scraping is broken Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

medialab/minet#1009 · 5 comments · Opened May 14, 2025
minet fetch --explode --filename-column should also explode the filename-column Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

medialab/minet#1005 · 2 comments · Opened Apr 8, 2025
scrape command should have a --plural flag to force pluralization Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

medialab/minet#1003 · Opened Mar 6, 2025
import_target does not always work Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 38/100

medialab/minet#1002 · Opened Mar 6, 2025
TikTok unauthenticated angle Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#1001 · Opened Feb 28, 2025
Experiment with importlib.LazyLoader Open

investigation optimization

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#996 · Opened Jan 4, 2025
Command to add jobs to a crawler's queue Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#982 · Opened Jul 24, 2024
When -c is not specified, we should default to test all available browsers instead of only firefox Open

dx enhancement

Difficulty 3/5 1-2 days Newbie friendliness 25/100

medialab/minet#975 · 1 comment · Opened May 31, 2024
Error on wikipedia pageviews Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 42/100

medialab/minet#969 · 1 comment · Opened May 14, 2024
Scrapping 1000's of comments on Instagram Open

bug question

Difficulty 4/5 3-5 days Newbie friendliness 25/100

medialab/minet#968 · 3 comments · Opened May 13, 2024
Retrieve videos from instagram hashtag function Open

bug enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

medialab/minet#967 · 9 comments · Opened Apr 25, 2024
ThreadsafeBrowser enhancements Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

medialab/minet#963 · Opened Apr 16, 2024
Refactor Crawler request_args as inheritance Open

refactor

Difficulty 4/5 3-5 days Newbie friendliness 35/100

medialab/minet#961 · Opened Apr 15, 2024
There should be a Crawler side global callback for each job Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#954 · Opened Apr 12, 2024
Add some crawler level job filter Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#950 · Opened Apr 3, 2024
Make minet installable without playwright Open

dx

Difficulty 3/5 1-2 days Newbie friendliness 25/100

medialab/minet#949 · Opened Apr 2, 2024
A challenges challenge Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

medialab/minet#947 · Opened Mar 26, 2024
Add a "minet hal" module? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#945 · Opened Mar 21, 2024
path column is not very useful when using --glob file on scrape/extract Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#939 · Opened Feb 21, 2024
Try to scrape twitter embed for tweets rather than using the Guest scraper Open

enhancement investigation

Difficulty 5/5 Over a week Newbie friendliness 15/100

medialab/minet#933 · Opened Jan 18, 2024
Add --raw flag to yt captions Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

medialab/minet#929 · Opened Jan 15, 2024
Possible issue with jobs duplication if crawler crashes somewhere around the processing? Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#928 · Opened Jan 12, 2024
Add linktr.ee scraper Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

medialab/minet#926 · Opened Dec 20, 2023
The crawler might ask a spider to process an already visited url even if the end_url is already in cache Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

medialab/minet#925 · Opened Dec 19, 2023
Scrape command -m, -e and --field Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 30/100

medialab/minet#922 · Opened Dec 11, 2023
Add extraction method to scrape command related to social network account displayed on homepages Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 25/100

medialab/minet#918 · Opened Nov 29, 2023
Add method to response to return stripped body and/or add middleware to edit response body on the flight Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#914 · Opened Nov 28, 2023
Add some diagram for the crawler's lifecyle and architecture Open

documentation

Difficulty 4/5 3-5 days Newbie friendliness 25/100

medialab/minet#911 · Opened Nov 21, 2023
Refactor mediacloud client and unify auth errors Open

refactor

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#909 · Opened Nov 16, 2023
Integrate a file writer to the http executor like the crawler? also integrate the folder strategy? Open

enhancement refactor

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#906 · Opened Nov 9, 2023
Move nested total of progress bar to upper column? Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 25/100

medialab/minet#902 · Opened Nov 2, 2023
Add capabilities to retry fetch/crawl/resolve etc. from an already written report so errors might tried again Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#897 · Opened Oct 25, 2023
Way to enable extension in non persistent contexts Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#895 · Opened Oct 21, 2023
The typed cli_args conundrum and the action kwargs Open

refactor

Difficulty 5/5 Over a week Newbie friendliness 20/100

medialab/minet#893 · 1 comment · Opened Oct 20, 2023
Multi execution capabilities for easy unit test on trivial commands Open

refactor

Difficulty 3/5 1-2 days Newbie friendliness 35/100

medialab/minet#891 · Opened Oct 19, 2023
Improve UrlCache add_many & enable contains_many etc. Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

medialab/minet#886 · Opened Oct 16, 2023
Improve progress bar ETA Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 20/100

medialab/minet#879 · Opened Oct 5, 2023

medialab/minet

Get new issues in your inbox