Owner
TeamHG-Memex
61 indexed repositories · View on GitHub
-
eli5
A library for debugging/inspecting machine learning classifiers and explaining their predictions
Jupyter Notebook · 2839 stars
-
scrapy-rotating-proxies
use multiple proxies with Scrapy
Python · 771 stars
-
tensorboard_logger
Log TensorBoard events without touching TensorFlow
Python · 627 stars
-
sklearn-crfsuite
scikit-learn inspired API for CRFsuite
Python · 440 stars
-
aquarium
Splash + HAProxy + Docker Compose
Python · 195 stars
-
deep-deep
Adaptive crawler which uses Reinforcement Learning methods
Jupyter Notebook · 167 stars
-
arachnado
Web Crawling UI and HTTP API, based on Scrapy and Tornado
Python · 162 stars
-
html-text
Extract text from HTML
HTML · 135 stars
-
autologin
A project to attempt to automatically login to a website given a single seed
Python · 129 stars
-
Formasaurus
Formasaurus tells you the type of an HTML form and its fields using machine learning
HTML · 121 stars
-
autopager
Detect and classify pagination links
HTML · 107 stars
-
page-compare
Simple heuristic for measuring web page similarity (& data set)
HTML · 91 stars
-
undercrawler
A generic crawler
Python · 81 stars
-
scrapy-crawl-once
Scrapy middleware which allows to crawl only new content
Python · 80 stars
-
soft404
A classifier for detecting soft 404 pages
Jupyter Notebook · 64 stars
-
agnostic
Agnostic Database Migrations
Python · 54 stars
-
json-lines
Read JSON lines (jl) files, including gzipped and broken
Python · 37 stars
-
autologin-middleware
Scrapy middleware for the autologin
Python · 36 stars
-
extract-html-diff
extract difference between two html pages
HTML · 33 stars
-
scrapy-kafka-export
Scrapy extension which writes crawled items to Kafka
Python · 31 stars
- 41 more repositories live on View on GitHub
-
automation
Difficulty 5/5 Over a week Newbie friendliness 30/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 32/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 45/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 42/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
TeamHG-Memex/eli5#430 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 28/100
TeamHG-Memex/agnostic#29 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 32/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 38/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 32/100
TeamHG-Memex/json-lines#17 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 45/100
TeamHG-Memex/soft404#39 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 35/100
TeamHG-Memex/fubook#12 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
TeamHG-Memex/linkrot#3 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 45/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 38/100
TeamHG-Memex/Formasaurus#37 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 28/100
TeamHG-Memex/arachnado#66 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 42/100
TeamHG-Memex/privoxy#3 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 42/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 32/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 30/100
TeamHG-Memex/quickpin#43 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 42/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 35/100
TeamHG-Memex/autologin#56 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
TeamHG-Memex/deep-deep#28 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 30/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
TeamHG-Memex/fortia#10 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
TeamHG-Memex/autopager#14 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 38/100
TeamHG-Memex/scrapy-cdr#21 ·
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 28/100
TeamHG-Memex/onetera#3 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 32/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 30/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 35/100
TeamHG-Memex/aquarium#34 ·
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
automation
Difficulty 5/5 Over a week Newbie friendliness 25/100
Showing the newest 100
This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.