Awesome ACG
Section: Downloaders · Dumb downloader that scrapes the web. [English]
FreshScore 84
Entry
you-get
Appears in 5 awesome lists
Universal content downloader: - download video from popular sites like #YouTube or #TikTok - scrape webpages and download images - download binary files and other non-html content from sites
Open github.comsoimort/you-get
Found in these lists
Awesome-crawler
Section: Python · Dumb downloader that scrapes the web.
StaleScore 56
Awesome Data Analysis
Section: Tools · A tiny command-line utility to download media contents (videos, audios, images) from the web.
FreshScore 80
awesome-python
Section: Other · arrow_double_down: Dumb downloader that scrapes the web
FreshScore 81
Maps, Geolocation and Transport
Section: Downloaders · Universal content downloader: - download video from popular sites like #YouTube or #TikTok - scrape webpages and download images - download binary files and other non-html content from sites
ActiveScore 73
Often listed next to it
browser-use
Minimal browser-automation agent harness with clean separation of tool registration, DOM state injection, action loop, and error recovery. Small codebase, clear structure — the best "minimal viable harness" reference for understanding core loop mechanics.
In 10 listsDetails
Selenium
Portable software testing framework for web applications. License: Apache 2 , .
In 9 listsDetails
playwright-python
Python version of the Playwright testing and automation library.
In 6 listsDetails
scrapy
Fast, high-level web crawling and scraping framework for Python. Extract structured data from websites at scale with built-in support for handling common challenges like pagination, cookies, and concurrent requests. BSD-3-Clause licensed.
In 6 listsDetails
Crawl4AI
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
In 5 listsDetails
gallery-dl
Quick and simple tool for downloading image galleries and collections from #flickr, #danbooru, #pixiv, #deviantart, #exhentai
In 6 listsDetails
Trafilatura
Python & Command-line tool to gather text and metadata on the Web - Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
In 4 listsDetails