Skip to content
#

webscraping

Star

Web scraping is the process of programmatically retrieving web pages and extracting structured data from them for analysis, storage, or reuse. It powers price monitoring, search indexing, market research, and training-data collection.

Scraping ranges from plain HTTP requests and HTML parsing to full browser automation for JavaScript-rendered and anti-bot-protected pages. The ecosystem includes request libraries, HTML parsers, headless browsers, and cloud extraction platforms.

Here are 10,500 public repositories matching this topic...

Language: All
Filter by language
All 10,500 Python 5,158 Jupyter Notebook 2,335 JavaScript 750 HTML 457 TypeScript 324 R 186 Java 176 Go 125 C# 107 PHP 68
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
Scrapling

D4Vinci / Scrapling

Sponsor
Star 87k

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

python crawler data automation ai mcp scraping crawling web-scraper web-scraping selectors xpath data-extraction stealth webscraping crawling-python playwright web-scraping-python ai-scraping mcp-server
  • Updated Oct 11, 2026
  • Python

CloakHQ / CloakBrowser

Star 32.1k

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

python recaptcha selenium fingerprint chromium cloudflare web-scraping webscraping browser-automation bot-detection ai-agents anti-detect undetected puppeteer captcha-bypass headless-browser cloudflare-bypass playwright antidetect-browser stealth-browser
  • Updated Oct 12, 2026
  • Python
invisible_playwright

feder-cr / invisible_playwright

Sponsor
Star 3.1k

Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

python firefox recaptcha scraping cloudflare web-scraping akamai browser-fingerprinting stealth webscraping browser-automation perimeterx bot-detection web-automation datadome headless-browser playwright antidetect-browser anti-detect-browser stealth-browser
  • Updated Oct 12, 2026
  • Python
invisible_selenium

feder-cr / invisible_selenium

Sponsor
Star 2.8k

Selenium that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

python firefox webdriver selenium web-scraping selenium-webdriver anti-bot stealth webscraping geckodriver browser-automation bot-detection web-automation anti-detect selenium-python headless-browser antidetect antidetect-browser anti-detect-browser stealth-browser
  • Updated Oct 12, 2026
  • Python
invisible_playwright_mcp

feder-cr / invisible_playwright_mcp

Sponsor
Star 2.8k

Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use.

web-scraping webscraping browser-automation autonomous-agents job-search web-automation job-hunting playwright ai-tools browser-agent antidetect-browser llm-agent gemini-cli computer-use stealth-browser model-context-protocol mcp-server mcp-tools claude-code-plugin gemini-cli-extension
  • Updated Oct 12, 2026
  • Python
Followers
367 followers
Website
github.com/topics/web-scraping

Related topics

browser-automation headless-browser playwright puppeteer selenium