Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
其他人工智能更新于 2026-10-25
其他其他AGPL-3.0
Repository dossier
germondai/trawl
Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.
Brief / README 摘要
查看原文Self-hosted web scraping for applications and AI agents. Get page content through an API or MCP, with built-in handling for supported browser challenges and CAPTCHAs. TRAWL starts with HTTP, reuses verified clearance and opens Camoufox when a browser is needed. Repeat requests fetch fresh content without repeating a full solve whenever the site accepts the saved session. Website · Documentation · Latest release Challenge handling: Cloudflare, Anubis, Akamai, Imperva, DDoS-Guard and supported AWS WAF and DataDome flows. Built-in CAPTCHA paths include Turnstile, reCAPTCHA v2, hCaptcha, GeeTest S…
Topics / 标签
01
浏览全部相关推荐
High performance self-hosted photo and video management solution.
其他前端更新于 2026-10-25
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
其他人工智能更新于 2026-10-25
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
其他人工智能更新于 2026-10-22
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
其他人工智能更新于 2026-10-22
Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown
其他其他更新于 2026-10-25