ScrapeGraphAI/Scrapegraph-ai: Python scraper based on AI
Python scraper based on AI.
爬虫相关
x-crawl
灵活的 Node.js AI 辅助爬虫库
itsOwen/CyberScraper-2077: A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama - itsOwen/CyberScraper-2077
raznem/parsera: Lightweight library for scraping web-sites with LLMs
Lightweight library for scraping web-sites with LLMs - raznem/parsera
jhao104/proxy_pool: Python ProxyPool for web spider
Python ProxyPool for web spider.
VinciGit00/Scrapegraph-ai: Python scraper based on AI
Python scraper based on AI.
Indices and tables — ScrapeGraphAI documentation
GitHub - Shubhamsaboo/awesome-llm-apps: Collection of awesome LLM apps with RAG using OpenAI, Anthropic, Gemini and opensource models.
Collection of awesome LLM apps with RAG using OpenAI, Anthropic, Gemini and opensource models. - Shubhamsaboo/awesome-llm-apps
GitHub - WwwwwyDev/crawlist: A universal solution for web crawling lists
A universal solution for web crawling lists. 抓取网页列表的通用解决方案 - WwwwwyDev/crawlist
ityard/python-fxxk-spider: 收集各种免费的 Python 爬虫项目
收集各种免费的 Python 爬虫项目.
GitHub - paulpierre/markdown-crawler: A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG - paulpierre/markdown-crawler
DrissionPage官网
4.1 版已发布，新的变化请查看 “特性介绍”。
g1879/DrissionPage: 基于python的网页自动化工具。既能控制浏览器，也能收发数据包。可兼顾浏览器自动化的便利性和requests的高效率。功能强大，内置无数人性化设计和便捷功能。语法简洁而优雅，代码量少。
Python based web automation tool. Powerful and elegant. - g1879/DrissionPage