tagscrawler
undefined

colly

Elegant Scraper and Crawler Framework for Golang

10.50

pyspider

A Powerful Spider(Web Crawler) System in Python.

undefined

examples-of-web-crawlers

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

undefined

newspaper

News, full-text, and article metadata extraction in Python 3. Advanced docs:

undefined

proxy_pool

Python爬虫代理IP池(proxy pool)

undefined

annie

👾 Fast, simple and clean video downloader

11.46

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

undefined

webmagic

A scalable web crawler framework for Java.