Scrapling
by D4Vinci
Scrapling is a Python library for collecting data from websites, covering single page requests, JavaScript-heavy sites and large crawls. It is used to pull out text, prices, listings and other information and save it as JSON, CSV or Markdown.
- Stars
- 89.9k +73 a day
- Licence
- BSD-3-Clause
- Runs on
- Your computer
- Setup
- Moderate
- Language
- Python
- Age
- 743 days
What you can do with it
- Fetch a web page and pull out specific fields using CSS or XPath selectors
- Build a crawler that visits many pages, rotates proxies, retries failures and exports results to JSON or CSV
- Let an AI agent browse and extract website data through the built-in MCP server
Make money with it
A freelancer could offer custom data collection or price-monitoring services to small businesses, delivering regular spreadsheets or feeds.
An idea, not financial advice. Check the licence before charging for anything built on it.
Ways a business could use it
- Track competitor prices and product listings automatically instead of paying for a monitoring service
- Gather lead lists or market research data from public websites to feed into sales or reporting
Can you use it commercially?
Free to use, change and sell, including in paid products. Keep the copyright notice.
Not legal advice. Read the project's licence file before building a product on it.
Getting it running
Install it with pip as the Scrapling package (a Docker image is also available), then write Python scripts or use the command-line tool.
Follow the official instructions in the project README.
Things to check
- Scraping may breach some websites' terms of service or data laws, so check before use
- Stealth and Cloudflare-handling features could be misused to bypass site protections
- Large crawls often need paid proxy services
- README is sponsor-heavy
Checked 27 Oct 2026. Summary drafted by AI from the project's README.
