ForkFree

AI agents and automation

pagesift

by YOLOW92

pagesift is a self-hosted tool that fetches web pages and reads documents such as PDFs, Office files and emails, then returns clean Markdown or JSON. It is built to feed web and document content to AI agents and language models, and it offers Firecrawl- and Jina Reader-style APIs.

Proof level: ReadHidden gemNew and promisingAGPL-3.0

Could replace Firecrawl and Jina Reader. We have not checked a price for them yet.

Get it on GitHubCompare

No demo yet

Proof level: Read. We read its README and licence and ran our automatic checks. We have not run it yet. So this page is based on its README and our automatic checks.

The catch

Hidden gemIt's a self-hosted single Rust binary that turns URLs, PDFs (with OCR) and Office files into clean Markdown or JSON. It also offers Firecrawl- and Jina-compatible APIs, so it can replace paid scraping services for small teams. The install steps, the docs and the broad coverage of formats and SDKs suggest a real, working tool. Best for indie builders needing self-hosted scraping and document parsing for LLM pipelines.
New and promisingUnder two months old. Expect rough edges and fast changes.

Check this first: AGPL-3.0 licence: running it as a network service may require sharing your source code, or buying a commercial licence.

Things to check

  • AGPL-3.0 licence: running it as a network service may require sharing your source code, or buying a commercial licence
  • The agent endpoint needs your own language model, which may mean paid API keys
  • Scraping websites can breach their terms of service
  • OCR runs best with an NVIDIA GPU and needs about 1.7 GB of memory with formula models
  • Benchmark claims come from the project itself

Can you use pagesift commercially?

Free to use. Anything you distribute that includes it must be open-sourced under the same licence. Running it as an online service also counts, so a hosted version must offer its source.

Not legal advice. Read the project's licence file before building a product on it.

What can you do with pagesift?

  • Turn web pages, whole sites or scanned PDFs into clean Markdown or JSON
  • Run a self-hosted server that works with existing Firecrawl or Jina Reader code
  • Connect it to an AI assistant as an MCP server so the assistant can scrape and crawl

How do you get pagesift running?

Run the Docker image ghcr.io/yolow92/pagesift, or install the command-line tool with cargo, pip or npm.

Follow the official instructions in the project README.

Make money with it

A freelancer could offer paid data-collection or document-conversion services, or build knowledge-base chatbots for clients, using pagesift as the extraction layer.

An idea, not financial advice. Check the licence before charging for anything built on it.

Ways a business could use it

  • Collect competitor pages, price lists or documentation into Markdown for internal research, without paying for a hosted scraping API
  • Convert client PDFs, scanned documents and Office files into searchable text for a document search or chatbot service

Checked 06 Nov 2026. Summary drafted by AI from the project's README. Proof level 1 of 4, Read: we read its readme and licence and ran our automatic checks. we have not run it yet.

Similar tools in AI agents and automation

craft-anything storytold
New and promising

Craft Anything is a desktop app and command-line tool that studies how a website, app or game works, then uses a coding agent to build your own version and check it against the original. It is meant for people who want to recreate or learn from existing software without writing it all by hand.

Proof level: Read 38.9k stars +2044 a day Apache-2.0
dsh-Go ccch1mneyyy
New and promising

DSH Go is an unofficial Android app that runs the DeepSeek Harness coding agent on your phone, or lets you control a copy running on your computer or server. It gives you a chat interface for talking to AI models, approving tool actions and sharing conversations.

Proof level: Read 28.6k stars +1280 a day AGPL-3.0
orca stablyai
Worth a look

Orca is a desktop app, with a phone companion, for running several AI coding agents side by side, each in its own git worktree. It lets you track, review and steer their work from one place.

Proof level: Read 130.3k stars +936 a day MIT