All repositories

RAG & vector DBsinfiniflow

ragflow

A ready-made RAG engine with a UI: it parses documents with templates, chunks them, searches with citations and supports agentic retrieval. Deploys with Docker.

Who it is for

For teams that want their own knowledge base with document chat without building a pipeline from scratch.

How to start

  1. Clone the repo: git clone https://github.com/infiniflow/ragflow.git.
  2. Go to ragflow/docker and check out the release tag (git checkout v1.0.0-rc1).
  3. Start the services: docker compose -f docker-compose.yml up -d, then check docker ps.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+1,778Oct 22 — Nov 19
92,62994,407

Author's description

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

firecrawl

firecrawl

Growing fastest

A service that turns any website into clean Markdown or structured data for models. It can search, scrape, crawl a whole site and even click through a page.

203Kstars+9.3K in 30 dTypeScript

microsoft

markitdown

Growing fastest

A small Microsoft utility that converts PDF, Word, PowerPoint, Excel and other files into Markdown that is easy to hand to a language model.

196Kstars+3.7K in 28 dPython

unclecode

crawl4ai

An open-source Python crawler: it visits pages with a real browser and returns clean Markdown for LLMs. Runs locally, in Docker or as a cloud service.

88Kstars+1.5K in 30 dPython

opendatalab

MinerU

Parses complex PDFs, scans and Office files into Markdown or JSON while keeping tables and formulas. Comes with a CLI, a Python SDK and an agent skill.

84Kstars+1.3K in 28 dPython

docling-project

docling

An IBM library for document parsing: PDF, Office, HTML and images become one unified structure from which Markdown is easy to get. Supports vision models for hard pages.

71Kstars+1.5K in 30 dPython

Mintplex-Labs

anything-llm

A ready-made «chat with your documents» app: plug in any model and vector database, upload files and talk to them. Has a desktop version, Docker and agents.

68Kstars+998 in 30 dJavaScript