All repositories

RAG & vector DBschroma-core

chroma

The easiest vector database to start with: it runs inside your app process, stores documents and finds similar ones. Great for prototypes, with a client-server mode and a cloud.

Who it is for

For beginners and anyone quickly building a RAG prototype.

How to start

  1. Install: pip install chromadb (for JavaScript: npm install chromadb).
  2. Create a collection and add documents as in the API section example.
  3. Find similar ones with collection.query, and use server mode if needed: chroma run --path /chroma_db_path.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+243Sep 6 — Oct 4
29,19629,439

Author's description

Search infrastructure for AI

microsoft

markitdown

Growing fastest

A small Microsoft utility that converts PDF, Word, PowerPoint, Excel and other files into Markdown that is easy to hand to a language model.

189Kstars+11K in 30 dPython

firecrawl

firecrawl

Growing fastest

A service that turns any website into clean Markdown or structured data for models. It can search, scrape, crawl a whole site and even click through a page.

189Kstars+12K in 30 dTypeScript

infiniflow

ragflow

A ready-made RAG engine with a UI: it parses documents with templates, chunks them, searches with citations and supports agentic retrieval. Deploys with Docker.

92Kstars+1.8K in 30 dGo

unclecode

crawl4ai

An open-source Python crawler: it visits pages with a real browser and returns clean Markdown for LLMs. Runs locally, in Docker or as a cloud service.

85Kstars+3.2K in 30 dPython

opendatalab

MinerU

Parses complex PDFs, scans and Office files into Markdown or JSON while keeping tables and formulas. Comes with a CLI, a Python SDK and an agent skill.

81Kstars+2K in 30 dPython

docling-project

docling

An IBM library for document parsing: PDF, Office, HTML and images become one unified structure from which Markdown is easy to get. Supports vision models for hard pages.

68Kstars+2.5K in 30 dPython