All repositories

exo

Joins several devices into one AI cluster so you can run models too big for a single machine's memory. Devices discover each other automatically; there is a dashboard and an API.

Who it is for

For enthusiasts with several computers who want to run a large model at home.

How to start

  1. Clone it: git clone https://github.com/exo-explore/exo.
  2. Build the dashboard: cd exo/dashboard && npm install && npm run build, then in the repo root uv sync --extra mlx.
  3. Run uv run exo and open http://localhost:52415.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+490Oct 22 — Nov 19
48,00548,495

Author's description

Run frontier AI locally.

ollama

ollama

The easiest way to run an open model on your own machine: one command downloads and starts it, plus a local REST API and libraries for Python and JavaScript.

188Kstars+3.3K in 29 dGo

huggingface

transformers

The core library for working with models: one codebase for text, vision, audio and multimodal tasks, for both inference and training. Most new open models ship through it.

169Kstars+1.3K in 29 dPython

open-webui

open-webui

A self-hosted ChatGPT-style interface that connects to Ollama and any OpenAI-compatible API. Installs with a single Docker command and runs on your own server.

159Kstars+2.5K in 28 dSvelte

ggml-org

llama.cpp

Growing fastest

A C/C++ engine that runs language models on ordinary hardware: laptops, phones, GPU-less servers. Much of local AI, Ollama included, is built on it.

136Kstars+3.7K in 29 dC++

pytorch

pytorch

The foundation under most modern neural networks: GPU-accelerated tensors and automatic differentiation, wrapped in ordinary Python. Transformers, Llama and nearly every open model are written on it.

106Kstars+674 in 30 dPython

deepseek-ai

DeepSeek-V3

Repository of the large open DeepSeek-V3 mixture-of-experts model: description, benchmark results and run instructions. It showed an open model can stand next to closed ones.

105Kstars+303 in 29 dPython