All repositories

Voice, video, multimodalOpenBMB

MiniCPM-V

A compact multimodal model that understands images and video and fits on a phone or laptop. Ships an online demo and a web demo you can self-host.

Who it is for

People who need image and video understanding on modest hardware without the cloud.

How to start

  1. Try the model online through the Hugging Face demo linked in the README.
  2. Download the MiniCPM-V weights from Hugging Face (huggingface.co/openbmb).
  3. To run the interactive demo yourself, open the Web Demo Deployment section of the README.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+230Sep 6 — Oct 6
26,26826,498

Author's description

A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

openai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

110Kstars+1.6K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython