All repositories

Voice, video, multimodalhuggingface

diffusers

The standard PyTorch library for diffusion models: ready-made pipelines for images, video and audio that run in a few lines.

Who it is for

Python developers embedding image and video generation into their products.

How to start

  1. Install: pip install --upgrade diffusers[torch].
  2. Load a pipeline: DiffusionPipeline.from_pretrained("stable-diffusion-v1-5/stable-diffusion-v1-5", dtype=torch.float16).
  3. Move it to the GPU with pipeline.to("cuda") and call it with a text prompt.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+245Sep 6 — Oct 4
34,40734,652

Author's description

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

openai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

110Kstars+1.6K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython