All repositories

Voice, video, multimodalopenai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

Who it is for

Anyone who needs to turn call recordings, podcasts and voice notes into text.

How to start

  1. Install the package: pip install -U openai-whisper (you also need ffmpeg, e.g. brew install ffmpeg).
  2. Transcribe a file: whisper audio.flac audio.mp3 audio.wav --model turbo.
  3. For non-English speech add --language, for example --language Japanese.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+1,630Sep 6 — Oct 6
108,392110,022

Author's description

Robust Speech Recognition via Large-Scale Weak Supervision

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython

myshell-ai

OpenVoice

Instant voice cloning: takes a short sample, transfers the timbre to any text and lets you control style, emotion and language. MIT-licensed and free for commercial use.

38Kstars+383 in 30 dPython