All repositories

Voice, video, multimodalpipecat-ai

pipecat

A Python framework for real-time voice and multimodal agents: compose a speech-model-speech pipeline from modules. Client SDKs for web and mobile included.

Who it is for

Developers building voice assistants and calling bots.

How to start

  1. Install the pipecat-ai package from PyPI.
  2. Scaffold a project: pipecat init quickstart.
  3. Follow the quickstart at docs.pipecat.ai and browse the examples in the repo.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+947Sep 6 — Oct 5
15,24116,188

Author's description

Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

openai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

110Kstars+1.6K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython