All repositories

Voice, video, multimodallivekit

agents

LiveKit's framework for realtime voice AI agents: the agent joins a call or room, listens, thinks and answers by voice.

Who it is for

Developers who want a voice agent backed by WebRTC infrastructure.

How to start

  1. Install: pip install "livekit-agents[openai,deepgram,cartesia]".
  2. Try the agent in your terminal: python myagent.py console.
  3. Use python myagent.py dev for development and python myagent.py start for production.

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+625Sep 6 — Oct 6
13,99014,615

Author's description

A framework for building realtime voice AI agents 🤖🎙️📹

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

openai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

110Kstars+1.6K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython
livekit/agents — what it is and how to start