All repositories

Voice, video, multimodalfacebookresearch

sam2

Meta's Segment Anything 2: picks out any object in an image or video from a click and tracks it across frames. The repo has code, checkpoints and notebooks.

Who it is for

People doing annotation, video editing and computer vision.

How to start

  1. Install: git clone https://github.com/facebookresearch/sam2.git && cd sam2, then pip install -e ..
  2. For notebooks add: pip install -e ".[notebooks]".
  3. Download checkpoints: cd checkpoints && ./download_ckpts.sh && cd ...

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+162Sep 6 — Oct 6
19,79119,953

Author's description

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

The classic browser UI for Stable Diffusion: text-to-image, inpainting, upscaling and thousands of community extensions.

165Kstars+664 in 30 dPython

Comfy-Org

ComfyUI

Growing fastest

A node-based builder for diffusion pipelines: wire up image, video and audio generation visually. Runs locally and exposes API endpoints.

136Kstars+4.7K in 30 dPython

openai

whisper

OpenAI's reference speech-recognition model: transcribes audio in dozens of languages, translates speech and detects the language.

110Kstars+1.6K in 30 dPython

RVC-Boss

GPT-SoVITS

Few-shot voice cloning: about a minute of recorded speech is enough to fine-tune a text-to-speech model. Ships a web UI for data prep and training.

62Kstars+1.1K in 30 dPython

ggml-org

whisper.cpp

Whisper rewritten in C/C++: runs fast on a plain CPU and on Macs with no Python or heavy dependencies. Easy to embed in apps.

54Kstars+759 in 30 dC++

2noise

ChatTTS

A speech-synthesis model tuned for natural conversational dialogue: handles pauses, laughter and intonation. Good for voice assistants and dialogue voice-over.

40Kstars+136 in 30 dPython
facebookresearch/sam2 — what it is and how to start