Search

LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

A cosy home for your LLMs.

Tensor library for machine learning

Turn dials. Summon bangers! NOW WITH MORE C++! Local AI music generation powered by GGML

Python bindings for ggml

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

ggml speech-to-text inference for 16+ model families

Local AI text-to-speech with voice cloning and voice design, powered by GGML. C++17 port of OmniVoice (k2-fsa/OmniVoice). 646 languages, 24 kHz mono output, runs on CPU, CUDA, ROCm, Metal, Vulkan.

Local AI text-to-speech with voice cloning and voice design, powered by GGML. C++17 port of Qwen3-TTS (QwenLM/Qwen3-TTS). 10 languages, 24 kHz mono output, runs on CPU, CUDA, ROCm, Metal, Vulkan.

Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.

Fast and portable Parakeet implementation in C++ with ggml

Port of Nvidia LocateAnything-3B on ggml

OpenAI's privacy filter NER model architecture implemented in a minimal C++/GGML runtime

A from-scratch C++17/ggml port of Depth Anything 3 (ByteDance)

Windows Llama App Companion

Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML

Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.