Search

LLM inference in C/C++

Omni inference in C/C++

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Port of OpenAI's Whisper model in C/C++

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

Python bindings for llama.cpp

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1× and 2× cards.

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

Free, open-source, 100% offline voice dictation for Linux. Speak and type anywhere via whisper.cpp, Whisper & VOSK engines, GPU-accelerated, works on X11 + Wayland!

Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

《金庸群侠传》c++复刻版，已完工

Abseil Common Libraries (C++)

Make a Greate FluentUI For Cpp Qt

云探针、多服务器探针、云监控、多服务器云监控，演示： https://tz.cloudcpp.com/

📚 Modern C++ Tutorial: C++11 to C++26 On the Fly | https://changkun.de/modern-cpp/

A C++ header-only HTTP/HTTPS server and client library

A rclcpp-compatible true zero-copy IPC middleware that supports all ROS message types, including message structs already generated by rosidl.

A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde

static analysis of C/C++ code

【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

cpprefjpサイトのMarkdownソース

Mixed-effects models in R using S4 classes and methods with RcppEigen

Source Code Generation for Automatic Differentiation using Operator Overloading

MNE-CPP: The C++ framework for real-time functional brain imaging.

Source code for the book Real-Time C++, by Christopher Kormanyos

中文的C++ Template的教学指南。与知名书籍C++ Templates不同，该系列教程将C++ Templates作为一门图灵完备的语言来讲授，以求帮助读者对Meta-Programming融会贯通。(正在施工中)

"结巴"中文分词的C++版本