Search

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

Agentic Framework for Java, written in 100% Java using Gemini, OpenAI, LocalAI, Anthropic. Build Autonomous Agents in Java with Multi AI voting mechanism. Convert Prompt to HTTP REST Calls, Java Method calls, Shell script calls or swagger rest api calls. Selenium AI Integration, Image processing with AI, Actions on Images with AI

Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization

OpenAI's privacy filter NER model architecture implemented in a minimal C++/GGML runtime

A from-scratch C++17/ggml port of Depth Anything 3 (ByteDance)

Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML