Search

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

Daily notes on AI research, especially those on LLMs, VLMs, AI agents and related techniques such as pre-, mid-, post-training, RL, continual learning, test-time scaling, RSI, and more.

LLMs and VLMs with MLX Swift

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Parsing-free RAG supported by VLMs

Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;

DataInfra Series. Redact EVERYTHING with local llms and vlms.

📚 A curated collection of papers and open-source code repositories dedicated to the application of Vision-Language Models (VLMs) for streaming video.

AI-powered agents for automating 3D content workflows using Vision-Language Models (VLMs). Content Agents analyze 3D assets and automate material assignment, physics property classification, and texture generation for USD files.