Search

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.io/aeon-7/aeon-vllm-ultimate:latest container, tuned for long-context draft acceptance on DGX Spark. 6 HF variants (BF16/NVFP4/MTP/MTP-XS), docker-compose, and QuickStart.

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models

GENERator: A Long-Context Generative Genomic Foundation Model

LocoFormer - Generalist Locomotion via Long-Context Adaptation

Claude 2026: The Developer’s Smartest AI for Long-Context Code & Writing

Official repository for the ACM MM 2026 Oral paper “Remember-R1: Mitigating Long-Context Visual Forgetting through Reinforcement Learning”

KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.