LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Find trending repositories by name or description.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
Unified large model proxy gateway, providing load balancing, fault transfer, current limiting, budget management, content auditing, caching, and MCP gateway capabilities.
DataLoader is a generic utility to be used as part of your application's data fetching layer to provide a consistent API over various backends and reduce requests to those backends via batching and caching.
A high performance caching library for Java
Lucee is a high-performance, open-source CFML server written in Java. Supporting JDBC, Caching, Parallelism, HTTP, ORM, REST, S3 and dynamic Java integration, Lucee is great for developers aiming to build fast, scalable applications, delivering faster startup, rapid compilation and better runtime performance.
A lightweight, pure-Swift library for downloading and caching images from the web.
:rocket: A strongly-typed, caching GraphQL client for the JVM, Android, and Kotlin multiplatform.
An image loading and caching library for Android focused on smooth scrolling
Layered caching library for OpenResty
Apache Traffic Server™ is a fast, scalable and extensible HTTP/1.1 and HTTP/2 compliant caching proxy server.
Transparent subrequest-based caching layout for arbitrary nginx locations.
GeoWebCache is a tile caching server implemented in Java that provides various tile caching services like WMS-C, TMS, WMTS, Google Maps, MS Bing and more
A caching library for Clojure implementing various cache strategies
A node module for serving static files. Does etags, caching, etc.
The httplib2 caching algorithms packaged up for use with requests.
A caching, resizing image proxy written in Go
⏱ Caching library with easy-to-use API and many cache backends.
A fast caching engine for WordPress.
Swift HTTP Networking with stubbing and caching support
The industry-leading GraphQL client for TypeScript, JavaScript, React, Vue, Angular, and more. Apollo Client delivers powerful caching, intuitive APIs, and comprehensive developer tools to accelerate your app development.
A caching extension for Flask
📱 A strongly-typed, caching GraphQL client for iOS, written in Swift.
PHP exchange rate provider layer for currency conversion: 30 services, chain fallback, and caching.
A Python utility library with a stdlib like feel and extra batteries. Paths, Progress, Dicts, Downloads, Caching, Hashing: ubelt makes it easy!
Unbound is a validating, recursive, and caching DNS resolver.
Bazel remote caching and execution service
Master JPA using Hibernate as the implementation. Learn the basics of JPA - entities, relationships, entity manager, annotations, JPQL and Criteria API. Take a step into the advanced world of JPA - caching, performance tuning(n + 1 queries), mapping inheritance hierarchies. Get a peek into the magic of Spring Data JPA & Spring Data Rest.
Eloquent model-caching made easy.
Automation for Kubernetes development and testing. Spin up production-like environments for development, testing, and CI on demand. Use the same configuration and workflows at every step of the process. Speed up your builds and test runs via shared result caching