A Datacenter Scale Distributed Inference Serving Framework
Find trending repositories by name or description.
A Datacenter Scale Distributed Inference Serving Framework
AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.
Dynamo Libraries for Revit
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
A tool for converting ONNX files to LiteRT/TFLite/TensorFlow, PyTorch native code (nn.Module), TorchScript (.pt), state_dict (.pt), Exported Program (.pt2), and Dynamo ONNX. It also supports direct conversion from LiteRT to PyTorch.
Sekiban - an Opinionated Event Sourcing and CQRS Framework using C#. It can store data into Azure Cosmos DB, AWS Dynamo DB or Postgres
Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and improve overall performance.
Offline optimization of your disaggregated Dynamo graph