Making large AI models cheaper, faster and more accessible
Python41,438 stars4,492 forksApache-2.0 aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism