kozistr/pytorch_optimizer
optimizer & lr scheduler & loss function collections in PyTorch
Python431 stars48 forksApache-2.0 adabeliefadaiadampadanademamixdeep-learningdiffgradgradient-centralizationlearning-rate-schedulinglookaheadloss-functionsmadgradmuonoptimizerpytorchradamrangersamscion