A collection of optimizers for PyTorch compatible with optim module
torch-optimizer
torch-optimizer — collection of optimizers for PyTorch compatible with optim module.
Simple example
import torch_optimizer as optim
# model = ...
optimizer = optim.DiffGrad(model.parameters(), lr=0.001)
optimizer.step()
Installation
Installation process is simple, just:
$ pip install torch_optimizer
Documentation
https://pytorch-optimizer.rtfd.io
GitHub