This repository contains Pytorch optim wrapper code to implement Optimization algorithms like
- Stochastic Mirror Descent
- Proximal Stochastic Mirror Descent
- Nesterov Accelerated Stochastic Mirror Descent
for optimizing deep neural networks under various types of regularization