I have explained Optimization algorithms for Deep learning like Batch and Minibatch gradient descent, Momentum, RMS prop, and Adam…