标签：-o   regular   die   batch   methods   and   mod   method   sum   

1. Optimization Methods

1.1 - Gradient Descent

1.2 - Mini-Batch Gradient descent

1.3 - Momentum

1.4 - Adam

2. Model with different optimization algorithms

2.1 - Mini-batch Gradient descent

2.2 - Mini-batch gradient descent with momentum

2.3 - Mini-batch with Adam mode

2.4 - Summary

Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods

标签：-o   regular   die   batch   methods   and   mod   method   sum   

原文地址：https://www.cnblogs.com/douzujun/p/13092358.html