TensorFLow: Gradient Clipping

标签：control   使用   sed   flow   param   port   optimize   orm   ini   

The parameters clipnorm and clipvalue can be used with all optimizers to control gradient clipping。
Keras的所有optimizer都可以使用clipnorm和clipvalue来防止梯度过大。

from keras import optimizers

# All parameter gradients will be clipped to
# a maximum norm of 1.
sgd = optimizers.SGD(lr=0.01, clipnorm=1.)

from keras import optimizers

# All parameter gradients will be clipped to
# a maximum value of 0.5 and
# a minimum value of -0.5.
sgd = optimizers.SGD(lr=0.01, clipvalue=0.5)

TensorFLow: Gradient Clipping

标签：control   使用   sed   flow   param   port   optimize   orm   ini   

原文地址：https://www.cnblogs.com/yaos/p/12770046.html