码迷,mamicode.com
首页 > 其他好文 > 详细

Gated Recurrent Unit (GRU)公式简介

时间:2016-04-14 22:24:33      阅读:1899      评论:0      收藏:0      [点我收藏+]

标签:

技术分享

update gate $z$: defines how much of the previous memory to keep around.  

\[z = \sigma (x_t U^z + s_{t-1} W^z )\]

reset gate $r$:determines how to combine the new input with the previous memory.

\[r = \sigma(x_t U^r + s_{t-1} W^r )\]

Cell value $h$: \[h = \tanh (x_t U^h + (s_{t-1} \odot r) W^h)\]

hidden value $s_t$: \[s_t = (1-z)\odot h + z \odot s_{t-1}\]

 

Gated Recurrent Unit (GRU)公式简介

标签:

原文地址:http://www.cnblogs.com/ZJUT-jiangnan/p/5392923.html

(7)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!