码迷,mamicode.com
首页 > 其他好文 > 详细

Lagrange Dual Theory for NLP

时间:2018-05-19 16:57:03      阅读:230      评论:0      收藏:0      [点我收藏+]

标签:box   only   classic   lag   AMM   not   which   and   src   

  1. Classic form of nonlinear programming
    F1: \(f,h,g\) are arbitrary (not necessarily diferentiable or continuous) functions.
    技术分享图片
    F2:
    技术分享图片
    F3:
    \[\begin{align*} \min \; & f(x)\ \textrm{s.t.} \; & g(x)\leq 0\ & h(x)=0 \ & x\in X; \end{align*}\]
    As \(h(x)=0\) can be equivalently written as two inequality constraints \(h(x)\leq 0\) and \(-h(x)\leq 0\), we only consider
    技术分享图片
    \(\color{red}{\mbox{Denote the primal domain by}}\) \(D=X\cap \{x|g(x)\leq 0, h(x)=0\}\).}

  2. Lagrange function and its dual
    1) Lagrange function:\(\mu \geq 0\) is called the Lagrange multiplier.
    技术分享图片
    2)Lagrange dual function
    技术分享图片
    [Remark]Observe that the minimization to calculate the
    dual is carried out over all \(x \in X\), rather than just those within the constraint set. For this reason, we can prove that for primal feasilbe \(x\in D\) and dual feasible \((\lambda, \mu \geq 0)\) , we have
    \[g(\bar{\lambda},\bar{\mu})\leq f(\bar{x})\]
    So we have for \(\mu \geq 0\) and \(x\in D\),
    \[d^*=\sup g(\lambda,\mu)\leq \inf f(x)=f^*\],
    which is called weak dual theorem.

  3. Weak duallity
    技术分享图片
    技术分享图片
    技术分享图片

Lagrange Dual Theory for NLP

标签:box   only   classic   lag   AMM   not   which   and   src   

原文地址:https://www.cnblogs.com/mathlife/p/9060544.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!