Convergence analysis of the direct extension of ADMM for multiple-block separable convex minimization
Tao, Yuan · math.OC · 2016-11-14 · 原文
Recently, the alternating direction method of multipliers (ADMM) has found many efficient applications in various areas; and it has been shown that the convergence is not guaranteed when it is directly extended to the multiple-block case of separable convex minimization problems where there are m\ge 3 functions without coupled variables in the objective. This fact has given great impetus to investigate various conditions on both the model and the algorithm's parameter that can ensure the convergence of the direct extension of ADMM (abbreviated as "e-ADMM"). Despite some results under very strong conditions (e.g., at least (m-1) functions should be strongly convex) that are applicable to the generic case with a general m, some others concentrate on the special case of m=3 under the relatively milder condition that only one function is assumed to be strongly convex. We focus on extending the convergence analysis from the case of m=3 to the more general case of m\ge3. That is, we show the convergence of e-ADMM for the case of m\ge 3 with the assumption of only (m-2) functions being strongly convex; and establish its convergence rates in different scenarios such as the
讲义
讲义·推断 依据「原文」自动生成的结构化摘要(推断),非原文表述;以原文为准。
1. 人话版
Recently, the alternating direction method of multipliers (ADMM) has found many efficient applications in various areas; and it has been shown that the convergence is not guaranteed when it is directly extended to the multiple-block case of separable convex minimization problems where there are m\ge 3 functions without coupled variables in the objective.
This fact has given great impetus to investigate various conditions on both the model and the algorithm's parameter that can ensure the convergence of the direct extension of ADMM (abbreviated as "e-ADMM").
2. 领域脉络
本文类目:math.OC,属于其所在研究脉络的最新进展。
3. 机制拆解
摘要未展开方法细节——精读时重点看方法/模型部分。
4. 证据与数字
Despite some results under very strong conditions (e.g., at least (m-1) functions should be strongly convex) that are applicable to the generic case with a general m, some others concentrate on the special case of m=3 under the relatively milder condition that only one function is assumed to be strongly convex.
We focus on extending the convergence analysis from the case of m=3 to the more general case of m\ge3.
That is, we show the convergence of e-ADMM for the case of m\ge 3 with the assumption of only (m-2) functions being strongly convex; and establish its convergence rates in different scenarios such as the
5. 反例与边界
摘要未声明局限与反例——这是需要警惕的信号,精读时先问边界。
6. 跨领域连接与意外收获
思考本文机制能否迁移到你正在跟进的问题。
7. 可复用方法
把本文机制与你手头项目对照,找一个两周内能验证的最小实验。
8. 术语表
精读时把不熟的术语记入此处,作为下次回忆的锚点。