IMA Journal of Numerical Analysis Advance Access originally published online on September 12, 2008
IMA Journal of Numerical Analysis 2008 28(4):711-720; doi:10.1093/imanum/drn008
| ||||||||||||||||||||||||||||||||||||||||||||||||||
The Speed of Shor's R-algorithm

Department of Mathematics, University of Washington, Seattle, WA 98195, USA

School of Operations Research and Information Engineering, Cornell University, Ithaca, NY 14853, USA

Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
Email: burke{at}math.washington.edu
Email: aslewis{at}orie.cornell.edu
Corresponding author. Email: overton{at}cs.nyu.edu
Received on 8 May 2007. Accepted for publication 4 December 2007.
| Abstract |
|---|
Shor's r-algorithm is an iterative method for unconstrained optimization, designed for minimizing nonsmooth functions, for which its reported success has been considerable. Although some limited convergence results are known, nothing seems to be known about the algorithm's rate of convergence, even in the smooth case. We study how the method behaves on convex quadratics, proving linear convergence in the two-dimensional case and conjecturing that the algorithm is always linearly convergent, with an asymptotic convergence rate that is independent of the conditioning of the quadratic being minimized.
Key Words: Shor's r-algorithm; space dilation; linear convergence; unconstrained optimization; nonsmooth optimization
Dedicated to M. J. D. Powell, master of convergence analysis for nonlinear optimization, on the occasion of his 70th birthday.