We present a general decomposition algorithm that is uniformly applicable to every (suitably normalized) instance of Convex
Quadratic Optimization and efficiently approaches the optimal solution. The number of iterations required to be within ε of optimality grows linearly with 1/ε and quadratically with the number m of variables. The working set selection can be performed in polynomial time. If we restrict our considerations to instances
of Convex Quadratic Optimization with at most k
0 equality constraints for some fixed constant k
0 plus some so-called box-constraints (conditions that hold for most variants of SVM-optimization), the working set is found
in linear time. Our analysis builds on a generalization of the concept of rate certifying pairs that was introduced by Hush
and Scovel. In order to extend their results to arbitrary instances of Convex Quadratic Optimization, we introduce the general
notion of a rate certifying q-set. We improve on the results of Hush and Scovel [8] in several ways. First our result holds for Convex Quadratic Optimization
whereas the results of Hush and Scovel are specialized to SVM-optimization. Second, we achieve a higher rate of convergence
even for the special case of SVM-optimization (despite the generality of our approach). Third, our analysis is technically
simpler.
This work was supported in part by the IST Programme of the European Community, under the PASCAL Network of Excellence, IST-2002-506778.
This publication only reflects the authors’ views. This work was furthermore supported by the Deutsche Forschungsgemeinschaft
Grant SI 498/7-1.