3de159b8329d7ef0.tex
1: \begin{abstract}
2: Owing to several applications in large scale learning and vision problems, fast submodular function minimization (SFM) has become a critical problem. Theoretically, unconstrained SFM can be performed in polynomial time~\cite{IFF01,IO09}. However, these algorithms are typically not practical. In 1976, Wolfe~\cite{W71} proposed an algorithm to find the minimum Euclidean norm point in a polytope, and in 1980, Fujishige~\cite{Fujishige80} showed 
3: how Wolfe's algorithm  can be used for SFM. For general submodular functions, this Fujishige-Wolfe minimum norm algorithm seems to have the best empirical performance. 
4: 
5: Despite its good practical performance, very little is known about Wolfe's minimum norm algorithm theoretically. To our knowledge, the only result is an exponential time analysis due to Wolfe~\cite{W71} himself. 
6: In this paper we give a maiden convergence analysis of Wolfe's algorithm. We prove that in $t$ iterations, Wolfe's algorithm returns an $O(1/t)$-approximate solution to the min-norm point on {\em any} polytope.
7: We also prove a robust version of Fujishige's theorem which shows that an $O(1/n^2)$-approximate solution to the min-norm point on the base polytope implies {\em exact} submodular minimization. As a corollary, we get the first pseudo-polynomial time guarantee for the Fujishige-Wolfe minimum norm algorithm for unconstrained  submodular function minimization. 
8: \end{abstract}
9: