Abstract: Iterative regularization is a classic idea in regularization theory, that has recently become popular in machine learning. On the one hand, it allows the designing of efficient algorithms controlling at the same time numerical and statistical accuracy. On the other hand, it allows shedding light on the learning curves observed while training neural networks. In this paper, we focus on iterative regularization in the context of classification. After contrasting this setting with regression and inverse problems, we develop an iterative regularization approach based on the hinge loss function. More precisely we consider a diagonal approach for a family of algorithms for which we prove convergence as well as rates of convergence. Our approach compares favorably with other alternatives, as confirmed also in numerical simulations.
With great joy and pride, the University of Thessaly announces that two members of its academic community, Dr. Evmorfia Bataka and Dr. Anastasia Fountouli, have been selected to advance to the second phase of the international programme Empowering… more