理化学研究所 革新知能統合研究センター (AIP) , 会議室3・4
Nihonbashi 1-chome Mitsui Building, 15th floor,1-4-1 Nihonbashi, Chuo-ku
Title:
Mini-batch stochastic gradient descent with dynamic sample sizes
Speaker:
Dr. Michael R. Metel (Universite Paris-Sud)
Abstract:
In this presentation we will look at stochastic gradient descent and its variants, with a particular focus on the mini-batch implementation, for use in solving constrained convex optimization problems. Basic convergence results will be reviewed as well as an overview of the current research done to improve its use in practice. New dynamic sample size rules will be presented which ensure a descent direction with high probability. Their performance will be compared to fixed sample implementations in a financial application.
