Robust Stochastic Gradient Descent with Student-t Distribution based First-order Momentum

IEEE 2020-12-16

Remarkable achievements by deep neural networks stand on the development of excellent stochastic gradient descent methods. Deep-learning-based machine learning algorithms, however, have to find patterns between observations and supervised signals, even though they may include some noise that hides the true relationship between them, more or less especially in the robotics domain. To perform well even with such noise, we expect them to be able to detect outliers and discard them when needed. We, therefore, propose a new stochastic gradient optimization method, whose robustness is directly built in the algorithm, using the robust student-t distribution as its core idea. We integrate our method to some of the latest stochastic gradient algorithms, and in particular, Adam, the popular optimizer, is modified through our method. The resultant algorithm, called t-Adam, along with the other stochastic gradient methods integrated with our core idea is shown to effectively outperform Adam and their original versions in terms of robustness against noise on diverse tasks, ranging from regression and classification to reinforcement learning problems.
journal article

Training; Stochastic processes; Robustness; Estimation; Noise measurement; Proposals; Neural networks; NA

Open access content. Open access content
This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0
metadata only access

English

JANST oai:naist.repo.nii.ac.jp:00004257
IEEE Transactions on Neural Networks and Learning Systems
1
14
2162-2388
1407001625

NARA INST OF SCI & TECH
From OAIster®, provided by the OCLC Cooperative.

edsoai.on1407001625