論文

• Kazuki Osawa, Yohei Tsuji, Yuichiro Ueno, Akira Naruse, Chuan-Sheng Foo, Rio Yokota. Scalable and Practical Natural Gradient for Large-Scale Deep Learning, IEEE Transactions on Pattern Analysis and Machine Intelligence, June 2020.

国際会議発表 (査読有り)

• Yuichiro Ueno, Kazuki Osawa, Yohei Tsuji, Akira Naruse, Rio Yokota. Rich Information is Affordable: A Systematic Performance Analysis of Second-order Optimization Using K-FAC, 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Aug. 2021.
• Yohei Tsuji, Kazuki Osawa, Yuichiro Ueno, Akira Naruse, Rio Yokota, Satoshi Matsuoka. Performance Optimizations and Analysis of Distributed Deep Learning with Approximated Second-Order Optimization Method, International Conference on Parallel Processing: The 1st Workshop on Parallel and Distributed Machine Learning, Proceedings of the 48th International Conference on Parallel Processing: Workshops, No. 21, Aug. 2019.
• Kazuki Osawa, Yohei Tsuji, Yuichiro Ueno, Akira Naruse, Rio Yokota, Satoshi Matsuoka. Second-order Optimization Method for Large Mini-batch: Training ResNet-50 on ImageNet in 35 Epochs, IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2019.
• Yuichiro Ueno, Rio Yokota. Exhaustive Study of Hierarchical AllReduce Patterns for Large Messages Between GPUs, 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), May 2019.

国内会議発表 (査読なし・不明)

• 横田理央, 大沢和樹, 辻陽平, 上野裕一郎, 成瀬彰. 大規模並列深層学習における2次の最適化手法の効果, 電子情報通信学会総合大会, Mar. 2019.

[ BibTeX 形式で保存 ]    [ 論文・著書をCSV形式で保存 ]    [ 特許をCSV形式で保存 ]