s

Research in our group lies at the intersection of high performance computing (HPC) and machine learning (ML). Our research group has access to the largest supercomputers in the world, and uses this rich computational resource to perform state-of-the-art distributed deep learning problems. Research is done at the application level (scaling laws of neural networks), algorithm level (fast linear algebra methods), and low-level implementation (CUDA/PTX, C++).

News

2025.09.29 Satoki Ishikawa's (1st year PhD) research proposal was accepted to ACT-X
2025.09.22 The joint work by Cong Bai (2nd year PhD) and RIKEN AIP was accepted to NeurIPS2025
2025.09.22 The joint work by Yukito Tajima (1st year Masters), Denso IT, and Prof. Inoue was accepted to NeurIPS2025
2025.01.23 Two papers by Qi Sun (1st year PhD) in collaboration with Sakana AI were accepted to ICLR2025
2025.01.23 Two papers by Satoki Ishikawa (2nd year Master) were accepted to ICLR2025
2025.01.23 Two papers by Taishi Nakamura (1st year Master) were accepted to ICLR2025
2024.10.09 Okazaki Lab, Yokota Lab, and AIST have released large language models Llama3.1-Swallow-8B and Llama3.1-Swallow-70B.
2024.07.01 Okazaki Lab, Yokota Lab, and AIST have released large language models Llama3-Swallow-8B and Llama3-Swallow-70B.
2024.03.15 The joint work by Kazuki Fujii (4th year Bachelor) and Taishi Nakamura (3rd year Bachelor) with Okazaki Lab won the Outstanding Paper Award at NLP2024.
2024.03.11 Okazaki Lab, Yokota Lab, and AIST have released large language models Swallow-MS and Swallow-MX.
more info.

About Us.

Tokyo Tech, GSIC, Advanced Computing Research Division, Advanced Applications of High-Performance Computing Group

» More Info.

Hierarchical Low-Rank Approximation

Dense matrices appear in many computational applications such as boundary integral methods for solving homogeneous partial differential .....

» More Info.

Application to Deep Learning

Deep learning does not require very high precision, and this fact is exploited by the recent low-precision hardware from NVIDIA and Google...

» More Info.