I am a graduate student in the Department of Electrical and Computer Engineering at Seoul National University. My research interests are mainly focusing on developing optimized system for deep learning.

Education

Seoul National University
- Ph.D student in Electrical and Computer Engineering (Mar. 2023 -)
Yonsei University
- B.S. in Computer Science (Sep. 2022)

Publication

Piccolo: Large-Scale Graph Processing with Fine-Grained In-Memory Scatter-Gather

Changmin Shin, Jaeyong Song, Hongsun Jang, Dogeun Kim, Jun Sung, Taehee Kwon, Jae Hyung Ju, Frank Liu, Yeonkyu Choi, Jinho Lee

International Symposium on High-Performance Computer Architecture (HPCA) · Mar 2025 · To appear

GraNNDis: Fast Distributed Graph Neural Network Training Framework for Multi-Server Clusters

Jaeyong Song, Hongsun Jang, Hunseong Lim, Jaewon Jung, Youngsok Kim, Jinho Lee

The International Conference on Parallel Architectures and Compilation Techniques (PACT) · Oct 2024 · To appear

PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor

Jaewon Jung, Hongsun Jang, Jaeyong Song, Jinho Lee

Computer Vision and Pattern Recognition Conference (CVPR) · Mar 2024 · 10.48550/arXiv.2403.06668

Pipette: Automatic Fine-Grained Large Language Model Training Configurator for Real-World Clusters

Jinkyu Yim¹, Jaeyong Song¹, Yerim Choi, Jaebeen Lee, Jaewon Jung, Hongsun Jang, Jinho Lee

Design, Automation and Test in Europe Conference (DATE) · Mar 2024 · 10.23919/DATE58400.2024.10546826

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

Hongsun Jang, Jaeyong Song, Jaewon Jung, Jaeyoung Park, Youngsok Kim, Jinho Lee

Best Paper Award-Honorable Mention, International Symposium on High-Performance Computer Architecture (HPCA) · Mar 2024 · 10.1109/HPCA57654.2024.00034

Pipe-BD: Pipelined Parallel Blockwise Distillation

Hongsun Jang, Jaewon Jung, Jaeyong Song, Joonsang Yu, Youngsok Kim, Jinho Lee

2023 Design, Automation & Test in Europe Conference & Exhibition (DATE) · Apr 2023 · 10.23919/DATE56975.2023.10137044

Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression

Jaeyong Song¹, Jinkyu Yim¹, Jaewon Jung, Hongsun Jang, Hyung-Jin Kim, Youngsok Kim, Jinho Lee

Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 · Jan 2023 · 10.1145/3575693.3575712

Fast Adversarial Training with Dynamic Batch-level Attack Control

Jaewon Jung, Jaeyong Song, Hongsun Jang, Hyeyoon Lee, Kanghyun Choi, Noseong Park, Jinho Lee

Design Automation Conference (DAC) · Jul 2023 · 10.1109/DAC56929.2023.10247930

Awards

Best Paper Award Honorable Mention in HPCA’24 (Mar. 2024)
- Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System (HPCA’24)
Samsung Humantech Paper Award (Feb. 2024)
- Encouragement Prize (Top 6%)
The 1th Graduate School Presidential Science Scholarship, Republic of Korea (top 120 out of 2,980)

Teaching Experience

Digital System Design and Practices (430.315A), Teaching Assistant (Fall 2023)
Programming Methodolgy (430.211), Teaching Assistant (Spring 2023)