HD-MoE: Hybrid and Dynamic Parallelism for Mixture-of-Expert LLMs with 3D Near-Memory Processing

Hochen Huang, Shuzhang Zhong, Zhe Zhang, Shuangchen Li, Dimin Niu, Hongzhong Zheng, Runsheng Wang, Meng Li
June, 2025
Type
Conference paper
Publication
In ACM/IEEE International Conference on Computer Aided Design (ICCAD) 2025
Shuzhang Zhong
Shuzhang Zhong
Second-Year PhD student

My research interests include distributed robotics, mobile computing and programmable matter.