Lei Li
About Me
I’m a PhD Candidate in Computer Science at Cleveland State University.
My work connects algorithm design with efficient AI systems, focusing on methods that are adaptive, robust, and practical to deploy. My recent work explores fast, tensor-native compression for large language models.
Research Interests
My research focuses on federated learning, efficient AI systems, and mathematical optimization, with emphasis on:
- Federated LearningEfficient sparse and multi-task learning across distributed clients, with an emphasis on adaptive training and communication efficiency.
- Efficient AI SystemsFast, accuracy-aware compression for large language models and tensor-native GPU codecs that reduce latency and energy use.
- Mathematical OptimizationOptimization methods for dynamic sparsity, min-max learning, and robust multi-task neural networks.
Publications
-
NOVA: A Tensor-Native GPU Codec for Fast and Accuracy-Aware LLM Weight Compression
HPCA2027
-
DyFreeze: A Dynamic Parameter-Freezing Framework for Federated Sparse Training
AAAI2027
-
Adaptive Parameter Freezing and Sparse Upload for Efficient Federated Dynamic Sparse Training
Pattern Recognition2027
-
Task-Aware Federated Multi-Task Learning
MMAsia2025
-
A Min-Max Optimization Framework for Sparse Multi-Task Deep Neural Network
Neurocomputing2025
Background
Experience
University of Minnesota, Twin Cities
Research Intern · Minneapolis, Minnesota
Developed NOVA, a tensor-native GPU codec for efficient LLM checkpoint compression, under the supervision of Prof. Caiwen Ding. The work combines prediction, transform coding, Hessian-guided optimization, and residual repair to reduce latency and energy use.
Education
Cleveland State University
PhD Candidate in Computer Science
GPA 3.81/4.0 · Advisor: Dr. Tianyun Zhang
Qingdao University
MS in Software Engineering
GPA 3.81/4.0 · Advisor: Dr. Min Gan
University of Jinan
BS in Information and Computing Sciences
Advanced algebra, mathematical analysis, and discrete mathematics
Contact
For research conversations and collaborations, the best way to reach me is by email.
l.li15@vikes.csuohio.edu