Dayou Du
Master of Data Science and Analytic
My research interests lies at hardware-software co-design for efficient deep learning system
Publications
[ACL 2024] BitDistiller synergizes Quantization-Aware Training and Knowledge Distillation, significantly enhancing sub-4-bit LLMs’ performance on complex tasks with reduced data and training resource demands.
Dayou Du,
Yijia Zhang, Shijie Cao, Jiaqi Guo, Ting Cao, Xiaowen Chu, Ningyi Xu