Publications

Dayou Du, Shijie Cao, Jianyi Cheng, Ting Cao, Mao Yang (2025). BitDecoding: Unlocking Tensor Cores for Long-Context LLMs Decoding with Low-Bit KV Cache.

PDF Code

Dayou Du, Yijia Zhang, Shijie Cao, Jiaqi Guo, Ting Cao, Xiaowen Chu, Ningyi Xu (2024). BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation. ACL 2024.

PDF Code

Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Peiyuan Zhou, Jiaxing Qi, Junjie Lai, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang (2024). SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs. arXiv.

PDF Code

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Qiang Wang, Xiaowen Chu (2013). Benchmarking and Dissecting the Nvidia Hopper GPU Architecture. IPDPS 2024.

PDF

(0001). .

Cite