Dayou Du
Dayou Du
Home
Projects
Publications
Light
Dark
Automatic
Source Themes
AFPQ: Asymmetric Floating Point Quantization for LLMs
[ACL 2024 Findings]
This study introduces asymmetric FP quantization for LLMs to address poor performance with small sizes or low bits, improving accuracy without extra storage compared to asymmetric INT quantization.
Yijia Zhang
,
Sicheng Zhang
,
Shijie Cao
,
Dayou Du
,
Jianyu Wei, Ting Cao, Ningyi Xu
PDF
Cite
Code
Cite
×