TA6b.3

Efficient Rotations for Quantized Large Language Models

Sang Heum Yeon, Jae Jun An, Junwon Lee, Seokho Han, Jong Hwan Ko, Sungkyunkwan University, Republic of Korea
Session:
TA6b: Efficient Architectures for Foundation Model Deployment in Resource-Constrained Systems Lecture
Track:
Architectures and Implementation
Location:
Room 6
Presentation Time:
Tue, 27 Oct, 11:05 - 11:30 PT (UTC -7)
Session Chair:
Eungjoo Lee, University of Arizona, United States
Presentation
Discussion
Resources
No resources available.
Session TA6b
TA6b.1: test
Seok-Ju Hahn, Argonne National Laboratory, United States; Byeongwoo An, Begas, Republic of Korea; Eungjoo Lee, University of Arizona, United States
TA6b.2: Conformal Speculative Speculative Decoding
Payel Bhattacharjee, University of Arizona, United States; Osvaldo Simeone, Northeastern University London, United Kingdom; Ravi Tandon, University of Arizona, United States
TA6b.3: Efficient Rotations for Quantized Large Language Models
Sang Heum Yeon, Jae Jun An, Junwon Lee, Seokho Han, Jong Hwan Ko, Sungkyunkwan University, Republic of Korea
TA6b.4: Towards Efficient Collective Dynamics in Multi-Agent Systems
Minah Lee, The University of Texas at Dallas, United States
Contacts