WA6a.2

Zero-Shot Inference-time Structured Approximation of Softmax Attention

Can Yaras, Princeton University, United States; Alec Xu, University of Michigan, United States; Pierre Abillama, Apple, United States; Changwoo Lee, Qualcomm, United States; Laura Balzano, University of Michigan, United States
Session:
WA6a: Compression and sparsity in deep learning optimization Lecture
Track:
Adaptive Systems, Machine Learning, and Data Analytics
Location:
Seascape
Presentation Time:
Wed, 28 Oct, 08:40 - 09:05 PT (UTC -7)
Session Chair:
Laura Balzano, University of Michigan, United States
Presentation
Discussion
Resources
No resources available.
Session WA6a
WA6a.1: Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation
Can Yaras, Laura Balzano, University of Michigan, United States; Peng Wang, University of Macau, United States; Qing Qu, University of Michigan, United States
WA6a.2: Zero-Shot Inference-time Structured Approximation of Softmax Attention
Can Yaras, Princeton University, United States; Alec Xu, University of Michigan, United States; Pierre Abillama, Apple, United States; Changwoo Lee, Qualcomm, United States; Laura Balzano, University of Michigan, United States
WA6a.3: Neuron Pursuit: A Parsimony-Driven Iterative Greedy Algorithm for Building Neural Networks
Akshay Kumar, Jarvis Haupt, University of Minnesota, United States
Contacts