MLSP-P21.9

BOOSTING KNOWLEDGE DISTILLATION VIA LOCAL CATEGORIES SIMILARITY SCALING

Dingyao Chen, National University of Defense Technology, China; Shanshan Zhang, Xiamen University, China; Keyan Jin, University of Granada, Spain; Yuxin Zhang, Long Lan, National University of Defense Technology, China; Xiao Teng, Naval University of Engineering, China
Session:
MLSP-P21: Training and Distillation Methods in Deep Learning Poster
Track:
Machine Learning for Signal Processing [ML]
Location:
Poster Area 8
Presentation Time:
Wed, 6 May, 09:00 - 11:00
Presentation
Discussion
Resources
No resources available.
Session MLSP-P21
MLSP-P21.1: MPR: Memory Perturbation Regularization for Controllable Stability-Plasticity Balancing in Continual Trajectory Prediction
Longhui Liu, Bruce X.B. Yu, Der-Horng Lee, Zhejiang University, China
MLSP-P21.2: HARNESSING MASKED GENERATIVE TRANSFORMERS FOR EFFECTIVE KNOWLEDGE DISTILLATION
Junhao Wang, Gaochao Xu, Jilin University, China
MLSP-P21.3: PLA-LOSS: POTENTIAL LABEL-AWARE TRAINING FOR TOP-K CLASSIFICATION
Kai Wang, Shuai Jia, Tianyi Ma, HiThink Research, China; Bin Cao, Zhejiang University of Technology, China
MLSP-P21.4: CODEPMP: SCALABLE PREFERENCE MODEL PRETRAINING FOR LARGE LANGUAGE MODEL REASONING
Huimu Yu, Ziyang Chen, Xing Wu, Institute of Information Engineering, Chinese Academy of Sciences, China; Haotian Xu, Debing Zhang, Xiaohongshu Inc, China; Songlin Hu, Institute of Information Engineering, Chinese Academy of Sciences, China
MLSP-P21.5: SHARPNESS-AWARE MINIMIZATION WITH Z-SCORE GRADIENT FILTERING
Vincent-Daniel Yun, University of Southern California, United States of America
MLSP-P21.6: DYNAMICAL ISOMETRY BASED RIGOROUS FAIR NEURAL ARCHITECTURE SEARCH
JianXiang Luo, University of Electronic Science and Technology of China, China; Junyi Hu, Tsinghua University, China; Wenrui Li, Harbin Institute of Technology, China; Guanghui Cheng, University of Electronic Science and Technology of China, China
MLSP-P21.7: LOSS-ONLY KNOWLEDGE TRANSFER: SIMILARITY-GUIDED LOSS WITH LLM PRIORS
Youngin Park, Chul-hee Hahm, Sangyoung Lee, Jiyong Moon, Visual Display Division, Samsung Electronics, Korea, Republic of
MLSP-P21.8: SAILING BEYOND SCARCITY: TASK-DRIVEN DIFFUSION MARINE DATA AUGMENTATION FOR MARINE OBJECT DETECTION
Jiawen Huang, Qi Xie, Riji Yu, Hubei University, China
MLSP-P21.9: BOOSTING KNOWLEDGE DISTILLATION VIA LOCAL CATEGORIES SIMILARITY SCALING
Dingyao Chen, National University of Defense Technology, China; Shanshan Zhang, Xiamen University, China; Keyan Jin, University of Granada, Spain; Yuxin Zhang, Long Lan, National University of Defense Technology, China; Xiao Teng, Naval University of Engineering, China
MLSP-P21.10: PanoIndoor and PanoOutdoor: Towards Comprehensive Datasets for Panoramic Instance Segmentation
Liang Hua, Hang Xu, Hangzhou Dianzi University, China; Xinyuan Liu, Institute of Computing Technology, Chinese Academy of Sciences, China; Yaoqi Sun, Lishui University, China; Chenggang Yan, Hangzhou Dianzi University, China; Feng Dai, Institute of Computing Technology, Chinese Academy of Sciences, China
Contacts