MA.L409.5
ATTENTION-GUIDED CONTRASTIVE MASKED IMAGE MODELING FOR TRANSFORMER-BASED Self-SUPERVISED LEARNING
Yucheng Zhan, Yucheng Zhao, University of Science and Technology of China, China; Chong Luo, Microsoft Research Asia, China; Yueyi Zhang, Xiaoyan Sun, University of Science and Technology of China, China
Session:
MA.L409: Attention Mechanisms and Transformers for Image Processing I Lecture
Track:
Applications of Machine Learning
Location:
Room 409
Presentation Time:
Mon, 9 Oct, 12:12 - 12:30 Malaysia Time (UTC +8)
Session Chair:
Debargha Mukherjee, Google LLC
Session MA.L409
MA.L409.1: TEAM DETR: GUIDE QUERIES AS A PROFESSIONAL TEAM IN DETECTION TRANSFORMERS
Tian Qiu, Linyun Zhou, Wenxiang Xu, Zhejiang University, China; Lechao Cheng, Zhejiang Lab, China; Zunlei Feng, Mingli Song, Zhejiang University, China
MA.L409.2: TRANSBUILDING: AN END-TO-END POLYGONAL BUILDING EXTRACTION WITH TRANSFORMERS
Mingming Zhang, Qingjie Liu, Beihang University, China; Wei Wang, National Disaster Reduction Center of China, China; Yunhong Wang, Beihang University, China
MA.L409.3: Parameter-efficient Vision Transformer with Linear Attention
Youpeng Zhao, University of Central Florida, United States of America; Huadong Tang, University of Technology Sydney, Australia; Yingying Jiang, Yong A, Samsung Research China-Beijing (SRC-B), China; Qiang Wu, University of Technology Sydney, Australia; Jun Wang, University of Central Florida, United States of America
MA.L409.4: FINDING CAMOUFLAGED OBJECT GUIDED BY CONTOUR AND ATTENTION
JunJie Cui, FengMing Sun, Xia Yuan, Nanjing University of Science and Technology, China
MA.L409.5: ATTENTION-GUIDED CONTRASTIVE MASKED IMAGE MODELING FOR TRANSFORMER-BASED Self-SUPERVISED LEARNING
Yucheng Zhan, Yucheng Zhao, University of Science and Technology of China, China; Chong Luo, Microsoft Research Asia, China; Yueyi Zhang, Xiaoyan Sun, University of Science and Technology of China, China
Contacts