26-30 July 2026

EMBC 2026

Toronto, Canada
Tu.P30.I-43

An End-to-End Context-Aware Multimodal System for Clinical Sign Language Interpretation Using Vision-Based Models and Large Language Models

Fabian A. Nana, Sergio J. M. Herrera, Romina Culque-Lopez, Adrian Gutierrez, Guillermo J. Armoa, Luiz H Palucci Vieira, Pontificia Universidad Católica del Perú

Session:
Tu.P30: Medical Imaging, Diagnostic AI & Computer Vision for Healthcare Poster

Track:
Biomedical & Health Informatics

Location:
Hall E; Bay I, Board #43

Presentation Time:
Tuesday, 28 July, 16:30 - 18:30

Presentation
Discussion
Resources
No resources available.
Session Tu.P30
Tu.P30.I-29: GEOMETRIC PRECISION VS. MORPHOLOGICAL FIDELITY: EVALUATING AUTOMATED 3D FACIAL LANDMARKING IN ANTHROPOMETRY
Ali Shadman Yazdi, Politecnico di Milano; Annalisa Cappella, University of Milan; Benedetta Baldini, Politecnico di Milano; Riccardo Solazzo, Gianluca Tartaglia, Chiarella Sforza, University of Milan; Giuseppe Baselli, Politecnico di Milano
Tu.P30.I-30: Quantitative MRI-based Biomarkers Validated Against Histology for Non-Invasive Liver Assessment in MASLD
Antonio Lucia-García, Universitat Politècnica de València; Josep Vicent Castelló-Barrachina, José Manuel Santabárbara, Roberto Aliaga, Alicia M Maceira, Ascires Biomedical Group; David Moratal, Universitat Politècnica de València
Tu.P30.I-31: RELIABLE MISLABEL DETECTION FOR VIDEO CAPSULE ENDOSCOPY
Julia Werner, Julius Oexle, Oliver Bause, University of Tübingen; Maxime Le Floch, Franz Brinkmann, Hannah Tolle, Jochen Hampe, University Hospital Dresden; Oliver Bringmann, University of Tübingen
Tu.P30.I-32: Touchless Intraoperative Image Access System Based on Vision-Based Hand Tracking
Yin Lin, Polytechnic University of Milan; Domenico Aquino, Fondazione IRCCS Istituto Neurologico Carlo Besta; Alberto Redaelli, Polytechnic University of Milan; Massimiliano Del Bene, Fondazione IRCCS Istituto Neurologico Carlo Besta; Riccardo Barbieri, Simona Ferrante, Polytechnic University of Milan
Tu.P30.I-33: STRUCTURED-LIGHT PERFUSION IMAGING-BASED LIVENESS DETECTION FOR ELDERLY CARE
Xuepeng Wang, Shandong University of Science and Technology; Qiongyan Wang, Southern University of Science and Technology; Xipo Li, Yuanyuan Wang, Hongwei Zhang, Yiran Ge, Shenzhen Elderly Care Center; Caifeng Shan, Nanjing University; Wenjin Wang, Southern University of Science and Technology
Tu.P30.I-34: COMPARATIVE ANALYSIS OF MACROPHAGE BEHAVIOR UNDER DIFFERENT WOUND CONDITIONS IN ZEBRAFISH
Giulia Lupi, Karol Mikula, Slovak University of Technology in Bratislava; Mai Nguyen Chi, CNRS/Université de Montpellier; Seol Ah Park, Slovak University of Technology in Bratislava
Tu.P30.I-35: EYE GAZE ANALYSIS OF REMOTE MEDICAL PROCEDURE TRAINING THROUGH AUGMENTED REALITY
Manuel Rebol, George Washington University; Weronika Celniak, AGH University of Krakow; Nimesh Rudra, Penn State University; Krzysztof Pietroszek, American University; Colton Hood, Adam Rutenberg, Neal Sikka, Claudia Ranniger, George Washington University
Tu.P30.I-36: MULTI-STAGE ADAPTIVE SECTORAL LOSS FOR RNFL THICKNESS ESTIMATION FROM FUNDUS IMAGES
Sirikorn Sangchocanonta, Tanna Chou, Phongphan Phienphanich, Poonnatuch Boonyarattanasoontorn, Adirek Munthuli, Sujittra Puangarom, Center of Excellence in Nexus for Advanced Intelligence in Law, Engineering, and Medicine (Nail’Em); Rath Itthipanichpong, Kitiya Ratanawongphaibul, Sunee Chansangpetch, Anita Manassakorn, Visanee Tantisevi, Prin Rojanapongpun, Center of Excellence in Glaucoma; Charturong Tantibundhit, Center of Excellence in Nexus for Advanced Intelligence in Law, Engineering, and Medicine (Nail’Em)
Tu.P30.I-37: Multiple Instance Learning for Temporal Localization of Abnormal Respiratory Sounds
Yun-Wen Yen, Jing-Tong Tzeng, An-Yan Chang, National Tsing Hua University; Chun-Hsiang Huang, National Taiwan University Hospital Hsin-Chu Branch; Edward Pei-Chuan Huang, National Taiwan University; Chi-Chun Lee, National Tsing Hua University
Tu.P30.I-38: Skill Assessment in Endoscopic Sinus Surgery Based on Mini-FESS Motion Data Using Machine Learning
Kaito Yamada, Masanobu Suzuki, Kou Miyaji, Koki Ebina, Hokkaidou University; Kazuya Sase, Tohoku Gakuin University; Teppei Tsujita, National Defense Academy of Japan; Xiaoshuai Chen, Hirosaki University; Takashige Abe, Hokkaido University; Shunsuke Komizunai, Kagawa University; Yuji Nakamaru, Taku Senoo, Akihiro Homma, Atsushi Konno, Hokkaido University
Tu.P30.I-39: UAM-CXR: Uncertainty-Aware Multimodal Learning for Chest X-ray Classification via Cross-Modal Conformal Prediction
Dawood Rehman, Chi-Chun Lee, National Tsing Hua University
Tu.P30.I-40: LEARNING VISUAL PROTOTYPES FOR SELF-EXPLAINABLE LUNG NODULE CLASSIFICATION
Duarte Moura, Eduardo Rodrigues, Hélder P. Oliveira, Tania Pereira, INESC TEC - Institute for Systems and Computer Engineering, Technology and Scien
Tu.P30.I-41: WHEN DEPTH HELPS AND WHEN IT HURTS: DEPTH AS A GROUNDING CUE FOR PROPAGATED SEGMENTATIONS IN ENDOSCOPIC NEUROSURGERY
Luca Violone, Manuel Rebol, Lana Lee, Jay Park, Vivek Buch, Stanford Surgical Innovation & Machine Interfacing (SIMI) Laboratory
Tu.P30.I-42: An Age-Stratified Reference-Conditioned Deviation Framework for 3D Perioral Outcome Benchmarking After Orthognathic Surgery
Ji-hye Nam, Chung-Ang University Hospital; Chooryung J. Chung, Gangnam Severance Hospital, Yonsei University College of Dentistry; Sercan Akyalcin, Harvard School of Dental Medicine
Tu.P30.I-43: An End-to-End Context-Aware Multimodal System for Clinical Sign Language Interpretation Using Vision-Based Models and Large Language Models
Fabian A. Nana, Sergio J. M. Herrera, Romina Culque-Lopez, Adrian Gutierrez, Guillermo J. Armoa, Luiz H Palucci Vieira, Pontificia Universidad Católica del Perú
Resources
No resources available.