I am a third-year Ph.D. student in Information Systems at the University of Maryland, Baltimore County (UMBC), specializing in Artificial Intelligence and Machine Learning. I am a Graduate Research Assistant in the Mobile Pervasive and Sensor Computing (MPSC) Lab, advised by Prof. Nirmalya Roy, and a Graduate Teaching Assistant with Prof. Zhiyuan Chen. I am also affiliated with the Center for Research in Use-Inspired Cyber-Physical Systems (CYPRESS).

My research focuses on trustworthy multimodal AI for healthcare. I develop methods for contactless physiological monitoring, estimating breathing and other vital signs from ordinary video and multimodal sensor data, using computer vision, time-series modeling, and vision-language models. A central question in my work is how AI systems use physiological evidence: I study where vision-language models and LLM-based agents fail, and make their outputs more reliable through calibration, evidence-grounded reasoning, uncertainty-aware inference, and counterfactual auditing, with particular attention to separating failures of perception, insufficient evidence, and reasoning.

I also care about getting these systems out of the lab. My work extends to efficient on-device inference on edge hardware and mobile robots, including field experiments with the DEVCOM Army Research Laboratory and demonstrations on the NSF-supported testbeds at CYPRESS, UMBC.

Previously, I was a research assistant at the Advanced Medical Engineering Research Institute (AMERI), University of Hyogo, Japan, as a HUMAP Fellow, working with Prof. Syoji Kobashi and Prof. Md Belayat Hossain on medical image processing and surgical video understanding. I have also worked as a Graduate Research Assistant in the QUEST Lab at the University of North Carolina at Charlotte, and spent two years as a Lecturer in Computer Science and Engineering at Leading University, Bangladesh.


Research Interests

Contactless Health Sensing Breathing and vital signs from ordinary video, robust to motion, lighting, and occlusion
Trustworthy Medical AI Vision-language models and agents that calibrate, verify, and audit their evidence
Deployable Health Systems Efficient on-device inference on edge hardware and mobile robots

🔥 News

  • Paper
    Two papers accepted at the NeurIPS 2026 Med-Reasoner Workshop on medical reasoning with vision-language foundation models.
  • Paper
    Two papers accepted at the AAAI 2026 Fall Symposium Series, on counterfactual auditing for multimodal health agents and therapeutic-boundary failures in LLM agents.
  • Paper
    Paper accepted at ACM CIKM 2026: Reliability-Guided Video Token Learning for Contactless Vital Sign Estimation.
  • Paper
    EviCal-RR accepted at the MICCAI 2026 SAFER Workshop.
  • Talk
    Presented ViTaL-Diff at the ICML 2026 Structured Data for Health (SD4H) Workshop.
  • Talk
    Presented CALIBRA at the CVPR 2026 GRAIL-V Workshop.
  • Award
    Received an NSF Student Travel Grant for IEEE/ACM CHASE 2026, with work at both the main conference and the SCH Workshop.
  • Demo
    Field experiments and research demonstrations at the NSF TRACE Testbed Workshop, CYPRESS Technology Research Center, UMBC. Gallery
  • Demo
    Demonstrated on-device contactless respiratory sensing on a Boston Dynamics Spot robot at DEVCOM ARL R2C2 during the ArtIAMAS University Experimentation Event. Event
Older news
  • Paper
    Published work at IEEE ICMLA 2025 (RespFormer), IEEE SmartComp 2025 (E2RespUNet), and IEEE/ACM CHASE 2025 (RRPIPS).
  • Paper
    Published a survey on remote photoplethysmography for contactless health sensing in WIREs Data Mining and Knowledge Discovery.
  • Milestone
    Completed my M.Sc. in Information Systems (AI/ML Track) at UMBC with a 4.00/4.00 CGPA.
  • Milestone
    Joined the Center for Real-time Distributed Sensing and Autonomy (CARDS) for collaborative research with the DEVCOM Army Research Laboratory.
  • Milestone
    Began my Ph.D. in Information Systems at UMBC and joined the MPSC Lab.

Research Highlights

Trustworthy and Agentic Reasoning for Health AI

NeurIPS 2026 @Med-Reasoner
Measure What Matters

Measure What Matters: Active Evidence Acquisition for Reliable Physiological Reasoning
Shadman Sakib, Nirmalya Roy
NeurIPS 2026 Workshop on Medical Reasoning with Vision Language Foundation Models (Med-Reasoner)

PDF

NeurIPS 2026 @Med-Reasoner
Can VLMs Keep Time?

Can VLMs Keep Time? Probing Quantitative Temporal Reasoning in Physiological Videos
Shadman Sakib, Nirmalya Roy
NeurIPS 2026 Workshop on Medical Reasoning with Vision Language Foundation Models (Med-Reasoner)

PDF

AAAI FSS 2026 @TAS
Counterfactual Auditing

Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents
Shadman Sakib, Nirmalya Roy
AAAI 2026 Fall Symposium on Trustworthy Agentic Systems (TAS 2026)

PDF

MICCAI 2026 @SAFER
EviCal-RR

EviCal-RR: Evidence-Calibrated Reasoning for Contactless Respiratory Monitoring
Shadman Sakib, Nirmalya Roy
MICCAI 2026 Workshop on Stable Adaptation and Faithful Evaluation of Reasoning in Medical Foundation Models (SAFER)

PDF

CHASE 2026
VLS-RR

Decoupling Perception and Reasoning for Contactless Respiratory Rate with Vision Language and Small Language Models
Shadman Sakib, Gaurav Shinde, Nirmalya Roy
IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE 2026)

PDF

CVPR 2026 @GRAIL-V
CALIBRA

CALIBRA: Calibration-Aware Multi-Agent Verification for Contactless Physiological Monitoring
Shadman Sakib, Gaurav Shinde, Nirmalya Roy
CVPR 2026 Workshop on Grounded Retrieval and Agentic Intelligence for Vision-Language (GRAIL-V)

PDF

Contactless Physiological Sensing

CIKM 2026
Reliability-Guided Video Token Learning

Reliability-Guided Video Token Learning for Contactless Vital Sign Estimation
Shadman Sakib, Haley Patel, Nirmalya Roy
35th ACM International Conference on Information and Knowledge Management (CIKM 2026)

PDF

ICML 2026 @SD4H
ViTaL-Diff

ViTaL-Diff: Video-Token Latent Diffusion for Contactless Respiratory Monitoring
Shadman Sakib, Nirmalya Roy
ICML 2026 Workshop on Structured Data for Health (SD4H)

PDF

ICMLA 2025
RespFormer

RespFormer: A Motion-Guided Temporal-Frequency Multimodal Fusion Transformer for Contactless Respiratory Monitoring
Shadman Sakib, Gaurav Shinde, Snehalraj Chugh, Mohammad Saeid Anwar, Nirmalya Roy
IEEE International Conference on Machine Learning and Applications (ICMLA 2025)

PDF

SmartComp 2025
E2RespUNet

E2RespUNet: End-to-End Respiratory Signal Reconstruction and Rate Prediction Using a Unified Attention-Enhanced U-Net
Shadman Sakib, Gaurav Shinde, Emon Dey, Nirmalya Roy
IEEE International Conference on Smart Computing (SmartComp 2025)

PDF

Selected Publications Google Scholar

1,200+ citations 16 h-index 23 i10-index Google Scholar, October 2026

Journal Articles

Conference and Workshop Papers

Under Review

  • UNDER REVIEW PhyResp: Robust Contactless Respiratory Sensing with Physics-Constrained Predictive State Modeling
    Shadman Sakib, Nirmalya Roy
  • UNDER REVIEW Pixels-to-Phase: Reliability-Aware Latent State-Space Modeling for Contactless Respiratory Estimation
    Shadman Sakib, Nirmalya Roy
  • UNDER REVIEW SAGE-RR: Selective Auditing with Grounded Evidence for Robust Contactless Respiratory Rate Estimation
    Shadman Sakib, Nirmalya Roy
  • UNDER REVIEW Vision-Language Models in Healthcare: A Comprehensive Review from Data to Diagnosis
    Aftar Ahmad Sami, Md. Jalal Uddin Chowdhury, Shakib Absar, Iftekhar Ahmed, Shadman Sakib, Md Rafiqul Islam, Sami Azam, Nirmalya Roy
More Publications

Honors and Awards

  • 2025, 2026Doctoral Research Poster Award, COEIT Research Day, UMBC
  • 2026NSF Student Travel Grant, IEEE/ACM CHASE 2026
  • 2025Student Travel Grant, Department of Information Systems, UMBC (IEEE ICMLA 2025)
  • 2021Best Paper Award, Signal Processing Track, IEEE IEMCON 2021
  • 2021Best Paper Award, Biomedical Engineering Track, IEEE R10 HTC 2021
  • 2020Student Travel Grant, University of Hyogo (IEEE SCIS & ISIS 2020)
  • 2019–2020HUMAP Fellowship, University of Hyogo, Japan
  • 2018–2020Outstanding Teaching Assistant Award, Department of EEE, IUBAT
  • 2016–2019University Merit Scholarship and Dean's List, IUBAT
  • 2016Chancellor's Award for Academic Excellence, IUBAT
  • 2015–2016Departmental Chair's Award for Outstanding Academic Performance, IUBAT

Education

Ph.D. in Information SystemsJan 2024 – Present

AI/ML Track · Advisor: Prof. Nirmalya Roy · CGPA 4.00/4.00

M.Sc. in Information SystemsJan 2024 – Aug 2025

AI/ML Track · CGPA 4.00/4.00

B.Sc. in Electrical and Electronic EngineeringAug 2015 – Aug 2019

CGPA 3.96/4.00 · Ranked 1st in class

Research Experience

Graduate Research AssistantJan 2024 – Present
Mobile, Pervasive and Sensor Computing (MPSC) Lab, University of Maryland, Baltimore County

Advisor: Prof. Nirmalya Roy. Trustworthy multimodal AI for contactless health monitoring.

  • Develop contactless respiratory and vital-sign monitoring from RGB, NIR, and IR video, robust to motion, lighting, and occlusion.
  • Study how vision-language models and health agents reason over physiological evidence, using calibration, evidence grounding, and counterfactual auditing to make them reliable.
  • Deploy sensing and reasoning pipelines on edge hardware and mobile robots.
  • Systems: RespFormer, E2RespUNet, RRPIPS, VLS-RR, CALIBRA, EviCal-RR, ViTaL-Diff.
Graduate Research AssistantMay 2025 – Aug 2025
Center for Real-time Distributed Sensing and Autonomy (CARDS), UMBC

In collaboration with the DEVCOM Army Research Laboratory (ARL).

  • Built an on-device respiratory monitoring system for a Boston Dynamics Spot robot on NVIDIA Jetson Orin.
  • Designed the vision and signal-processing pipeline for changing viewpoints, outdoor lighting, partial occlusion, and robot motion.
  • Evaluated the system in field experiments at the ARL Robotics Research Collaboration Campus (R2C2), Graces Quarters, Maryland.
Graduate Research AssistantJan 2023 – Dec 2023
Quantitative Ultrasound Imaging (QUEST) Lab, University of North Carolina at Charlotte
  • Applied deep learning and quantitative ultrasound to obstetric imaging.
  • Worked on image segmentation and registration for non-invasive tissue characterization and early screening.
Research AssistantSep 2019 – Sep 2020
Advanced Medical Engineering Research Institute (AMERI), University of Hyogo, Japan

HUMAP Fellow. Media feature

  • Developed deep-learning methods for surgical video captured by wearable smart glasses: phase recognition, hand-frame extraction, and tool detection.

Field Demonstrations

NSF TRACE Testbed Workshop and Field ExperimentApr 2026
CYPRESS Technology Research Center, UMBC

Field experiments and research demonstrations on the NSF-supported TRACE testbed for autonomous and cyber-physical systems. Gallery · Workshop

Collaborative Remote Robotics ExperimentAug 2025
DEVCOM ARL R2C2, Graces Quarters, Maryland

Demonstrated on-device contactless physiological sensing on a Boston Dynamics Spot robot at the ArtIAMAS University Experimentation Event, using the Distributed Virtual Proving Ground (DVPG). Event

Teaching

Graduate Teaching AssistantJan 2024 – Present
Department of Information Systems, University of Maryland, Baltimore County (UMBC)

With Prof. Zhiyuan Chen, across undergraduate and graduate courses.

IS 420Database Application DevelopmentFall 2026 · Fall 2025 · Spring 2025
Lead weekly lab sections for 80+ students on SQL, PL/SQL, ER modeling, normalization, stored procedures, triggers, and transaction control.
IS 620Advanced Database ProjectsSpring 2026 · Fall 2024
Supported a project-based graduate course for 50+ students in database design, schema development, query optimization, and transaction processing; reviewed project proposals and evaluated final deliverables.
IS 427Introduction to Artificial IntelligenceSpring 2024
Supported 45+ students in search, probabilistic reasoning, supervised learning, and Python/scikit-learn projects.
LecturerOct 2020 – Dec 2022
Department of Computer Science and Engineering, Leading University, Sylhet, Bangladesh
  • Taught Machine Learning, Artificial Intelligence, Digital Signal Processing, Microprocessors and Interfacing, and Electrical Circuits, with their laboratory and project courses.
  • Designed course materials, laboratory exercises, assignments, and examinations.
  • Supervised 13+ undergraduate theses, several of which led to peer-reviewed publications.
  • Mentored students in research design, scientific writing, and manuscript preparation.

Professional Service

Program Committee
AAAI 2026 Fall Symposium Series (FSS-26)
Conference Reviewer
IEEE ISBI 2026 · MICCAI 2026 · IEEE BigData 2026 · ICVGIP 2026 · AusDM 2026 · NCA 2026 · IEEE ICSIPA 2026 · IEEE SCIS–ISIS 2024, 2026
Workshop Reviewer
NeurIPS 2026 Med-Reasoner, JUDGe, SocialAgent NeurIPS 2025 MusIM ICML 2026 FMSD, SD4H, MusIML ICLR 2026 TSALM CVPR 2026 Med-Reasoner ECCV 2026 HCV
Journal Reviewer
Applied Soft Computing · Array · Biomedical Signal Processing and Control · Computational Biology and Chemistry · Computers in Biology and Medicine · Data in Brief · Frontiers in Computer Science · Healthcare Analytics · Informatics in Medicine Unlocked · Intelligence-Based Medicine · Medical Engineering & Physics · Multimedia Tools and Applications · Pulmonary Medicine
Organization
Organizing Team, NSF TRACE Testbed Workshop, UMBC, 2026 Local Organizer, IEEE PerCom 2025
Mentoring
Mentor, IEEE Leading University Student Branch, 2021–2022
Memberships
IEEE (Graduate Student Member) · ACM (Student Member) · ACM SIGIR · AAAI (Student Member)

Open to Research Collaboration

I am always glad to hear from researchers, students, and clinical partners working on related problems, particularly in:

Contactless Physiological Sensing Multimodal Reasoning for Healthcare Vision-Language Models for Health Trustworthy and Calibrated AI Multimodal Sensor Fusion Edge AI and On-Device Inference Computer Vision and Video Analysis Smart Health and Remote Monitoring Medical Imaging

Contact

Office
ITE 457
Lab
Mobile, Pervasive and Sensor Computing (MPSC) Lab
Department
Information Systems
Institution
University of Maryland, Baltimore County
1000 Hilltop Circle, Baltimore, MD 21250, USA
Connect
ssakib1@umbc.edu · LinkedIn