Reading the Whole Patient: Multimodal AI in Healthcare

A single patient’s health leaves behind a scattered trail of data—medical images, health records, clinical notes, biosignals—that no clinician can take in at a glance. This talk asks whether artificial intelligence can draw those fragments into a single, more patient-centered picture. Drawing on recent developments in multimodal AI, Shamout considers how such systems might help clinicians monitor patient health, interpret complex information, and support clinical decision-making, while weighing the real-world challenges of reliability, fairness, and practical usefulness for patients and clinicians alike. Speakers

• Farah Shamout, Assistant Professor of Computer Engineering, NYU Abu Dhabi; Associated Faculty, Department of Computer Science and Engineering, NYU Tandon School of Engineering