Yimu Pan | Penn State

About Me

I am currently pursuing a Ph.D. in Informatics at the College of Information Sciences and Technology at The Pennsylvania State University, under the supervision of Prof. James Z. Wang. My research focuses on Computer Vision and Multi-Modality Learning with applications in healthcare, emotion understanding, and AI-assisted clinical tools. I worked as an Applied Scientist Intern at Amazon during the summer of 2024 under the guidance of Yelin Kim, Hongda Mao, and Cici Chen, focusing on Last Mile applications.

I hold a B.S. in Computer Science (Summa Cum Laude), as well as B.S. degrees in Mathematics and Statistics (both Magna Cum Laude), all from The Pennsylvania State University, class of 2021. My skills include developing machine learning algorithms and applying them in areas such as healthcare and medical imaging.

Research Interests

Computer Vision: robustness improvement, video understanding, medical image analysis
Multi-Modality Learning: cross-modal learning, vision-language model, generative model

News

[Mar. 2025] Glad to have the opportunity to present our work at the Young Achievers Symposium hosted by the Center for Socially Responsible Artificial Intelligence at Penn State. Thanks to the organizers for the invitation!
[Mar. 2025] It was great to meet so many people at AAAI 2025. See you at future conferences!
[Mar. 2025] Our work on placenta analysis using photographs is featured by NIBIB in the article "Picture This: Using AI to Analyze Photographs of the Placenta".
[Feb. 2025] Our work on placenta analysis using photographs is featured in the podcast episode "Making Sense of Pregnancy: What Experts Want you To Know About Your Body".
[Feb. 2025] The code for S2S2 is now available online.
[Dec. 2024] Our work about robust medical image segmentation is accepted to AAAI 2025. Two other papers are accepted to AAAI Workshop on Health Intelligence.
[Dec. 2024] Our work about placenta analysis using photographs is featured by Northwestern Now News and Penn State News.
[Oct. 2024] Our work about placenta analysis using photographs is accepted by Cell Press Patterns.
[Aug. 2024] Successfully completed my internship at Amazon. Grateful for the support and guidance from all my colleagues.
Show more

Publications

AAAI

S2S2: Semantic Stacking for Robust Semantic Segmentation in Medical Imaging

Yimu Pan, Sitao Zhang, Alison D. Gernand, Jeffery A. Goldstein, and James Z. Wang

Annual AAAI Conference on Artificial Intelligence (AAAI), 2025.

PDF Code

W3PHIAI@AAAI

AI-SAM: Automatic and Interactive Segment Anything Model

Yimu Pan, Sitao Zhang, Alison D. Gernand, Jeffery A. Goldstein, and James Z. Wang

The 9th International Workshop on Health Intelligence, in conjunction with the Annual AAAI Conference on Artificial Intelligence (W3PHIAI@AAAI), 2025.

PDF Code

W3PHIAI@AAAI

VLCD: Vision-Language Contrastive Distillation for Accurate and Efficient Automatic Placenta Analysis

Manas Mehta, Yimu Pan, Kelly Gallagher, Alison D. Gernand, Jeffery A. Goldstein, Delia Mwinyelle, Leena Mithal and James Z. Wang

The 9th International Workshop on Health Intelligence, in conjunction with the Annual AAAI Conference on Artificial Intelligence (W3PHIAI@AAAI), 2025.

Patterns

Cross-Modal Contrastive Learning for Unified Placenta Analysis Using Photographs

Yimu Pan, Manas Mehta, Jeffery A. Goldstein, Joseph Ngonzi, Lisa M. Bebell, Drucilla J. Roberts, Chrystalle Katte Carreon, Kelly Gallagher, Rachel E. Walker, Alison D. Gernand, and James Z. Wang

Cell Press Patterns, 2024.

PDF Code

CVPR

Learning Emotion Representations from Verbal and Nonverbal Communication

Sitao Zhang*, Yimu Pan*, and James Z. Wang

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

PDF Code (*Equal contribution)

MICCAI

Enhancing Automatic Placenta Analysis through Distributional Feature Recomposition in Vision-Language Contrastive Learning

Yimu Pan, Tongan Cai, Manas Mehta, Alison D. Gernand, Jeffery A. Goldstein, Leena Mithal, Delia Mwinyelle, Kelly Gallagher and James Z. Wang

International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023.

PDF

MICCAI

Vision-Language Contrastive Learning Approach to Robust Automatic Placenta Analysis Using Photographic Images

Yimu Pan, Alison D. Gernand, Jeffery A. Goldstein, Leena Mithal, Delia Mwinyelle and James Z. Wang

International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022.

PDF Early Accept

Services

Conference Reviewers

International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2024