Unveiling GPT-4V’s Hidden Challenges Behind High Accuracy on USMLE Questions

Published in Journal of Medical Internet Research (2025), 2025

Summary: Dissects GPT-4V responses to USMLE-style questions, cataloging error patterns in multimodal reasoning, visual grounding, and factual calibration. Provides actionable evaluation protocols for clinical AI deployment.

Recommended citation: Yang, Z., Yao, Z., Tasmin, M., Vashisht, P., Jang, W.S., Ouyang, F., Wang, B., McManus, D., Berlowitz, D., Yu, H. Unveiling GPT-4V's hidden challenges behind high accuracy on USMLE questions: Observational Study. J Med Internet Res 27:e65146 (2025).
Download Paper