Sunghyun Lee

KAIST Master's Degree Student. AI Creativity Explorer.

prof_pic.jpg

Kim Jaechul Graduate School of AI

KAIST(Korean Institute of Advanced Science and Technology)

Daejeon, Republic of Korea

Email: romanticbox@kaist.ac.kr

👋 About Me

I’m a Master’s student studying Multimodal AI at KAIST’s Kim Jaechul Graduate School of AI, advised by Professor Yong Man Ro. My work explores creativity, multimodality, and language of AI, driven by two research questions:

  • How can we make AI unveil the complex and tacit context of human communication, and use it to assist human life?
  • How can we make AI assist humans’ productive and creative activities, ultimately making human life safer, happier, and more convenient?

Motivated by these questions, I’m broadly interested in Computational Linguistics, Multimodal AI, World Models, Computational Creativity, and AI for Human.

I completed my undergraduate studies in Computer Science and French Language and Literature at Yonsei University, graduating summa cum laude (top 3%).


🗓️ Timeline

2016 – 2019
Sejong Global High School
2020 – 2025
Yonsei University
(incl. Military Service, 2021 – 2022)
2023 – 2024
MindForge
Internship (2mo)
2024 – 2025
KAI System
Internship (15mo)
2026 – Present
KAIST

🧠 Research Interests

  • Computational Linguistics (Multilinguality, Pragmatics, Phonetics)
  • Multimodal AI (Human Motion, Theory of Mind, Multimodal Communication, etc.)
  • World Models
  • Computational Creativity
  • AI for Human

✨ Motto

“Savor the Journey, Not the Destination”


Feel free to check out my publications and recent blog posts, or get in touch through the icons below!

news

Nov 08, 2025 AAAI-26 Oral, 1st Co-Author I’m so happy to share a news that our paper has been accepted to AAAI-26 as oral presentation!! Do you think MLLMs understand sound as human understands? For some models, the answer is YES, for others, the answer is NO. GPT and Gemini seems to not infer the sound as humans does. However, Qwen2.5 resembled the result of experiment conducted by humans. Our research digged down to this question. This is the first paper I participated as co-author, researching with Jinhong Jeong and supervised by professor Youngjae Yu. I would like to appreciate all authors; Jinhong Jeong, Jaeyoung Lee, Seonah Han, and Youngjae Yu. Jinhong Jeong provided fabulous and deep insights with linguistics, leading the whole research. Jaeyoung Lee provided marvelous ideas with the research, helping to turn the idea of the research to consider mechanistic interpretability with our research. Seonah Han devoted a lot of effort with ideation during our meeting, and spent lots of effort in constructing and preprocessing the dataset. And, Youngjae Yu supervised our research a lot, always helped our research to think out of the box and to think about key questions that researchers would ask. I, Sunghyun Lee, took effort in constructing the dataset, set the experiments to be precise and persuasive (introducing semantic dimension for the experiment), and analyzed the attention layers. Here I share you the links: [github] [arxiv] See you in Singapore!
Sep 18, 2025 Master’s Degree at KAIST I am pleased to announce my admission to KAIST (Korean Advanced Institute of Science and Technology) for a Master’s degree program. I will enroll in March 2026 at the Kim Jaecheol AI Graduate School (김재철 AI 대학원) under the supervision of Professor Ro Yong Man. I am delighted to join IVY Lab & IVL Lab as a new member! Furthermore, I would like to express my sincere and profound gratitude to Professor Yu Young Jae (Seoul National University) for supervising and supporting all research activities during my undergraduate research internship period. All my participation and accomplishments during my undergraduate studies would not have been possible without the guidance of the professor and the members of the MIR lab. See you in Daejeon!

latest posts

selected publications

  1. 25’ ACL
    Speaking Beyond Language: A Large-Scale Multimodal Dataset for Learning Nonverbal Cues from Video-Grounded Dialogues
    Youngmin Kim*†, Jiwan Chung*, Jisoo Kim, and 5 more authors
    25’ ACL, Vienna Main paper , Jun 2025
  2. 25’ EMNLP
    MAVL: A Multilingual Audio-Video Lyrics Dataset for Animated Song Translation
    Woohyun Cho, Youngmin Kim, Sunghyun Lee, and 1 more author
    EMNLP 2025, Suzhou Main paper , Aug 2025
  3. 26’ AAAI
    Do Language Models Associate Sound with Meaning? A Multimodal Study of Sound Symbolism
    Jinhong Jeong*, Sunghyun Lee*, Jaeyoung Lee, and 2 more authors
    26’ AAAI, Singapore Oral presentation , Jan 2026