Jin Lee
AI Scientist
Gaudio Lab

  

Me.

I am an AI scientist at Gaudio Lab and study music technology, artificial intelligence, and physical modeling, involving audio, music, speech, and acoustics. My research interests include virtual sound synthesis, numerical simulation, and other sound-related topics like speaker verification, voice conversion, echo cancellation, and music transcription.


Education

2019 - 2024 Ph.D. in Intelligence and Information, Seoul National University (SNU)


Thesis: Physical Modeling for String Instrument Sound Synthesis based on Finite-difference Scheme and Automatic Differentiation
Advisor: Kyogu Lee

2013 - 2019 B.Sc. in Mechanical Engineering, Pohang University of Science and Technology (POSTECH)


Thesis: Deep Learning Approach in Multi-scale Prediction of Turbulent Mixing-layer

Previous Positions

Redmond, WA, 2024

Research Scientist Intern, Meta (with Sebastian Prepeliţă)

Seoul, KR, 2021,2023

Research Scientist Intern, Supertone (with Hyeong-Seok Choi)

Publications

[Google Scholar] [h5-index: Engineering & Computer Science / Artificial Intelligence / Acoustics & Sound ]
Selected publications are highlighted.


2024

1. Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation [TL;DR] [demo] [poster] [openreview]
Jin Woo Lee, Jaehyun Park, Min Jun Choi, and Kyogu Lee
NeurIPS 2024
2. Inverse Nonlinearity Compensation of Hyperelastic Deformation in Dielectric Elastomer for Acoustic Actuation [TL;DR]
Jin Woo Lee, Gwangseok An, Jeong-Yun Sun, and Kyogu Lee
IEEE Access 2024
3. String Sound Synthesizer on GPU-accelerated Finite Difference Scheme [TL;DR] [code] [demo] [poster]
Jin Woo Lee, Min Jun Choi, and Kyogu Lee
IEEE ICASSP 2024

2023

4. AECSQI: Referenceless Acoustic Echo Cancellation Measures using Speech Quality and Intelligibility Improvement [TL;DR] [slides]
Jin Woo Lee, Hyeong-Seok Choi, and Kyogu Lee
IEEE WASPAA (Oral Presentation) 2023
5. Neural Fourier Shift for Binaural Speech Rendering [TL;DR] [code] [demo] [poster]
Jin Woo Lee and Kyogu Lee
IEEE ICASSP 2023
6. Global HRTF Interpolation via Learned Affine Transformation of Hyper-conditioned Features [TL;DR] [code] [demo] [poster]
Jin Woo Lee, Sungho Lee, and Kyogu Lee
IEEE ICASSP 2023

2022 and earlier

7. Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification [TL;DR] [slides]
Jin Woo Lee, Eungbeom Kim, Junghyun Koo, and Kyogu Lee
ISCA Interspeech (Oral Presentation) 2022
8. Deep Learning Approach in Multi-scale Prediction of Turbulent Mixing-layer [TL;DR]
Jin Woo Lee, Sangseung Lee, and Donghyun You
arXiv 2019

Teaching Experience

Machine Listening (TA) 2024F
Physical Modeling and Numerical Sound Synthesis (Student Instructor) 2024S

Invited Talks (Selected)

1. 2024 Physics-based Differentiable Sound Rendering and Machine Listening, University of Iowa, Dept. of Communication Sciences and Disorders Seminar (host: Inyong Choi)
2. 2024 Differentiable Physical Modeling for Sound Synthesis: From Design to Inverse Problems, Stanford CCRMA, DSP Seminar (host: Julius O. Smith)
3. 2024 Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation, Korea Advanced Institute of Science & Technology (KAIST), Music and Audio Computing Lab (host: Juhan Nam)

Professional Societies

Academic Paper Reviewer

International Conference on Learning Representations (ICLR)
International Speech Communication Association (ISCA) Interspeech
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Membership

International Speech Communication Association (ISCA)
IEEE Signal Processing Society (IEEE SPS)
International Society of Music Information Retrieval (ISMIR)

Technical Skills

Programming C/C++, Python Matlab
Audio Eng. Sound Recording, Studio Mixing, Reaper, JUCE
Elec. Eng. Digital Signal Processing, Physical Modeling
Mech. Eng. Microcontroller, Computational Fluid Dynamics, Metal Machining, Welding, CAD
Multiphysics Comsol, Blender, Ansys

Last updated on 2025-03-30