Changes in Piano Waveforms from the Perspective of Physics and Deep Learning

In this study, it was possible to visually check the difference in sound depending on the way the piano key is pressed through the spectrogram. When the keyboard is pressed hard, the high-frequency component is emphasized, and when pressed gently, the low-frequency component is prominent. In addition, it was confirmed that the pattern of the spectrogram varies depending on the playing techniques such as staccato and legato, or whether or not to use the pedal. We tried to analyze whether the pianist's touch or expressive power could make a difference in the physical wave form, and on the contrary, the pianist was able to accurately infer the connection between the way he played and the sound through the spectrogram.