Timbre Transfer using Differentiable Digital Signal Processing - Deep Learning
Topics in Audio Signal Processing and Music Technology - 02 Differentiable Digital Signal Processing: Timbre Transfer - Deep Learning
GitHub:
00:00:00 Timbre Transfer Demo
00:02:55 Installing and Importing the DDSP Library
00:03:10 Recording or Uploading Audio
00:05:08 Loading a Model: Violin
00:06:56 Resynthesizing Audio
00:08:01 Modifying Conditioning
00:09:06 Pre-trained Trumpet Model
00:10:22 Pre-trained Flute2 Model
00:11:18 Pre-trained Tenor Saxophone Model
00:12:56 Pitch Shifting
00:13:50 Demo Application Conclusions
00:15:19 DDSP ICLR Paper: The International Conference on Learning Representations
00:17:18 Install and Imports
00:18:16 Gin Config Framework
00:22:35 Recording Audio
00:26:23 base64: Decode the Base64 encoded bytes-like object or ASCII string
00:26:43 Audio bytes to Numpy
00:27:44 Uploading an Audio File
00:29:29 Colab Files Upload
00:33:43 Log Magnitude Spectrogram
00:36:40 DDSP Spectral Operations: Compute Magnitude
00:37:11 DDSP