tarsosDSP_presentation
-
Upload
kapil44629 -
Category
Documents
-
view
16 -
download
0
Transcript of tarsosDSP_presentation
![Page 1: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/1.jpg)
Outline and Goal Basics TarsosDSP Conclusion
Audio Processing Joren Six
25 March 2011
![Page 2: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/2.jpg)
Outline and Goal Basics TarsosDSP Conclusion
Goal
Cover the basic principles of doing stuff with audio.
![Page 3: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/3.jpg)
Outline and Goal Basics TarsosDSP Conclusion
Outline
Outline and Goal
BasicsAnalog AudioDigital Audio
TarsosDSPExamplesContact
Conclusion
![Page 4: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/4.jpg)
Outline and Goal Basics TarsosDSP Conclusion Analog Audio Digital Audio
Basics - Analog Audio
f (x)
x
Figure: Continuous wave
![Page 5: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/5.jpg)
Outline and Goal Basics TarsosDSP Conclusion Analog Audio Digital Audio
Basics - Digital Audio
f (x)
x
Figure: Sampled wave
![Page 6: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/6.jpg)
Outline and Goal Basics TarsosDSP Conclusion Analog Audio Digital Audio
Basics - Digital Audio - Samplerate
Listing 1: A sampled sine wave buffer
1 double sampleRate = 44100.0;
double frequency = 440.0;
double seconds = 2.0;
float[] b = new float[seconds * sampleRate ];
for (int sample = 0; sample < b.length; sample ++) {
6 double time = sample / sampleRate;
b[sample] = 0.8 * Math.sin(twoPiF0 * time);
}
![Page 7: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/7.jpg)
Outline and Goal Basics TarsosDSP Conclusion Analog Audio Digital Audio
Basics- Digital Audio - Bit depth
Listing 2: A sampled sine wave buffer
final byte[] byteBuffer = new byte[b.length * 2];
2 int bIndex = 0;
for (int i = 0; i < byteBuffer.length; i++) {
final int x = (int) (b[bIndex ++] * 32767.0);
byteBuffer[i] = (byte) x;
i++;
7 // unsigned right shift
byteBuffer[i] = (byte) (x >>> 8);
}
float in [−1.0, 1.0] to 16bit signed little endian PCM.Multiply each sample with b(216 − 1)/2c = 32767
![Page 8: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/8.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - What
TarsosDSP is a collection of JAVA classes to do simple audioprocessing. Bascially chainable operations on float or byte buffers.
![Page 9: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/9.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - Contents
I Filters: low pass, high pass
I Pitch detectors: YIN and MPM
I FFT
I WAV file writer
I . . .
![Page 10: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/10.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - Sound Detection
Demo
![Page 11: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/11.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - Pitch Detection
Figure: Pitch detection
![Page 12: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/12.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - Percussion Detection
Figure: Percussion onset detection
![Page 13: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/13.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - FFT to MIDI
Demo
![Page 14: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/14.jpg)
Outline and Goal Basics TarsosDSP Conclusion Examples Contact
TarsosDSP - Contact
Figure: https://github.com/JorenSix/TarsosDSP
![Page 15: tarsosDSP_presentation](https://reader035.fdocuments.net/reader035/viewer/2022070300/543dc995afaf9fa00a8b4b49/html5/thumbnails/15.jpg)
Outline and Goal Basics TarsosDSP Conclusion
Conclusion and Questions