Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral...
Transcript of Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral...
![Page 1: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/1.jpg)
2018 FallCTP431: Music and Audio Computing
Fundamentals of Musical Acoustics
Graduate School of Culture Technology, KAISTJuhan Nam
![Page 2: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/2.jpg)
Outlines
• Introduction to musical tones
• Musical tone generation- String- Pipe, Membrane
• Properties of musical tones- Time-domain- Frequency-domain- Time-Frequency domain
• Human perception
![Page 3: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/3.jpg)
Introduction to Musical Tones
![Page 4: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/4.jpg)
Taxonomy of Musical Instruments
Source: https://jameskennedymonash.wordpress.com/2012/05/06/mind-map-taxonomy-of-musical-instruments/
![Page 5: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/5.jpg)
Musical Tone Generation
Amplitude Envelope
Pitch and Spectral Envelope
Musical Instrument Action
Excitation (plucking, striking)
Source-driven (bowing, blowing)
1D vibration(string, pipe)
2D vibration(bar, drum)
Sound
![Page 6: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/6.jpg)
Musical Tone Generation
Musical Instrument Action
Excitation (plucking, striking)
Source-driven (bowing, blowing)
1D vibration(string, pipe)
2D vibration(bar, drum)
Sound
Newton“Law of motion”
Rayleigh“Wave Properties
of Sound”
![Page 7: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/7.jpg)
Musical Tone Generation: String
1. Drive force on a sound object2. Vibration by restoration force 3. Propagation 4. Reflection5. Superposition6. Standing Wave (modes)7. Radiation
![Page 8: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/8.jpg)
Musical Tone Generation: String
• One-dimensional ideal vibrating string
K ∂2y∂x2
= ε∂2y∂t2
Wave Equation
Boundary Conditions
Initial Conditions
Action (plucking, striking)
Fixed or open ends 𝑦 0,0 = 0 𝑦 𝐿, 0 = 0
c = Kε
(string tension)(linear mass density)
![Page 9: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/9.jpg)
Wave Propagation
• Explained by wave equation on the vibrating string
K ∂2y∂x2
= ε∂2y∂t2
y(x, t) = yr (t − x / c)+ yl (t + x / c)General solution Any left-traveling wave, any right-traveling wave
and the sum of the two satisfy the wave equation.
𝑦 𝑥, 𝑡 = 𝐴 ) sin(𝜔𝑡 + 𝑘𝑥)
Source: https://www.acs.psu.edu/drussell/Demos/wave-x-t/wave-x-t.html
Note that wave is a function of time and position
(An example of solutions)
![Page 10: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/10.jpg)
Wave Reflection
• Explained by the boundary conditions
Source: http://www.acs.psu.edu/drussell/Demos/reflect/reflect.html
Hard Boundary Soft Boundary
(wave is flipped) (wave is mirrored)
![Page 11: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/11.jpg)
Wave Superposition and Standing Wave
• The sum of two travelling waves in opposite directions with the same frequency cancel or reinforce each other, creating a stationary oscillation
Source: http://www.acs.psu.edu/drussell/Demos/superposition/superposition.html
![Page 12: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/12.jpg)
Complex Harmonic Oscillation
• Combination of modes are determined by the initial conditions (including the string length)
Modes Wave Motion
Source: https://www.acs.psu.edu/drussell/Demos/string/Fixed.html
![Page 13: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/13.jpg)
Video
https://www.youtube.com/watch?v=_X72on6CSL0
![Page 14: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/14.jpg)
Musical Tone Generation: Pipe
• Analogous to ideal 1D string- Woodwind or brass instrument: flute, clarinet, trumpet - Blowing: continuous excitation- Longitudinal pressure wave to travel in air column
Source: https://www.acs.psu.edu/drussell/Demos/StandingWaves/StandingWaves.html
![Page 15: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/15.jpg)
Musical Tone Generation: Membrane
• 2D wave equation: 𝑦 𝑥, 𝑦, 𝑡- Drum, percussion- Boundary condition: by the shape of membrane- Circular harmonic oscillation à generate inharmonic tones
Source: https://www.acs.psu.edu/drussell/Demos/MembraneCircle/Circle.html
(0,1) Mode
(2,1) Mode
(1,1) Mode
(0,2) Mode
![Page 16: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/16.jpg)
Properties of Musical Tones
• Time domain- Intensity (dynamics)- Amplitude envelope (ADSR)
• Frequency domain- Pitch (fundamental frequency)- Spectral envelope (formant)- Harmonicity: ratio between tonal and noise- Inharmonicity
• Time-Frequency domain- Temporal changes of spectral envelope
Amplitude envelope
Spectrum(inharmonic)
Spectrogram
![Page 17: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/17.jpg)
Sound Generation and Perception
Generation Perception
Vibration on instruments Traveling via the air Sensation of the air vibration through ears
Physical Psychological
Propagation
![Page 18: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/18.jpg)
Sound Perception
• human auditory system- Ears (physiological sense) and brain (cognitive sense)
• Ears- A series of highly sensitive transducers- Three parts- Outer, middle and inner ears
- Transform sound into sub-band signals
• Brain- Segregate and organize the auditory stimulus- Recognize loudness, pitch and timbre
Air
Mechanical
Fluid
Electric
(Cook, 1999)
![Page 19: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/19.jpg)
Outer Ear
• Pinnae- Collect sounds: http://www.douglas-self.com/MUSEUM/COMMS/ear/ear.htm
- Related to recognize the sound direction (spatial sound)- Head-related transfer function (HRTF)
• Auditory canal- Protect ear drums- Quarter-wave resonance: boost the
vibration around 3kHz by 15-20 dB
• Ear drum- Membrane that transduces air vibration
to mechanical vibration- Malleus (hammer) is attached to it
![Page 20: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/20.jpg)
Middle Ear
• Ossicles - malleus (hammer), incus (anvil) and stapes(stirrup)- The smallest bones in human body- Impedance matching: between air pressure (outer) and fluid (inner)- Without ossicles, only about 1/30 of the sound energy would have been
transferred to inner ears- Amplification- Work as a lever: membrane size
changes from the large (ear drum) to the small (oval windows)
• Muscles- Reduce the sound transmission
in response to loud sounds
![Page 21: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/21.jpg)
Inner ears
• Cochlea- Transduces fluid vibration to nerve firing
• Basilar membrane- Fluctuate at different positions selectively
according to the frequency of incoming vibration
- Similar to a bank of band-pass filters
• Organ of Corti- One row of inner hair-cell: fire neural spikes - Three rows of outer hair-cell: gain control
Source: http://acousticslab.org/psychoacoustics/PMFiles/Module03a.htm
High freq. Low freq.
BasilarMembrane
![Page 22: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/22.jpg)
Auditory Transduction
http://www.youtube.com/watch?v=PeTriGTENoc
![Page 23: Fundamentals of Musical Acoustics · Musical Tone Generation Amplitude Envelope Pitch and Spectral Envelope Musical Instrument Action Excitation (plucking, striking) Source-driven](https://reader030.fdocuments.net/reader030/viewer/2022040522/5e7e09491b1dfd4a6512f6d5/html5/thumbnails/23.jpg)
References
• UNSW Music Acoustics Website- http://newt.phys.unsw.edu.au/music/
• Stanford Music150 (by Tom Rossing)- https://ccrma.stanford.edu/courses/150/
• The Science of Sound (3rd Edition)- Thomas D. Rossing, F. Richard Moore, and Paul A. Wheeler