What? Processing of sensory signals (sounds, images,…) –information about outside world...

16
What? Processing of sensory signals (sounds, images,…) information about outside world perceived and processed by human cognitive system sometimes produced by human beings for use in human communication (speech, gestures, graphical symbols, writing,…) Describe the signal, so that it can be stored and/or efficiently transmitted and reconstructed

Transcript of What? Processing of sensory signals (sounds, images,…) –information about outside world...

Page 1: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

What?

Processing of sensory signals (sounds, images,…)

– information about outside world– perceived and processed by human cognitive system– sometimes produced by human beings for use in human

communication (speech, gestures, graphical symbols, writing,…)

Describe the signal, so that it can be– stored and/or efficiently transmitted and reconstructed– modified and reconstructed– used for extraction of information…..

Page 2: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

How?

• That is what this class is about• physiology of sensory organs• psychophysics of perception• emulation of the knowledge in engineering

Page 3: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

• The most important question

WHY ?

Page 4: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

In the South Seas there is a cargo cult of people. During the war they saw airplanes with lots of good materials, and they want the same thing to happen now. So they've arranged to make things like runways, to put fires along the sides of the runways, to make a wooden hut for a man to sit in, with two wooden pieces on his head to headphones and bars of bamboo sticking out like antennas--he's the controller--and they wait for the airplanes to land. They're doing everything right. The form is perfect. It looks exactly the way it looked before. But it doesn't work. No airplanes land.

In a similar way, cargo cult scientist follows all the apparent precepts and forms of scientific investigation, but the planes don't land.

adopted from Richard Feynman, Caltech Commencement 1974

Page 5: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

WHY ?

• Why should we care how are the cognitive signals processed in biology?

Page 6: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.
Page 7: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

original flipped reversed

double power (1.4 amplitude)

eight times power (2.8 amplitude)

power-law of perception

percept=stimulus r

r = 0.33 for hearing

Page 8: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

acoustic /ba/ and visual /ga/ yields /da/ or /tha/

Page 9: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

“bad” engineering perceived

good engineering perceived as

Page 10: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

perception

engineering

good engineering could be consistent with biology• physiology of sensory organs• psychophysics of perception• emulation of the knowledge in engineering

cognitive signal

effect ( signal )

effect ( signal )

Page 11: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

Should Airplanes Flap Wings ? (And should machines have eyes and ears?)

How should we proceed ?

Page 12: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.
Page 13: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.
Page 14: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.
Page 15: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.
Page 16: What? Processing of sensory signals (sounds, images,…) –information about outside world –perceived and processed by human cognitive system –sometimes produced.

homework

• Why do I want to take this class