““They say that lightning never strikes the They say that lightning never strikes the same place twice but with Joost’s founders same place twice but with Joost’s founders it could well become three in a row in it could well become three in a row in terms of phenomenal startups.”terms of phenomenal startups.”

TechCrunchTechCrunch

http://www.techcrunch.com/2007/06/15/embedded-joost-will-change-the-market/http://www.techcrunch.com/2007/06/15/embedded-joost-will-change-the-market/

20012001

In 2002, the Kazaa Web site and logo was In 2002, the Kazaa Web site and logo was sold to Sharman Networks Ltd., which is sold to Sharman Networks Ltd., which is incorporated on the island of Vanatu near incorporated on the island of Vanatu near Australia. Australia.

20032003

2006: Joost2006: Joost

1.000.000 beta users1.000.000 beta users

215 Channels 215 Channels 9208 Programs9208 Programs

Niklas Zennström & Janus FriisNiklas Zennström & Janus Friis

““Lightning doesn’t strike twice”Lightning doesn’t strike twice”

They’re thinking different!They’re thinking different!

In the web, running under TCP-IP, data has In the web, running under TCP-IP, data has a physical address.a physical address.

But to their fasttrack peer-to-peer But to their fasttrack peer-to-peer technology, DATA has no physical technology, DATA has no physical address!address!

I invite you to think different.I invite you to think different.

I invite you to think what may be, perhaps, I invite you to think what may be, perhaps, the next TCP-IP.the next TCP-IP.

Organizing principles of cognitive technologyOrganizing principles of cognitive technology: : the game of the centurythe game of the century

Alexandre LinharesAlexandre Linhareshttp://www.capyblanca.comhttp://www.capyblanca.com

http://www.intuition-sciences.comhttp://www.intuition-sciences.com

All that fun in the XXth century!All that fun in the XXth century!

• Transistor and the computer revolutionTransistor and the computer revolution• DNA raceDNA race• Space raceSpace race• Nuclear raceNuclear race

Even more fun in the XXIth century!Even more fun in the XXIth century!

• NanotechnologyNanotechnology• Clean energy (or asphyxia)Clean energy (or asphyxia)• The cognitive technology raceThe cognitive technology race……& the unknowns& the unknowns

A large-scale theory of the human brainA large-scale theory of the human brain

• The cortical algorithm, orThe cortical algorithm, or

• fluid concepts evolving.fluid concepts evolving.

Our heroesOur heroes

Kasparov once saidKasparov once said

““You have to have good enemies.You have to have good enemies.I was lucky because I had Karpov.”I was lucky because I had Karpov.”

Our competitorsOur competitors

A declaration of War!A declaration of War!

……so, mr. Jeff Hawkins, can we be your worst enemies, please?so, mr. Jeff Hawkins, can we be your worst enemies, please?

ScienceScience

• Daniel KahnemanDaniel Kahneman• Shane FrederickShane Frederick• Doug HofstadterDoug Hofstadter• Jeff HawkinsJeff Hawkins• Gerg GigerenzerGerg Gigerenzer• Gary KleinGary Klein• Bechara & DamasioBechara & Damasio• Intuition, Decision, Reason, Economics, Intuition, Decision, Reason, Economics,

Psychology, Computer Science, etc…Psychology, Computer Science, etc…

Linguists: syntax & semantics

Vision: 2D, 2½D, 3D sketches

AI: Minsky’s Frames

Neuroscience: huge number of studies, but no attempt at a large-scale theory

Hawkins 3 criteria for a theoryHawkins 3 criteria for a theory

• Time:Time: brains process rapidly changing streams brains process rapidly changing streams of information; there is nothing static about the of information; there is nothing static about the brainbrain

• Feedback:Feedback: the brain is “saturated with feedback the brain is “saturated with feedback connections” (p.25), some places with 10 times connections” (p.25), some places with 10 times more connections going towards the input than more connections going towards the input than from the input.from the input.

• The brain is organized around a “The brain is organized around a “repeating repeating hierarchyhierarchy”. This structural design seems ”. This structural design seems important.important.

Current neural networksCurrent neural networks

• Have usually three layers (disrespecting Have usually three layers (disrespecting the complex design of the brain)the complex design of the brain)

• Do not process rapidly changing Do not process rapidly changing information, but only static patternsinformation, but only static patterns

• Do not have feedback (even Do not have feedback (even backpropagation does not count—since backpropagation does not count—since it’s bound only to a “learning phase”)it’s bound only to a “learning phase”)

Is the brain modular?Is the brain modular?

It seems to beIt seems to be. If you have a stroke in. If you have a stroke in• Right parietal lobeRight parietal lobe, you can lose your , you can lose your

ability to perceive (or conceive) anything ability to perceive (or conceive) anything on your left side;on your left side;

• Broca’s areaBroca’s area: you can lose ability : you can lose ability concerning the rules of grammarconcerning the rules of grammar

• Fusiform gyrusFusiform gyrus: lose ability to recognize : lose ability to recognize facesfaces

(p.44)(p.44)

However… However…

• ““The same layer, cell types, and The same layer, cell types, and connections exist thoughout”. (p.51)connections exist thoughout”. (p.51)

• ““Newborn ferret brains can be rewired—so Newborn ferret brains can be rewired—so that they “see” with the “hearing” area of that they “see” with the “hearing” area of the brain” (~p.54)the brain” (~p.54)

• Rats can be surgically rewired so that Rats can be surgically rewired so that “pieces of [their] visual cortex [process] “pieces of [their] visual cortex [process] touch, instead of vision”. (~p.54)touch, instead of vision”. (~p.54)

What can we learn from this?What can we learn from this?

1.1. Neuroscientists are evil. They get small, Neuroscientists are evil. They get small, defenseless creatures, rewire their brains, and defenseless creatures, rewire their brains, and have a lot of fun doing these nasty things.have a lot of fun doing these nasty things.

2. The brain is NOT modular; it is plastic, and 2. The brain is NOT modular; it is plastic, and reorganizes rapidly to fit new incoming stimuli. reorganizes rapidly to fit new incoming stimuli. “Congenitally blind adults use the [area] which “Congenitally blind adults use the [area] which ordinarily becomes dedicated to vision to read ordinarily becomes dedicated to vision to read braille.” (p. 54) braille.” (p. 54)

Why not the area dedicated to touch? Because Why not the area dedicated to touch? Because “cells were not born to specialize in vision or “cells were not born to specialize in vision or touch or hearing.” (p.54)touch or hearing.” (p.54)

The declaration of independence reads “all The declaration of independence reads “all men are created equal”men are created equal”

This is a declaration of functional This is a declaration of functional independence that reads “all cells are independence that reads “all cells are created equal” created equal”

BUT WAIT!BUT WAIT!

This can’t be right! Because if it were, then This can’t be right! Because if it were, then we could create new senses, based, for we could create new senses, based, for example, on radar technology.example, on radar technology.

Actually, we can.Actually, we can.

Paul Bach y Rita (U of Wisconsin) has helped blind Paul Bach y Rita (U of Wisconsin) has helped blind people to see by linking a small camera with a people to see by linking a small camera with a chip on their tongues. Visual images are chip on their tongues. Visual images are translated to pressure intensities, pixel by pixel, translated to pressure intensities, pixel by pixel, and the brain, over time, learns how to project and the brain, over time, learns how to project “sensations in the tongue to images in space” “sensations in the tongue to images in space”

(p. 61)(p. 61)

But wait!But wait!

What this means is that the brain does not care What this means is that the brain does not care which area is processing which type of which area is processing which type of information. The areas are function-information. The areas are function-independent. They can all implement the same independent. They can all implement the same functions.functions.

They work under the very same principles.They work under the very same principles.

They process information the same way.They process information the same way.

They implement They implement one algorithmone algorithm..

This algorithm – this information-processing This algorithm – this information-processing mechanism – is our objective.mechanism – is our objective.

We’re so close, and yet so far…We’re so close, and yet so far…

Have you ever solved a Rubik’s cube?Have you ever solved a Rubik’s cube?

I think we’re 5 or 6 moves away from solving I think we’re 5 or 6 moves away from solving this Rubik’s cube, of finding out the nature this Rubik’s cube, of finding out the nature of this “neocortical algorithm”. of this “neocortical algorithm”.

So things look like a mess now; but if we get So things look like a mess now; but if we get some steps right, we may solve it.some steps right, we may solve it.

What is the rule, then, for playing this game?What is the rule, then, for playing this game?

CHANGE!CHANGE!

We must be able to implement things in We must be able to implement things in such a way that everything and anything such a way that everything and anything can change, and can change, and it is easy to do soit is easy to do so..

This is why this is also a course on This is why this is also a course on software software designdesign. .

Good design enables change.Good design enables change.

Software designSoftware design1.1. Closed for modificationClosed for modification. . The framework The framework

should, obviously, be closed for modification, should, obviously, be closed for modification, once ready. This means that there must be a once ready. This means that there must be a core set of underlying mechanisms which should core set of underlying mechanisms which should not need to change in any other domain. This not need to change in any other domain. This leads to the second requirement:leads to the second requirement:

2.2. Open for extensionOpen for extension. . The framework, though The framework, though having a closed, fixed, core, should be having a closed, fixed, core, should be extensible, and applicable to new domains. This extensible, and applicable to new domains. This is obtained through inheritance, composition, is obtained through inheritance, composition, loose coupling, the Hollywood principle, and so loose coupling, the Hollywood principle, and so forth.forth.

Software designSoftware design

3. 3. Information efficiencyInformation efficiency.. It should be relatively easy to It should be relatively easy to describe, in a high level, the workings of each part of describe, in a high level, the workings of each part of the system. It should be possible for an astute the system. It should be possible for an astute observer to implement on their own the same ideas observer to implement on their own the same ideas without having to look at our actual code.without having to look at our actual code.

4.4. Elegant implementationElegant implementation. . This is a hard to define one. This is a hard to define one. The system should be elegant, in the sense of The system should be elegant, in the sense of providing all needed functionality, all the while providing all needed functionality, all the while maintaining a sense of simplicity and neatness. maintaining a sense of simplicity and neatness. Beauty is achieved when everything is essential and Beauty is achieved when everything is essential and nothing else is required.nothing else is required.

Software designSoftware design

5. 5. Clean codeClean code. . The code should be readable and The code should be readable and understandable, without need for heavy (or even not-understandable, without need for heavy (or even not-so-heavy) refactoring or heavy commenting.so-heavy) refactoring or heavy commenting.

6.6. A test history kept at each stepA test history kept at each step. . So that others may So that others may follow a step-by-step approach to implementation and follow a step-by-step approach to implementation and be certain they're on the right track, tests for each be certain they're on the right track, tests for each major class should be preserved, and maintained even major class should be preserved, and maintained even in the first executable version of NUMBO.in the first executable version of NUMBO.

7.7. No globalsNo globals. . There is good evidence that there are no There is good evidence that there are no global variables in either the brain or the mind. So global variables in either the brain or the mind. So alternative approaches to global variables (such as alternative approaches to global variables (such as temperature, the obvious candidate) should be strived temperature, the obvious candidate) should be strived for.for.

How does the brain get its job done?How does the brain get its job done?

How does the brain “see”, if it’s dark inside?How does the brain “see”, if it’s dark inside?How does the brain “hear”, if it’s silent How does the brain “hear”, if it’s silent

inside?inside?

After information is fed “inside”, it starts to After information is fed “inside”, it starts to be processed. There are no images be processed. There are no images anymore, there are no sounds anymore, anymore, there are no sounds anymore, only information being processed, only only information being processed, only number-crunching. The brain processes number-crunching. The brain processes information, but…information, but…

The brain is not a computerThe brain is not a computer

……because the brain processes because the brain processes information, people have compared it to a information, people have compared it to a computer, but that is misleading…computer, but that is misleading…

The brain is not a computerThe brain is not a computer

The brain is not a CPUThe brain is not a CPU

The brain is The brain is memorymemory; ; a machine to a machine to predict memorypredict memory..

So the brain is like computer memory?So the brain is like computer memory?

NO. NO.

The brain is about “analogical memory”.The brain is about “analogical memory”.

It is about “invariant representations”.It is about “invariant representations”.

The memory-prediction frameworkThe memory-prediction framework

• Surprises get your attentionSurprises get your attention

• Understanding is about “generating Understanding is about “generating expectations”, about “a state of meaningful expectations”, about “a state of meaningful anticipation”anticipation”

Invariant representations & analogiesInvariant representations & analogies

Two examples:Two examples:

• How many daddies do I have?How many daddies do I have?

• Chess [From A. Linhares & P. Brum (2007) Chess [From A. Linhares & P. Brum (2007) Understanding our understanding of strategic Understanding our understanding of strategic scenarios: what roles do chunks playscenarios: what roles do chunks play? To Appear in ? To Appear in Cognitive ScienceCognitive Science.].]

Invariant representations & analogiesInvariant representations & analogies

How many daddies do I have?How many daddies do I have?

Invariant representations & analogiesInvariant representations & analogies

Linhares and Brum (2007) to appear in Linhares and Brum (2007) to appear in Cognitive ScienceCognitive Science..

Invariant representations & analogiesInvariant representations & analogies

Linhares and Brum (2007) to appear in Linhares and Brum (2007) to appear in Cognitive ScienceCognitive Science..

Invariant representations & analogiesInvariant representations & analogies

Linhares and Brum (2007) to appear in Linhares and Brum (2007) to appear in Cognitive ScienceCognitive Science..

Invariant representations & analogiesInvariant representations & analogies

Linhares and Brum (2007) to appear in Linhares and Brum (2007) to appear in Cognitive ScienceCognitive Science..

This time, the science and the This time, the science and the technology are coming togethertechnology are coming together

EntrepreneurshipEntrepreneurship

• Is it possible to develop this technology?Is it possible to develop this technology?

• Is it possible to create valuable applications?Is it possible to create valuable applications?

• Is it possible to succeed in Brazil?Is it possible to succeed in Brazil?

Is it possible to develop this technology?Is it possible to develop this technology?

1.1. It will be hard; we are certainly close, but It will be hard; we are certainly close, but a Rubik's cube looks very messed up a Rubik's cube looks very messed up some steps prior to completionsome steps prior to completion

2.2. Imagine the early days of TCP/IP; that’s Imagine the early days of TCP/IP; that’s where we’re going, but this time, there where we’re going, but this time, there are ample applications waitingare ample applications waiting

Is it possible to create valuable applications?Is it possible to create valuable applications?

Anything that’s hard to do with computers Anything that’s hard to do with computers and easy to do by humansand easy to do by humans

Is it possible to succeed in Brazil?Is it possible to succeed in Brazil?

• The major cost is Diet Coke & PizzaThe major cost is Diet Coke & Pizza

• Can we beat our competitors?Can we beat our competitors?– Will our systems pass the “do not suck” test?Will our systems pass the “do not suck” test?

• The VCs are arrivingThe VCs are arriving

Draper Fisher Draper Fisher JurvetsonJurvetson Enters Brazilian Market Enters Brazilian Market

““As part of the agreement the two new As part of the agreement the two new partners will also launch a $100 million partners will also launch a $100 million fund, DFJ FIR Brazil Fund II, targeting fund, DFJ FIR Brazil Fund II, targeting offshore investors wanting to invest in offshore investors wanting to invest in Brazilian companies in high-growth Brazilian companies in high-growth industries.”industries.”

DivX, Skype, Mobile 365, and BaiduDivX, Skype, Mobile 365, and Baidu

SummarySummary

1.1. Welcome to the race for cognitive technologyWelcome to the race for cognitive technology2.2. We will search for the central organizing principles of We will search for the central organizing principles of

the human mindthe human mind3.3. The same thing is going on all over the cortexThe same thing is going on all over the cortex4.4. The brain processes information, but it’s not a CPUThe brain processes information, but it’s not a CPU5.5. The brain is a machine to predict analogical memoriesThe brain is a machine to predict analogical memories6.6. Where are we in this race?Where are we in this race?

Image creditsImage creditsMad scientist: Mad scientist: http://en.wikipedia.org/wiki/User:J.Jhttp://en.wikipedia.org/wiki/User:J.J..

Dendrites Merge: Dendrites Merge: http://www.flickr.com/photos/neurollero/15002021/in/set-366106/http://www.flickr.com/photos/neurollero/15002021/in/set-366106/

Jeff Bezos: Associated Press/Ted WarrenJeff Bezos: Associated Press/Ted Warren

Skype founders: Skype founders: http://www.skype.comhttp://www.skype.com