“Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts:...

27
“Year 2020” -Topics in Information Theory for Further Studies

Transcript of “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts:...

Page 1: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

“Year 2020” -Topics inInformation Theory for Further

Studies

Page 2: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Comprestimation

Page 3: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 104

Comprestimation

lossy compression of ”non-natural”images (regular lossy compression usesMSE)

compression of images so that thestatistical inferences on thecompressed images remain valid

E.g. compression of microarray images

Page 4: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105

Microarray images

Page 5: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 106

Comprestimation cont.

also known as ”Multi-terminal datacompression”

T. Han & S.Amari; R. Jörnsten & B. Yu;

Page 6: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Algorithmic Information Theory

Page 7: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 108

Algorithmic Information Theory

…as used by Chaitin for ”meta-mathematics”

incompleteness theoremsGödel (logic)Turing (algorithm)The Halting Probability Omega (information,

randomness)

http://www.umcs.maine.edu/~chaitin/

Page 8: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 109

Physics, information and games

Page 9: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

2020: Quantum Odyssey“On Quantum Computing and information transmission”

Page 10: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 111

Motivation Computers as physical systems Technological issues

miniaturization and speedup - Moore’s lawneed for energy efficiency

Page 11: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 112

Why would we bother?

Cryptography: QC can break RSA codes Communication of messages that betray

the presence of eavesdropping Teleportation: moving qubits around

without having them ever beingtransmitted over an insecure channel

Page 12: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 113

Central concepts Superposition: a “blend” of 0 and 1

simultaneously, i.e., quantum parallelmode

http://www.quantiki.org Reversible computing: logical

irreversibility implies thermodynamicirreversibility (i.e., heat dissipation)

Charles Bennett0

10 0 1

Page 13: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 114

Wave/particle duality

Page 14: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 115

Mach-Zehnder interferometer

Page 15: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 116

The Capabilities of Computers

(Deterministic)Turing Machine

ProbabilisticTuring Machine

QuantumTuring Machine

Page 16: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 117

Proving vs. providing proof

QTM can simulate a TM - QTMuniversal

TM provides a proof as the sequence ofsteps performed

QTM can provide an answer without aproof trace (worse: if you try to “peek”QTM that would disrupt the proof!)

Page 17: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 118

Bits and Qubits

Each bit is represented by the state ofa simple 2-state quantum system e.g.,spin state)

We need finite dimensional Hilbertspace

ω2

ω1

ω0

“Complex linear vector space”

Page 18: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 119

Bra-ket

For a simple two-state system you canwrite the state as a “ket (vector)”

!"

#$%

&'+=

1

01100 |||

(

()()()

Probability interpretation

!"

=

=1

0

2

2

)|statein system(n

i

i

i

iP

#

#$

Page 19: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 120

Unitary operators

2-state system has 2 eigenstates called|ψ0> and |ψ1> (basis)

!"

#$%

&=!

"

#$%

&+!"

#$%

&=

!"

#$%

&=!

"

#$%

&=

1

0101

0

0

1|

1

01|,

0

10|

'

'''(

Page 20: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 121

Unitary operators continued To change the quantum world one needs

an operator, e.g. NOT

0|0

1

1

0

01

101|NOT

,1|1

0

0

1

01

100|NOT

=!"

#$%

&=!

"

#$%

&!"

#$%

&=

=!"

#$%

&=!

"

#$%

&!"

#$%

&=

One can also have non-classical gatessuch as NOT

Page 21: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 122

Universality In classical computation AND and NOT

are enough to build any circuit In quantum computing it is enough to

use a 2-qubit gate (Barenco et al)

!!!!!

"

#

$$$$$

%

&

'

'=

+

'

)cos()sin(00

)sin()cos(00

0010

0001

),,(ˆ

)(

)(

((

((()*

)()

())

ii

ii

eie

ieeA

Page 22: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 123

Fundamentals One can have quantum interference

whenever there is more than one way ofobtaining a particular result

measuring a quantum system:if the system is in eigenstate the outcome

is one of the eigenvaluesif the system is in superposition state the

result is given by

0 20 40 60 80 100

0

20

40

60

80

100

50.0

!"

=

=1

0

2

2

)|statein system(n

i

i

i

iP

#

#$

Page 23: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 124

“A good quantum calculation”

Create a superposition of registerelements

Calculate in “one shot” all functionvalues F(j)

Do something clever with all the F(j)values(Use interference to increase the amplitudes andthus probabilities of the solution states)

Page 24: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 125

Quantum entanglement (EPR)

If two systems (particles) are“Quantum correlated” one talks aboutentanglement

For entangled particles their joint stateis not factorizable as the directproduct of two simpler states

Produced by conservation of someattribute

Page 25: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 126

Teleportation

1010010...

•dissociation•information transmission•reconstitution

Page 26: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 127

Well, at least a qubit ...

Page 27: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images

Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 128

Further topics

quantum search quantum cryptography dense coding random number generation breaking unbreakable codes quantum complexity theory ...