Additive Combinatorics and Computational...
Transcript of Additive Combinatorics and Computational...
![Page 1: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/1.jpg)
Additive Combinatorics and
Computational Complexity
Luca Trevisan
U.C. Berkeley
Ongoing joint work with Omer Reingold,
Madhur Tulsiani, Salil Vadhan
![Page 2: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/2.jpg)
• Combinatorics:
– Studies: Graphs, hypergraphs, set systems
– Considers: cuts, subgraphs, intersections
– Typical question:
• max number of edges in triangle free graph
• Additive combinatorics• Additive combinatorics
– Studies: subsets of abelian groups (e.g. primes)
– Considers: properties that can be described with linear equations
– Typical question:
• largest subset of integers in {1,...,N} with no length-3 arithmetic progression
![Page 3: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/3.jpg)
• Additive number theory
– Questions about primes which can be formulated as systems of linear equations
• Does y=x+2 have infinitely many solutions in primes?
• Does x+y=2n have solutions in primes for all n>2?
• Are there infinitely many non-trivial solutions in primes to x-y=y-zy-z=z-w
![Page 4: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/4.jpg)
• Additive number theory
– Questions about primes which can be formulated
as systems of linear equations
• Some questions better approached in broader
generality, separating combinatorics and number
theorytheory
1. Under what conditions does a set of integers
possess a desired property?
2. Do the primes satisfy such conditions?
[number theory needed only here]
![Page 5: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/5.jpg)
• Additive combinatoricshas seen a confluence of
– Graph and hypergraph theory
– Analysis
– Ergodic theory
• Techniques have been applied in theoretical computer science tocomputer science to
– Property testing
– Pseudorandomness and derandomization
– PCP
– Lower bounds
– ...
![Page 6: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/6.jpg)
• Additive combinatorics
– Graph and hypergraph theory
• Regularity Lemmas -> property testing [Alon-....]
– Analysis
• Regularity Lemmas in groups -> PCP [Khot-O’Donnell]
• Gowers-Balog-Szemeredi Thm-> low-degree testing [Samorodnitsky]
• Gowers-Balog-Szemeredi Thm-> low-degree testing [Samorodnitsky]
• Gowers Uniformity -> PCP [Samorodnitsky-T], -> pseudorandomness [Bogdanov-Viola]-> direct product thms [Viola-Wigderson],. . .
– Ergodic theory
• ???
![Page 7: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/7.jpg)
• Arithmetic Combinatorics
Subsets of rings, properties defined via
addition and multiplication
– Sum-product Theorems– Sum-product Theorems
• Applications to Computer Science:
– Expanders, extractors
[Barak-Impagliazzo-Wigderson,...]
![Page 8: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/8.jpg)
• Additive (and arithmetic) Combinatorics
• What do the very different techniques have in common?
– Randomness versus structure[Terence Tao, ICM 2006 Lecture]
• Why so useful in (theoretical) computer science?
– ??
– In different language, notions of – In different language, notions of • pseudorandomness,
• indistinguishability,
• property testing,
• compact representations (sketches),
• approximation,
• worst-case analysis,
• . . .
![Page 9: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/9.jpg)
• Additive (and arithmetic) Combinatorics
http://www.cs.princeton.edu/theory/index.php/
Main/AdditiveCombinatoricsMinicourse
[Barak, Charikar, T., Wigderson]
• Google: additive combinatorics princeton
![Page 10: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/10.jpg)
In this talk
• The structure of the proof of the Green-Tao
Theorem
• A look at a key combinatorial step• A look at a key combinatorial step
• Complexity-theoretic interpretation
• New “complexity-theoretic” proofs
new results in complexity theory
![Page 11: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/11.jpg)
Green-Tao (2004)
• “The primes contain arbitrarily long arithmetic
progressions”
199, 409, 619, 829, 1039, 1249, 1459, 1669, 1879, 2089199, 409, 619, 829, 1039, 1249, 1459, 1669, 1879, 2089
![Page 12: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/12.jpg)
Green-Tao (2004)
• “The primes contain arbitrarily long arithmetic
progressions”
• Previously, two lines of attack:
The primes are dense– The primes are dense
Erdos (conj): all sets of density 1/ln N have long APs
– The primes are pseudorandom
Hardy-Littlewood (conj): primes satisfy linear
systems as often as random sets of density 1/ln N
![Page 13: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/13.jpg)
Density
• Erdos (conj): if A is set of integers such that Σ1/a
diverges, then A has long APs
[~equivalent: if A has density 1/ln N, then long APs]
• Erdos-Turan (conj, 1940s): if A has constant density, • Erdos-Turan (conj, 1940s): if A has constant density,
then A has long APs
– [Szemeredi, 1970s] density 1/log* log* N
– [Furstenberg, 1970s] density o(1)
– [Gowers, 1998-01] density 1/loglog N
![Page 14: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/14.jpg)
Pseudorandomness
• Hardy-Littlewood: take a system of linear equationse.g. y-x = z-yz-y = w-zz-y = w-z
• Then approximately as many solutions in primes as in “a random set of density 1/ln N”
• Twin primes conjecture: y-x=2
![Page 15: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/15.jpg)
Pseudorandomness
• Hopeless for now
• Strong results for “almost primes:” integers
with few, large, factorswith few, large, factors
• E.g.: y-x =2 has infinitely many solutions, x
prime, y at most two factors
![Page 16: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/16.jpg)
Green-Tao Idea
• Pseudorandomness works only for almost
primes
• Density works only for o(1) density• Density works only for o(1) density
• Combine the two
![Page 17: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/17.jpg)
Green-Tao Proof
1. Thm: primes have const density in almost primes
2. Thm: almost primes are pseudorandom
3. Thm: [Main]
if R is pseudorandom
and D has constant density in R, and D has constant density in R,
then there is M of constant density
indistinguishable from D
4. Thm: [Szemeredi] M has long APs
5. so does D
![Page 18: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/18.jpg)
{1,...,N }
Thm
There is a pseudorandom set of integers R s.t. a
constant fraction of R are primes
Primes
![Page 19: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/19.jpg)
{1,...,N }
Thm
There is a pseudorandom set of integers R s.t. a
constant fraction of R are primes
Primes
R
![Page 20: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/20.jpg)
{1,...,N }
If R is pseudorandom and D is subset, |D| > δ|R|,
then there is a model M indistinguishable from D,
|M| > δN
Primes
RM
![Page 21: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/21.jpg)
{1,...,N }
By Szemeredi's Thm, M contains k-AP
Because of indistinguishability, so does D
PrimesM
47
23 35
231117
![Page 22: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/22.jpg)
Key step
Dense Model Theorem:
• If R pseudorandom in X
and D subset of R has size > δ|R|and D subset of R has size > δ|R|
• Then there is M of size > δ|X| that is
indistinguishable from D
![Page 23: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/23.jpg)
Key step
Dense Model Theorem:
• If R is pseudorandom distribution in X
and for all x, D(x) < R(x)/ δand for all x, D(x) < R(x)/ δ
• Then there is M that is indistinguishable from D
and for all x, M(x) < 1/ δ |X|
![Page 24: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/24.jpg)
R
X
![Page 25: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/25.jpg)
DR
X
![Page 26: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/26.jpg)
DR
X
M
![Page 27: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/27.jpg)
The Green-Tao(-Ziegler) proof
D
X
R
![Page 28: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/28.jpg)
The Green-Tao(-Ziegler) proof
D
X
![Page 29: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/29.jpg)
The Green-Tao(-Ziegler) proof
DD
X
![Page 30: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/30.jpg)
The Green-Tao(-Ziegler) proof
DD
X
![Page 31: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/31.jpg)
Find partition of X:
i) blocks are large and easily recognizable; ii) D is indistinguishable from
i. - Sample z ~ Dii. - Let B be block of ziii. - Sample x ~ B
Above distribution is dense:
Pr [ x is sampled ] = Pr [ D in Bx] / |B
x|
Pr [ D in Bx] < Pr [ R in B
x] / δ
Pr[ R in Bx] < | B
x| / |X| + ε
Pr [ x is sampled ] < 1/δ|X| + ε /δ|Bx|
![Page 32: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/32.jpg)
Find partition of X: (i) blocks are large and easily recognizable; (ii) D is indistinguishable from:
- Sample z ~ D
- Let B be block of z
- Sample x ~ B
To find partition
- Start from trivial partition
- While distribution distinguishable from D
- refine partition using level sets of distinguisher
Potential function argument:
- only need poly(1/ε ,1/δ) refinement steps- upper bound on potential function
uses pseudorandomness of R
![Page 33: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/33.jpg)
Green-Tao(-Ziegler) Proof
Applies to computational setting
• R poly(ε,δ)-pseudorandom in X
against circuits of size O(S*exp(1/δ,1/ε))
• D is “δ-dense” in R• D is “δ-dense” in R
Then there is M that is ε-indistinguishable from D by
circuits of size S
Exponential loss: partition has exp many pieces
![Page 34: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/34.jpg)
New Proof
[Reingold, T., Tulsiani, Vadhan, FOCS’08]
• R poly(ε,δ)-pseudorandom in X against circuits of size O(S*poly(1/δ,1/ε))
• D is “δ-dense” in R
Then there is M that is ε-indistinguishable from D by circuits of size S
Proof using linear programming duality
Same idea independently [Gowers, 2008]
![Page 35: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/35.jpg)
New Proof
[Reingold, T., Tulsiani, Vadhan, FOCS’08]
As noted by Russell Impagliazzo, can also prove:
Suppose D is such that for every f of size S*poly(1/ δ,1/ε)
Pr[f(D)=1] < Pr[f(U)] /δ + poly(ε)Pr[f(D)=1] < Pr[f(U)] /δ + poly(ε)
Then there is M that is “δ –dense”
and ε-indistinguishable from D by circuits of size S
![Page 36: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/36.jpg)
Consequence of New Proof
[Reingold, T., Tulsiani, Vadhan, FOCS’08]
The following 3 properties of D are equivalent:
1. Domination by pseudorandom distributionthere is R indistinguishable from Usuch that for all x, D(x) < R(x)/δsuch that for all x, D(x) < R(x)/δ
2. “Pseudodensity”for all efficient f Pr[f(D)] < Pr[f(U)]/δ + ε
3. Pseudoentropy (defined by Hastad-Impagliazzo-Luby-Levin)there is M indistinguishable from D such that for all x, M(x) < U(x)/ δ = 1/(δ|X|)
![Page 37: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/37.jpg)
Consequence of New Proof
Suppose
• G: {0,1}512 -> {0,1}100,000
is a cryptographic pseudorandom generator
• D is a distribution of seeds of entropy 510 • D is a distribution of seeds of entropy 510
(e.g. two digits are fixed)
Then there is a distribution M of entropy 99,998
which is indistinguishable from G(D)
![Page 38: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/38.jpg)
New Proof
[Reingold, T., Tulsiani, Vadhan, FOCS’08; Gowers 2008]
Suppose Dense Model Theorem is false
Then there is D dense in pseudorandom R such that Then there is D dense in pseudorandom R such that for every dense model M there is a distinguisher
Then there is a distinguisher that works against all models
It can be used to distinguish R from Uniform
Contradiction
![Page 39: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/39.jpg)
Comparison with Previous Proof
[Reingold, T., Tulsiani, Vadhan, FOCS’08; Gowers 2008]
Leads to computational application with
polynomial parameters
Green-Tao-Ziegler has exponential lossGreen-Tao-Ziegler has exponential loss
The model is shown to exist non-constructively
Green-Tao-Ziegler exhibits model
Best of two worlds?
![Page 40: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/40.jpg)
Comparison with Previous Proof
Dense Model TheoremImpagliazzoHard Core LemmaHard Core Lemma
Min-max
Iterative partitioning
“boosting”
![Page 41: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/41.jpg)
The Impagliazzo Hard-Core Lemma
• Suppose g: {0,1}n -> {0,1} is
weakly hard-on-average:
for all f of size S*poly(1/ε,1/δ)
Pr[ f(x)=g(x)] < 1- δ
• Then there is dense distribution on which g is
strongly hard-on-average:
– For all x, H(x) < 1/ δ 2n is such that
– PrD[f(x) = g(x) ] < ½ + ε for all f of size S
![Page 42: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/42.jpg)
Comparison with Previous Proof
Dense Model TheoremImpagliazzoHard Core LemmaHard Core Lemma
Min-max
Iterative partitioning
“boosting”
![Page 43: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/43.jpg)
Comparison with Previous Proof
Dense Model TheoremImpagliazzoHard Core LemmaHard Core Lemma
Min-max
Iterative partitioning
“boosting”
![Page 44: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/44.jpg)
Comparison with Previous Proof
Dense Model TheoremImpagliazzoHard Core LemmaHard Core Lemma
Min-max
Iterative partitioning
“boosting”
![Page 45: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/45.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model Theorem
ImpagliazzoHard Core LemmaHard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model Theorem
![Page 46: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/46.jpg)
Ongoing work by T., Tulsiani, VadhanOngoing work by T., Tulsiani, Vadhan
![Page 47: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/47.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model Theorem
ImpagliazzoHard Core LemmaHard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model Theorem
![Page 48: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/48.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model Theorem
ImpagliazzoHard Core LemmaHard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model Theorem
Generalized SzemerediRegularity Lemma
![Page 49: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/49.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model Theorem
ImpagliazzoHard Core LemmaHard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model Theorem
Generalized SzemerediRegularity Lemma
![Page 50: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/50.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model TheoremPoly complexity
ImpagliazzoHard Core Lemma
“Constructive”Dense Model Theorempoly complexity
Hard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model TheoremExp complexity
Generalized SzemerediRegularity LemmaExponential complexity
Generalized SzemerediRegularity LemmaPoly complexity
![Page 51: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/51.jpg)
Comparison with Previous Proof
“Non-constructive”Dense Model TheoremPoly complexity
ImpagliazzoHard Core Lemma
“Constructive”Dense Model Theorempoly complexity
Hard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model TheoremExp complexity
Generalized SzemerediRegularity LemmaExponential complexity
Generalized SzemerediRegularity LemmaPoly complexity
![Page 52: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/52.jpg)
Regularity Lemma
G
![Page 53: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/53.jpg)
Regularity Lemma
G GG’
Given: dense graph G, approximation ε
Find partition of vertices into Oε(1) blocks
G is indistinguishable by cuts from graph G’ that has weighted complete bipartite subgraph between blocks
![Page 54: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/54.jpg)
Abstract Version
• Finite space X [edges of complete graph]
• g: X: -> [0,1] [graph]
• ε
• F={ f }, f: X -> [0,1] [char functions of cuts]
• Can find approximating function
A(x) = h(f1(x),…,fk(x)), k = poly(1/ε), fi() in F
• Such that for all f in F
| E f(x)g(x) – E f(x)A(x) |= < ε
![Page 55: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/55.jpg)
Abstract Version
• Finite space X [edges of complete graph]
• g: X: -> [0,1] [graph]
• ε
• F={ f }, f: X -> [0,1] [char functions of cuts]
• Can find approximating function
A(x) = h(f1(x),…,fk(x)), k = poly(1/ε), fi() in F
in standard proof, h has exp(1/ε) complexity
• Such that for all f in F
| E f(x)g(x) – E f(x)A(x) |= <f,g-A> < ε
![Page 56: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/56.jpg)
Abstract Version
• Finite space X [edges of complete graph]
• g: X: -> [0,1] [graph]
• ε
• F={ f }, f: X -> [0,1] [char functions of cuts]
• Can find approximating function
A(x) = h(f1(x),…,fk(x)), k = poly(1/ε), fi() in F
in new “boosting” proof, h has poly(1/ε) complexity
• Such that for all f in F
| E f(x)g(x) – E f(x)A(x) |= <f,g-A> < ε
![Page 57: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/57.jpg)
Rephrasing
• Finite space X = {0,1}n
• Given distribution D such that D(x) < 1/δ2n
(min-entropy > n – log 1/δ)
• There is samplable distribution M:
– Also M(x) < 1/δ2n
– M is (S,ε) indistinguishable from D
– Samplable (and computable) by circuits of size
S*poly(1/ε, 1/δ)
![Page 58: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/58.jpg)
Derive the Hard Core Lemma
• Given: g weakly hard on average
• Find efficient approximation A of g
• Easy to prove:• Easy to prove:g is very hard on average on distribution in which point x has probability proportional to |A(x) – g(x)|
• Also easy to prove direct product lemma, Yao’s XOR lemma, and other complexity result from “polynomial complexity regularity lemma”
![Page 59: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/59.jpg)
“Non-constructive”Dense Model TheoremPoly complexity
ImpagliazzoHard Core Lemma
“Constructive”Dense Model Theorempoly complexity
Hard Core Lemma
Min-maxIterative partitioning
“boosting”
“Constructive”Dense Model TheoremExp complexity
Generalized SzemerediRegularity LemmaExponential complexity
Generalized SzemerediRegularity LemmaPoly complexity
![Page 60: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/60.jpg)
Returning to big picture
• Additive combinatorics
– Graph theory
regularity lemma
– Analysis
Graph Property Testing
Pseudorandomness– Analysis
Gowers Uniformity
– Ergodic Theory
???
– Finitary Ergodic Theory
??
PseudorandomnessDirect Product TheoremsPCP
![Page 61: Additive Combinatorics and Computational Complexitytheory.stanford.edu/~trevisan/addcomb/beijing08.pdf · 2008-11-08 · • Combinatorics: – Studies: Graphs, hypergraphs, set systems](https://reader033.fdocuments.net/reader033/viewer/2022060411/5f1090607e708231d449ba82/html5/thumbnails/61.jpg)
Returning to the big picture
• Additive combinatorics
– Graph theory
regularity lemma
– Analysis
Graph Property Testing
Pseudorandomness– Analysis
Gowers Uniformity
– Ergodic Theory
???
– Finitary Ergodic Theory
??Average-case complexitypseudorandomness
PseudorandomnessDirect Product TheoremsPCP