Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu...

29
of 29 August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research

Transcript of Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu...

Page 1: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 1

Algebraic Codes and Invariance

Madhu SudanMicrosoft Research

Page 2: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Disclaimer

Very little Algebraic Geometry in this talk!

Mainly: Coding theorist’s perspective on Algebraic and

Algebraic-Geometric Codes What additional properties it would be nice to

have in algebraic-geometry codes.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 2

Ex-

Page 3: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Outline of the talk

Part 1: Codes and Algebraic Codes Part 2: Combinatorics of Algebraic Codes

Fundamental theorem(s) of algebra Part 3: Algorithmics of Algebraic Codes

Product property Part 4: Locality of (some) Algebraic Codes

Invariances Part 5: Conclusions

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 3

Page 4: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Part 1: Basic Definitions

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 4

Page 5: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Error-correcting codes

Notation: - finite field of cardinality Encoding function: messages codewords

associated Code Key parameters:

Rate ; Distance .

Pigeonhole Principle Algebraic codes: Get very close to this limit!

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 5

Page 6: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Algorithmic tasks

Encoding: Compute given . Testing: Given , decide if ? Decoding: Given , compute minimizing [All linear codes nicely encodable, but algebraic ones

efficiently (list) decodable.]

Perform tasks (testing/decoding) in time. Assume random access to Suffices to decode , for given

[Many algebraic codes locally decodable and testable!]

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 6

Locality

Page 7: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

General paradigm: Message space = (Vector) space of functions Coordinates = Subset of domain of functions Encoding = evaluations of message on domain

Examples: Reed-Solomon Codes Reed-Muller Codes Algebraic-Geometric Codes Others (BCH codes, dual BCH codes …)

Algebraic Codes?

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 7

Reed-Solomon Codes:Domain = (subset of) Messages = (univ. poly. of deg. )Reed-Muller Codes:Domain = Messages = (-var poly. of deg. )

Algebraic-Geometry Codes:Domain = Rational points of irred. curve in Messages = Functions of bounded “order”

Page 8: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Part 2: Combinatorics Fund. Thm

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 8

Page 9: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Essence of combinatorics

Rate of code Dimension of vector space Distance of code Scarcity of roots

Univ poly of deg has roots. Multiv poly of deg has fraction roots. Functions of order have fewer than roots

[Bezout, Riemann-Roch, Ihara, Drinfeld-Vladuts]

[Tsfasman-Vladuts-Zink, Garcia-Stichtenoth]

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 9

Page 10: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Consequences

codes satisfying For infinitely many , there exist infinitely many

and codes over satisfying

Many codes that are better than random codes Reed-Solomon, Reed-Muller of order 1, AG,

BCH, dual BCH …

Moral: Distance property Algebra!

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 10

Page 11: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Part 3: Algorithmics Product property

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 11

Page 12: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Remarkable algorithmics

Combinatorial implications: Code of distance

Corrects fraction errors uniquely. Corrects fraction errors with small lists.

Algorithmically? For all known algebraic codes, above can be

matched! Why?

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 12

Page 13: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

For vectors , let denote their coordinate-wise product.

For linear codes , let

Obvious, but remarkable, feature: For every known algebraic code of distance code of co-dimension s.t. is a code of distance .

Terminology: error-locating pair for

Product property

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 13

Reed-Solomon Codes: deg poly deg poly deg poly

Page 14: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Unique decoding by error-locating pairs

Given : Find s.t. Algorithm

Step 1: Find s.t. [Linear system]

Step 2: Find s.t. [Linear system again!]

Analysis: Solution to Step 1 exists?

Yes – provided #errors Solution to Step 2 ?

Yes – Provided large enough.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 14

[Pellikaan], [Koetter], [Duursma] – 90s

Page 15: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

List decoding abstraction

Increasing basis sequence

()

[Guruswami, Sahai, S. ‘2000s] List-decoding algorithms correcting fraction errors exist for codes with increasing basis sequences.

(Increasing basis Error-locating pairs)

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 15

Reed-Solomon Codes: (or its evaluations etc.)

Page 16: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Part 4: Locality Invariances

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 16

Page 17: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Locality in Codes

General motivation: Does correcting linear fraction of errors require

scanning the whole code? Does testing? Deterministically: Yes! Probabilistically? Not necessarily!!

If possible, potentially a very useful concept Definitely in other mathematical settings

PCPs, Small-set expanders, Hardness amplification, Private information retrieval …

Maybe even in practice Aside: Related to LRCs from Judy Walker’s talk.

Focus here on more errors.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 17

Page 18: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Locality of some algebraic codes

Locality is a rare phenomenon. Reed-Solomon codes are not. Random codes are not. AG codes are (usually) not.

Basic examples are algebraic … … and a few composition operators preserve it.

Canonical example: Reed-Muller Codes = low-degree polynomials.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 18

Page 19: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

ISIT: Locality in Coding Theory 19 of 29

Message = multivariate polynomial; Encoding = evaluations everywhere.

Locality? (when ) Restrictions of low-degree polynomials to lines yield low-degree (univ.) polys. Random lines sample uniformly (pairwise ind’ly) Locality ~

Main Example: Reed-Muller Codes

June 16, 2015

Page 20: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Locality ?

Necessary condition: Small (local) constraints. Examples

has low-degree (so values on line are not

arbitrary)

Local Constraints local decoding/testing? No!

Transitivity + locality?

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 20

Page 21: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Symmetry in codes

Well-studied concept. “Cyclic codes”

Basic algebraic codes (Reed-Solomon, Reed-Muller, BCH) symmetric under affine group Domain is vector space (where ) Code invariant under non-singular affine

transforms from

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 21

Page 22: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Symmetry and Locality

Code has -local constraint + 2-transitive Code is -locally decodable from -fraction errors. 2-transitive? –

Why? Suppose constraint Wish to determine Find random s.t. ; random, ind. of

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 22

Page 23: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Symmetry + Locality - II

Local constraint + affine-invariance Local testing … specifically

Theorem [Kaufman-S.’08]: -local constraint & is -affine-invariant is -

locally testable.

Theorem [Ben-Sasson,Kaplan,Kopparty,Meir] has product property & 1-transitive 1-

transitive and locally testable and product property

Theorem [B-S,K,K,M,Stichtenoth] Such exists. ( = AG code)

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 23

Page 24: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Aside: Recent Progress in Locality - 1

[Yekhanin,Efremenko ‘06]: 3-Locally decodable codes of subexponential length.

[Kopparty-Meir-RonZewi-Saraf ’15]: -locally decodable codes w. -locally testable codes w. Codes not symmetric, but based on symmetric

codes.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 24

Page 25: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Aside – 2: Symmetric Ingredients …

Lifted Codes [Guo-Kopparty-S.’13]

Multiplicity Codes [Kopparty-Saraf-Yekhanin’10] Message = biv. polynomial Encode via evaluations of

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 25

Page 26: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Part 5: Conclusions

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 26

Page 27: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Remarkable properties of Algebraic Codes

Strikingly strong combinatorially: Often only proof that extreme choices of

parameters are feasible.

Algorithmically tractable! The product property!

Surprisingly versatile Broad search space (domain, space of

functions)

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 27

Page 28: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Quest for future

Construct algebraic geometric codes with rich symmetries. In general points on curve have few(er)

symmetries. Can we construct curve carefully?

Symmetry inherently? Symmetry by design?

Still work to be done for specific applications.

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 28

Page 29: Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.

of 29

Thank You!

August 4, 2015 SIAM AAG: Algebraic Codes and Invariance 29