Top Banner
Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford), Salil Vadhan (Harvard)
36

Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Dec 17, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Better Pseudorandom Generators from Milder Pseudorandom

Restrictions

Raghu Meka (IAS)Parikshit Gopalan, Omer Reingold

(MSR-SVC) Luca Trevian (Stanford), Salil Vadhan (Harvard)

Page 2: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Can we generate random bits?

Page 3: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Can we generate random bits?

Page 4: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Pseudorandom Generators

Stretch bits to fool a class of “test functions” F

Page 5: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Can we generate random bits?

• Complexity theory, algorithms, streaming

• Strong positive evidence: hardness vs randomness – NW94, IW97, …

• Unconditionally? Duh.

Page 6: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Can we generate random bits?

• Restricted models: bounded depth circuits (AC0), bounded space algorithms

Nis91, Bazzi09, B10, … Nis90, NZ93, INW94, …

Page 7: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

•  

Reference Seed-length

Nisan 91

LVW 93

Bazzi 09

DETT 10

DETT 10

PRGs for AC0

For polynomially small error best waseven for read-once CNFs.

Page 8: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

 

PRGs for Small-space

Reference Seed-length

Nisan 90, INW 94

Lu 01

BRRY10, BV10, KNP11, De11

For polynomially small error best waseven for comb. rectangles.

Page 9: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

This Work

PRGs with polynomial small error

Page 10: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Why Small Error?

• Because we “should” be able to

• Symptomatic: const. error for large depth implies poly. error for smaller depth

• Applications: algorithmic derandomizations, complexity lowerbounds

Page 11: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

This Work

Generic new technique: iterative application of mild random

restrictions.

1. PRG for comb. rectangles with seed .

2. PRG for read-once CNFs with seed .

3. HSG for width 3 branching programs with seed .

Page 12: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Combinatorial Rectangles

Applications: Number theory, analysis, integration, hardness amplification

Page 13: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

PRGs for Comb. Rectangles

Small set preserving volume

Volume of rectangle ~ Fraction of positive PRG points

Page 14: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Thm: PRG for comb. rectangles with seed .

PRGs for Combinatorial Rectangles

 

Reference Seed-lengthEGLNV92

LLSZ93

ASWZ96

Lu01

Page 15: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Read-Once CNFs

Each variable appears at most once

 Thm: PRG for read-once CNFs with seed .

Page 16: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

This Talk

Comb. Rectangles similar but different

Thm: PRG for read-once CNFs with seed .

Page 17: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Outline

1. Main generator: mild (pseudo)random restrictions.

2. Interlude: Small-bias spaces, Tribes

3. Analysis: variance dampening, approximating symmetric functions.

The “real” stuff happens here.

Page 18: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Random Restrictions

• Switching lemma – Ajt83, FSS84, Has86

 * * *1 100 0 0** *** *

Page 19: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

 • Problem: No strong derandomized switching lemmas.

PRGs from Random Restrictions

• AW85: Use “pseudorandom restrictions”.

* * ** *** * *

Page 20: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

* * * * * ** * * 0 0 1 0 0 00 0 0

Mild Psedorandom Restrictions

• Restrict half the bits (pseudorandomly).

* * * * * *

“Simplification”: Can be fooled by small-bias spaces.

* * *

Page 21: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Thm: PRG for read-once CNFs with seed .

Repeat Randomness:

Full Generator Construction

 

Pick half using almost k-wise

* * * * * * * *

Small-bias

* * * *

Small-bias

* *

Small-bias

 

Page 22: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Outline

1. Main generator: mild (pseudo)-random restrictions.

2. Interlude: Small-bias spaces, Tribes

3. Analysis: variance dampening, approximating symmetric functions.

Page 23: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Toy example: Tribes

Read-once CNF and a Comb. Rectangle

Page 24: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Small-bias Spaces

• Fundamental objects in pseudorandomness

• NN93, AGHP92: can sample with bits

Page 25: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Small-bias Spaces

 

• PRG with seed • Tight: need bias

Page 26: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

The “real” stuff happens here.

Outline

1. Main generator: mild (pseudo)-random restrictions.

2. Interlude: Small-bias spaces, Tribes

3. Analysis: variance dampening, approximating symmetric functions.

Page 27: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Analysis Sketch 

Pick half using almost k-wise

* * * * * * * *

Small-bias

* * * *

Small-bias

* *

Small-bias

* * * * * * * *

Uniform

 

1. Error is small2. Size reduces:

Page 28: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Main idea: Average over uniform to study “bias function”.

• First try: fix uniform bits (averaging argument)

• Problem: still Tribes

0 1 0 0 0 10 0 0

Pick half using almost k-wise

* * * * * ** * *

Analysis for Tribes

* * * * * ** * * * * * * * ** * *Pick exactly half from each clause

White = small-biasYellow = uniform

* * * * * ** * * 0 1 0 0 0 10 0 0

Page 29: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Fooling Bias Functions

• Fix a read-once CNF f. Want:

• Define bias function: False if we fixed X!

Page 30: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Fooling Bias Functions• Let

  

 

 

Page 31: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Fooling Bias Functions

   

 

 

“Variance dampening”: makes things work.

    

(Without “dampening”)

1−2−𝑤

Page 32: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Fooling Bias Functions

: ’th symmetric polynomial

• F’s fooled by small-bias• ’s decrease geometrically under uniform• No such decrease for small-bias• Conditional decrease: decrease

conditioned on a high probability event (cancellations happen)

Page 33: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Ex: If then

An Inequality for Symmetric Polynomials

Lem:

Proof uses Newton-Girard identities.

Comes from variance dampening.

Page 34: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Summary1. Main generator: mild (pseudo)-

random restrictions.

2. Small-bias spaces and Tribes

3. Analysis: variance dampening, approximating sym. functions.

PRG for RCNFs

Combinatorial rectangles similar but different

Page 35: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Open Problems

Q: Use techniques for other classes? Small-space?

•  

Page 36: Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),

Thank you

“The best throw of the die is to throw it away”

-