Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures:...
Transcript of Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures:...
![Page 1: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/1.jpg)
John Doyle 道陽 Jean-Lou Chameau Professor
Control and Dynamical Systems, EE, & BioE
tech 1 # Ca
Universal laws and architectures: Theory and lessons from
brains, bugs, nets, grids, planes, docs, fire, bodies, fashion,
earthquakes, turbulence, music, buildings, cities, art, running, throwing, Synesthesia, spacecraft, statistical mechanics
![Page 2: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/2.jpg)
A minimal prologue
![Page 3: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/3.jpg)
Diverse applications
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
Tuesday
Wednesday
Thursday
Monday
![Page 4: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/4.jpg)
Diverse applications Diverse mathematics
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty
Details are not serious
![Page 5: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/5.jpg)
CDS
Diverse applications (not just engineering)
Diverse mathematics (not just “applied”)
ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty “Universal
laws and architectures”
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
![Page 6: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/6.jpg)
CDS
Diverse applications
Domain experts have “core”
interface to diverse math and tools
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
![Page 7: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/7.jpg)
CDS
Diverse mathematics
Math (not just applied) has “core” interface to diverse application drivers
ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty
![Page 8: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/8.jpg)
CDS as architecture • Architecture= “constraints that deconstrain”
– Constraint = CDS core concepts and math – Deconstraint = connections between new applications
and (also possibly new) math
• How to explain this? • Laws: Universal constraints on achievable robust
performance and efficiency • Architectures: Universal organizational strategies
to flexibly achieve what is possible • Case studies: concrete and familiar examples to
illustrate “universals” 8
![Page 9: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/9.jpg)
Core protocols
• From Architecture slides, understanding the “OS” is difficult and essential
• But term “OS” seems to confuse • Replace with “core protocols”? • Highly conserved/constrained core (knot) • Highly diverse/deconstrained edges
• What is “CDS” in this context? 9
![Page 10: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/10.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Horizontal App
Transfer
Horizontal Hardware Transfer
![Page 11: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/11.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Tradeoffs
![Page 12: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/12.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Tradeoffs = “laws?”
![Page 13: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/13.jpg)
Slow
Fast
Flexible Inflexible General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation Metabolism
Signal
Sense Motor
Prefrontal
Fast
Reflex
vision
VOR
Layered architectures
![Page 14: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/14.jpg)
OS
Horizontal App
Transfer
Horizontal Hardware Transfer
Constrained
Deconstrained
Deconstrained
Architecture = Constraints that deconstrain
![Page 15: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/15.jpg)
Horizontal Transfer
Horizontal Transfer
Constrained
Deconstrained
Deconstrained
“Hourglass” Universal architectures
![Page 16: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/16.jpg)
Con
stra
ined
Dec
onst
rain
ed
Dec
onst
rain
ed
“Bowtie”
Horizontal versus vertical is an arbitrary convention.
![Page 17: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/17.jpg)
CDS
Diverse applications (not just engineering)
Diverse mathematics (not just “applied”)
ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty “Universal
laws and architectures”
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
![Page 18: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/18.jpg)
“Pasteur’s quadrant?” (Donald Stokes)
Typically poor choice of colors and font sizes
![Page 19: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/19.jpg)
“Pasteur’s quadrant?” (Donald Stokes)
Low
High
Edison
Bohr
Practical use
Fundamental Understanding
Low
High Relative emphasis
Use inspired basic research
(Pasteur)
![Page 20: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/20.jpg)
Low
High
Edison
Pasteur Bohr
Practical use
Fundamental Understanding
Low
High
“Pasteur’s quadrant?” Redrawn
Relative emphasis
Pasteur aimed for
both
![Page 21: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/21.jpg)
Apps CDS Math
Practical use
Fundamental Understanding
![Page 22: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/22.jpg)
Later
Deep, Universal
Apps
CDS Math
Practical impact
Specific
Now
CDS’ quadrant?
Scope
![Page 23: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/23.jpg)
Later
Deep, Universal
Apps
CDS Math
Practical impact
Specific
Now
Fast
Slow
Flexible Inflexible General Special
SW Apps
OS
HW
Related but somewhat flipped
Scope
![Page 24: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/24.jpg)
Later
Deep, Universal
Apps
Math
Specific
Now
Circa 1975
Modern control theory
Practical impact
Scope
![Page 25: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/25.jpg)
Later
Deep, Universal
Apps
Math
Specific
Now
Circa 1990 Complexity science
Robust control
theory
Modern control theory
Practical impact
Scope
![Page 26: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/26.jpg)
Later
Deep, Universal
Apps
Math
Specific
Now
2014
CDS
Complexity science
Network science
Never
Nothing
Practical impact
Scope
![Page 27: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/27.jpg)
Later
Deep, Universal
Specific
Now
Complexity science
Network science
Never
Nothing
Practical impact
Scope
Humans love this corner!
![Page 28: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/28.jpg)
CMS
Later
Deep, Universal
Apps
Math
Practical impact
Specific
Now
Near future?
CDS
Complexity science
Network science
![Page 29: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/29.jpg)
Later
Deep, Universal
Apps
Math
Practical impact
Specific
Now
The dream?
CDS
Complexity science
Network science
![Page 30: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/30.jpg)
Horizontal Transfer
Horizontal Transfer
Constrained
Deconstrained
Deconstrained
Universal architectures
Universal laws
Fast
Slow
Flexible Inflexible General Special
SW Apps
OS
HW
![Page 31: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/31.jpg)
Slow
Fast
Flexible Inflexible General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation Metabolism
Signal
Sense Motor
Prefrontal
Fast
Reflex
vision
VOR
Layered architectures
![Page 32: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/32.jpg)
CDS
Diverse applications
“core” interface to
minimal math and tools
Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience
Morning
Universal laws and
architectures
Undergrad math
![Page 33: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/33.jpg)
CDS
Diverse mathematics
Networks, Distributed
Cutting edge theory foundations
ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty
Afternoon
![Page 34: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/34.jpg)
Later
Deep, Universal
Apps
Math
Practical impact
Specific
Now
The dream?
CDS
Complexity science
Network science
![Page 35: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical](https://reader034.fdocuments.net/reader034/viewer/2022042315/5f03a7a37e708231d40a1e69/html5/thumbnails/35.jpg)
Caveats
• Many ideas are classic “robust control”, but much of the organization (the architecture) is fairly new
• Motivating case studies also new
• Many rough edges • Nobody is working on it quite like this • We want to change that