(SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Post on 13-Apr-2017

2.162 views 0 download

Transcript of (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Images Courtesy of NASA/JPL-Caltech/Cornell

October 2015

SPOT309

Inspiring Innovation in the Cloud@ NASA/JPL and Beyond

Khawaja ShamsNoSQL Engineering, AWS

Tom Soderstrom IT CTO, JPL

Rob Witoff Director, Coinbase

1936 Suicide Squad and the first rocket test x

1943 JPL officially established

We were in the IAAS business long before Amazon

The Deep Space Network

Goldstone, USA Madrid, Spain Canberra, Australia

Amazon SWF

Decider

Data Processing Tasks

File Transfer Tasks

Decision Tasks

Data Processing Workers

EC2 EC2 EC2 EC2 S3

JPL Data Center

Decider

File Transfer Workers

Data Processing

Workers

Polyphony

AWS

Public Outreach

http://bit.ly/marsCaseStudy

Large Image Tiling

Deep Zoom Images: http://bit.ly/marsDeepZoom

http://json.jpl.nasa.gov

]

Live Demo: http://bit.ly/marsDemo

Step by Step tutorial: http://bit.ly/marsTutorial

App: Mars Images

@DrMarkPowell

http://bit.ly/marsApp

Mars 2020

And Beyond.

Pioneer IV

Mariner IV

Mariner 69

Mariner 10

Voyager

Galileo

Opt

ical

C

omm

unic

atio

ns

Kepler Cassini

Equ

ival

ent D

ata

Rat

e fro

m J

upite

r

1012

10-6 1960 1990 2010

Data Rates

1960 1970 1980 1990 2000 2010 2020

Giga

Mega

Kilo

1

Milli

Micro

*normalized from Jovian Distance

Power of Cloud Computing

Differences in Carbon Dioxide

Orbiting Carbon Observatory-2 (OCO-2) satellite

RADAR as an instrument

Christ Church Earthquake New Zealand February, 2011

from radar data acquired 3 days after earthquake

zone map released 4 months after earthquake

SWOT Surface Water Ocean Topography

NISAR NASA-ISRO Synthetic Aperture Radar

Power of Cloud Computing

Lessons Learned for Scientific Computing

1. Our Data Travels Too Much

Lessons Learned for Scientific Computing

2. There are great algorithms & software to be shared

Lessons Learned for Scientific Computing

The New Scientific Method to Collaborate

images

videos

files

binaries

snapshots

EC2

Amazon Elastic MapReduce

Amazon S3EC2 Machine Images

3. Everyone wants more infrastructure

Lessons Learned for Scientific Computing

“my cluster is not big enough...”- every scientist

“buying a bigger cluster is too expensive...”

- every IT department

“my queue wait time is too long...”- every scientist

“that’s the only way I can run efficiently...”- every IT department

?

a top-500 supercomputer

ready in 100 seconds

for less than $100 per hour

Jet Propulsion LaboratoryCalifornia Institute of Technology

This journey was not easy …

Our Recipe for Cloud Computing

Explore, Secure, Procure

Impact

JPL Open House

Oct 10th & 11th

4800 Oak Grove Dr Pasadena, CA

Remember to complete your evaluations!

@ksshams

Thank you!

@ksshams@robwitoff