Experimenting a cloud based solution for image processing and data access

20
Jérôme GASPERI GSCB - Cloud Computing Workshop Toulouse - 29 february 2012 EXPERIMENTING A CLOUD BASED SOLUTION FOR IMAGE PROCESSING AND DATA ACCESS

Transcript of Experimenting a cloud based solution for image processing and data access

Page 1: Experimenting a cloud based solution for image processing and data access

Jérôme GASPERI

GSCB - Cloud Computing Workshop

Toulouse - 29 february 2012

EXPERIMENTING A CLOUD BASED

SOLUTION FOR IMAGE PROCESSING

AND DATA ACCESS

Page 2: Experimenting a cloud based solution for image processing and data access

?

Page 3: Experimenting a cloud based solution for image processing and data access

host build consumeIAAS PAAS SAAS

Page 4: Experimenting a cloud based solution for image processing and data access

host build consumeIAAS PAAS SAAS

Page 5: Experimenting a cloud based solution for image processing and data access

Private or Public ?

Page 6: Experimenting a cloud based solution for image processing and data access

Public clouds have some serious issues...

Page 7: Experimenting a cloud based solution for image processing and data access

Data costs you money evenif you do not use them

Page 8: Experimenting a cloud based solution for image processing and data access

process 1 €

store 5 €

access 0.5 €

to

+

1 time

per year

each time

(Very) approximative computations for a 20x20 km PA+XS Pleiades product - based on Amazon EC2 and S3 pricings

Page 9: Experimenting a cloud based solution for image processing and data access

The majority of cloud providers are companies subject to the USA Patriot Act law

Page 10: Experimenting a cloud based solution for image processing and data access

Cloud providers mainly rely on proprietary or non standardized solution. This is a major

concern for development portability

Page 11: Experimenting a cloud based solution for image processing and data access

...so we go private !

Page 12: Experimenting a cloud based solution for image processing and data access

(Ideal) use case

Page 13: Experimenting a cloud based solution for image processing and data access

A cloud infrastructure to store raw data imagery, process to orthorectified level and provide access to full resolution products

Page 14: Experimenting a cloud based solution for image processing and data access

Real use case

Page 15: Experimenting a cloud based solution for image processing and data access

OpenStack on a small cloud (20 processors) storing SRTM tiles - Two steps processing chain, using OTB and including hill shading followed by spherical mercator reprojection ("Google") - Results tiled and accessed through WMS protocol

* ORFEO Tool Box - http://orfeo-toolbox.org

*

Page 16: Experimenting a cloud based solution for image processing and data access

Video

Page 17: Experimenting a cloud based solution for image processing and data access

OpenStack is a promising solution supported by several major IT actors

Page 18: Experimenting a cloud based solution for image processing and data access

The deployment of and existing processing chain is straightforward

Page 19: Experimenting a cloud based solution for image processing and data access

Accessing Cloud Storage from computing instances remains an issue since http paradigm

is incompatible with "filesystem like" tasks

Page 20: Experimenting a cloud based solution for image processing and data access

...Thanks Merci شكرا Grazie Danke Gracias

tak Спасибо תודה ačiū eskerrik asko ध"यवादobrigado 谢谢 Thanks Merci شكراGrazie

Danke Gracias tak Спасибо תודה ačiū eskerrik asko ध"यवाद obrigado 谢谢 Thanks

Merci شكرا Grazie Danke Gracias tak

Спасибо תודה ačiū eskerrik asko ध"यवाद