The research leading to these results is partially supported by the European Community's Seventh...

28
The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007- 2013) under grant agreement n° 215605. Cloud Computing The Dawn of a New [Computing] Era ? Benny Rochwerger IBM Haifa Research Lab.

Transcript of The research leading to these results is partially supported by the European Community's Seventh...

Page 1: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 215605.

Cloud ComputingThe Dawn of a New [Computing] Era ?

Benny Rochwerger

IBM Haifa Research Lab.

Page 2: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy2 www.reservoir-fp7.eu

A new era …

Page 3: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy3 www.reservoir-fp7.eu

YlvaS @ flickr

Once upon a time …

Page 4: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy4 www.reservoir-fp7.eu

Page 5: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy5 www.reservoir-fp7.eu

Internet radio take 1

Page 6: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy6 www.reservoir-fp7.eu

Page 7: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy7 www.reservoir-fp7.eu

Value added for the content [service] provider: Listed in portal Cross reference in similar stations

Recommendation based on people’s taste Increased reach

Page 8: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy8 www.reservoir-fp7.eu

Internet radio take 1

Page 9: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy9 www.reservoir-fp7.eu

Internet radio take 2 - Hosted

Anyone can become a broadcaster Infrastructure provider deals with scalability, availability,

licensing, etcAnalogue to Cloud Computing

Broadcasters [developers] provide music [applications] Cloud Computing provider puts the infrastructure and charges

per useFirst step towards “democratization” of services

Whoever has content can distribute/benefit from it Still the infrastructure provider business is a “big guys game”

“… only a select group of cloud-wielding Internet giants has had the resources to scoop up huge masses of information and build businesses upon it …”

“… Humanity emits the data, and a handful of companies — the likes of Google, Yahoo!, or Amazon.com — transform the info into insights, services, and, ultimately, revenue …”

“… And they [Google] add on new clusters — four new data centers this year alone, at an average cost of $600 million apiece …”

From Google and the wisdom of clouds, by Steven Baker - BusinessWeek.com

Page 10: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy10 www.reservoir-fp7.eu

Why Cloud Computing ?

• Innovative business models require a utility-like intelligent infrastructure that embraces complexity to be successful in the competitive, fast-paced, services-based global economy. – ECONOMICS: Small up front investment and can be billed by

consumption. Reduction of TCO allows clients to pursue operational efficiency and productivity.

– RISK MANAGEMENT: Small up front commitment allows clients to try many new services faster and choose. This reduces big failure risks and allows clients to be innovative.

– TIME TO MARKET: Adopt new services quickly for pilot usages and scale quickly to global scale.

– INFORMATION SOCIETY: Value-added information generated by collection and analysis of massive amounts of unstructured data.

– UBIQUITOUS SOCIETY: Accessible via a heterogeneous set of devices (PC, phone, telematics..)

Because it makes sense !!!

SaaS PaaS IaaS

Page 11: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy11 www.reservoir-fp7.eu

Why now ?

• Broadband networks• Adoption of Software as a Service

– Salesforce.com

– Web 2.0 mindset

• Fast penetration of virtualization technology for x86-based servers – Virtual appliances

– General purpose on-line virtual machines that can do anything

Page 12: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy12 www.reservoir-fp7.eu

Is it really new ?

• Massive scale resource sharing over the Internet

• Sound a lot like grid computing, yet …

Grid• Highly specialized

resources that need to

be shared by thousands

[researchers]• Large data sets• Sharing is a goal• In many cases, providers

are also consumers • Interoperable by design

Cloud• Reducing CAPEX, OPEX,

time to market• Millions of users that

share to save not for the

sake of sharing• Providers want market

share and customer lock-

in• Need for interoperability

driven by customers

Page 13: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy13 www.reservoir-fp7.eu

Internet radio take 2 - Hosted

Page 14: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy14 www.reservoir-fp7.eu

Internet radio take 3 - Federated

Page 15: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy15 www.reservoir-fp7.eu

Internet radio take 3 - Dynamic“… Unfortunately, at least to date, the methods used to achieve these goals in today’s commercial clouds have not been open and general purpose, but instead been mostly proprietary and specialized for the specific internal uses (e.g., large-scale data analysis) of the companies that developed them. The idea that we might want to enable interoperability between providers (as in the electric power grid) has not yet surfaced. Grid technologies and protocols speak precisely to these issues, and should be considered…”

“…will move towards a mix of microproduction and large utilities, with increasing numbers of small-scale producers (wind, solar, biomass, etc., for energy; for computing, local clusters and embedded processors—in shoes and walls?) co-existing with large-scale regional producers, and load being distributed among them dynamically …”

From There’s Grid in then thar Clouds - Ian Foster

Page 16: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy16 www.reservoir-fp7.eu

Cloud Computing:A style of computing where massively scalable IT-enabled

capabilities are delivered as a service to external customers

using Internet technologies.

Premise:No single cloud can create a seemingly infinite

infrastructure capable of serving massive amounts of users

at all times, from all locations

RESERVOIR:Investigate technologies for advanced Cloud Computing

Focus on technologies that enable to build a

federation of cooperating computing clouds

Page 17: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy17 www.reservoir-fp7.eu

My Partner Cloud

Federation of cooperating clouds

My Private Cloud

A Public Cloud

Page 18: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy18 www.reservoir-fp7.eu

Federation of cooperating clouds

My Partner Cloud

My Private Cloud

A Public Cloud

Page 19: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy19 www.reservoir-fp7.eu

Federation of cooperating clouds

My Partner Cloud

My Private Cloud

A Public Cloud

Page 20: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy20 www.reservoir-fp7.eu

Federation of cooperating clouds

My Partner Cloud

My Private Cloud

A Public Cloud

Page 21: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy21 www.reservoir-fp7.eu

Federation of cooperating clouds

My Partner Cloud

My Private Cloud

A Public Cloud

Page 22: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy22 www.reservoir-fp7.eu

My Partner Cloud

My Private Cloud

Federation of cooperating clouds

A Public Cloud

Page 23: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy23 www.reservoir-fp7.eu

The pillars of CC (according to RESERVOIR)

• Separation– Cloud computing providers lease resources on pay-per-use basis but do not

expose infrastructure details to customers or partners– Cloud computing consumers use leased resources without exposing details

of their applications to providers• Isolation

– Given the hosting nature of cloud computing providers, consumers need mechanisms and warranties that their application are isolated from others that are being hosted in the same infrastructure

• Elasticity– Cloud computing providers should automatically adjust the resources

allocated to a particular application according to “elasticity rules” provided by cloud computing consumer

• Federation– To overcome the finite amount of resources available locally, cloud computing

providers should be able to collaborate among themselves and share their resources

Page 24: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy24 www.reservoir-fp7.eu

Where all of this is going …

http://www.anl.gov/Media_Center/logos22-1/electricity.htm

The US National Power Grid

http://www.rootsweb.com/~nytigs/BurdenPayrollRecords.htmThe Burden Iron Works Water Wheel

http://ieee-virtual-museum.org/collection/event.php?id=3456876The Pearl Street Station

http://www.by-star.net/techspeak/datacenter/

http://www.smcplus.com/applications.asp?id=32http://www.informationweek.com/galleries/showImage.jhtml?galleryID=62&imageID=13

Google @ The Dulles, OR

Efficient Distribution

Page 25: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy25 www.reservoir-fp7.eu

http://www.wired.com/wired/archive/13.05/solar.html?pg=1&topic=solar&topic_set=

Where all of this is going …

Page 26: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy26 www.reservoir-fp7.eu

http://www.pcworld.com/article/155933/ps3_black_hole.html?tk=rss_news

http://www.wired.com/techbiz/it/news/2007/10/ps3_supercomputer

Where all of this is going …

Page 27: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy27 www.reservoir-fp7.eu

Five computers ?"I think there is a world market for about five computers"

– Attributed to Thomas J. Watson, IBM

“… In a sense, says Yahoo Research Chief Prabhakar Raghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …”

– Steven Baker, From Google and the wisdom of clouds

“… The World Wide Web is becoming ONE vast, programmable machine. As NYU's Clay Shirky likes to say, Watson was off by four …”

– Nicholas Carr, From Wired Magazine Q&A with Nicholas Carr

Page 28: The research leading to these results is partially supported by the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement.

March 2-6, 2009 OGF 25/EGEE User Forum, Catania Italy28 www.reservoir-fp7.eu

A new era … some things never change