Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

30
Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011

Transcript of Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Page 1: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Condor and Distributed Computing

David Ríos

CSCI 6175Fall 2011

Page 2: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Why are we going to spend 25 minutes on Condor?

Page 3: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 4: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 5: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

What is Condor?

Page 6: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 7: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Who can benefit from Condor?

• Movie and Film Industry• Software Industry• Investment Brokerage Firms• Genome Research Firms• Engineering Firms• Electronics Design and Manufacturing• Anyone!

Page 8: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

US Air Force

• March 2011• Cluster of 1,716

PS3s

Page 9: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 10: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

High Throughput (Condor Strength)

Page 11: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Opportunistic Computing (Condor Strength)

Page 12: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Speed of Job Completion

Page 13: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Performance

Page 14: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Planning vs. Scheduling

Page 15: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 16: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Flexibility

Page 17: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Let Communities Grow Naturally

Page 18: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Leave the owner in control, no matter what the cost

Page 19: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Plan Without Being Picky

Page 20: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Lend and Borrow

Page 21: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 22: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Condor at Work

Page 23: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Basic Condor Pool

Page 24: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Condor Cluster Environment

Page 25: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Physical Condor Cluster

Page 26: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 27: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Evolution of Condor

Page 28: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Condor-G

• The Globus Project• Interface for batch execution• GRAM protocol (Grid Resource Access

Management)

Page 29: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

Archer

• Virtual Machine

• Condor is installed on VM

• Fast deployment

• Expertise not required

Page 30: Condor and Distributed Computing David Ríos CSCI 6175 Fall 2011.

What we discussed today…

• Why Condor is important to you• What is Condor• Who can benefit from Condor• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor