Download - Apache Airavata Cloud Integration

Transcript
Page 1: Apache Airavata Cloud Integration

Apache Airavata Cloud IntegrationHeshan Suriyaarachchi

Page 2: Apache Airavata Cloud Integration

Outline

● Airavata EC2 Integration

● Airavata Platform As A Service (PAAS)

Page 3: Apache Airavata Cloud Integration

Airavata EC2 Integration

Page 4: Apache Airavata Cloud Integration

Amazon EC2 Integration

● Instance management ● EC2 job submissions

● S3 file transfer

● Workflow composition

Page 5: Apache Airavata Cloud Integration

Instance Management

Page 6: Apache Airavata Cloud Integration

Instance Management ...

Page 7: Apache Airavata Cloud Integration

Airavata Architecture

Page 8: Apache Airavata Cloud Integration

Solution Architecture

Page 9: Apache Airavata Cloud Integration

Architecture - Main Components

● EC2 Provider

● Cloud Scheduler

● Scheduling algorithms

● Extension points

Page 10: Apache Airavata Cloud Integration

Success Stories - BioVLab

● MicroRNAs, play critical roles in developmental biology and the etiology of numerous diseases, including cancer.

● Ability to conduct genome-wide microRNA-mRNA (gene) integration currently requires sophisticated, high-end informatics tools

Page 11: Apache Airavata Cloud Integration

BioVLab Workflow

Page 12: Apache Airavata Cloud Integration

BioVLab Workflow - Result

Page 13: Apache Airavata Cloud Integration

Why BioVLab use Airavata?

● Easily modifiable by graphic icons in workflow.

● On-demand use of cloud resources.

● Distributed orchestration is supporting complex and long running workflows asynchronously.

Page 14: Apache Airavata Cloud Integration

Why BioVLab use Airavata ...?

● Reduces the burden on the user.

● User only has to focus on the real application rather than the infrastructure.

● Instance management through a GUI.

Page 15: Apache Airavata Cloud Integration

Airavata Platform As A Service (PAAS)

Page 16: Apache Airavata Cloud Integration

Why ?

● Who uses Airavata?

● Users from different technical backgrounds

● Installing and configuring VMs

● Troubleshooting issues on VMs

Page 17: Apache Airavata Cloud Integration

Why ... ?

● Not following the documented steps

● Issues in setting up environment

● User not being able to diagnose the issues at their end on their own

● Security policies at client's firewall

Page 18: Apache Airavata Cloud Integration

Solution

● Airavata Deployment Studio (ADS)

● FutureGrid

● One button configurable deployment○ OpenStack, EC2, Eucalyptus

○ Ubuntu, CentOS, Redhat

○ X86, 64-bit

○ Airavata 0.6

Page 19: Apache Airavata Cloud Integration

ADS Sneak Peak

Page 20: Apache Airavata Cloud Integration

ADS Sneak Peak ...

Page 21: Apache Airavata Cloud Integration

Advantages

● One button install

● Deploying on various Cloud Platforms

● Ease of use and evaluation

● ADS on demand

Page 22: Apache Airavata Cloud Integration

Interested?

● http://airavata.apache.org/

[email protected]

[email protected]

Page 23: Apache Airavata Cloud Integration

References

● Airavata EC2 Integration ○ http://tinyurl.com/lnstu7m○ http://tinyurl.com/jvhqocv○ http://tinyurl.com/mvsg7f9

● Airavata Deployment Studio (ADS) http://tinyurl.com/l22fxyn, http://tinyurl.com/mnods6c

● BioVLab project http://tinyurl.com/kralcu8

● FutureGrid https://portal.futuregrid.org/

Page 24: Apache Airavata Cloud Integration

Acknowledgement

● Marlon Pierce

● Suresh Marru

● Gregor von Laszewski

● Science Gateways Group & Apache Airavata community

Page 25: Apache Airavata Cloud Integration

Thank you !