Slide 1Slide 1

Custom Templates for Reusable Composition of Data-intensive Application Workflows

Presenter: Prasad Calyam

Team: Ronny Bazan Antequera (PhD Student), Saptarshi Debroy (PostDoc/CI Engineer)

September 2015

NSF Award #1440582, “CC*IIE Engineer: Exploration of Roles and Tools to Fulfill Diverse Researcher Needs in Collaborative Environments”

Slide 2

Distributed/Federated Resource Management Need

• Data-intensive applications in biosciences, geosciences and imaging demand advanced cyberinfrastructure technologies

Slide 3

CI Engineer Challenge

• To compose repeatable/reusable custom templates for resource provisioning and service composition– Should satisfy diverse user and

application specific needs– Should be provisioned fast, and

easily monitored/managed

Requirements and Resource abstractions need to be matched

Slide 4

User Questionnaire for “Right” Resource Provisioning

Slide 5

Our Approach (Work in Progress)

• We are building a “Custom Template Catalog” to automate resource provisioning of workflows– Soybean Knowledge Base utilizing MU & iPlant (SoyKB), Simulation-as-

a-Service for Advanced Manufacturing utilizing GENI (SMaaS), …– Complements research in: (a) FutureCloud e.g., RSpecs/Workflows, (b)

OASIS Topology & Orchestration Spec. for Cloud Apps (TOSCA)

Slide 6

User Expectation of CI Engineer “Magic”!

• “What do my options cost?”• “How to connect to my

resources?”• “How to check my environment

is working correctly?”• …

Slide 7

CI Personalization Service - Workflow

ResearcherFederated IAM

Resource ManagementReal-time Monitoring Resource Discovery/Reservation

Application Questionnaire

CI Engineer

1 2 3

4

56

7

8

Custom Template Catalog

Slide 8

Our Work Summary and Discussion

• Data-intensive applications need distributed resource provisioning and benefit from advanced CI technologies– We are creating user questionnaire and resource abstractions

for CI Engineer to maintain a “Custom Template Catalog”

• CI Engineer needs to engage users and satisfy diverse QoS expectations, and provide cost-effective solutions– We are implementing a “CI personalization service” that allows

for repeatable and reusable custom templates

What are your efforts to deliver advanced CI services that are easy-to-use and cost-effective for domain science users?

(i.e., how are you making a CI Engineer job easier?! )