Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D....

33
Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist) National Center for Genome Analysis Support

Transcript of Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D....

Page 1: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Providing National Cyberinfrastructure to Biologists, esp. Genomicists.

William K. Barnett, Ph.D. (Director)Thomas G. Doak (Manager & Domain Biologist)

National Center for Genome Analysis Support

Page 2: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

2

Lab of Mike Lynch

Page 3: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Thank YouOSG Team Rob Quick and Soichi

Hayashi

Questions?

Bill Barnett ([email protected])

Le-Shin Wu ([email protected])

Carrie Ganote ([email protected])

Tom Doak ([email protected])

[email protected]

Page 4: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

An outline:

• The science and research NCGAS addresses

• What tools and infrastructure NCGAS provides to researchers

• What is the near to mid-term future of bioinformatics research

Page 5: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Genomics

Proteomics

Transcriptomics

MetaGenomics

MetaProteomics

MetaTranscriptomics

‘omics is expanding to include everything

then Population Genomics, etc. … .

Page 6: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Cost per Genome

Page 7: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

03/23/2015 http://omicsmaps.com/

Page 8: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

8

Page 9: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Making it easier for Biologists

• Web interface to NCGAS resources

• Supports many bioinformatics tools

• Available for both research and instruction.

Common

Rare

Computational Skills

LOW

HIGH

Page 10: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Researchers must balance cost, ease, and availability.

Page 11: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

NCGAS’s primary goals:

• Provide bioinformatics expertise• Maintain a curated set applications• Provide access to HPC resources, esp.

large-memory clusters = Mason• Build Galaxy instances for our software• Pursue out-reach to biologists

Page 12: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

NCGAS is embedded in Research Technologies

12

Page 13: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

NCGAS is embedded in Research Technologies

13

Page 14: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

• 16-nodes, 500GB RAM

• 10TB project space

• Bioinformatics software

• Galaxy instance

• 50TB archive space/userWe ask that you

acknowledge our grant in any published work

that uses our resources.

Collaborations and authorship are requested for intellectual

contributions.

THE FACTS

The fine print

Page 15: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Mason and NCGAS use over time

Users

Page 16: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Mason Use

Page 17: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)
Page 18: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

CASE STUDYSuspect: Horned Dung BeetleScientific Name: Onthophagus taurus, O. sagittarius, and O. nigriventrisWanted for:Nutrition, metabolism, and horn development. Warning! Subject may be armed with horns which “vary in size, number, position on the body, and degree of sexual dimorphism”. Rapidly evolving genes in three closely related species may be implicated in the diversity of these structures. Suspects’ genomes are under current investigation for strong signals of selection.

PI: Melissa Pespeni (lab of Armin Moczek)

Page 19: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

• Our role in Melissa’s researchWe recommended assembly procedures and Unix commands – when and how to concatenate data sets together to retrieve the desired information

We wrote customized scripts to get the data in the format required by the programs requested

We troubleshot issues with

the system that were beyond

user experienceWe assisted with the data moving process and advised steps to address data corruption and failures

We added new users to project and brought them up to speed on the project and on Unix …With a smile

Page 20: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

GALAXY.NCGAS.ORG Model

Virtual box hosting Galaxy.ncgas.org

The host for each tool is configured individually

Quarry Mason

Data Capacitor

Archive

NCGAS establishes tools, hardens them, and moves them into production.

Custom Galaxy tools can be made for moving data

Individual projects can get duplicate boxes – provided they support it themselves.

Policies on the DC guarantee that untouched data is removed with time.

Page 21: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Simplify this!

Page 22: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

From our recent NSF survey:

Page 23: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

From our NSF survey:• “The biggest impediment to discovery by

biologists is the need to rely on others with knowledge of impenetrable systems and obscure acronyms to process and interpret data. Don't know how to fix this, but on some level user friendly platforms programs like Geneious more than make up for their lack of power by providing an intuitive platform that encourages free exploration and experimentation with data.”

Page 24: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)
Page 25: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

The end…

Page 26: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

Mason Use

Page 27: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

27

From our recent NSF survey:

Page 28: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

28

From our recent NSF survey:

Page 29: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

29

From our recent NSF survey:

Page 30: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

30

From our recent NSF survey:

Page 31: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

31

From our recent NSF survey:

Page 32: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

32

From our recent NSF survey:

Page 33: Providing National Cyberinfrastructure to Biologists, esp. Genomicists. William K. Barnett, Ph.D. (Director) Thomas G. Doak (Manager & Domain Biologist)

33

From our recent NSF survey: