Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community...
Transcript of Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community...
![Page 1: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/1.jpg)
DataAnalysisandWorkflowsDataONECommunityEngagement&OutreachWorking
Group
![Page 2: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/2.jpg)
ReviewoftypicaldataanalysesReproducibility&provenanceWorkflowsingeneralInformalworkflowsFormalworkflows
LessonTopics
![Page 3: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/3.jpg)
LearningObjectivesAftercompletingthislesson,theparticipantwillbeableto:
UnderstandasubsetoftypicalanalysesusedDefineaworkflowUnderstandtheconceptsinformalandformalworkflowsDiscussthebenefitsofworkflows
![Page 4: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/4.jpg)
TheDataLifeCycle
![Page 5: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/5.jpg)
DataAnalysesProcesses:
Conductedviapersonalcomputer,grid,cloudcomputingStatistics,modelruns,parameterestimations,graphs/plots,etc.
![Page 6: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/6.jpg)
TypesofAnalysesProcessing:subsetting,merging,manipulating
Reduction:importantforhigh-resolutiondatasetsTransformation:unitconversions,linearandnonlinearalgorithms
![Page 7: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/7.jpg)
TypesofAnalysesGraphicalanalyses
Visualexplorationofdata:searchforpatternsQualityassurance:outlierdetection
![Page 8: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/8.jpg)
ConventionalStatistics
ExperimentaldataExamples:ANOVA,MANOVA,linearandnonlinearregressionRelyonassumptions:randomsampling,random&normallydistributederror,independenterrorterms,homogeneousvariance
DescriptiveStatistics
ObservationalordescriptivedataExamples:diversityindices,clusteranalysis,quadrantvariance,distancemethods,principalcomponentanalysis,correspondenceanalysis
StatisticalAnalyses
FromOksanen(2011)MultivariateAnalysisofEcologicalCommunitiesinR:vegantutorial
![Page 9: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/9.jpg)
TypesofAnalysesStatisticalanalyses(continued)
Temporalanalyses:timeseriesSpatialanalyses:forspatialautocorrelationNonparametricapproachesusefulwhenconventionalassumptionsviolatedorunderlyingdistributionunknownOthermis.analyses:riskassessment,generalizedlinearmodels,mixedmodels,etc.
AnalysesofverylargedatasetsDatamininganddiscoveryOnlinedataprocessing
![Page 10: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/10.jpg)
AfterDataAnalysisRe-analysisofoutputsFinalvisualizations:charts,graphs,simulations,etc
Scienceisiterative:Theprocessthatresultsinthefinalproductcanbecomplex
![Page 11: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/11.jpg)
ReproducibilityReproducibilityatcoreofscientificmethodComplexprocess=moredifficulttoreproduce
Gooddocumentationrequiredforreproducibility
Metadata:dataaboutdataProcessmetadata:dataaboutprocessusedtocreate,manipulate,andanalyzedata
![Page 12: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/12.jpg)
EnsuringReproducibility:DocumentingtheProcess
Processmetadata:Informationaboutprocess(analysis,dataorganization,graphing)usedtogettodataoutputsRelatedconcept:dataprovenance
OriginsofdataGoodprovenance=abletofollowdatathroughoutentirelifecycleAllowsforReplication&reproducibilityAnalysisforpotentialdefects,errorsinlogic,statisticalerrorsEvaluationofhypotheses
![Page 13: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/13.jpg)
Workflows:TheBasicsFormalizationofprocessmetadataPrecisedescriptionofscientificprocedureConceptualizedseriesofdataingestion,transformation,andanalyticalstepsThreecomponents
Inputs:informationormaterialrequiredOutputs:informationormaterialproduced&potentiallyusedasinputinotherstepsTransformationrules/algorithms(e.g.analyses)
Twotypes:InformalFormal/Executable
![Page 14: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/14.jpg)
InformalWorkflowsInputsoroutputsincludedata,metadata,orvisualizationsAnalyticalprocessesincludeoperationsthatchangeormanipulatedatainsomewayDecisionsspecifyconditionsthatdeterminethenextstepintheprocessPredefinedprocessesorsubroutinesspecifyafixedmulti-stepprocess
![Page 15: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/15.jpg)
InformalWorkflowsWorkflowdiagrams:Simplelinearflowchart
Conceptualizinganalysisasasequenceofstepsarrowsindicateflow
![Page 16: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/16.jpg)
InformalWorkflowsFlowCharts:simplestformofworkflow
![Page 17: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/17.jpg)
InformalWorkflowsFlowcharts:simplestformofworkflow
TransformationRules
???Thesestepsareknowninworkflowsas“transformationrules”.Transformationrulesdescribewhatisdoneto/withthedatatoobtaintherelevantoutputsforpublication.
![Page 18: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/18.jpg)
InformalWorkflowsFlowcharts:simplestformofworkflow
InputsandOutputs
???Nowwefocusontheactualdata.TheInputs&outputsofthisworkflowareshownhereinred.Thefirstinputsaretherawtemperature&salinitydata.TheseareimportedintoR.TheoutputofthisprocessisthedatainRformat.ThatdatainRformatthenbecometheinputforthequalitycontrolanddatacleaningstep.Theoutputofthisstepis“clean”temperatureandsalinitydata,whichisthentheinputfortheanalysisstep.Theoutputoftheanalysisstepisthesummarystatistics,suchasmeanandstandarddeviationbymonth.Thesearesubsequentlytheinputsforthevisualizationstep.
![Page 19: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/19.jpg)
InformalWorkflowsWorkflowdiagrams:addingdecisionpoints
![Page 20: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/20.jpg)
InformalWorkflowsWorkflowdiagrams:asimpleexample
![Page 21: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/21.jpg)
InformalWorkflowsWorkflowdiagrams:acomplexexample
![Page 22: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/22.jpg)
InformalWorkflowsCommentedscripts:bestpractices
Well-documentedcodeiseasiertoreview,share,enablesrepeatedanalysisAddhigh-levelinformationatthetop
Projectdescription,author,dateScriptdependencies,inputs,andoutputsDescribesparametersandtheirorigins
NoticeandorganizesectionsWhathappensinthesectionandwhyDescribedependencies,inputs,andoutputs
Construct“end-to-end”scriptifpossibleAcompletenarrativeRunswithoutinterventionfromstarttofinish
![Page 23: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/23.jpg)
Formal/ExecutableWorkflowsAnalyticalpipelineEachstepcanbeimplementedindifferentsoftwaresystemsEachstep&itsparameters/requirementsformallyrecordedAllowsreuseofbothindividualstepsandoverallworkflow
![Page 24: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/24.jpg)
Formal/ExecutableWorkflowsBenefits
SingleaccesspointformultipleanalysesacrosssoftwarepackagesKeepstrackofanalysisandprovenance:enablesreproducibility
Eachstep&itsparameters/requirementsformallyrecordedWorkflowcanbestoredAllowssharingandreuseofindividualstepsoroverallworkflow
AutomaterepetitivetasksUseacrossdifferentdisciplinesandgroupsCanrunanalysesmorequicklysincenotstartingfromscratch
![Page 25: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/25.jpg)
Formal/ExecutableWorkflowsExample:KeplerSoftware
Open-source,free,cross-platformDrag-and-dropinterfaceforworkflowconstructionSteps(analyses,manipulationsetc)inworkflowrepresentedby“actor”ActorsconnectfromaworkflowPossibleapplications
TheoreticalmodelsorobservationalanalysesHierarchicalmodelingCanhavenestedworkflowsCanaccessdatafromweb-basedsources(e.g.databases)
Downloadsandmoreinformationatkepler-project.org
![Page 26: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/26.jpg)
Formal/ExecutableWorkflowsExample:KeplerSoftware
![Page 27: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/27.jpg)
Formal/ExecutableWorkflowsExample:KeplerSoftware
![Page 28: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/28.jpg)
Formal/ExecutableWorkflowsExample:KeplerSoftware
![Page 29: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/29.jpg)
Formal/ExecutableWorkflowsExample:VisTrails
OpensourceWorkflowandprovenancemanagementsupportGearedtowardexploratorycomputationaltasks
CanmanageevolvingSWFMaintainsdetailedhistoryaboutstepsanddata
www.vistrails.org
![Page 30: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/30.jpg)
WorkflowsinGeneralScienceisbecomingmorecomputationallyintensiveSharingworkflowsbenefitsscience
ScientificworkflowsystemsmakedocumentingworkflowseasierMinimally:documentyouranalysisviainformalworkflowsEmergingworkflowapplications(formal/executableworkflows)will
Linksoftwareforexecutableend-to-endanalysisProvidedetailedinfoaboutdata&analysisFacilitatere-use&refinementofcomplex,multi-stepanalysesEnableefficientswappingofalternativemodels&algorithmsHelpautomatetedioustasks
![Page 31: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/31.jpg)
BestPracticesforDataAnalysisScientistsshoulddocumentworkflowsusedtocreateresults
DataprovenanceAnalysesandparametersusedConnectionsbetweenanalysesviainputsandoutputs
Documentationcanbeinformal(e.g.flowcharts,commentedscripts)orformal(e.g.Kepler,VisTrails)
![Page 32: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/32.jpg)
SummaryModernscienceiscomputer-intensive
Heterogeneousdata,analyses,softwareReproducibilityisimportantWorkflows=processmetadataUseofinformalorformalworkflowsfordocumentingprocessmetadataensuresreproducibility,repeatability,validation
![Page 33: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/33.jpg)
ResourcesforDataAnalysis&Workflows1. W.MichenerandJ.Brunt,Eds.EcologicalData:Design,ManagementandProcessing.(Blackwell,NewYork,2000).
![Page 34: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/34.jpg)
Thefullslidedeckmaybedownloadedfrom:http://www.dataone.org/education-modules
Suggestedcitation:DataONEEducationModule:AnalysisandWorkflows.DataONE.RetrievedOctober262016.Fromhttp://www.dataone.org/sites/all/documents/L9_AnalysisWorkflows.pptx
Copyrightlicenseinformation:Norightsreserved;youmayenhanceandreuseforyourownpurposes.WedoaskthatyouprovideappropriatecitationandattributiontoDataONE.
![Page 35: Data Analysis and Workflows - GitHub Pages€¦ · Data Analysis and Workflows DataONE Community Engagement & Outreach Working Group. Review of typical data analyses Reproducibility](https://reader030.fdocuments.net/reader030/viewer/2022040412/5f03eb297e708231d40b6a36/html5/thumbnails/35.jpg)