Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica...
Transcript of Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica...
![Page 1: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/1.jpg)
Click to edit Master title style
Click to edit Master subtitle style
1
ResearchapplicationswithNOAA’sClimateDataRecord
Program
JessicaMatthewsNovember29,2016
![Page 2: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/2.jpg)
2
NOAA’sCDRProgram
Mission:Todevelopandimplementarobust,sustainable,andscientificallydefensibleapproachtoproducingandpreservingclimaterecordsfromsatellitedata.
https://www.ncdc.noaa.gov/cdr
![Page 3: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/3.jpg)
3
WhatareCDRs?
• TheNationalResearchCouncil(NRC)definesa CDR asatimeseriesofmeasurementsofsufficientlength,consistency,andcontinuitytodetermineclimatevariabilityandchange.
• NOAAisapplyingmoderndataanalysismethodstohistoricalglobalsatellitedatatoreturnneweconomicandscientificvaluefromtherecords.
![Page 4: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/4.jpg)
4
WhyareCDRsimportant?
• Providetrustworthyinformationonhow,where,andtowhatextenttheland,oceans,atmosphereandicesheetsarechanging.
• Thisinformationwillbeusedbyenergy,waterresources,agriculture,humanhealth,nationalsecurity,coastalcommunityandotherinterestgroups.
![Page 5: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/5.jpg)
5
FundamentalandthematicCDRs
• CDRs aregroupedbyFundamental CDRs andThematic(Atmospheric,Oceanic,andTerrestrial) CDRs.
• Fundamental CDRs aresensordata(e.g.calibrated radiances,brightnesstemperatures)thathavebeenimprovedandqualitycontrolledovertime,togetherwiththeancillarydatausedtocalibratethem.
• Thematic CDRs aregeophysicalvariablesderivedfromthe FCDRs.
![Page 6: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/6.jpg)
6
CDRexamples
• Fundamental:– Brightnesstemperatures,Reflectances,Meanlayertemperatures
• Atmospheric:– Aerosolopticalthickness,Cloudproperties,Ozone,Precipitation
• Oceanic:– Seaiceconcentration,Seasurfacetemperature
• Terrestrial:– Snowcoverextent,LAI,NDVI,FAPAR
![Page 7: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/7.jpg)
7
NOAACDROperationalSpiralDevelopment
6 – BenchmarkCDR
5 – FullOperationalCDR
4 – SustainedCDR
3 – InitialOperationalCDR
2 – ResearchCDR
1 - ConceptualCDR
Ope
ratio
ns
Research
![Page 8: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/8.jpg)
8
ResearchtoOperations•Goal- TomovefromtheResearchandDevelopmentofaCDRtoInitialOperationalCapability(IOC).
• IOC- ACDRdevelopmentstateachievedwhenaCDR(includingthedataset,sourcecode anddocumentation)isscientificallydefensibleandisarchived,maintained,andmadepubliclyavailable byNOAA.Itsdatamayormaynothavebeenindependentlyreproduced.Itisnotregularlymaintainednorisitnecessarilyextendedasnewdatabecomeavailable.
• FOC- ACDRdevelopmentstatewhenaCDRwillbesystematicallyandoperationallymaintainedinacycleofcontinuousimprovement.Sourcecodeanddocumentationmeethighstandardsandresultsarereproducible.Therecordwillberoutinelyextendedasnewdatabecomeavailableortoreprocesstherecordifrecalibrateddatabecomeavailable.
R2O IOC FOC
![Page 9: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/9.jpg)
9
CDRR20ProcessDiagram1)Assess
– AssembleIPT: PI,PIAssistant,SME,PM,Ops,Archive,Access– Assesssamplesofdata,documentation,sourcecode– Developtransitionschedule
2)Prepare– PIUpdatesSourceCode(CDRPcodingstandards,README)– PICreatesDocumentation(CATBD,FlowChart,MaturityMatrix)– PIPrepsDatafordelivery(netCDFFormat,Metadata,SubmissionAgreement)
3)Transfer– PItransfersacopyoftheSourceCode,Documentation,andDatatoNCDC
4)Verify– IPTverifiesSourceCode,Documentation,andData– Iterativeprocessuntilcode,documentation,anddatameetstandards
5)Archive– NCDCpreservesacopyofSourceCode,DocumentationandDatainthearchive
6)Access– ORR,thenprovidepublicaccesstoeverythingviatheCDRaccessportal
5/30/2012 OperationalReadinessReview
• ProductDescription• ORRChecklist• Websitedemo
Codemadeavailable
Documentationmadeavailable
Productmadeavailable
6)Access
ArchiveAncillaryData
ArchiveCodePackage
ArchiveDocumentation
ArchiveProductData
5)Archive
Verify‘README’
4)Verify
VerifyDataandMetadata
KDP
OperationsBranch ArchiveBranch AccessBranchPI
CDRAssessment
1)Assess
Entercodeintoversioncontrol
2)Prepare
Data
Documents
Code
VerifyFlowDiagram,
CATBD,andMaturityMatrix
3)Transfer
TransferDocuments
Verifysourcecodepackage
ConductSecurityReview
ITBranch
CreateDocuments
CDRP
TransferData
Iterativeuntilallpartshavebeenverified
CreateData
Updatesourcecode
Submissionagreement
TransferSourcecode
IOC
ORR
CDRIPT
Science Branch
![Page 10: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/10.jpg)
10
IntegratedProductTeam
• R2OTransition– NotataskthePIdoesalone,partnershipwiththeIPT
• IPTconsistsof:– PIandanyAssistants– R2OProjectManager– InternalNCEIScientist– ArchiveBranchrepresentative– OperationsBranchrepresentative– AccessBranchrepresentative– AdditionalsupportfromIT,UserEngagement,andotherCDRPmembers
• NCEIpersonnelspend400-600hourstransitioningeachCDRtoIOC
• TypicalR2Otransitiontakestheteam8-12monthstocomplete
![Page 11: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/11.jpg)
11
CICS-NCsupportofCDRs
Science
Scientificprogramming
Stewardship
![Page 12: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/12.jpg)
12
Tropicalmonitoringandprediction
• TheMadden–JulianOscillation(MJO),equatorialRossby waves,andKelvinwavesaredominantsourcesofsynoptic-to-subseasonalvariabilityinthetropics
• Divergentcirculationsfromtheirconvectioncaninfluencetropicalcyclonesandotherweatherpatternsaroundtheglobe
• ForecastersintheenergyindustryharnesstheselongtimescalesandglobalimpactstoanticipateenergydemandintheUS
![Page 13: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/13.jpg)
13
Tropicalmonitoringandprediction
• TropicalmonitoringderivedinpartfromOutgoingLongwaveRadiationCDRdata
• 18hr lag• ForecastsfromNCEPClimate
ForecastSystem• Tropicalcyclogenesistracking• Diagnosticsusedoperationally
byNOAACPCandAirForce14th WeatherSquadron
https://ncics.org/portfolio/monitor/mjo/
![Page 14: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/14.jpg)
14
High-ResolutionNEXRADReanalysis
• Providesrainfallamountsat1-kmresolutioneveryfivemin
• Available from2000topresent• Processingstats:– 130millionradarfiles– 500kjobs– 3millionhrs CPU-time– ~1yr real-time
![Page 15: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/15.jpg)
15
High-ResolutionNEXRADReanalysis
● Israinfallassociatedwithanincrease/decreaseinfatalaccidents?
● Howdoesthisvary...- byregion?- byseason?- bytimeofday?
● Comparefrequencyofcrasheswhichtakeplaceduringtheraintothefrequencyofrainitself
● Intheabsenceofacorrelation,thesefrequenciesshouldberoughlyequal
![Page 16: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/16.jpg)
16
High-ResolutionNEXRADReanalysis
• Blue=climatologicalfrequencyofrainfall
• Red=frequencyofcrashesduringrain
• Allregionsshowahigherpercentageofrain-associatedcrashesthanwouldbeexpectedbasedonclimatology
![Page 17: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/17.jpg)
17
SeaIceConcentrationCDR
• ThePassiveMicrowaveseaiceconcentrationsareanestimateofthefractionofoceanareacoveredbyseaicemean STD
![Page 18: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/18.jpg)
18
SeaIceConcentrationCDR
• Verificationandvalidation(a)CDR-GSFC (b)CDR-BT
(c)CDR-NT (d)BT-NT
bias
biasbias
biasRMSD
RMSDRMSD
RMSD
![Page 19: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/19.jpg)
19
SeaIceConcentrationCDR
WholeArctic
CentralArctic(lightgreen) Greenland(darkgreen) HudsonBay(darkbrown)
SpatialandTemporalVariabilityofSeaIceCoverage
![Page 20: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/20.jpg)
20
Obs4MIPS
• TheObservationsforModelInter-ComparisonProject(obs4MIPs)isanefforttomakeobservationaldataavailabletotheclimatemodelingcommunityinthesameformatthattheyusetoshareclimatemodeloutputs.
• TosupportCDRdataaccess,CICS-NCcreatedatooltoconvertCDRdatatoobs4MIPscompliantformatandspecifications.
![Page 21: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/21.jpg)
21
Obs4MIPS
https://ncics.org/data/obs4mips/
OptimalInterpolationSeaSurfaceTemperature(OISST)
HIRSOutgoingLongwaveRadiation(OLR)
PassiveMicrowaveSeaIceAreaFraction
![Page 22: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/22.jpg)
22
Otherresearchhighlightedhere
• “ScientificStewardship- WhatIsItandWhatDoesItMeantoUs?”– GePeng
• “DiurnalCycleofLandSurfaceTemperaturesunderAll-skyConditions”– Anand Inamdar
• “Long-termHIRS-BasedTemperatureandHumidityProfiles”– JessicaMatthews
• “AnEvaluationofSatelliteQuantitativePrecipitationEstimates(QPEs)Products”– OlivierPrat
• “LinkingnetCDF DatawiththeSemanticWeb-EnhancingDataDiscoveryAcrossDomains”– JimBiard
![Page 23: Research applications with Click to edit Master title ... · Humidity Profiles” – Jessica Matthews • “An Evaluation of Satellite Quantitative Precipitation Estimates (QPEs)](https://reader034.fdocuments.net/reader034/viewer/2022050201/5f54f96daebf4b068d400b25/html5/thumbnails/23.jpg)
23
Summary
• NOAA’sCDRsarerobust,sustainable,andscientificallydefensible.
• CICS-NCsupportstheeffortwithscience,scientificprogramming,andstewardshipexpertise.
• Tolearnmore:https://www.ncdc.noaa.gov/cdr