NOAA Satellite Products, Data Access and Direct Readout Overvie · 2020. 5. 4. · • Overview of...
Transcript of NOAA Satellite Products, Data Access and Direct Readout Overvie · 2020. 5. 4. · • Overview of...
Department of Commerce // National Oceanic and Atmospheric Administration // 1
Satellite and
Information
Service
NOAA Satellite Products, Data Access and Direct Readout Overview
Natalia Donoho, (Physical Scientist/Program Manager)
AOMSUC-10
Melbourne, Australia
4 December, 2019
Department of Commerce // National Oceanic and Atmospheric Administration // 2
Smoke from Australian wildfires
GOES-17 GeoColor – 14 November, 2019Courtesy: CIRA
S-NPP VIIRS – 8 November, 2019
Department of Commerce // National Oceanic and Atmospheric Administration // 3
• Overview of OSPO and NOAA Satellites
• Data Access and Distribution
• Direct Broadcast Overview• GOES-R Series GOES Rebroadcast (GRB) and User Group
• High Rate Information Transmission/ Emergency Managers
Weather Information Network (HRIT/EMWIN) and User Group
• High Rate Data (HRD) Broadcast and User Group
• Product Distribution and Access (PDA)
• Data Archive - CLASS
• NOAA Big Data Project - Cloud
• Websites and Other resources
Outline
Department of Commerce // National Oceanic and Atmospheric Administration // 4
• NOAA NESDIS Office of Satellite and Product Operations
• Performs command and control of United States operational
weather satellites
• Operates ground sites for command and control; and for data
acquisition and retransmission
• Produces derived products from satellite observations and
distributes those products to authorized users in near real-
time or to the archive for use by the scientific community
Satellite and Product Operations (OSPO)
Department of Commerce // National Oceanic and Atmospheric Administration // 5
Operates the Nation’s 16 environmental satellites:
• 4 Geostationary (GOES) by NOAA
• 2 Joint Polar Satellite Systems by NOAA + NASA
(NOAA-20, Suomi-NPP)
• 3 Polar-Orbiting (POES) by NOAA
• 5 Defense Meteorological Satellite program (DMSP)
operated by NOAA
• 1 OSTM Jason-3 (Ocean Surface Topography Mission)
- Joint NOAA, NASA, CNES, EUMETSAT effort
• 1 DSCOVR (Deep Space Climate Observatory) by
NOAA
Office of Satellite and Product Operations
Department of Commerce // National Oceanic and Atmospheric Administration // 6
Current GOES Constellation
GOES-15 to continue tandem GOES-West operations through December, 2019 and then transition to
on-orbit storage
GOES-T (GOES-18) scheduled for launch on or before FY2022 and after post-launch checkout will
transition to on-orbit storage
Department of Commerce // National Oceanic and Atmospheric Administration // 7
• The entire portfolio of GOES-16 and
GOES-17 level 1b products from all
12 instruments are validated at
provisional
• All data are available via GRB, PDA &
CLASS (terrestrial subscription
access), except for EUV which awaits
bias and dark counts temperature
correction due no later than end of
Spring 2020
• Validation Artifacts & READMEs: https://noaasis.noaa.gov/GOES/product_quality.html
16 17
GOES-16 and GOES-17 L1b Products
Department of Commerce // National Oceanic and Atmospheric Administration // 8
Baseline ABI L2 Products
23 of 24 ABI level 2 products are
validated at provisional
1 remaining product (Snow Cover)
is due in February 2020
Full Validation dates are in 2021 for
GOES-16 and 2022 for GOES-17
Enterprise ABI L2 Products
“Delta” post-provisional validation
dates are for enterprise algorithm
promotions and will also include
ABI “hot period” analysis
Volcanic Ash is to-be-determined
GOES-16 and GOES-17 ABI L2 Products
Department of Commerce // National Oceanic and Atmospheric Administration // 9
Overview of GOES-R Series Data Access
Department of Commerce // National Oceanic and Atmospheric Administration // 10
Overview of GOES-R Series Data Access
Department of Commerce // National Oceanic and Atmospheric Administration // 11
GOES-R Series Products on GRB
Level 1b Products:
Radiances from the Advanced
Baseline Imager: 16 Bands; Full
Disk, CONUS, and Mesoscale
Solar imagery from the Solar
Ultraviolet Imager
Solar flux from the Extreme
Ultraviolet and X-ray Irradiance
Sensors
Energetic heavy ions from the
Space Environment In-Situ Suite
Space environment magnetic field
from the Magnetometer
Level 2 products:
Geostationary Lightning Mapper
Space Weather Products
Department of Commerce // National Oceanic and Atmospheric Administration // 12
ABI L1 Quicklooks
ABI true color
Community Satellite Processing Package
for Geostationary Data
Funded by NOAA GOES-R Program to create and distribute software to
process direct broadcast data from geostationary satellites, generating
products in real-time. Software is available at:
http://cimss.ssec.wisc.edu/csppgeo/
All software is free to download and use. Capabilities include:
– Process the GOES-16 and GOES-17 GRB data streams,
reconstructing the products that were generated on the ground
system
– Further process GOES-16/17 ABI data to generate Level 2 products
– Create high quality RGB and single band images in GeoTiff format
Department of Commerce // National Oceanic and Atmospheric Administration // 13
• 61 sites. Some sites have
more than 1 receive station
• 89 receive stations
(antennas)
GRB User Community
Department of Commerce // National Oceanic and Atmospheric Administration // 14
NOAA NWS
• Anchorage
• Ford Island, Honolulu, HI
Chilean Weather Service Easter Island
receives GOES-17
MeteoFrance generates
products from the GOES-
17 GRB in Tahiti
(Interregional
Meteorological Center)
for users in French
Polynesia
Fiji is planning to
install a GOES-17
GRB receive station
NOAA National Weather
Service (NWS) National
Centers receive GOES-16
and GOES-17
GOES-17 GRB sites
United States Navy
• FNMOC (Planned)
• JTWC (Planned)
Department of Commerce // National Oceanic and Atmospheric Administration // 15
The High Rate Information Transmission (HRIT) / Emergency Managers Weather
Information Service (EMWIN) broadcast is operational on GOES-16 and GOES-
17 with a data relay capacity of 400 Kbps
• The initial HRIT/EMWIN product offering includes:
• EMWIN products includes National Weather Service watches, warnings,
forecasts and graphics
• Copy of the GOES-DCS observations
• Environmental maritime products from National Hurricane Center
• Additional 4 km resolution GOES-15 & Himawari-8 IR/WV/Visual
Imagery (GOES-17 only)
• GOES-16 & 17 Imagery – ABI Cloud and Moisture Imagery (CMI)
converted to the 2013 CGMS Global LRIT/HRIT standard
• 2 kilometer spatial resolution ABI Full Disk Bands 2, 7, 8, 9, 13, 14
and 15 available every 30 minutes
• ABI mesoscale imagery in Bands 2, 7 and 13 available every 15
minutes (Band 2 is .5 km while Bands 7 and 13 are 2 km resolution)
HRIT/EMWIN
Department of Commerce // National Oceanic and Atmospheric Administration // 16
➢ All full disk imagery is in it’s native spatial resolution of 2 kilometers (km), in exception of
Band 2, which has been scaled down from 0.5 km to 2 km for bandwidth management.
➢ All seven full disk bands are currently available every 30 minutes, containing the :00 - :10
and :30 - :40 scan times.
➢ All meso imagery is in it’s native spatial resolution and distributed every 15 minutes.
CMI Band 2
0.86umCMI Band 7
3.9um
CMI Band 8
6.2umCMI Band 9
6.9um
CMI Band 13
10.3um
CMI Band 14
11.2um
CMI Band 15
12.3um
Scene 1 Meso
Scene 2 Meso
Scene 1 Meso
Scene 2 Meso
Scene 1 Meso
Scene 2 Meso
Visual BandIR Shortwave
Band
Mid-Upper Tropospheric
Water Vapor BandsIR Longwave Bands
Imagery Group Products
Department of Commerce // National Oceanic and Atmospheric Administration // 17
VCID
#Product Name
GOES-16
Availability
GOES-17
Availability
Frequency
(Minutes)
Priority on
Broadcast
Guaranteed
BandwidthFormat Resolution Product Status
0 Admin Text X X 60 1 72% Text Messages N/A Active and available
1 Mesoscale Imagery X X 15 1272%
HRIT/LRIT0.5km Band 2, 2km for
bands 7 and 13
Both Meso scenes active and
available
2 CMI Band 2 X X 30 7 72% HRIT/LRIT 2 km Active and available
5 GOES-15 WV Imagery X 30 - 180 13 72% LRIT 4 km Active and available until 2020
6 GOES-15 IR Imagery X 30 - 180 13 72% LRIT 4 km Active and available until 2020
7 CMI Band 7 X X 30 6 72% HRIT/LRIT 2 km Active and available
8 CMI Band 8 X X 30 8 72% HRIT/LRIT 2 km Active and available
9 CMI Band 9 X X 30 9 72% HRIT/LRIT 2 km Active and available
13 CMI Band 13 X X 30 5 72% HRIT/LRIT 2 km Active and available
14 CMI Band 14 X X 30 10 72% HRIT/LRIT 2 km Active and available
15 CMI Band 15 X X 30 11 72% HRIT/LRIT 2 km Active and available
16 G16 CMI Band 13 X 60 17 72% HRIT/LRIT 4 km Active and available
17 G17 CMI Band 13 X 60 17 72% HRIT/LRIT 4 km Active and available
20 EMWIN – High Priority X X Continuous 1 8% Text N/A Active and available
21 EMWIN - Graphics X X 15 - 60 3 8%Graphic (e.g. GIF,
JPEG)N/A Active and available
22 EMWIN – Low Priority X X Continuous 2 8% Text N/A Active and available
23 NWS Discussion Products X X Variable 14 72% Text N/A Active and available
24 NHC Maritime Graphics X X Variable 14 72%Graphic (e.g. GIF,
JPEG)N/A Active and available
25GOES-R/S Level II
Ancillary ProductsX X Variable 15 72% HRIT/LRIT 2 - 10 km Active and available
30 DCS Admin X X Continuous 4 5% DCS Formatted Text N/A Active and available
32 DCS Data X X Continuous 4 5% DCS Formatted Text N/A Active and available
60 Himawari-8 X 60 16 72% HRIT/LRIT 4 km Active and available
Virtual Channel Listing
Department of Commerce // National Oceanic and Atmospheric Administration // 18
Users are defined as a having a
complete receiving station capable of
obtaining the HRIT/EMWIN broadcast
downlink
Known HRIT/EMWIN User Community
Department of Commerce // National Oceanic and Atmospheric Administration // 19
GOES West HRIT/EMWIN User Community
RA-V HRIT/EMWIN Users
• Solomon Islands
• Tahiti
• Samoa (2)
• Tonga (2)
• Federated States of Micronesia
• Niue
• Papua New Guinea
• Kiribata
• Marshall Islands
• Fiji
• Cook Island
• Tuvalu
• Vanuatu
* 20+ receive stations are planned for the
future*
Department of Commerce // National Oceanic and Atmospheric Administration // 20
• The polar orbiting satellites in the Joint Polar Satellite System (JPSS)
constellation gather global measurements of atmospheric, terrestrial and
oceanic conditions, including sea and land surface temperatures,
vegetation, clouds, rainfall, snow and ice cover, fire locations and smoke
plumes, atmospheric temperature, water vapor and ozone
• The High Rate Data (HRD) is the S-NPP and JPSS direct broadcast.
NOAA has accounted for 47 X-band receive stations that are receiving
HRD
• The JPSS Program funded the University of Wisconsin-Madison to
install and operate a network of polar satellite receiving stations in North
America and the Pacific to deliver advanced sounder data, including
ATMS and CrIS data, to NWP centers with low latency for rapid refresh
data assimilation
• The NOAA network is part of the worldwide DBNet system coordinated
by the WMO Space Program
High Rate Data (HRD) Broadcast
Department of Commerce // National Oceanic and Atmospheric Administration // 21
HRD Sites
Department of Commerce // National Oceanic and Atmospheric Administration // 22
Production Distribution and Access (PDA)
• New subscriptions to Environmental Satellite Processing Center PDA are on hold
• PDA service is dedicated for authorized near real-time users. Other near real-time distribution services are being explored as PDA is a finite resource
• The PUSH services are available only to users with a 24x7 support desk
• Data access information is available at: http://www.ospo.noaa.gov/Organization/About/access.html
• Must be signed by the Government official responsible for the data flow on the subscriber’s end
• For existing users who contact ESPC about a problem:
▪ Make sure to say that you are a PDA user and provide our PDA user group name
▪ Provide PDA product names or exact files names for the data you are missing. The filename of the last data you received is most useful to help us pinpoint your problem quickly
Department of Commerce // National Oceanic and Atmospheric Administration // 23
Comprehensive Large Array-data Stewardship System
(CLASS)
• CLASS is NOAA's Archive and delayed-mode distribution system for
distribution of NOAA and US Department of Defense (DoD) Polar-orbiting
Operational Environmental Satellite (POES) data, NOAA's Geostationary
Operational Environmental Satellite (GOES) data, and derived data.
• CLASS is not a near real-time system and data availability is not guaranteed
• CLASS stores an average of 180 Terabytes/month of data. The total amount
of data at CLASS is almost 14 Petabytes
• Register: https://www.bou.class.noaa.gov/saa/products/user_profile
• A demonstration is available at:
https://www.class.noaa.gov/notification/demo.htm
• A tutorial is available at:
https://www.avl.class.noaa.gov/notification/pdfs/CLASS%20Data%20Access
%20Tutorial_042015.pdf
• For questions regarding access in CLASS please contact:
Department of Commerce // National Oceanic and Atmospheric Administration // 24
NOAA Big Data Project
• NOAA’s Big Data Project (BDP) is designed to facilitate public use of key
environmental datasets by providing copies of NOAA’s information in the
Cloud, allowing users to do analyses of data and extract information
without having to transfer and store these massive datasets themselves
• http://www.noaa.gov/big-data-project
• CICS-NC is a partner in the BDP and acts as a broker between NOAA
and the public cloud providers
• Links to Public Cloud Information and Datasets
▪ GOES-16/17 Data:
― Amazon Web Services
― Google Cloud Platform
― Open Commons Consortium
Department of Commerce // National Oceanic and Atmospheric Administration // 25
Big Data Program History (4/2015-5/2019)
• Cooperative Research and Development Agreements
▪ 5 separate but identical 4-year agreements (Google, IBM,
Microsoft, AWS, OCC)
• Industry provides access to NOAA’s open data to all
▪ Data storage and egress are free, are not to be sold
▪ Collaborators can monetize services based on data
▪ NOAA provides data and expertise
• Combines 3 powerful resources based on NOAA’s open data:
1. NOAA’s science and subject matter expertise
2. Industry’s data storage and access expertise
3. Cloud's scalable and on-demand processing capability
Department of Commerce // National Oceanic and Atmospheric Administration // 26
Websites\
NOAA STAR GOES Image Viewer
https://www.star.nesdis.noaa.gov/GOES/
NOAA/NESDIS Geostationary Satellite Server
https://www.goes.noaa.gov/
NOAASIS Website: https://noaasis.noaa.gov/
NOAA Centers for Environmental Information (NCEI) portal
CLASS
http://www.class.ngdc.noaa.gov/saa/products/welcome
NOAA does not control or guarantee the accuracy, relevance, timeliness, or completeness of information
contained in the non-NOAA sites. NOAA does not endorse the organizations or individuals maintaining these
sites, any views they express, or any products/services they offer
Department of Commerce // National Oceanic and Atmospheric Administration // 27
Notifications, Status, and Contacts
24/7 Help Desk [email protected]
ESPC Messages https://www.ospo.noaa.gov/Operations/messages.html
User Services [email protected]
Data Access [email protected]
Facebook https://www.facebook.com/NOAASatellites/
Twitter https://twitter.com/NOAASatellites
GOES Status https://www.ospo.noaa.gov/Operations/GOES/status.html
GOES User Information
and Documentshttps://www.ospo.noaa.gov/Operations/GOES/documents.html
Direct Services https://noaasis.noaa.gov/NOAASIS/
GRB/HRD User Group [email protected]
HRIT/EMWIN User
GNC-A User Group [email protected]
Department of Commerce // National Oceanic and Atmospheric Administration // 28
Contributors
• Jim McNitt
• Seth Clevenstine
• Matt Seybold
• Liz Kline
• Dan Lindsey
• Michelle Smith
• Mitch Goldberg
Department of Commerce // National Oceanic and Atmospheric Administration // 29
Thank you!