Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

56
Lola Olsen and IDN Staff Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team

Transcript of Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Page 1: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Lola Olsen and IDN StaffLola Olsen and IDN StaffLola Olsen and IDN StaffLola Olsen and IDN Staff

CEOS WGISS 26

IDN Task Team

CEOS WGISS 26

IDN Task Team

Page 2: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

I. Introduction/Final Response to User Working Group (UWG) Recommendations

II. Usage and Content StatisticsIII. Extending Keyword VocabulariesIV. Interoperability ForumV. Climate Diagnostics Portal (CL-06-02-14)

I. Introduction/Final Response to User Working Group (UWG) Recommendations

II. Usage and Content StatisticsIII. Extending Keyword VocabulariesIV. Interoperability ForumV. Climate Diagnostics Portal (CL-06-02-14)

IDN AgendaIDN AgendaIDN AgendaIDN Agenda

Page 3: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

I. Introduction/Final Response to User Working

Group (UWG) Recommendations

I. Introduction/Final Response to User Working

Group (UWG) Recommendations

Page 4: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.
Page 5: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

II. Usage and Content StatisticsII. Usage and Content Statistics

Page 6: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

DIF Population Growth(February 2004 - August 2008)

Approaching 20,000!

Page 7: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

SERF Population Growth(February 2004 - August 2008)

Approaching 2,000!

Page 8: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

New, Updated, and Deleted DIFs(January 2007 - August 2008)

Updates coincide with internal release of Link Editor in 2008

NCDC AADC

LSI

Page 9: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

New and Updated Platforms and Instruments

(January 2007 - August 2008)

AGU

Expanded Platform and Instrument Descriptions

LSI

Page 10: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

DIF Population by Science Keyword

Page 11: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

SERF Population by Service Keyword

Page 12: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

International Users - CEOS IDN Countries

(January 1999 - August 2008)

Page 13: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

(as of August)

History of GCMD Hits

42,664,019

48,165,6879 47,333,812

32,373,773

Average Per Month: 4 million

Page 14: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Unique Visitors(January 2007 - August 2008)

Average Unique Visitors Per Month: 43,283

Page 15: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Earth Science Keyword Searches(January - August 2008)

Page 16: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Service Keyword Searches(January - August 2008)

Page 17: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

How Do Users Find the IDN?(January - August 2008)

Page 18: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

When Do Users Visit the IDN?Most Popular Day of the Week

(January - August 2008)

Page 19: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

When Do Users Visit the IDN?Most Popular Time of Day

(January - August 2008)

Page 20: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Popular Keyword SearchesPopular Keyword Searches(January - August

2008)

Science/Service Keyword Searches:

1.1.OceansOceans2.2. AtmosphereAtmosphere3.3. Climate IndicatorsClimate Indicators4.4. AgricultureAgriculture5.5. Data CentersData Centers6.6. Land SurfaceLand Surface7.7. Data Analysis & Data Analysis &

VisualizationVisualization8.8. LocationLocation9.9. Solid EarthSolid Earth10.10. ModelsModels

Full-Text Searches:

1.1.Global WarmingGlobal Warming2.2.AMDAMD3.3.JamstecJamstec4.4.ChinaChina5.5.TemperatureTemperature6.6.OBIS/SCARMARBINOBIS/SCARMARBIN7.7.GlobalGlobal8.8.AfricaAfrica9.9.WindWind10.10. GISGIS

Page 21: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Website Searches by Interface(December 2005 - August 2008)

Releases: 9.6 (July 2006) 9.7 (April 2007) 9.7.1 (June 2007) 9.8 (June 2008)

Page 22: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Free-Text Searches(December 2005 - August 2008)

Release 9.7 (April 2007) changed location of free-text search boxes on homepage

Page 23: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

III. Extending Keyword Vocabularies

III. Extending Keyword Vocabularies

Page 24: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

GCMD Science Keywords and Essential Climate Variables

(ECV)

GCMD Science Keywords and Essential Climate Variables

(ECV)

GCMD Science Keywords

Mutually exclusive

Six level hierarchy (with detailed keywords)

Refinements based on the input of data providers and the science community

Useful for creating ontologies

Supported by actual metadata content

Essential Climate Variables

Two-level hierarchy

Highly respected: created by top scientists

Not based on actual metadata content

Page 25: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Development of Climate Data Classifications

Development of Climate Data Classifications

CDR: Climate Data Records

EDR: Environmental Data Records

FCDR: Fundamental Climate Data Records **

ESDR: Earth System Data Records

TCDR: Thematic Climate Data Records

SDR: Sensor Data Records

ECV: Essential Climate Data Variables **

SBA: Societal Benefit Areas **

Page 26: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

IV. Interoperability ForumIV. Interoperability Forum

Page 27: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Access from IDN website or email directly. Is monitored to diminish spam - not to restrict usage. Possible topics:

– Feedback on website – Requests related to metadata standards (DIF/SERF)– Requests or suggestions of keyword changes – Requests for new Portals

Access from IDN website or email directly. Is monitored to diminish spam - not to restrict usage. Possible topics:

– Feedback on website – Requests related to metadata standards (DIF/SERF)– Requests or suggestions of keyword changes – Requests for new Portals

Reminder of INTEROP Email

Reminder of INTEROP Email

Page 28: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.
Page 29: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

V. Climate Diagnostics V. Climate Diagnostics PortalPortal

Action item Action item (CL-06-02-14):(CL-06-02-14):

V. Climate Diagnostics V. Climate Diagnostics PortalPortal

Action item Action item (CL-06-02-14):(CL-06-02-14):

Page 30: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Mission Statement: Mission Statement:

This "Climate Diagnostics" web site was inspired by the ideas and foresight of Mitchell D. Goldberg, NOAA/NESDIS, SaTellite Applications and Research (STAR), and Chief of the Satellite Meteorology and Climatology Division. Mitch is the Committee on Earth Observation Systems (CEOS) Climate Societal Benefit Area (SBA) lead and responsible for CEOS's Global Climate Observing Systems (GCOS) actions. The Working Group on Information Systems and Services (WGISS) had used the CEOS International Directory Network (IDN) to provide a portal to data through the GCOS Essential Climate Variables, in order to focus a CEOS GCOS task for CEOS agencies to make data related to these variables available.

This "Climate Diagnostics" web site was inspired by the ideas and foresight of Mitchell D. Goldberg, NOAA/NESDIS, SaTellite Applications and Research (STAR), and Chief of the Satellite Meteorology and Climatology Division. Mitch is the Committee on Earth Observation Systems (CEOS) Climate Societal Benefit Area (SBA) lead and responsible for CEOS's Global Climate Observing Systems (GCOS) actions. The Working Group on Information Systems and Services (WGISS) had used the CEOS International Directory Network (IDN) to provide a portal to data through the GCOS Essential Climate Variables, in order to focus a CEOS GCOS task for CEOS agencies to make data related to these variables available.

Page 31: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Mission Statement Continued Mission Statement Continued

Upon viewing this portal, Mitch's vision was to offer a resource that would provide information to enhance the Global Earth Observation System of Systems (GEOSS) by providing visualizations of climate trends and variability. He envisioned that the visualizations (climate diagnostics) could be more easily interpreted by decision makers, for the benefit of society than the data alone. The climate visualizations are targeted to address the Societal Benefit Areas (SBAs) related to: Disasters, Health, Energy, Climate, Water, Weather, Ecosystems, Agriculture, and Biodiversity. Every description of a climate visualization in the directory is tagged with one or more of the potentially significant Societal Benefit Areas. The visualizations are created from scientific data by a multitude of providers. The site is designed to offer visualizations that could be readily interpreted by decision makers. If a better understanding of the significance of the science can be achieved, the societal benefits of scientific research would be enhanced by providing these visualizations for long-term diagnostic analyses. The visualizations, also known as "Climate Diagnostics", are expected to be supportive and useful in decision-making processes. They have been based on the careful analysis of significant variables.Anticipating future consequences related to climate in the nine Societal Benefit Areas could be pivotal to our survival.

Page 32: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

The Challenges of Creating the Infrastructure

The Challenges of Creating the Infrastructure

Assumption: all portals are virtual subsets of the directory. Climate Diagnostics does not fit this assumption.

Researched climate diagnostics sources relevant to societal benefits (journals, agency bulletins, universities, instrument theme pages, etc.).

Attempted to use current infrastructure. Discovered that unique content and user base required new software

infrastructure and keywords. Implemented new requirements for content, design and database. Refined requirements as content evolved {such as added Societal

Benefit Area (SBA) keywords and mapped to Essential Climate Variables (ECV)}

Assumption: all portals are virtual subsets of the directory. Climate Diagnostics does not fit this assumption.

Researched climate diagnostics sources relevant to societal benefits (journals, agency bulletins, universities, instrument theme pages, etc.).

Attempted to use current infrastructure. Discovered that unique content and user base required new software

infrastructure and keywords. Implemented new requirements for content, design and database. Refined requirements as content evolved {such as added Societal

Benefit Area (SBA) keywords and mapped to Essential Climate Variables (ECV)}

Page 33: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Early Feedback on Creating Content

Early Feedback on Creating Content

“I spent some time just using Piclens on the Firefox browser to look at hundreds and hundreds of images that come up using "climate diagnostics" […]. One discovers precious few results […] but they are far flung and often just isolated images. At this point I still have little idea where these resources are supposed to come from. Without being directed to a particular provider of such visualizations, it seems like a fool's errand to just search for them.

[Observation from external source]

“I spent some time just using Piclens on the Firefox browser to look at hundreds and hundreds of images that come up using "climate diagnostics" […]. One discovers precious few results […] but they are far flung and often just isolated images. At this point I still have little idea where these resources are supposed to come from. Without being directed to a particular provider of such visualizations, it seems like a fool's errand to just search for them.

[Observation from external source]

Page 34: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

• Time Span: seeking climatologies 20-30 years (settled for GT 5 years).

• Continuous Coverage - A continuous coverage with very few gaps.

• Descriptions - Good descriptive summaries detailing the trend in the visualization.

• Time Span: seeking climatologies 20-30 years (settled for GT 5 years).

• Continuous Coverage - A continuous coverage with very few gaps.

• Descriptions - Good descriptive summaries detailing the trend in the visualization.

The Challenges of Creating the Infrastructure

The Challenges of Creating the Infrastructure

Guidelines: Guidelines:

Page 35: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Unique content required the following:1) New metadata fields needed:

• File Attributes• Personnel Role

2) Renaming of fields:• Visualization Provider• Visualization Description• Visualization Citation

3) New sets of controlled keywords:• Analysis Types• Visualization Types• Format• Personnel Role

Unique content required the following:1) New metadata fields needed:

• File Attributes• Personnel Role

2) Renaming of fields:• Visualization Provider• Visualization Description• Visualization Citation

3) New sets of controlled keywords:• Analysis Types• Visualization Types• Format• Personnel Role

The Challenges of Creating the Infrastructure

The Challenges of Creating the Infrastructure

Page 36: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

File Attributes File Attributes

Page 37: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

File Attributes File Attributes

Visualization URLVisualization URL- Field created to store URL visualization to be accessed.- URL needed by the user to obtain the file and to display with selected entry on screen.

Thumbnail URLThumbnail URL- This URL points to the sample that the website will display on the results interface.- Thumbnails used on the Climate Diagnostics homepage to randomly display the different types of climate visualizations in the Portal.

Visualization URLVisualization URL- Field created to store URL visualization to be accessed.- URL needed by the user to obtain the file and to display with selected entry on screen.

Thumbnail URLThumbnail URL- This URL points to the sample that the website will display on the results interface.- Thumbnails used on the Climate Diagnostics homepage to randomly display the different types of climate visualizations in the Portal.

Page 38: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

File AttributesFile Attributes

Visualization TypeVisualization TypeCreated to inform the user of the dimensional type of the visualization.

Analysis TypeAnalysis TypeCreated to inform the user of analysis/statistical method used to create the visualization.

Visualization TypeVisualization TypeCreated to inform the user of the dimensional type of the visualization.

Analysis TypeAnalysis TypeCreated to inform the user of analysis/statistical method used to create the visualization.

Page 39: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

File AttributesFile Attributes

Visualization DurationVisualization Duration

This is a required field if the visualization is an Animation or video to inform the user the run-time length of the animation or video.

FormatFormat

The field is to notify the user of the type of graphic file format used for the visualization.

Visualization DurationVisualization Duration

This is a required field if the visualization is an Animation or video to inform the user the run-time length of the animation or video.

FormatFormat

The field is to notify the user of the type of graphic file format used for the visualization.

Page 40: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Viewing SpecificationsCreated to inform the user of any special application required to view the visualization.Applications that might be needed are QuickTime, MS Player, or Google Earth.

Visualization File SizeThe file size field was created to allow the user to know how much disk space is required to download the visualization file.

Viewing SpecificationsCreated to inform the user of any special application required to view the visualization.Applications that might be needed are QuickTime, MS Player, or Google Earth.

Visualization File SizeThe file size field was created to allow the user to know how much disk space is required to download the visualization file.

File AttributesFile Attributes

Page 41: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Climate DiagnosticsClimate Diagnostics

Page 42: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Climate DiagnosticsClimate Diagnostics

Page 43: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

The Evolution of the Interface The Evolution of the Interface

Page 44: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

The Evolution of the Interface

Display Pages

The Evolution of the Interface

Display Pages

Page 45: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

The Evolution of the Interface

Display Pages

The Evolution of the Interface

Display Pages

Page 46: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Future Goals for the PortalFuture Goals for the Portal

• Gather feedback from diverse communities (data community, policy makers, educators, etc.).

Are the visualizations adequate to relay the information? Does the users understand and use these diagnostics? Is this having the societal

benefit impact intended?

• Create use case scenarios to demonstrate usability of these climate diagnostics.

• Further evaluate user base audience.

• Continue caretaking - funding would be required to continue the population effort and maintaining the website.

• Advertise website through CEOS, AGU, AMS etc. Possible use within GEOSS.

• Gather feedback from diverse communities (data community, policy makers, educators, etc.).

Are the visualizations adequate to relay the information? Does the users understand and use these diagnostics? Is this having the societal

benefit impact intended?

• Create use case scenarios to demonstrate usability of these climate diagnostics.

• Further evaluate user base audience.

• Continue caretaking - funding would be required to continue the population effort and maintaining the website.

• Advertise website through CEOS, AGU, AMS etc. Possible use within GEOSS.

Page 47: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Initial CommentsInitial Comments

Mitchell D. Goldberg:Mitchell D. Goldberg:

“This addition will help the climate community and decision makers with easier

access to climate information.”

Mitchell D. Goldberg:Mitchell D. Goldberg:

“This addition will help the climate community and decision makers with easier

access to climate information.”

Page 48: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

VI. Land Surface Imaging Portal

VI. Land Surface Imaging Portal

Page 49: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.
Page 50: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Instrument/Platform Interface

Instrument/Platform Interface

Page 51: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Instrument/Platform Interface

Instrument/Platform Interface

Page 52: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Data at No CostData at No Cost

Page 53: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

User Feedback and ResponseUser Feedback and Response What’s the difference

between Land Surface Temperature and Land Skin Temperature? Response: A better option might be to rename the “Land Temperature” Term to “Surface Thermal Properties”. Then Surface Temperature and Surface Skin Temperature can safely reside together as variables, along with Emissivity, Heat Capacity, and Thermal Anomalies.

What definitions were used in making this distinction? Response: The definition and reference can be found by tapping the “i” feature next to the keyword, which takes one to this definition.

Page 54: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

User Feedback and Response

The intention of the LSI portal…prioritize “free” datasets and include cost information within portal display.Response: Within the Distribution field, a Fees subfield exists that captures cost information. The Fees subfield will be required in the future.

Page 55: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

“Suggestion to make the distinction between “data” and “products”.Response: Level 0 and 1 data will be moved to a revised Topic, named “Radiance/Imagery” as “data”. Land Surface Products will be found within the “Land Surface” Topic.

“Suggestion to make the distinction between “data” and “products”.Response: Level 0 and 1 data will be moved to a revised Topic, named “Radiance/Imagery” as “data”. Land Surface Products will be found within the “Land Surface” Topic.

User Feedback and ResponsesUser Feedback and Responses

Page 56: Lola Olsen and IDN Staff CEOS WGISS 26 IDN Task Team.

Questions?Questions?Questions?Questions?