1

Earth System Modeling Framework

ESMF and the Transformation of Earth System Modeling

http://www.esmf.ucar.edu

Sylvia Murphymurphys@ucar.edu

2

Outline

What is ESMF? Who is Using it? How is ESMF Transforming Earth System Modeling? Current Development Status Future Directions

3

What is ESMF?

ESMF is a software library that consists of coupling tools and model utilities that increase modularity, interoperability, and performance of geoscience applications.

4

What models are using ESMF?

Operational Version of the GFS Weather Forecasting Model

GEOS-5 Atmospheric GCM

HYCOM Ocean ModelCOAMPS Atmospheric ModelCICE-HYCOM

58 components are currently using ESMF

WRF Weather Forecasting Model

ADCIRC Hydrodynamic modelADCIRC-WASH123

MIT GCM

GFDL FMSMOM4 UCLA AGCM

5

What programs are using ESMF? NUOPC: National Unified Operational Prediction Capability Consortium (NOAA, Navy, Air Force Weather Agency)

Has announced intentions to base its next generation National Weather Prediction (NWP) system on ESMF

BEI: Battlespace Environments InstituteDeveloping integrated forecasting systems

across DoD.

MAP: Modeling and Analysis ProgramFacilitating research and model use of NASA data

Image from NOAA rapid refresh (RR) model, a replacement model for the Rapid Update Cycle (RUC) model.

6

The Transformation of Earth System Modeling

How models are structured How models are developed The scale of collaborations Governance strategies for

developing community scientific software

ESMF is changing:

7

How Models are Structured

Hierarchical component based architecture

Interchangeability Easy replacement of

component elements Interoperability

Swapping component between applications

Coupling diverse applications

8

How Models are Developed

Large number of components available from across the community

Develop science components for a well-understood community architecture and interfaces

Technological advances are propagated quickly across many applications simultaneously

9

The Scale of Community Collaborations

Collaborations across: Operational centers (e.g

CNMOC, COPC, FNMOC) Research centers (e.g.

GFDL, NCAR, NASA Goddard)

Universities (e.g. MIT, University of Hawaii)

Different domains (weather, climate, space weather, hydrology)BEI: Battlespace Environment Institute

NUOPC: National Unified Operational Prediction Capability

CCSM: Community Climate System Model

WRF: Weather Research & Forecasting Model

MAP: Modeling Analysis and Prediction Program

10

Governance strategies for developing community scientific software

Distributed, global development

Direct participation of users in setting development priorities

Multi-agency management

Incorporates open-source methodologies into scientific software development

Shared governance model emphasizes:

esmf_jst@ucar.edu has 300 subscribers who participate in ESMF development

11

ESMF Release Plan2002 2003 2004 2005 2006 2007 2008 2009 2010

ESMF v1Prototype

ESMF v2Components, VM and UtilsESMF_GridCompRun()

ESMF v3Index Space OperationsESMF_ArraySparseMatMul()

ESMF v4Grid OperationsESMF_GridCreate()ESMF_FieldRegrid()

ESMFv5StandardizationBuild, init, data types, error handling, …

Last publicESMF v2.2.2r

Last internalESMF v3.0.3

12

Current Features (v3.0.3) Component-based architecture Allows serial or parallel execution Components can run concurrently or sequentially Single executable support, limited support for multiple

executables Support for model ensembles User friendly uniform, rectilinear, and curvilinear grid

representation Unstructured and multi-patch grids represented in index space Regridding via sparse matrix multiply with user defined weights Utilities such as time manager, message logger, and resource

file manager are usable and adding features Fortran interfaces and complete documentation, increasing

number of C interfaces Distributed with Reference Manual, Users Guide, ~2500 tests

and examples ~2000 downloads

13

Current Supported Platforms Cray X1 Cray XT3/4 HP ZX6000 Linux intel IBM Bluegene, IBM Opteron Linux pathscale IBM Opteron Linux pgi IBM SP MAC G5 Darwin xlf MAC G5 Darwin xlfgcc MAC G5 Darwin nag

ESMF runs 2500 tests on all these platforms every night

MAC G5 Darwin absoft Pentium III Linux lahey Pentium III Linux pgi Pentium III Linux pgigcc PC Xeon Cluster Linux

absoftintel PC Xeon Cluster Linux g95 PC Xeon Cluster Linux intel PC Xeon Cluster Linux nagintel SGI Altix Linux nagintel SGI Origin 3800

14

Sparse Matrix Multiply Updated

User supplied weights Facilitates the widest possible couplings The methods have the following new features:

Improved performance and reduced memory usage

Support for distributed definition of factors

Support for user-supplied arbitrary sequence indices via 1D DistGrid

Support for ESMF_TYPEKIND_I4/I8/R4/R8 Default initialization of destination Array to zero (can be overridden)

15

New Structured Grids

Support 1D, 2D, 3D and higher dimensions

Supports parallelization across any or all grid dimensions

Supports uniform, rectilinear and curvilinear grids

Image of HYPSE (Hydrostatic Padua Surface Elevation Model) Dept .of Physics, Univ. of Padua

16

Near Future: Structured Grids

Multi-tile grids (e.g. cube-sphere) More efficient memory use for

non-curvilinear grids Coordinate halo A wide variety of different types of

connections between tile edges Automatic generation of topology

and coordinates for common shapes (e.g. sphere)

Image courtesy Steve Thomas and Rich Loft, NCAR

17

Near Future: General Regridding

Exact curl

Curl of bilinear interpolant

Curl of patch-recovered interpolant

Work conducted by David Neckels/ESMF in collaboration with Bill Large of the ocean modeling section at NCAR.

18

Near Future: Unstructured Grids

Uses same infrastructure as general regridding

Representation for hydrology grids and other grids

Future basis for exchange grids and observational data streams

Image of rossby waves on a triangular adaptive grid (Alfred-Wegener-Institute for Polar and Meteorological Forecasting)

19

Longer Term: Interoperability & Integration Initiative

Enable groups with compilations of ESMF components to develop integrated modeling systems

Define standards to increase component interoperability Metadata conventions

Strategies for automation and supplemental tools (e.g. MAPL)

http://esmfi3.org/wiki/

20

Questions?

http://www.esmf.ucar.edu