Managing Image Data on the ArcGIS PlatformManaging Image Data on the ArcGIS PlatformOptions and Recommended ApproachesOptions and Recommended Approaches

Peter BeckerPeter Becker

• Petroleum requirements for imagery and raster• Traditional solutions and issues• Overview of ArcGIS imaging capabilities• Demonstration• Resolving the imagery issues• Recommendations

Imagery and Rasters in the Petroleum Industry

• Base for most geospatial applications• Background image• Source for interpretation• Temporal change• Raster Analysis

• Multiple sources:• Satellites: QB, Ikonos, ..• Aerial photography: orthophotos, (few raw camera data)• Scanned maps• Elevation data

2

Most petroleum companies have a high investment in imagery and rasters

Requirements in Petroleum Industry

• Need to maximize the value of imagery• Provide Accessibility

– Large range of applications– Different locations

• Data Managers– Large collections of existing imagery– New imagery being acquired

• Users– Accessibility– Capability

Data Managers – Traditional Approach

• Handle images as individual files–Stored on disk – Multiple formats–Stored in database – Managed ArcSDE Raster Catalogs

• Create mosaic–Raster Mosaic – ArcSDE–Bunch of (tif) files–MrSID, ECW, JPEG2000

Data Managers – Traditional Issues

• Data management• Volume – Data duplication• Disparate datasets• Different resolutions• Temporal• Dynamics• Security

t1t2

t3t4

t5

? ?

? ?

Users – Traditional Approach & Issues

• Traditional - Open File

• Updated - Open web service

• Issues– Which image / service – Formats – TIF, JPEG, JPEG2000, NITF, ECW, MrSID, ERS, BIL, FLT, RAW ……..

– Projections – DD WGS84, UTM, StatePlane,….

– Speed – zzzzzzzzzzzzzzz– Bandwidth – DSL connection– Metadata – what metadata?– Capability – What can I do?– Dynamics – New imagery available

What has changed?

• ArcGIS Desktop – Improvements• ArcGIS Server – Image Services• ArcGIS Server – Image Extension (Image Server)• ArcGIS Server – Map Caching• Web Applications – WebMap, JavaScript, Silverlight, ArcGIS Explorer,

Google Earth, Virtual Earth

ArcGIS Provides Enterprise Image Management

• Manages catalogs of imagery from various sources• Integrates imagery into workflows toCollect, Manage, Produce and Exploitall forms of geospatial data

• ESRI has a long history ofimagery/raster solutions

• ESRI users are the largestcollection of professionalimagery users in the world.

Imagery adds value to GIS, GIS adds value to imagery“They are two sides of the same coin”

UC 2008 Tech Workshop 9

ArcGIS Integrates Imagery

ArcGIS provides:A scalable, standards based andgeneric, cross industry platformtechnology to:

• Manage• Process• Analyze• Disseminate• Visualize• Exploit

Imagery, in a wide range of applications

ArcMap

RasterMosaic

MosaicTile

RectifiedScene

NoneRectified

Use

Serve

Author

Web MapViewer

Desktop Explorer

GIS Server

Mobile OpenAPIs

Enterprise Service Bus

ImageServices

As part of the complete Enterprise GIS

Components of a completeEnterprise Image Management solution

• ArcGIS Desktop• Integrates all forms of geospatial data including imagery• Is the authoring tool for information and knowledge

• ArcGIS Server• Provides the Services Orientated Architecture• Provides the GeoDatabase

• ArcGIS Server Image Extension• Provides the solution for large numbers of images

• Other important components include:ArcGIS Explorer, Spatial Analyst, GeoDatabase Rasters, ArcGIS Online, Appliances, Professional Services, Partner Solutions

ArcGIS Desktop provides for Imagery

• Access• Individual Rasters• Raster Catalogs/Mosaics• Image Services

• Visualization• Band combination, Band stretch, Contrast• Projection• Pan Sharpen, Orthorectification

• Analysis / Processing• Mosaic, clip• Georeferencing• Pan Sharpen, Orthorectification• Spatial Analysis

• Management• Files, GDB rasters, Image Services

RasterMosaic

RasterCatalog

MosaicTile

RectifiedScene

NoneRectified

GP Tools

ArcGIS Desktop

Image ServerIS Direct Connect

ArcGIS Server

Image Service WMS/WCS

ArcGIS Server Family

Serve

3 Tiers

GlobeServices

MapServices

Analysis &ModelingServices

Web MapViewer

Desktop Explorer Mobile EnterpriseService Bus

OpenAPIs

Use• Many Clients

Author• Desktop

GeoCodingServices

GeoDataServices

Imagery is an integral part of a complete GIS

ImageServices

Multi-platform

ArcGIS Server provides for Imagery

Access• Image Services

Serve any raster dataset• Open Standards: WMS, WCS, SOAP,

REST, KML…• Imagery data, not just “pictures”• Many clients ArcMap, 3rd Party, JavaScript,

Flex,…• Image extraction• Caching for optimized very large scale web

access• Processing

• Server rendering• Geoprocessing

• Management• Simple• Web based & ArcCatalog

MapDoc.

ArcGIS ServerMap

DesktopArc

Engine3rd

Party

ArcMap

ArcGlobe

Globe Mobile

Mobile.Net

Mobile

ArcGISExplorer

WebMap.NET/Java

Web

GoogleEarthKML

OGCWMS

OGCWCS

Google MapsMicrosoft

Virtual Earth

Mashup

Image

SOAP, RESTWMS, WCS, KML

ServiceDefinition

ArcGIS Server - Image ExtensionArcGIS Image Server technologyExtends ArcGIS Server to:

• Access• Single point of access to large collections of images• Client control over imagery mosaic / delivery• Maintain source information for every pixel• Additional CAD & GIS clients

• Processing• Dynamic mosaicking• On-the-fly processing• Multiple products from same source

(Natural Color, False Color, IR, NDVI) without data duplication

• Management• Maintain source data and metadata• Define image processing• Limited pre-processing required

Use

Serve

Author

Image Extension

ServiceDefinition

ServiceDefinition

ServiceDefinition

ArcGIS Server

ArcGIS Image Server Paradigm Combine Processing with Serving• Keep imagery in native form• Author service definition (catalog)

• Properties of images• Processing to be applied• Properties of the service• Generate service overviews (optional)

• Publish image service• Client application accesses image service

• Defines area of interest• Server accesses and processes imagery• Required image transmitted to client• Client displays image

Use

Serve

Author

Image ExtensionImage Extension

ServiceDefinition

ServiceDefinition

ServiceDefinition

ArcGIS Server

Radiometric Processes

• Extract / Stack Bands• Image Algebra, NDVI• Spectral Matrix• Grayscale• Stretch• Convolution Filter• Pan-sharpen• Trend• Classify• Colormap• Elevation Visualization• Histogram

Geometric Processes

• Reproject, Warp, Orthorectify• Single Sampling, improves quality

• Clip/crop image to:• Exclude non wanted areas• Seamlessly blend images

• Mosaicking Methods• Reorder overlapping imagery

• By Attribute – Date, SunAngle, …..• Closest Nadir – Most top down• Viewpoint – North, East, South, West• Lock Image – Specific image(s)• Seamline – Blend

Client Controllable Image Service Properties

• Projection• Define output projection, irrespective of input projections

• Sampling methods• Nearest neighbor, bilinear, cubic convolution

• Compression for transmission• JPEG, JPEG 2000, LZ77• Enables access over low bandwidth networks

• Mosaic method• Controls overlap• Lock Image

• Metadata Access

Accessing Image Services

• Large Number of clients• Desktop

• ArcGIS, AutoCAD, Microstation, GeoMedia, …• ArcGIS Explorer 900• WMS, WMC

• Web• WebMap, JavaScript, Flash, Silverlight• WMS, WCS

Demonstration

• Accessing image Services• Author image service of satellite imagery• Author image service of elevation data

Additional Applications

• Geospatial Raster Analysis – Spatial Analysis• Partners – Provide Best of Breed technology

• Image Analysis – ITT ENVI• Feature Extraction – ITT ENVI FX, Ecognition• Stereo Capture – BAE, DAT/EM

• Service Orientated Architectures

ArcGIS ServerImage Service

ArcGIS ServerGeoProcesing Service

Users – New Approach & Issues Resolved

• Open Application• Zoom to AOI• View Imagery• Access Metadata• Change properties

• Issues?– Which image / service: Combined, Best imagery on top– Formats: Irrelevant– Projections: Resolved– Speed: Fast– Bandwidth: Low if necessary– Metadata: Accessible– Capability:

– Use as picture (view) or data (analysis)– Order imagery to exploit temporal– Utilize dynamic range and multispectral

– Dynamics: New imagery become available

Data Managers – New Approach & Resolved Issues

• Leave images in their existing locations/formats• Create and Serve Image Service Definition• Create multiple image products• Update as new imagery or parameters becomes available• Issues

– Data management: Simplified– Volume – Reduced: No data duplication, compression where possible– Disparate datasets: No issue– Different resolutions: No issue– Temporal: Can be exploited– Dynamics: Update as required– Security: Solved

t1t2

t3t4

t5

✓ ✓

✓ ✓

How to achieve requirements?

• Catalog and Serve existing data– Create Image Services

• New image acquisition– Add to existing Image Services

• Use Image Services to make imagery accessible• Value of imagery increased• Rapid Return of Investment

Implementation Recommendations

• Identify all imagery/rasters• Formats, volume, type, projections, metadata

• Remove duplicates & derived products (eg reprojected/mosaicked)• Add to central storage (DAS,NAS,SAN)• Create ‘Best’ Image Services

• Imagery• Color Imagery• False-Color Imagery• NDVI

• Elevation• Elevation• Shaded Relief• Relief Shade• Aspect

• Add metadata attributes (eg source)• Use in all geospatial applications• Create Special Service (Security, application specific)• If need to scale to very large number of users

• Create Map Cache from Image Service• Distribute Cache on separate location

Scaling to very large number of user

ServiceDefinition

ServiceDefinition

ServiceDefinition

Image Extension

ArcGIS Server ArcGIS ServerCaching GP

AuthorService Overviews

Basic Imagery

MoreAdvancedUsers

GeneralUsers

ImageServiceWMS, WCS, KML

Cache,WMS,KML

Tiles

On Demand Caching

Use

Serve

Author

Image ExtensionImage Extension

ServiceDefinition

ServiceDefinition

ServiceDefinition

ArcGIS Server

Use

Serve

Author

Image ExtensionImage Extension

ServiceDefinition

ServiceDefinition

ServiceDefinition

ArcGIS Server

Image ExtensionArcGIS Server

GeoDatabase

Collect Manage

ExploitProduce

Files

Parameters

Services/Orthos Visualize/Analyze

Image ExtensionArcGIS Server

GeoDatabase

Collect Manage

ExploitProduce

Information Centric Approach to WorkflowsArcGIS is the interoperable organizing system to enable workflows

• GeoDatabase – Common information model. Simplifies integration of disparate systems• ArcGIS Server – Enables SOA + Federated/Distributed storage and management• ArcGIS Desktop – Uniform and integrated environment for managing and authoring• Web clients – Web query and exploitation

GISFiles

Imagery

Vectors

Image Extension

ArcGIS Server

GeoDatabase

ArcGIS Imagery Based Workflows / SolutionsWorkflows contain many standard tasks

42

31

Plan

Acquire

ProcureCatalog Refine

Radiometry (Color Enhance)

RefineGeometry

Process

MosaicMaintain

ExploitAnalyze

Visualize

Order of the tasks need not be linear

Files

Name used depends on industry

ArcGISMaximizes the Value of Imagery

• Enterprise wide image accessibility• Increases access and use• Very large image datasets• Within GIS, CAD, imaging, and Web applications

• Direct read of imagery in its native form• Simplifies data management• Reduces redundancy• Reduce delay in making imagery accessible

• On-the-fly server-based image processing• Dynamic Mosaicking• Serves multiple customized imagery products• From a single source• Utilizes image depth• Makes imagery dynamic

• End users get• Fast image access• Optimized to their requirements• Improved image quality• Important image metadata