Image Management and Dissemination - Recent Proceedings · 2011. 3. 25. · Differentiator Raster...
Transcript of Image Management and Dissemination - Recent Proceedings · 2011. 3. 25. · Differentiator Raster...
Image Management and Dissemination
Peter Becker
OUTLINE
• Requirements• Intro to Mosaic Datasets• Workflows & Demo• Dynamic Mosaicking, On-the-fly processing• Properties• Differentiator Raster Catalog, ISDef, Mosaic Datasets• Summary• Questions
ImageryImagery
Field UsersField Users
GeoreferencedGeoreferencedContentContent
Knowledge BaseKnowledge Base
++ Sensor NetworksSensor Networks
Base MapsBase Maps& Globes& Globes
AnalystsAnalysts
Data ManagersData Managers
Decision MakersDecision Makers
•• Geospatial workflowsGeospatial workflows•• Actionable information & knowledgeActionable information & knowledge
GISGIS
Geospatial Information, Integrated & AccessibleGeospatial Information, Integrated & Accessible
Imagery is Core to GISImagery is Core to GIS
CloudCloud
EnterpriseEnterprise
LocalLocal
•• ManageManage•• VisualizeVisualize•• AnalyzeAnalyze•• DisseminateDisseminate
––DiscoverDiscover––CollaborateCollaborate
WebWeb
MobileMobile
DesktopDesktop
ArcGIS 10 A Complete System for Geographic Knowledge
Transforming GISTransforming GIS
Manage, Disseminate, Visualize, Analyze
• ArcGIS enables you to:
Manage, Disseminate, Visualize and Analyze
all forms of imagery
• Platform for complete Imagery Solutions
• Mosaic Datasets are the optimum model of managing and serving imagery and rasters
• Maximizing the Value of Imagery
Imagery is Core to GIS
Trends in ImageryTrends in ImageryEntering the Platinum Age of ImageryEntering the Platinum Age of Imagery
AccuracyAccuracy
20122012
20092009
20052005
CurrencyCurrencyCurrentCurrent
2424
66
1212
1818
20092009
2424
1212
2424
1212
20152015
AnyAny
DayDay
EOEO AGIAGI
SensorSensorAnyAny
DayDay
SpaceSpace••AirAir
••GroundGround••SpaceSpace
••InternetInternet
PlatformPlatform
VarietyVariety
00
2020
4040
6060
20052005 20092009 2015201500
2020
4040
20052005 20092009 20152015
AnyAny
DayDay
VolumeVolume
00
2020
4040
6060
8080
100100
120120
20052005 20092009 20152015
Amount of imagery storedAmount of imagery stored
Improved positional accuracy and pixel resolutionImproved positional accuracy and pixel resolutionDemand for current dataDemand for current data
6
x
x
x
ArcGIS – Maximizing the Value of Imagery
• Providing Image Accessibility:- Timely- Quickly- Accurately- Collectively- Simply
• Exploiting Rich Information Content:- Resolution- Temporal change- Spectral range- Dynamic range
Three Differentiators of Imagery
•• Volume:Volume:-- Magnitudes larger then other dataMagnitudes larger then other data
•• Value:Value:-- High operational valueHigh operational value-- High strategic valueHigh strategic value
•• Fixed:Fixed:-- A snapshot in timeA snapshot in time
$$
timetimeOperational Strategic
• Direct Access- Raster- Mosaic Dataset
Image AccessibilityTo Multiple Applications
• Direct Access- Raster- Mosaic Dataset
• Static Web Services- Map Cache- Compact Cache- JPGPNG
Image Accessibility
ArcGIS provides image accessibilityArcGIS provides image accessibility
CacheTiles
To Multiple Applications
Pre-Process
• Direct Access- Raster- Mosaic Dataset
• Static Web Services- Map Cache- Compact Cache- JPGPNG
• Dynamic Image Services- Server based processing- Image Services, WMS, WCS, KML- SOAP, REST interfaces
Image Accessibility
ArcGIS provides image accessibilityArcGIS provides image accessibility
CacheTiles
Image Service
To Multiple Applications
Pre-Process
Wide Variety of Imagery
•• Multiple SourcesMultiple Sources-- Satellites, Aerial ,Terrestrial, ScanningSatellites, Aerial ,Terrestrial, Scanning
•• Multiple FormsMultiple Forms-- Ortho Images TilesOrtho Images Tiles
-- Image StripsImage Strips
-- Processed RastersProcessed Rasters-- Elevation models / LidarElevation models / Lidar
-- Analysis resultsAnalysis results
-- Thematic mapsThematic maps
-- ScenesScenes
-- Sensor ImagesSensor Images
•• Multiple FormatsMultiple Formats-- TIF, NITF, JP2,TIF, NITF, JP2,……
Procured as Procured as BackgroundBackground
Acquired forAcquired forAnalysisAnalysis
Management and Dissemination Requirements
• Imagery as Background• Imagery for Analysis• Catalog• Define processing• Provide Accessibility
- Direct Access- Serve- Cache ?
• Importance of time, temporal• Simple Workflows
Mosaic DatasetMosaic Dataset
• Within ArcGIS Desktop• Quickly Catalog
- All raster datasets- Imagery from different sensors
• Define – In Geodatabase- Metadata- Processing to be applied- Default viewing rules
• Access – In all ArcGIS applications- As Image
- Dynamic Mosaic , Processed on the fly
- As Catalog- Footprints, Detailed metadata
Optimum Model for Image Data Management
Workflow overview
Workflow overview
Workflow overview
Workflow overview
Image Service
Workflow overview
Image Service
+
Workflow overview
Image Service
+Reference MD
Workflow overview
CacheTiles
Image Service
Cache?
+Reference MD
Creating a Mosaic Dataset
• GDB, Personal or Enterprise Geodatabase
• Name• Coordinate System
- For management and overviews- Web Mercator ?
• Bands, Pixel Type – Data will internally be converted to this
Mosaic Dataset in ArcMap
• Visible as Group Layer- Boundary – Extent of Mosaic Dataset- Footprints – Extent of raster + Attributes
(inc Raster & Function)- Image – Processed and mosaicked image- Seamline – Extents used for Seamline mosaic method
Mosaic Dataset – Properties and Tools
• Properties- Properties of Mosaic Dataset
• Tools- Data Management, Mosaic Dataset- Data Management, Raster Catalog
Demo – Simple workflow
Image Preparation / Pre-Processing
• Generally not required• Conversion – Optimization of some formats
- ASCII DEM- Large non tiled rasters- Compression (Lossy or Lossless)
• Pyramids – Reduced Resolution Datasets- When NCols >5000
• Stats – Enable automated enhancement- For non enhanced imagery
• Consider also as a post process. Create service quickly, then replace
Raster Types
• Raster Dataset- For common rasters
• Sensor Specific- Loads Product specific Metadata
and defines processing- Often combine multiple rasters
(PanSharpening)
• Table- More advanced workflows
(Catalogs, RPDefs, Derived MD)
• Templates- Store setting for future use
• Custom- Automate ingest of other imagery
and rasters
Overviews
• Provide fast small scale access• Similar to Cache for small scale• Optional
- Often better to use other imagery
• Define Overview• Build Overview
Cell/Pixel Sizes
• Define usable sizes of cells• Attributes of Footprint Table• LoPS, HiPS
- Range of cells size for the raster- Set when rasters added
• MinPS,MaxPS- Range to display rasters- Set when added or Compute Cell size
• Direct relation to scale: Scale=PixelSize * 96 / 0.0254• Compute Cell Size tool – Computed MinPS,MaxPS
based on imagery overlap• Optionally used Table Calculate
Properties, Metadata and Attributes
• Raster Properties- For each raster
• Raster Metadata- Directly from Raster Dataset- Sstored with Raster- Available using identify
• Table Attributes- From raster type- Added by Author- For query & ordering / sorting
Dynamic Mosaicking
• Order of imagery is changed as required• Imagery clipped by Footprint• Mosaic Methods
- None – Order of records, for tiled images- Nearest Center – Image Center closest to screen center- By Attribute – Order based on attribute. Eg SunAngle- ViewPoints– Order based on location of sensor- Most Northwest – Fixed- Lock Raster – Defined list- Seamline – Sorder + Seamline polygons
• Query Definition – Any SQL statement• Mosaic Dataset Property define default• End User can refine
t1t1t2t2
t3t3t4t4t5t5
On-The-Fly Processing
• Process image as accessed• Stretch, Extract Bands
• Clip, Mask
• Reproject,
• Orthorectify
• Pan Sharpen
• Vegetation Index, Classify
• Shaded Relief, Slope, Aspect
• Color Correction
• …
QuickBird Scenes Tehran, Iran
Credit: Imagery Courtesy of Digital Globe & MDA FederalCredit: Imagery Courtesy of Digital Globe & MDA Federal
Color Corrected
Color Correction onColor Correction on--thethe--fly fly Without Color Correction
No Data and Clipping Footprints
• Exclude non required pixels• Clip out non required pixels
- Legends borders, clouds, sea,…
• NoData- Specific data values (eg -999)- No Data Mask- Define valid pixel range
• Clip by footprints- All rasters clipped by footprints- Build Footprints- Manually Edit- Define
Mosaic Dataset Properties
• Compression for transmission• Mosaic Methods• MaxRows/Cols• Time• Stats• …
Updating thousands of images in minutes.
Credit: Imagery Courtesy of GeoEyeCredit: Imagery Courtesy of GeoEye
Synchronizing & Update
• Syncrhonize- Update Mosaic Dataset when source changes- Updates overviews
• Use Model Builder
Updating thousands of image in minutes
Demo – More Advanced Workflow
Reference and Derived Mosaic Datasets
• Reference Mosaic Dataset- Create different services using same base mosaic
datasets- Globally add functions – Eg HillShade or NDVI- Define Queries – Refine accessible rasters- Refine boundary – Exclude Areas- Change properties – Allowed mosaic methods,…
• Derived Mosaic Datasets- Replicates records- Add raster functions- Uses Table Raster Type- Synchronize with source
Customizing
• Model Builder – Automate using standard tools• Raster Types – Custom to automated image product
creation• XForms – Image To Ground transform. Eg Sensor
models• Functions – Pixel based processes• ArcObjects – Advanced
Changing Workflows for Linear to Transactional
• Conventional Image Processing Workflows are Linear- Multiple processes create intermediate results- Products created as static mosaic
• Mosaic Datasets Enable Transactional Workflows- Processes applied on demand- Products created on demand
Imagery Dynamically Processed and Served
BenefitsBenefits•• Simpler access Simpler access •• Image IntegrationImage Integration•• Fast VisualizationFast Visualization•• Lowers CostLowers Cost•• Dynamic AnalysisDynamic Analysis
• Image Libraries
• Image Services
StandardStandardClientsClients
Mosaics DatasetsMosaics Datasets
ArcGIS ArcGIS Server
Using Image Server Technology
Shorten the time from sensor to use
Differences to Raster Catalog, Image Server
Publishing Image Services
• Dynamic Imagery Service• Client make request : Server processes as required• Image Services – Core to ArcGIS Server
- Single Raster – Single Service- Compression for transmission – Low bandwidth networks- Functions (as LYR or user definable)- Export
• Image Extension – Extends Image Services- Mosaic Dataset – Large Collections with OTF processing- Mosaic Rules- Query- Catalog & raster Metadata- Download (with clipping)
Using Image Services
• ArcGIS Desktop• ArcGIS Explorer• Web
- APIs- WMS,WCS,KML
• Mobile (via map document)• 3rd Party – AutoCAD, Microstation (promoting use of
WMS)
GeoProcessing
• Directly use in ArcGIS tools• Use in Models
- MakeImageServer Layer – Set Max Rows/Cols very large- Resample- Download
ArcGIS – A Platform for Complete Imagery Solutions
•• ESRI works closely with its partnersESRI works closely with its partners
•• ArcGIS provides THE platformArcGIS provides THE platform
•• Partners provide domain expertisePartners provide domain expertise
•• Automated Feature ExtractionAutomated Feature Extraction•• Multispectral AnalysisMultispectral Analysis•• Hyperspectral AnalysisHyperspectral Analysis•• RadarRadar•• Specialized Sensor SupportSpecialized Sensor Support•• Stereo DisplayStereo Display•• ……
Trimble (Applanix)Trimble (Applanix)Microsoft (Vexcel)Microsoft (Vexcel)DigitalGlobeDigitalGlobePictometryPictometryRapidEyeRapidEyeGeoEyeGeoEyeSPOTSPOT
PCI GeomaticsPCI GeomaticsTrimble (Inpho)Trimble (Inpho)
LizardTechLizardTechii--cubedcubed
MDAMDA
DAT/EMDAT/EMPurVIEWPurVIEWTerraGoTerraGo
QcoherentQcoherent
ITT VISITT VISDefiniensDefiniensClark LabsClark LabsOverwatchOverwatchBAE SystemsBAE Systems
Service partners not listedService partners not listed
Information Centric Workflows Enable Efficiency & Interoperability
Summary
• Mosaic Dataset - Optimum scalable model for Image Data Management
• Image Services – Serve to large numbers of users• Dynamic Mosaicking and On-The-Fly Processing
- Reduces time to make image accessible- Remove a lot of pre-processing
• Image Extension- Extends Image Services to serve Mosaic Datasets
Please Fill Out Evaluation Forms Your comments help us meet your conference needs each year.
Reminder: National Museum of Natural History - Tonight- Buses start loading at 6:00pm at L:street entrance- Rotate till 9:30pm
Thank you…
Any Questions?