Creating a Hydrologically Conditioned DEM -...

46
Creating a Hydrologically Conditioned DEM Dean Djokic ([email protected])

Transcript of Creating a Hydrologically Conditioned DEM -...

Page 1: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Creating a Hydrologically Conditioned DEMDean Djokic ([email protected])

Page 2: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• What is a “hydrologically conditioned DEM”• How to develop hydro DEM• Tools for hydro DEM conditioning• Using hydro DEM/flow direction

Content

2Creating a Hydrologically Conditioned DEM

Page 3: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

What is a “hydrologically conditioned DEM”

Page 4: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Hydrologically conditioned DEM (Hydro DEM) is a DEM whose flow direction defines expected flow of water over the terrain (DEM).

• What is important is the resulting flow pattern, not the actual elevation in the DEM.

What is a “hydrologically conditioned DEM”

4Creating a Hydrologically Conditioned DEM

Page 5: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Elevation in the DEM is secondary to the flow direction it generates. You are NOT“fixing” elevations in the DEM – just making changes to get the flow direction correctly. Take advantage of that (don’t sweat the small things)!

• Do NOT use hydro DEM for surface characterization, just for flow direction determination.

What is a “hydrologically conditioned DEM”

5Creating a Hydrologically Conditioned DEM

Page 6: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Flow Direction

64 128

116

8 24

32

128 128

2

2 2

2

2

2

4

4

4

8

1 1 2

1

4

2

8

4

4

8

2

1

2

1

1

1

4

1

4

4

4

16

4

878

74

72

67

69

56

71

49

58

50

69

64

53

58

44

55

37

22

38

31

48

24

68

74

61

53

47

34

21

12

16

11

19

12

46

49

Elevation

Direction Coding

Flow Direction

6Creating a Hydrologically Conditioned DEM

Page 7: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• What matters is the drainage pattern!

Hydro DEM

7Creating a Hydrologically Conditioned DEM

Page 8: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Hydro DEM is a function of analysis being performed. Different analyses will require different hydro DEM for the same area. Some examples:

- Environmental (low) flows – small depressions in the terrain are important and should be explicitly modeled. They will catch and retain water.

- High flows (floods) – smaller depressions (and some larger ones) will fill and contribute to the downstream areas. They can be “ignored”.

One size does not necessarily fit all

8Creating a Hydrologically Conditioned DEM

Page 9: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Examples continued:- Design conditions (e.g. structure design). Most depressions can be “ignored” as it is

expected that under design conditions they will be filled due to the size of the event and will eventually contribute to the flow downstream.

- Real-time management (e.g. emergency management). While depressions will eventually fill and “spill”, the storage they provide might be critical for timing of the runoff and timely management of the resources (e.g. evacuation).

One size does not necessarily fit all

9Creating a Hydrologically Conditioned DEM

Page 10: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Examples continued:- Hydrology. Focus on getting the contributing area. DEM can be coarser and generalized,

but has to extend to larger area – whole watershed. Have to deal with depressions but coarser DEM will “smooth” out details, so there will be less issues to deal with.

One size does not necessarily fit all

10Creating a Hydrologically Conditioned DEM

Page 11: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Examples continued:- Hydraulics. Focus on channel flow conveyance. Has to be detailed, but has more limited

spatial extent – just floodplain. Does not have to be as concerned with smaller imperfections.

- Explicit models and modeling techniques. - 1-D or 2-D overland models.- Are depressions modeled as storage areas or not.- DEM too detailed/large.- …

One size does not necessarily fit all

11Creating a Hydrologically Conditioned DEM

Page 12: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

How to develop hydro DEM

Page 13: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

How to develop hydro DEM… carefully

• You have to know your terrain!- Do field work. Talk to the locals. Know the history.- Get wet - be there when it rains .

• You have to know what it will be used for.• Have supplemental topographic/hydrographic data:

- Known drainage lines (streams).- Known ridges.- Known depressions.

Creating a Hydrologically Conditioned DEM 13

Page 14: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

How to develop hydro DEM… carefully

• Have “other” supplemental data sources such as land use, soils, vegetation, that can all help in identifying geomorphologic elements (e.g. certain soils indicate standing water that in turn indicates depressions).

Creating a Hydrologically Conditioned DEM 14

Page 15: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Process can be iterative if you do not know the existing drainage pattern or/and do not have supplemental data.

- Make assumptions on the flow pattern- Apply them (burn streams, wall ridges)- Get the flow direction based on those assumptions- Evaluate the flow pattern and modify the assumptions if necessary

How to develop hydro DEM

15Creating a Hydrologically Conditioned DEM

Page 16: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• More difficult in flat areas!- If you do not know where the critical morphological structures are (ridges in particular), it

might be impossible to determine them from the DEM alone.

How to develop hydro DEM

16Creating a Hydrologically Conditioned DEM

Page 17: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Key techniques for hydro DEM development… not that many

• “Fill” sinks.• “Burn” streams.• “Wall” ridges (also called “fencing”).• Manage flow within lakes.• When all fails – change flow direction directly instead of modifying DEM to get the

right flow direction.

Creating a Hydrologically Conditioned DEM 17

Page 18: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Fill sinks

• Sinks

- Global fill

- Dealing with internal basins

- Selective fill

- Depth

- Area

… to fill or not to fill …

… or you can shave off peaks …18Creating a Hydrologically Conditioned DEM

Page 19: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

“Burn” streams or “fence” ridges… aka AGREE (UT – Hellweger)

Creating a Hydrologically Conditioned DEM 19

Page 20: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Modify flow direction directly… but be careful

• Sometimes easier (for few well defined cells)• Sometimes the only way (e.g. flow splits)• Early work at OMNR – Kenny & Matthews

Creating a Hydrologically Conditioned DEM 20

Page 21: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automating hydro DEM development… does it make sense?

• Although hydro DEM development might be iterative process and a function of the predominant terrain morphology (dendritic/deranged), the workflow can be captured and automated.

• Automation ensures implementation of best practices and consistency of the approach through the iterations and datasets.

Creating a Hydrologically Conditioned DEM 21

Page 22: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automating hydro DEM development… does it make sense?

• Usefulness of the results of the automated process will depend on the quality of the input data and knowledge of the terrain being modeled.

• How much QC is needed?- QC on the DEM itself- QC on vector data as input into the processing workflow

Creating a Hydrologically Conditioned DEM 22

Page 23: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Data input checks (work in progress)- Vectors

- Streams- Sinks, lakes- Boundaries

- Mix of Data Reviewer and geoprocessing

AH Data Health Check (1)

23Creating a Hydrologically Conditioned DEM

Page 24: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

AH Data Health Check (2)

24Creating a Hydrologically Conditioned DEM

Page 25: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Use Data Reviewer capabilities

AH Data Health Check (3)

• Custom GP QC checks when needed

25Creating a Hydrologically Conditioned DEM

Page 26: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Configuration on NHD / NHDPlus V2 data• Check as a service

• Does NOT fix data – just identifies issues!

AH Data Health Check (4)

26Creating a Hydrologically Conditioned DEM

Page 27: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Tools for hydro DEM conditioning

Page 28: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Specialized software (ANUDEM, TAUDEM, TOPAZ, …) that can generate raster datasets.

• ArcGIS- Spatial Analyst (basic functionality)

- TopoToRaster- Arc Hydro (advanced functionality, automation)

Tools for hydro DEM conditioning

28Creating a Hydrologically Conditioned DEM

Page 29: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Spatial Analyst (Hydrology toolset)- Sink (for identification)- Fill- Flow Direction

Tools for hydro DEM conditioning

29Creating a Hydrologically Conditioned DEM

Page 30: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Arc Hydro (Terrain Preprocessing toolset)- Adjust Flow Direction in Lakes- Adjust Flow Direction in Sinks- Adjust Flow Direction with Streams- Build Walls (*)- Create Sink Structures (for identification)- DEM Reconditioning- Fill Sinks- Flow Direction- Level DEM- Sink Evaluation (for identification)- Sink Prescreening- Sink Selection (for identification)

Tools for hydro DEM conditioning

30Creating a Hydrologically Conditioned DEM

Page 31: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automating hydro DEM conditioningWithin terrain preprocessing workflows captured in Model Builder models

Creating a Hydrologically Conditioned DEM 31

Page 32: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automating hydro DEM conditioningDetails (Known Sink Location And Some Filling)

Creating a Hydrologically Conditioned DEM 32

Portion of the overall model dealing with development of hydro DEM and flow direction

Page 33: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automating hydro DEM conditioningMore details (Known Sink Location And Some Filling)

Creating a Hydrologically Conditioned DEM 33

… and this is one of the medium complexity processes

Page 34: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Using hydro DEM/flow direction

Page 35: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Once correct flow direction is established, other raster and vector functions can be applied to determine important drainage pattern elements (drainage lines, catchments, watersheds, watershed characteristic, …).

• Many of these are captured in Arc Hydro tools and terrain preprocessing workflows.

Using hydro DEM/flow direction

35Creating a Hydrologically Conditioned DEM

Page 36: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Using hydro DEM/flow directionExample terrain preprocessing workflow (UC4 – combined with unknown sinks and streams)

1. Sink Evaluation.

2. Selection of sinks process.

3. Create Sink Structures.

4. Fill Sinks.

5. Flow Direction.

6. Adjust Flow Direction in Sinks.

7. Adjust Flow Direction in Lakes.

8. Sink Watershed Delineation.

9. Flow Accumulation.

10. Stream Definition.

Creating a Hydrologically Conditioned DEM 36

11. Stream Segmentation.

12. Combine Stream Link and Sink Link.

13. Drainage Line Processing.

14. Catchment Grid Delineation.

15. Catchment Polygon Processing.

16. Adjoint Catchment Processing.

17. Append Coastal Catchments.

18. Assign CatType Attribute to Catchment FC.

Page 37: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Terrain preprocessing workflows and tools - workflows

37Creating a Hydrologically Conditioned DEM

Page 38: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automated global processing (1)Work in progress …

• Inputs:- Start with DEM in a mosaic dataset

- Scalable!- Have your “clean” vector data - Have your terrain preprocessing workflows in a model builder/python script

Creating a Hydrologically Conditioned DEM 38

Page 39: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Automated global processing (2)Work in progress …

• Outputs:- Fully processed Arc Hydro global dataset (ready for use in tools/services)

- Global network and processing units- AH processed individual PUs

Creating a Hydrologically Conditioned DEM 39

Page 40: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Using hydro DEM/flow directionInteractive analyses

• Watershed delineation (interactive or batch)

Creating a Hydrologically Conditioned DEM 40

• Watershed characterization (e.g. flow path length)

Page 41: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Summary

Page 42: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Hydrologically correct DEM’s role is derivation of proper flow direction grid which in turn is the foundation for hydro analyses.

• Same extent can have several hydro DEMs, depending on the analysis type.- Hydro DEM is derived with analysis in mind.

• There are few core techniques for “correcting” DEM, but many permutations of how to use them depending on the available data and terrain morphology.

• Development of hydro DEM can be iterative process.• Be patient and know your “dirt”.

Summary

42Creating a Hydrologically Conditioned DEM

Page 43: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

• Tools in the Spatial Analyst Toolbox• Tools in Arc Hydro• Sample tools, models, and workflows are available in

ArcGIS Online• Hydro Resource Center

resources.arcgis.com/en/communities/hydro• Analysis and Geoprocessing Tool Gallery

• Arc Hydro forum

Where is this functionality?

43Creating a Hydrologically Conditioned DEM

Page 44: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Using the tools

Page 45: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain

Thank you…

• Questions ?

Creating a Hydrologically Conditioned DEM 45

Page 46: Creating a Hydrologically Conditioned DEM - Esriproceedings.esri.com/library/userconf/proc15/tech-workshops/tw_897... · • Many of these are captured in Arc Hydro tools and terrain