WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led...

31
217 217 217 200 200 200 255 255 255 0 0 0 163 163 163 131 132 122 239 65 53 110 135 120 112 92 56 62 102 130 102 56 48 130 120 111 237 237 237 80 119 27 252 174 .59 “The views, opinions and findings contained in this report are those of the authors(s) and should not be construed as an official Department of the Army position, policy or decision, unless so designated by other official documentation.” Subtitle Prepared by John Dubberley 9 August 2019 WATERBORNE COMMERCE STATISTICS CENTER (WCSC) PRESENTATION TO GICA 1

Transcript of WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led...

Page 1: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

217 217 217

200 200 200

255 255 255

0 0 0

163 163 163

131 132 122

239 65 53

110 135 120

112 92 56

62 102 130

102 56 48

130 120 111

237 237 237

80 119 27

252 174 .59

“The views, opinions and findings contained in this report are those of the authors(s) and should not be construed as an official Department of the Army position, policy or decision, unless so designated by other official documentation.”

Subtitle Prepared by John Dubberley 9 August 2019

WATERBORNE COMMERCE STATISTICS CENTER (WCSC) PRESENTATION TO GICA

1

Page 2: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

We aspire to remain a WORLD-CLASS organization, now and into the future, by setting the professional standard and stepping-up as a reliable Federal option. Perhaps the MOST STRATEGIC thing we can do is to simply DELIVER OUR PROGRAM…with exceptional quality, on time, and on budget.

Page 3: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

Provide safe, reliable, efficient, effective and environmentally sustainable waterborne transportation systems for

movement of national security needs, commerce, and recreation.

USACE NAVIGATION MISSION

Page 4: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

WATERBORNE COMMERCE STATISTICS CENTER (WCSC) OVERVIEW

4

• WCSC collects, processes, checks, distributes, and archives domestic and foreign vessel trip and cargo data.

• Data provides essential information for analyses of navigation projects (i.e., performance measures) and annual funding prioritization for operations and maintenance of existing projects.

• Under Federal law, companies must report domestic waterborne commercial vessel movements.

• Foreign data:

• U.S. Customs and Border Protection • U.S. Census Bureau • Port Import Export Reporting Service

Presenter
Presentation Notes
New water transportation projects and activities Set priorities for new investment and rehabilitation Management of existing projects.
Page 5: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

WCS AUTHORIZATION & HISTORY 5

• Rivers & Harbors Act of 1922 (amended and codified in 33 U.S.C. 555) authorizes the USACE to collect, process, distribute and archive waterborne commercial vessel trip and cargo data.

• 33 USC § 555 • Recognition of need to track the U.S. transportations system,

1970s • Water Resources Development Act of 1986 • 33 CFR § 207.800 • ENG Forms 3925, 3925b, 3925c, 3925p, 3932, and 3931 • Raw Data is considered to be proprietary and therefore are not

available to the general public as stated in the Trade Secrets Act Title 18, U.S. Code, Chapter 93, Section 1905

Presenter
Presentation Notes
Describe these events that led to development and growth of WCSC Following a review of the U.S. Foreign Waterborne Transportation Statistics program, the Office of Management and Budget (OMB) designated the U.S. Army Corps of Engineers (Corps) as the "central collection agency" for the program, and transferred program responsibility to the Corps, with operational support from the Maritime Administration (MARAD), effective October 1, 1998. The Corps collects and publishes the data pursuant to its authority under the 1922 River and Harbor Act, as amended, (33 U.S.C. 555) by which it has historically collected and published waterborne commerce statistics. To ensure the continuity of data, these products are currently identical to those formerly produced by Census. However, the long-term goal is to meet customer data requirements through improved data collection, production, and access. This information-gathering is the beginning of that process, and provides an opportunity for public input into the redesign of the program. This is consistent with the principles of the National Performance Review to provide better delivery of Federal services.
Page 6: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

LPMS AND WATERBORNE COMMERCE STATISTICS CENTER (WCSC)

• LPMS data is used in conjunction with data produced by WCSC to check vessel movements and ensure data quality.

• WCSC provides more details and in-depth data as information provided is more specific.

6

Web-based system used to collect and report data on vessels and commodities transported through USACE owned or operated locks.

Data is entered either manually by lock operator or through automatic identification signals (AIS) from ships.

LPMS Technical center under IWR NDC that is responsible for U.S. domestic and foreign waterborne transportation statistics mission.

Collects, compiles, and publishes waterborne statistics. Information collected includes vessels, tonnage, commodities, origin, and destination.

WCSC

Presenter
Presentation Notes
LPMS - Real time and tonnage is not as precise/accurate. Elaborate on why information provided to WCSC is more specific. Each company has 30 days from the end of the month to submit information via ENG Forms 3925 and 3925b (or equivalent).
Page 7: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

GEOGRAPHIC AGGREGATION 7

• National • State • County • Congressional District • Corps Project • Waterway • Waterway Segment • Past a point • Port • Dock/Terminal

Presenter
Presentation Notes
Since the waterborne commerce statistics dataset is a vessel/commodity movement-based dataset, it allows for many levels of aggregation, which can be used for USACE budget development, stakeholder outreach, USACE planning studies and general publications. Unique Foreign dataset. Only comprehensive Foreign dataset that contains: vessel, commodity, and TEU data at dock aggregated to Corps projects, port, waterway, state, and national levels. Top image: The U.S. Army Corps of Engineers Pittsburgh District Repair Party installs a needle dam at Montgomery Locks and Dam on the Ohio River near Monaca, Pa. Source: https://www.usace.army.mil/Media/Images/igphoto/2000746494/
Page 8: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

PUBLIC RESOURCES • Movement and Commodity

• Waterborne Commerce of the United States

• Ports and Waterways Web Tool • Waterborne Commerce Cargo

Data • Waterborne Commerce Trips Data • Principal Ports • Origin and Destination by

Commodity • Navigation Points of Interests

• Complete Dock List • Vessels

• Waterborne Transportation Lines of the United States

Presenter
Presentation Notes
Descriptions of resources: Waterborne Commerce Cargo Data and Trips Data: The Waterborne Commerce Cargo and Trips File presents data on the movements of commodities at the ports and harbors and on the waterways and canals of the United States and its territories. Ports and Waterways Web Tool: An interactive web interface that presents data on the movements of commodities at ports or on US waterways Principal Ports: Publication for each major port in terms of tonnage for the calendar year Origin and Destination by Commodity (suggest renaming this bullet to "Public Domain Data"): Annual commodity movements from state to state, and region to region Complete Dock List: Spreadsheet that contains a list of all facility types (dock, anchorage, mile point, etc.) that may be reported as the origin or destination of commercial waterborne vessel moves. The Waterborne Commerce of the United States (WCUS) is a five-part publication that provides annual statistics on foreign and domestic waterborne commerce moved on the United States waters. WCSC publishes the Transportation Lines of the United States report annually which includes national summaries, vessel company summaries, and vessel characteristics. The product provides an inventory of vessel companies and their American flag vessels operating in the transportation of freight and passengers, and a national summary of all vessels. https://www.iwr.usace.army.mil/About/Technical-Centers/WCSC-Waterborne-Commerce-Statistics-Center/
Page 9: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

WHAT’S AT STAKE?

• Federal Budget • Performance-based budgeting • Federal Funding for New and Existing Federal navigation projects • Investment to improve delays • High/Medium/Low Use Waterways

• Grants

• Agency assessments of Port and Waterway Performance • Regional Economic Indicators

• Private Investment Decisions

Page 10: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

NAVIGATION COMMUNITY PROVIDES Vessel Operating Report

• Vessel ID & Operator • Origin Port & Dock • Destination Port & Dock • Date Depart & Arrive

VORs Vote for Waterways, Locks, and Ports

• Route Taken • Draft • Commodity • Tonnage

VESSEL OPERATION REPORT REPORT FOR MONTH OF August ENG FORM 3925B DATE 10/4/18

Trips Vessel Load Port or

Locality Load Dock Name Load Date Load Draft Unload Port or Locality Unload Dock Name Unload Date

Unload Draft Commodity Tons

Page 11: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

NAVIGATION COMMUNITY PROVIDES

Voluntary Dock Receipt Provided by Ports and Dock Owners Lists : vessels that called dates of arrival dates of departure Used to assure proper location is getting credit. Prefer Excel format version of dock receipt.

Page 12: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

REPORTING LOCATION QUALITY ISSUES

Operators identify origins and destinations inconsistently Example: KINDER MORGAN ENERGY PARTNERS on the Houston Ship Channel Reported by 42 operators, 200 different ways

Page 13: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

LOCATION REPORTING SOLUTION

Best Practice: Dock Identification WATERWAY + MILE + PORT + DOCK Example: HSC - 47.0 - HOUSTON, TX - KINDER MORGAN ENERGY PARTNERS

Note: Utilize the National Waterway Network for waterway names

Page 14: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

RAMIFICATIONS OF POOR DATA

Dock 1 annually ships around 1.5M tons to locations upstream

When studying a proposed lock

extension, the vessel movements carrying the 1.5M tons were incorrectly captured as going through Lock A

– Affected automation of economic modeling

– Affected traffic forecasts

Required additional time to clean up data before economic modeling/forecasts could be completed

Page 15: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

PRODUCTION WORKFORCE SKILLS

Page 16: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

WCSC PRODUCTION STEPS

1. Receive the Data -improved by recent automation

2. Prepare data for ingestion -improved by recent automation

3. Data ingest to preprocessor

4. Fix items flagged by preprocessor

5. Push to database – improving database currently

6. Legacy code routes trips and flags errors in TOWS -scheduled improvements in database initiative

7. Reprocess data to fix errors flagged

8. Perform QC with dock receipts

9. Publish Results

Page 17: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

QUALITY CONTROL IMPROVEMENTS

Old QC New QC QC on totals for ports, areas By dock Almost any input allowed to DB Restrict Input rigorously Next day feedback Immediate feedback End of year QC Continuous QC Stove Pipe Areas of Responsibility Interlocking QC support

Page 18: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

CONTINUOUS PROCESS IMPROVEMENTS

• Database modernization • User friendly and geospatial data links • Quarterly Reports • Timely Publications

• 30 Sep Waterborne Commerce Data • Preliminary Statistics and Estimates

• New tools for error checking • Most up-to-date data available

• http://www.iwr.usace.army.mil/About/TechnicalCenters/WCSCWaterborneCommerceStatisticsCenter.aspx

Presenter
Presentation Notes
Data modernization will feed CWBI, create GIS query tools and port shape files
Page 19: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

WHAT IS STATISTICAL PORT?

Collection of docks within a single municipality or collection of municipalities recognized by a state or states for the purpose of being designated as a port.

Upon internal approval, USACE has authority to accept all deletions,

modifications to, or establishments of port areas in the United States.

Legal definition of the port comes from:

• legislative enactments of state, county, or city governments • corporate limits of a municipality

USACE uses statistical ports to publish waterborne commodity data

Presenter
Presentation Notes
Item V
Page 20: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

NEW PRODUCT

File Name

20

Provided with active dock list. Used to check WCSC crediting proper boundary and including correct docks.

Page 21: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

GIWW TONNAGE CARRIED

File Name

21

Page 22: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

GIWW TONNAGE CARRIED

File Name

22

Page 23: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

GIWW TONNAGE CARRIED

File Name

23

Page 26: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

THE ORACLE WATERBORNE SYSTEM (TOWS)

26

TOWS contains WCSC’s database of record to store commercial cargo and vessel movement data (both foreign and domestic) and navigation points of interest. It generates monthly, quarterly, and yearly* reports that are a resource for budget analysis. Other outputs include:

• Data on foreign imports and exports • Domestic receipts and shipments (by types of traffic)

of waterborne commerce at U.S. harbors and along waterways

*Yearly includes both calendar and fiscal year

Presenter
Presentation Notes
Calendar year data is not available until 9 months after the close of the calendar year
Page 27: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

DOCKS INFORMATION 27

In the past there were two groups collecting information on docks used in commercial navigation activities, but no coordination until the development of Master Docks Plus. Single source of dock information, including geographic attributes, commodity details, etc. Source for navigation points of interest including:

• Piers, Wharves, and Docks • Mile points • Fleeting areas • Bridges • Anchorages • Locks • Lock chambers • Open water

Presenter
Presentation Notes
Each is referred to as a navigation unit and has a unique nav_unit_id. Fixed point (can have a lat/long assigned) Contiguous area Accommodate a waterborne vessel Recognized by industry peers Impact commercial business
Page 28: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

FOREIGN COMMERCE STATISTICS

• Cargo datasets: • PIERS Import and Export data subscription • Foreign Trade Statistics Program, U.S. Census Bureau

• Vessel movement data

• Customs & Border Protection Vessel Management System

• Imports and exports and In-Transit Cargo through United States

• Product: Integrated dataset representing foreign cargo transiting U.S. ports and waterways

Presenter
Presentation Notes
Processing: Match cargo data to vessel movement data Enable geographic accuracy to the dock level Create composite data set Reconcile gaps between PIERS base data set and supplemental sources Execute quality control activities Ensure tonnage is captured once and credited in correct port/waterway
Page 29: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

CONTRIBUTORS AND USERS

• Census Bureau • Customs & Border Patrol • Department of Energy, U.S. Energy Information

Administration • Government Accountability Office • Internal Revenue Service • State Tax Agencies • U.S. Coast Guard • And other federal agencies with navigation related

missions

Presenter
Presentation Notes
Waterborne statistics provide key insights that inform investment decisions for new as well as existing USACE projects IRS – When briefing this slide, make sure to thoroughly explain how IRS data is used as this connection can raise concerns with operators. Census Bureau – provides WCSC foreign shipment information EIA - Uses data from WCSC (TOWS) related to specific energy commodities. The EIA has a responsibility and set of OMB forms to gather this data and information. WCSC data is used to quality check prior to reporting. EIA receives information relating to when a commodity crosses a PADD Coast Guard – receives information from TOWS relating to certain dangerous cargos (CDCs)
Page 30: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

DATABASE REDESIGN Enhance efficiency by moving from a disorganized, highly complicated system to a simple, relational database design. Leveraging the technology available in new versions of Oracle allows for

improvement in data access efficiency. Reducing redundancy inherent in the current design leads to more efficient data

access Implementing a consistent and more efficient key design allows for rapid data

access.

Ensure data integrity by: Preventing duplication of data by storing all objects that share common attributes in

a single place. Using views to eliminate unnecessary table replications. Using foreign key constraints to enforce data integrity.

Leverage auditing Improving the process Automating tasks

Extensibility

Page 31: WATERBORNE COMMERCE STATISTICS CENTER (WCSC) … · 2019-09-04 · Describe these events that led to development and growth of WCSC\爀屲Following a review of the U.S. Foreign Waterborne

RELEASE DATA MORE OFTEN

Expand Current Quarterly Report • Include more waterways • Include Top Port Reports • Include Vessel Summary • Include USACE Project Statistics

31