INDEPENDENT ASSESSMENT OF THE COOLING TOWER …fbportsmouth.com/docs/Solicitations/X670A/SOW... ·...

I N D E P E N D E N T A S S E S S M E N T O F T H E P R E M A T U R E F A I L U R E O F T H E X - 6 7 0 A

C O O L I N G T O W E R C O I L S

CONTRACT NO. PO-0012421

SOLICITATION NO. FBP13SC30604

DOCUMENT NO. FFE.IA.001, REV 0 MARCH 24, 2014

PREPARED BY:

FFE.IA.001, REV 0 MARCH 24, 2014

Page i

Independent Assessment of the Premature Failure of the X-670A Cooling Tower Coils

TABLE OF CONTENTS

PURPOSE ....................................................................................................................................................... 1

EVENT SUMMARY ......................................................................................................................................... 2

SUMMARY TIMELINE OF SIGNIFICANT EVENTS ........................................................................................ 3

ORIGINAL DESIGN SPECIFICATION FOR COOLING TOWER COILS ................................................................. 6

X-670 RCW SYSTEM WATER SPECIFICATIONS ............................................................................................... 6

HISTORICAL WATER CHEMISTRY DATA ......................................................................................................... 8

WATER TREATMENT EFFORTS .................................................................................................................... 15

CAUSES OF PREMATURE FAILURE ............................................................................................................... 16

PROPOSED RECOMMENDATIONS ............................................................................................................... 16


Page 1/16


PURPOSE

A new Dry Air Plant, Bldg X-670, was constructed at the DOE Portsmouth Facility and placed in operation by September 2010. Five cooling tower cells constructed as part of this project provided cooling water for Bldg X-670, X-300, and Bldg X-710. By September 2013, all five of the cooling tower coils on the closed loop cooling system had failed due to leaks in the coils.

An independent investigation was performed to determine the probable cause of the cooling coil failures and to evaluate proposed corrective actions.

The investigation included: review of EVAL-TS-2014-0001; review of the Bldg X-670 and the X-670A Cooling Tower System P&IDs, design specifications, vendor data, as-built drawings, water quality data; and interviews with personnel associated with the project.

Personnel interviewed or consulted included: NAME COMPANY POSITION

Wayne Hacker FBP* Lead Engineer Bob Penn FBP* System Engineer Bernie Carrick FBP* Design Authority Al Hoffman FBP* Utilities Lead Dick Armstrong FBP* Utilities Manager Wendell Jenkins FBP* Technical Support Chris Kelly GE Water & Process Technologies FBP water quality vendor

Brian Bridgeford Stoermer-Anderson, Inc. Manufacturer’s Rep. for Marley Cooling Technologies/SPX, cooling tower supplier

Scott Massie Geiger Brothers President, mechanical contractor Larry Smith Camp Dresser & McKee (CDM) Design Manager, design/build prime contractor Jeff Bowley Air Relief Technical Support, air compressor vendor

Leisa Corbett Houghton Chemical Corp Water Treatment Business Manager, propylene glycol supplier

Richard De Martino Industrial Water Technologies Corrosion consultant for Houghton Chemical Corp * USEC employee during the Dry Air Plant construction

The purpose of this report is to address the following:

a) Event Summary including a timeline of significant events for X-670A Cooling Tower and X-670 RCW Systems.

b) Analysis of the original project design specification for the X-670A Cooling Tower coils and the required water quality.

c) Analysis of the water specifications provided by the X-670 RCW systems and limitations d) Analysis of the historical X-670 RCW System water chemistry from day 1 (start-up) of the X-670A

Cooling Tower to the present time. e) Analysis of the efforts to maintain and control the water chemistry over time. f) Conclusion summary of the cause(s) of the premature failure of the X-670A Cooling Tower coils

and the cause(s) of other heat exchanger problems in the X-670 RCW system. g) Analysis of proposed recommendations of how to correct the problem for the long term.


Page 2/16


EVENT SUMMARY

The X-670A cooling towers were installed as part of a design-build project to provide recirculating cooling water (RCW) to the Portsmouth DOE site. The recirculating cooling water system was designed to provide cooling to the Bldg X-670 Dry Air Plant, the X-300 Plant Control Facility chiller, and the two X-710 Laboratory chillers.

The RCW system was started up on September 30, 2010. Flushing was performed using Ferroquest FQ7103 to clean and passivate the steel piping. The initial flushing was noted to have been incomplete, in that the water in the system was still visibly rusty after three flushes. A corrosion inhibitor, Corrshield OR4407, and glycol were added to the glycol closed-loop system and startup activities continued. The Dry Air Plant system was put into operation on 09-30-2010.

Although efforts were made to filter out the iron, the system was plagued with excess iron in the glycol system. This apparently caused fouling of the equipment which necessitated increased flow and lower cooling water temperatures.

The pH declined steadily from the point of startup. Within a year of startup, the copper corrosion coupon indicated increased corrosion rate, from 0 mpy to 0.3 mpy. A copper corrosion inhibitor was added in December 2011, which reduced the rate of corrosion and increased the pH briefly, but the system continued to decline in pH and the corrosion issue persisted.

Almost two years after the system was put in operation, the plant began experiencing issues with leaks in the compressor and dryer cooling systems. During repairs by the air compressor vendor, it was discovered that the cooling water side of the system was filled with iron sludge. The X-670 Dry Air Plant compressed air system was shut down but the cooling towers continued to operate to provide cooling for the X-300 and X-710 chillers.

Copper corrosion rates appear to have increased to 0.8 mpy by December 2012. A maintenance shutdown from March 2013 to May 2013 prevented treatment of the system during this time period. Copper corrosion inhibitor was added to the glycol system in April 2013 with no noticeable impact.

Leaks began developing in the cooling tower closed-loop coils in May 2013. Between May 2013 and September 2013, GE Water added copper corrosion inhibitor and borate to the glycol system, in an effort to raise the system pH. During this time, each of the cooling tower closed loop coils developed leaks.

Eventually, the cooling tower glycol system coils failed, resulting in total shutdown of the X-670A RCW system. The X-300 and X-710 chillers were switched over to the X-726 RCW system.

A summary timeline of events is shown below.


Page 3/16


SUMMARY TIMELINE OF SIGNIFICANT EVENTS

DATE EVENT

• X-670 RCW initial construction completed, flushing performed using Ferroquest FQ7103

• Three flushes completed but the water was still visibly rusty

• X-670 RCW system filled with corrosion inhibitor, CorrShield OR4407, and propylene glycol solution

• X-670 air compressors placed in service

• GE Water performs particle size analysis to determine filtration requirements

• Corrosion coupons installed

• Iron sludge sample provided to GE Water for analysis

• GE Water recommends filtration to remove excess iron from glycol system

• Meeting to discuss iron removal

• Side-stream filter skid installed

• Coupons indicate increase in corrosion rate in glycol system (up to 0.2 mpy for mild steel and 0.4 mpy for copper)

• GDP M&O responsibilities transferred to FBP

• Azole copper corrosion inhibitor (AZ8104), dispersant (DIANODIC DN2300), and phosphate added to glycol system

• Corrosion rates drop, pH increases 12-13-11

10-01-11

Aug–Dec 2011

Aug 2011

02-01-11

Jan 2011

12-28-10

12-03-10

11-05-10

09-30-10

09-22-10 09-23-10

09-22-10


Page 4/16


DATE EVENT

• #1 Compressor shut down on high vibration • after cooler leak discovered, due to tube pitting • cooler cavities full of iron sludge

• #2 compressor shut down on surging

• #3 Compressor shut down on surging • Intercooler leak discovered • Replaced intercooler

• #2 Compressor aftercooler leaks found • Iron sludge in water side of cooler

• #3 oil cooler failed • Found leaks in oil cooler • Iron sludge in water side of cooler

• GE Water performs test to determine feasibility of using polymers for coagulation of iron to improve filtration from glycol system

• Tests indicate polymer use to be impractical

• #3 Compressor surging • All three compressors shut down until water quality resolved • X-670 RCW continues to operate for cooling X-300 & X-710

• Brass corrosion coupon exhibits signs of tarnish

• Work activities suspended until JHAs and work packages prepared

• Corrosion inhibitor (azole) added to glycol system

• Cooling Tower Cell #2 glycol system coil failure, leaks

• 60 gallons of azole (AZ8104) added to glycol system

05-21-13

05-20-13

04-20-13

Mar–May 2013

12-11-12

11-21-12 11-23-12

10-23-12

Oct 2012

09-27-12

09-17-12

09-17-12

07-25-12


Page 5/16


DATE EVENT

• Replaced side stream filter skid with larger capacity filter system (2% 0f system flow)

• Marginal decrease in glycol system iron content

• Meeting held to discuss changes in chemical treatment in order to remove iron • Ordered mixed metal corrosion inhibitor (Corrshield MD4100), dispersant

(GENGARD GN7004), and a biodispersant (SPECTRUs BD1507)


• 60 gallons of borate (Corrshield BT4301) added to glycol system • copper coupon corrosion rate drops to 0.2 mpy

• 60 gallons of azole (AZ8104) added to glycol system

• Borate (Corrshield BT4301) added to system • pH increases from 6 to 6.6


• 120 gallons of borate (Corrshield BT4301) added to glycol system • pH increases to 7.3

• 120 gallons of borate (Corrshield BT4301) added to glycol system


• GE performed analysis to determine borate concentration required to neutralize the glycol system

• Cooling Tower Cell #5 glycol system coil failure, leaks • All cooling towers out of service

• X-710 and X-300 chillers switched over to X-626 RCW system

09-23-13

09-23-13

09-17-13

09-14-13

08-29-13

08-27-13

08-24-13

08-16-13

08-13-13

08-06-13

07-17-13

07-11-13

06-17-13


Page 6/16


ORIGINAL DESIGN SPECIFICATION FOR COOLING TOWER COILS

REQUIREMENTS

• USEC ESO E3373, Specification 2.1.5.1.5-12, MAJOR EQUIPMENT PROCUREMENT SPECIFICATION, X-670A – Dry Air Plant Cooling Tower Procurement, Par. 2.1 J. identified the cooling tower Heat-Exchanger Coils requirements as:

1. Tube and Tube Sheet Materials: Prime-coated steel tube and sheet with outer surface of tube and sheet hot-dip galvanized after fabrication.

2. Heat-Exchanger Arrangement: Serpentine tubes 3. Field Piping Connections: Vent, supply, and return suitable for mating to ASME B16.5,

Class 150 flange • Par. 2.1.T.3. identified the following heat exchanger coil requirements:

a. Fluid Type: 40% Propylene Glycol and Water b. Fluid Flow/Cell: 1250 gpm per cell c. Fluid Pressure Drop: 11.46 psig d. Entering-Fluid Temperature: 100 deg. F e. Leaving-Fluid Temperature: 85 deg. F f. Entering-Air Wet-Bulb Temperature: 78 deg F

EVALUATION

• The SPX vendor data for the cooling tower coils, submitted by Stoermer-Anderson, was consistent with the performance requirements identified in the specification.

• The specification did not directly address water quality requirements for the closed loop (glycol loop).

X-670 RCW SYSTEM WATER SPECIFICATIONS

REQUIREMENTS

• USEC ESO E3373, Specification 2.1.5.1.5-1, MAJOR EQUIPMENT PROCUREMENT SPECIFICATION, Air Compressor Procurement, Par. 4, identified the following design criteria:

Cooling Water Design Temperature: 85°F +10/-5°F Cooling Water Design Pressure: 70 psig +5/-35 psig

• USEC ESO E3373, Specification 2.1.5.1.5-6, Par. 4.9.4 required the cooling water for the dryer aftercooler to be treated for corrosion control and have a supply design temperature of 65 °F at 50-65 psig.

• USEC SOW-ENG-010-021, Specification Section 15074, Cleaning of Utility Piping, addressed cleaning of the internal surfaces of piping designated as utility piping for tower cooling water service (TWC) and Process Water (PW). Par. 1.03 required the Contractor submit a TWC Pipe Cleaning and Flushing Plan. Par. 3.02 required that all pipelines shall be flushed at no less than their design flow rate unless a lesser rate is approved by the STR.

• USEC SOW-ENG-010-021, Specification Section 15051-F138, Process Cooling, Raw and Cooling Tower Water, indicated that, unless otherwise specified, all material includes a minimum corrosion allowance of 0.065 inch.


Page 7/16


• The proposed New Coolant Piping Cleaning Sequence reviewed for this assessment required charging the new X-670 system piping with cleaning chemicals then recirculating the water for 48-72 hours while controlling pH in the 6.5 to 7.0 range.

• Par. 2.10 required replacing one-half the system volume with fresh water and new cleaning chemicals if the iron level exceeded 1200 ppm.

• Par. 2.11 required flushing the entire new X-670 piping system when the iron levels reached a plateau.

• Section 3.0 proposed addition of the propylene glycol to the X-670 piping then adding inhibitors through the equalization tank.

EVALUATION

• The cooling water heat transfer requirements appear to be adequate. More information is required to perform a detailed analysis of the cooling capacity of the system.

• The design documents did not provide details of the design basis. Specific water quality requirements for the glycol loop were not located during this assessment.

• The proposed New Coolant Pipe Cleaning Sequence recirculation duration of 48-72 hours is not consistent with the product data sheet for Ferroquest FQ7103, which indicates a minimum recirculation period of 72 hours, followed by a 24 hour rinse.

• The propylene glycol product sheets provided by the project were for Safe-T-Therm, which is inhibited. Conversations with Houghton Chemical, the propylene glycol supplier, indicated that the product that was ordered and delivered was uninhibited glycol. Uninhibited glycol is corrosive to steel and copper, which could have a detrimental impact on the system until corrosion inhibitors are added. The impact of the contact with the uninhibited glycol would be proportionate to the amount of time between introduction of the propylene glycol and addition of the corrosion inhibitor.


Page 8/16


HISTORICAL WATER CHEMISTRY DATA

The water chemistry data indicate the following trends:

The general trend over time was an increase in iron and copper (See FIGURE 1 below). This would be consistent with an increase in corrosion over time.

FIGURE 1

0

50

100

150

200

250

300

350

400

0

1000

2000

3000

4000

5000

6000

Copp

er (p

pm)

Iron

(ppm

)

Date

METAL CONCENTRATION vs TIME Iron (ppm) Copper (ppm) Linear (Iron) Linear (Copper)


Page 9/16


The pH trend for the X-670 glycol cooling system was a fairly consistent drop from the time the system monitoring began until the system was shut down (see FIGURE 2 below). Chemical addition accounts for the local points of rise in pH.

FIGURE 2

5.0

5.5

6.0

6.5

7.0

7.5

8.0

8.5

9.0

pH

DATE

pH vs TIME pH Linear (pH)


Page 10/16


The trend for the level of iron and copper in the water was consistent with the pH level (see FIGURE 3 below), which would be expected. Data for events such as water addition, glycol addition, and removal of metals by filtration was not available but did not appear to have a significant impact on the overall trend.

FIGURE 3

0

50

100

150

200

250

300

350

400

0

1,000

2,000

3,000

4,000

5,000

6,000

5.0 5.5 6.0 6.5 7.0 7.5 8.0 8.5

Copp

er (p

pm)

Iron

(ppm

)

pH

METAL CONCENTRATION vs pH Iron (ppm) Copper (ppm) Linear (Iron) Linear (Copper)


Page 11/16


The trend for propylene glycol concentration over time (FIGURE 4) is similar to the trend for pH over time (FIGURE 2), which is consistent with the fact that glycol breaks down into organic acids at an accelerated rate when the pH drops below about 7. The general trend for propylene glycol concentration was to drop as the pH decreased (FIGURE 5), which would be expected. The individual points would be affected by glycol or make-up water addition, if they occurred. These events were not identified in the timeline but seem likely to have been necessary.

FIGURE 4

FIGURE 5

20

25

30

35

40

45

Prop

ylen

e G

lyco

l (%

)

DATE

GLYCOL CONCENTRATION vs TIME Propylene Glycol % Linear (Propylene Glycol %)

20

25

30

35

40

45

5.0 5.5 6.0 6.5 7.0 7.5 8.0 8.5 9.0

Prop

ylen

e G

lyco

l (%

)

pH

GLYCOL CONCENTRATION vs pH Propylene Glycol % Linear (Propylene Glycol %)


Page 12/16


The level of potassium in the cooling water is an indicator of the amount of corrosion inhibitor present. The levels of potassium were generally too low to determine the impact on the amount of iron in the water, which would be an indication of the rate of corrosion. FIGURE 6 shows the relationship between the amount of iron in the water and the amount of corrosion inhibitor. FIGURE 7 shows the change in the level of corrosion inhibitor over time. The increase in potassium in January 2012 correlates with the addition of corrosion inhibitor in December 2011. Data points for potassium were not provided for the period after July 2013.

FIGURE 6

FIGURE 7

0

50

100

150

200

250

300

350

400

0

1,000

2,000

3,000

4,000

5,000

6,000

0 50 100 150 200

Copp

er (p

pm)

Iron

(ppm

)

Potassium (ppm)

METAL CONCENTRATION vs POTASSIUM CONCENTRATION Iron (ppm) Copper (ppm) Linear (iron) Linear (Copper)

0

20

40

60

80

100

120

140

160

180

200

Pota

ssiu

m (p

pm)

DATE

POTASSIUM CONCENTRATION vs TIME Potassium (ppm) Linear (Potassium)


Page 13/16


The level of azole in the water was typically too low to contribute to a trend. Azole is a copper corrosion inhibitor. The comparison of the level of copper to azole in the glycol water is shown in FIGURE 8. The level of azole in the water over time is shown in FIGURE 9.

FIGURE 8

FIGURE 9

0

20

40

60

80

100

120

0

1000

2000

3000

4000

5000

6000

0 20 40 60 80 100 120

Copp

er (p

pm)

Iron

(ppm

)

Azole (ppm)

METAL CONCENTRATION vs AZOLE CONCENTRATION Iron (ppm) Copper (ppm) Linear (Iron) Linear (Copper)

0

20

40

60

80

100

120

Azol

e (p

pm)

DATE

AZOLE CONCENTRATION vs TIME Azole (ppm) Linear (Azole)


Page 14/16


The corrosion rates for the mild steel and copper were generally low. The mild steel corrosion rate varied from 0 to 1.3 mpy with half of the readings at 0 mpy. The copper corrosion rate varied from 0 to 10 mpy, with 30% of the readings at 0 mpy. The coupon corrosion rates would be expected to correspond with the levels of iron and copper in the solution but the general trend indicated no significant change in metal level with change in corrosion rate. The design allowance for corrosion was identified as 0.065 inches. Assuming a useful life of 30 years for the equipment results in an allowable corrosion rate of 2.167 mils per year (mpy). The corrosion rates measured for mild steel never exceeded 1.3 mpy, with the majority of the rates at 0 mpy. FIGURE 10 shows the relationship between the amount of iron in the cooling water and the mild steel corrosion rate.

FIGURE 10

0

1,000

2,000

3,000

4,000

5,000

6,000

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 1.1 1.2 1.3 1.4

Iron

(ppm

)

Mild Steel Corrosion (mpy)

IRON CONCENTRATION vs CORROSION RATE Iron (ppm) Linear (ppm)


Page 15/16


WATER TREATMENT EFFORTS

DISCUSSION

The timeline indicates that water treatment for the X-670 project glycol loop consisted of cleaning and passivation of the glycol pipe, prior to introduction of propylene glycol. The cleaning and passivation plan included adding Ferroquest FQ7103 to the cooling water loop and circulating the water for 48 to 72 hours while flushing as needed to ensure the iron levels remained below 1,200 ppm.

The actual sequence of events from the construction logs is not clear. The timeline information provided indicates that three flushes were performed and the flush water was still visibly rusty. It is not clear as to whether water quality data was taken. The decision was made to discontinue the cleaning effort and add the necessary quantity of propylene glycol to bring the glycol concentration in the system to 40%.

The plan for propylene glycol addition included adding propylene glycol then circulating the mixture through the glycol cooling loop. Corrosion inhibitors were then to be added to the glycol loop through the equalization tank.

The timeline shows that corrosion inhibitor, CorrShield OR4407, was added to the propylene glycol solution between 09-22-10 and 09-23-10. No water quality data was available until November 2010, so the condition of the glycol loop water is unknown until that date. The data for November 2010 shows the pH was 8.8, copper was <0.5 ppm, iron was 91 ppm, and tolyltriazole was 10 ppm. No value was provided for potassium.

Treatment efforts from that point on appear to have been primarily focused on removal of the iron particles in the water through filtration.

Filtration appears to have had little impact on the total iron in the water.

In December of 2011, corrosion inhibitors were added in response to what was characterized as increased corrosion in the test coupons.

A brass corrosion coupon was installed prior to January 2013. Indication of corrosion in the coupon resulted in addition of a copper corrosion inhibitor in April 2013 and May 2013.

In June 2013, the side stream filtration rate was increased in an attempt to reduce the level of iron in the glycol loop water.

In July, the decision to change chemical treatment resulted in a plan to treat the water with a corrosion inhibitor, dispersant, and biodispersant. These chemicals were ordered but not received before the system was shut down.

A buffer (Corrshield BT4301) was added several times in August 2013 in an attempt to control the corrosion by increasing the glycol system pH. The pH did increase but the system failed before further treatment could be applied.

EVALUATION

It appears that the treatment of the glycol water system was primarily limited to removing excess iron through filtration and controlling perceived accelerated corrosion of copper until the system was close to failure. At that point efforts to control corrosion by adding corrosion inhibitor and dispersants were curtailed by failure of the cooling tower coils.


Page 16/16


CAUSES OF PREMATURE FAILURE

Excess iron in the X-670 glycol loop, left from incomplete cleaning and passivation of the system, appears to have caused restrictions through the heat exchangers and coils of the equipment. This required increased flow and lower cooling water temperatures in order to achieve the required cooling.

The excess iron may have contributed to consumption of the initial batch of corrosion inhibitor and a drop in pH of the system. As the pH dropped, the degradation rate of the propylene glycol increased, resulting in the presence of organic acids which caused the corrosion of the steel to increase. The continued corrosion of the steel prevented the filtration from significantly impacting the iron levels in the water.

The use of uninhibited propylene glycol compounded the difficulty in the initial treatment of the system and may have contributed to the increased rate of system degradation.

Corrosion inhibitor for the steel was not added to the system until August 2013, when the cooling tower coils were failing. By this time, the propylene glycol had been subjected to low pH levels for extended periods of time, resulting in accelerated degradation of the glycol and increased production of organic acids. The degradation of the glycol may have caused bacterial colonies to develop.

The restrictions in the coils may have caused high velocities and erosion may have caused excess wear in the coils. It is also possible that the copper in the water may have caused pitting in the coils. Microbial corrosion could also have been a factor in the coil failure.

PROPOSED RECOMMENDATIONS

• The X-670 loop should be emptied of the existing treated water and flushed clean. • The failed coils should be removed and the failed sections examined to determine the cause of

the leaks. Examination should reveal the type of failure and provide insight into possible issues impacting corrective actions.

• All components of the system should be physically cleaned and examined for damage. The extent and method of cleaning should be determined, based on the component characteristics, so that the majority of deposits are removed and so as to limit interference with examination. The method and frequency of examination should be based on the salient features of the component and the failure modes determined from the analysis of the failed components.

• The fill lines into the equalization tank should be extended beneath the operating level of the tank, to limit aeration of the water.

• The lines should be thoroughly flushed and passivated prior to adding glycol. • Leak testing of the system should be performed prior to glycol addition. • An inhibited glycol solution should be added to the system. • Monitoring of the water quality should be performed regularly, including testing for biological

activity.

INDEPENDENT ASSESSMENT OF THE COOLING TOWER …fbportsmouth.com/docs/Solicitations/X670A/SOW... ·...

Documents

Transcript of INDEPENDENT ASSESSMENT OF THE COOLING TOWER …fbportsmouth.com/docs/Solicitations/X670A/SOW... ·...