Maintaining Program Integrity

The Role of Product Testing

• Goal: Protect the integrity of the label

– Require the submission of appropriate test data on a product specific basis

• Enhancing ESTAR Test Methods by referencing industry test procedures, developing test facility manuals, and requiring third-party documentation, where necessary

– Implementing Testing Initiative to identify potential compliance problems

• Set in motion a review process to ensure manufacturers take corrective measures

Referencing Industry Test Procedures

• Dehumidifiers: Test Criteria: Tests shall be conducted in accordance with Clauses 4, 5, and 7 of ANSI/AHAM Standard DH-1, except that a watt-hour meter shall be used to measure dehumidifier energy consumption during the capacity rating test. The watt-hour meter shall be accurate within 0.5 percent of the indicated value and have a scale with graduations of 1 watt-hour or less. Energy Factor is to be calculated according to Section 4.2 of CAN/CSA-C749-94.

• EX: ESTAR Ceiling Fan Test Facility Guidance Manual

– Provides procedures and specifications for building and setting up an air delivery room, specifies equipment, test method reporting procedures

– Requires laboratories to calibrate to ensure consistent, repeatable results

• All laboratories are required to calibrate, using the same reference fan, once a year and produce results within +/-3% of each other.

Quality Assurance: Improved Test Methods

Quality Assurance: Improved Test Methods (cont.)

• EX: ESTAR Monitor Test Method Committee

– More than 30 industry representatives collaborating with EPA on the draft monitor test method

– References published specifications from VESA and IEC

• supplement guidelines where necessary with methods developed in cooperation with industry

– Process will ensure On Mode testing consistency among manufacturers

Compliance Testing Initiative

• Selecting products with greatest market share

• Using existing ESTAR testing guidelines

• Independent testing lab

• Stakeholder communication protocol with defined steps for non-compliance

• Test results and recommendations– July/August -- Televisions

– Nov. -- DVDs

– Dec./Jan. -- Monitors

• Future efforts under consideration: potential on-site test method evaluations

TV Results

ManufacturerModel

NumberEnergy Star Limit in Standby Mode

(Watts)

Standby Mode Power (Watts) Pass/Fail

Unit#1

Unit #2

Unit #3

1 A 3.0 0.7 0.7 0.8 Pass

1 B 3.0 0.7 0.7 0.7 Pass

1 C 3.0 0.6 0.6 0.6 Pass

1 D 3.0 0.4 0.5 0.4 Pass

1 E 3.0 1.0 1.2 0.9 Pass

2 A 3.0 2.8 2.7 2.7 Pass

2 B 3.0 1.1 1.0 1.2 Pass

2 C 3.0 2.9 2.9 3.0 Pass

2 D 3.0 0.7 0.9 0.9 Pass

2 E 3.0 0.8 0.6 0.7 Pass

2 F 3.0 0.7 0.7 0.5 Pass

2 G 3.0 0.5 0.4 0.4 Pass

2 H 3.0 0.4 1.4 1.9 Pass

3 A 3.0 1.6 2.5 1.6 Pass

3 B 3.0 1.8 2.0 1.8 Pass

DVD Results

Manufacturer Model NumberDVD

Product Type

Audio/DVD Partner Status

Standby Mode Power (Watts)

Pass/FailUnit#1

Unit #2

Unit #3

1 A DVD No 0.0 0.0 0.0 N/A (Pass)

2 A DVD No 1.3 1.2 1.2 N/A (Pass)

3 A DVD Yes 2.0 1.9 1.7 Pass

3 B DVD Yes 2.4 2.4 2.4 Pass

3 C DVDYes (model

labeled, but not qualified)

1.4 1.4 1.5 Pass

3 D DVD/VCR Yes 3.2 3.5 3.1 Pass

4 A DVD No 2.9 1.8 1.8 N/A (Pass)

5 A DVD/VCRYes (model

isn’t labeled or qualified)

11.6 7.6 7.4 N/A (Fail)

6 A DVD Yes 1.7 2.0 2.0 Pass

7 A DVD Yes 0.3 0.4 0.3 Pass

7 B DVD Yes 0.4 0.6 0.4 Pass

7 C DVD Yes 0.5 0.8 0.3 Pass

7 D DVD Yes 0.6 0.6 0.4 Pass

7 E DVD Yes 0.3 0.3 0.3 Pass

8 A DVDYes (model

labeled, but not qualified)

0.9 0.9 0.9 Pass

Lighting: Fixtures and Bulbs

• Routine/ongoing testing initiative– PEARL -- creation and funding of certified

lab to test product quality and performance

– Two rounds of testing to date

– Products failing are removed from ENERGY STAR

Retail PartnerStore Level Assessment

Background and Summary

Rounds 1 & 2

Retail Store Level Assessment

• Designed to evaluate the consumer shopping experience with ENERGY STAR in retail channel– Programmatic changes to increase product

purchases

• Three part assessment:– Salesperson knowledge and extent ENERGY

STAR messaging is used in sales process

– Visibility/presence of ENERGY STAR in store displays by department

– Availability/visibility of ENERGY STAR qualified and labeled products in stores

Basic Approach

• Approx. 7 qualified product categories for each trial (e.g., DVDs, TVs); some variability

• Approx. 5 national retailers including Best Buy, Home Depot, Lowe’s, Sears, Wal*Mart

• Approx. 7 cities across the country from MA to CA

Cities/Products Fall & Summer

• Atlanta, GA

• Baltimore, MD

• Boston, MA

• Dallas, TX

• Milwaukee, WI

• Portland, OR

• San Diego, CA

• TVs (fall 01)

• DVDs (summer 02)

Evaluation Process

• Sales Staff Evaluation– “Shoppers” Evaluate

• 3 top considerations identified during sale

• Mention of ENERGY STAR and understanding of program goals, elements, or features during the sales process

– Combine to one score and scale to “100”

– To reach “100” • Present ENERGY STAR, energy efficiency, and

environment as top considerations

• Demonstrate thorough knowledge of ENERGY STAR program during the sale

Evaluation Process

• Display Check– Display material (POS/POP) present beyond

labeled products– Who generates/applies and relative size

• Product Shelf Inventory– Measure proportion ENERGY STAR-qualified

products on shelves– Check visibility/presence of ENERGY STAR

label on products and packaging

Summary Findings – 2 rounds

• Salesperson knowledge– Scores by product 25-50

– Highest = CFLs, appliances

– Lowest = electronics

• Store display visibility– Little difference in presence of ENERGY

STAR focused materials in the two rounds

– High opportunity in lighting and CE departments to coordinate materials with ENERGY STAR product promotions

Summary Findings – 2 rounds

• Product inventory– Shelf area devoted to qualified products

consistent with market penetration data

– Ideal = see increase, over time, in inventory of ENERGY STAR qualified products

• Product labeling– 26% of qualified DVD models not labeled at

all; 26% models “mixed”

– Small number of products “mis-labeled”

Our Action Steps

• Retail partner “strategies”– Best Buy, Costco, Nationwide, RadioShack,

Sears, Wal*Mart• Training/Product stocking

• Promotion “matchmaking”– Contact with retailers/vendors

• Website re-engineering– Shopping tool more robust– Qualified Product lists more accurate, easier to

use

• Future RSL plans

– 2 rounds/year

– Some variation in products/retailers

– Local appliance/electronics dealers included on a limited basis

• Questions

Our Action Steps

Logo Monitoring

• Newspaper/magazine clips

– monthly

• Websites

– quarterly

• Follow up

– calls

– letters

– referral to DOJ

Discussion and Feedback

• Are there additional measures we should consider taking to protect the integrity of the ENERGY STAR label?