Literacy September 2012

Dana Leaman and Jim “Smitty” Smith

NCSL International

Learning Objectives You will be able to:

•RECOGNIZE potential performance increases and cost benefits of structured measurement process evaluation and Standard compliance

•UNDERSTAND the relationship and variety of Regional, National, and Partnered measurement establishments and signatories;

•UNDERSTAND how to maximize the relationship between Assessors and Test Management

•RECOGNIZE the differences between key industry groups such as NCSLI & national metrology institutes (NMIs), accreditation bodies, and other various calibration suppliers;

•VISUALIZE traceability via the NCSLI Poster;

•FAMILIARIZE yourself with key terms, their accepted & referenced definitions and some of the misconceptions. (compliance, compliant calibration, accredited lab vs. accredited calibrations, etc.)

2

Tester Engineering Management:

Various Roles

• Key Competitive Advantage

• Customer Assurance

– Safety

– Performance

– Cost Effectiveness, impact to Customer profit

• Product Assurance

– Liability

• Product Cost Multiplier

• Reduction or elimination of profit

• Company Success Assurance

– If we under-perform, we jeopardize the success of our

Companies

3

Testers and Process Assurance

• Internal Procedures & Processes

• Contractual Requirements

– SOW (Statements of Work)

– Documentary Standards (ASTM, ASME, ISO etc.)

– Compliance requirements

– Accreditation requirements

• National & International Standards, e.g.

– AS9100 (Aerospace Quality)

– ISO 17025 (International, Test & Calibration labs)

• Input: Investment Costs, Process revision, awareness

• Output: Efficiency, Customer Loyalty and positive ROI

4

Drowning in Alphabet Soup?

Acronym List

5

Let’s Start With Basics…….

• BIPM – International Bureau of Weights and

Measures

• NMI – National Metrology Institute (Category)

• NIST – National Institute of Standards and

Technology (USA)

• ILAC – International Laboratory Accreditation

Cooperation (Cooperative of Recognition)

• NCSLI - National Conference of Standards

Laboratories international (professional organization)

• VIM – International Vocabulary of Metrology

(reference material)

6

Examples of Resources

• VIM

• SI Brochure

• NIST SP 330

• NIST SP 811

• NIST “How to Measure” Pubs

• Beginners Guide to Uncertainty in Measurement

• Guide to Management Review

• Guide to Internal Auditing

• And many others…see the reference file on your CD

7

Global Measurement Infrastructure

Realization of the “SI” to each Country or Economy

8

Copyright Robert Rathe

Ph

oto

co

urt

esy o

f B

IPM

The key link in Commerce, Industry, Manufacturing and Test: XYZ must = XYZ

Copyright Robert Rathe

The Metre Convention & Structure

• 1875; Signed by representatives of 17 nations

• Established a permanent organizational structure for

member governments to act in common accord on all

matters relating to units of measurement

– Intergovernmental organization

– Under authority of the CGPM and the supervision of

the CIPM

• World Matters – increasing accuracy, range and

diversity as well as needs associated with the

demonstration of equivalence between national

measurement standards

9

Essential Elements of Traceability

• Unbroken chain of comparisons

• Measurement uncertainty element and capture

• The Documentation Trail

• Competence to perform

• Realization of SI Units to specific parameter

• Periodic recalibration (Certification and Risk reduction

through closed end analysis)

– Unlike a qualification test a calibration is like a “set of

bookends” by closing the loop reduces data error risks

(FYI; rarely applied 100% due to usage variables)

10

11

The NMI Sandbox

Regional Metrology Organizations

APMP

SIM

SIM Inter-American Metrology System

EURAMET European Association of National Metrology Institutes

APMP Asia Pacific Metrology Program

COOMET Euro-Asian Cooperation of National Metrological

Institutions

AFRIMETS Intra-Africa Metrology System

AFRIMETS

EURAMET

COOMET

RMOs:

The Accreditation Sandbox

Regional Cooperation Bodies

ILAC International Laboratory Accreditation Cooperation

EA European Accreditation Cooperation

APLAC Asia Pacific Laboratory Accreditation Cooperation

IAAC InterAmerican Accreditation Cooperation

SADCA Southern African Development Community Accreditation

ILAC

EA

APLAC

IAAC

SADCA

Accreditation Bodies

(US Signatory ABs)

Testing and Calibration

• A2LA

• NVLAP

• IAS

• ACLASS

• LAB

• PJLA

Testing Only

• ASCLAD/LAB

• AIHA

• FQS

14

Who gets accredited?

• Testing Laboratories • Manufacturers

• Gaming

• Voter Systems

• Food Safety

• Materials Test

• Fastners Mfgs.

• Information Technology

• Environmental & Systems Labs

• ….others

15

• Calibration Laboratories

• Dimensional

• Electrical

• Mechanical

• Thermodynamics

• Optical

• Large Article Optics

• Field Services

• Utilities and Nuclear Power

Support

• ….others

Laboratory Scope of Accreditation

• Document detailing the technical measurement

capability of the accredited laboratory

• Normally published on the accrediting body’s website

• Revision/Renewal - Accreditation process/period

16

Assessment ROI

• Assessor (External) is a SME and a consultant

– No Findings are a “red-flag”, what did you pay for?

– Manager focus on zero findings is reverse of

maximizing your investment and potential savings

• Outside eyes and a “process improver”; unbiased,

emotionally unattached to process

• Self assessment, breaking the trail to prepare for

increased success

– Using your Metrology provider as internal consultants

– Technical Oversight

– Quality Oversight

– Efficiency Review

17

What Questions do you

have??

18

Additional Information

19

ISO/IEC 17025

• General requirements standard

• Used for assessment of both testing and calibration

laboratories

• Section 4 – Management Requirements

• Section 5 – Technical Requirements

20

Common Areas of Concern in 17025

• Section 4

– Document Control (4.3)

– Contract Review (4.4)

– Corrective Action (4.11)

– Preventive Action (4.12)

– Internal Audit (4.14) vs. Management Review (4.15)

21

Common Areas of Concern in 17025

• Section 5

– Procedures (5.4)

– Traceability (5.6)

– Calibration reports (5.10)

22

What is an accredited calibration?

• 17025 Compliant certificate

• 17025 Accredited certificate

• Z540.3 Compliant certificate

• Endorsed 17025 accredited certificate

23