Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six...
Transcript of Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six...
![Page 1: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/1.jpg)
Method Verification
The HowM.L. Jane Weitzel ALACC Chair
![Page 2: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/2.jpg)
The What
Released early 2008
http://www.aoac.org/alacc_guide_2008.pdf
![Page 3: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/3.jpg)
Meet ISO 17025 Requirement
![Page 4: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/4.jpg)
Categories of Methods
The six categories of chemical analytical methods are:
1. Confirmation of Identity, a method that ensures a material is what it purports to be or confirms the detection of the target analyte.
2. Quantifying an analyte at a low concentration. 3. Determining if an analyte is present above or
below a specified, low concentration (often called a Limit Test). The specified concentration is close to the LOQ.
![Page 5: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/5.jpg)
Categories of Methods
4. Quantifying an analyte at a high concentration.
5. Determining if an analyte is present above or below a specified, high concentration (often called a Limit Test). The specified concentration is substantially above the LOQ.
6. Qualitative test.
![Page 6: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/6.jpg)
Tables 2 -6
Requirements of Method Verification for the Six Categories of Chemical Test Methods (Tables 2–6)
![Page 7: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/7.jpg)
Category 1: Confirmation of Identity
![Page 8: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/8.jpg)
![Page 9: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/9.jpg)
ISO Technical Specification ISO/TS 21748, Guidance forthe use of repeatability, reproducibility and trueness estimates in measurement uncertainty estimation
![Page 10: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/10.jpg)
ISO/TS 21748Template for Verification ISO 21748 is a thorough guide to verifying
a method. The examples will be based on ISO 21748
![Page 11: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/11.jpg)
“Specification for the Method”
The results of collaborative study yield performance indicators (sR, sr) and, in some circumstances, a method bias estimate, which form a “specification” for the method performance.
In adopting the method for its specified purpose, a laboratory is normally expected to demonstrate that it is meeting this “specification.”
![Page 12: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/12.jpg)
Repeatability
In most cases, this is achieved by studies intended to verify control of repeatability and of the laboratory component of bias, and by continued performance checks (quality control and assurance)
![Page 13: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/13.jpg)
Many added benefits
Method verification Estimate of Uncertainty Better understanding of the method
![Page 14: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/14.jpg)
Equation
y= μ +δ +B+ Σcix′i +e
![Page 15: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/15.jpg)
Equation Components
y = µ + δ + Β + e + Σ cix′i
Result = ideal result + method
bias + lab bias + repeata
bility +sum of effects NOT included in collabora-
tive study
![Page 16: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/16.jpg)
What if your method was not collaboratively studied?
The approach described by ISO 21748 is still relevant. Intermediate precision could be substituted for
reproducibility Fewer variables would be included in intermediate
precision study than during a reproducibility study There would be more effects included in Σ cixi’ The approach provides a detailed, organized procedure for
identifying and evaluating these effects
![Page 17: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/17.jpg)
Method Bias
δmethod bias
Collaborative StudyNote: the study may not include this
component
![Page 18: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/18.jpg)
Lab Bias
Β
lab bias
Collaborative StudysL
2
sR2 = sL
2 +sr2
Thus
sL2 = sR
2 - sr2
![Page 19: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/19.jpg)
Repeatability
e
repeatability
Collaborative Studysr
2
![Page 20: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/20.jpg)
Effects NOT includedΣ cix′i
sum of effects NOT included in collaborative study
Examine the equation and procedure.
![Page 21: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/21.jpg)
Table Summary
y µ δ Β e Σ cix′i
Result Ideal result Method bias Lab bias Repeatability
Sum of effects not included
in collaborative
study
Source of Specification
for the method
Collaborative Study. Note:
the study may not include
this component
CollaborativeStudysL2
sR2 = sL
2 +sr2
ThussL
2 = sR2 - sr
2
CollaborativeStudy
sr2
Examine the equation and
procedure
![Page 22: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/22.jpg)
Method Bias
δmethod bias
Collaborative StudyNote: the study may not include this component.
The study may include method bias, if for example the results are corrected for a known method bias. The procedure for assessing method bias is included in
the ISO standard in detail in “Incorporating Trueness Data”.(Uncertainty associated with CRV becomes important)
![Page 23: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/23.jpg)
Repeatability - Equation
erepeatability
Collaborative Study sr2
Do repeatability study in lab. Calculate sw.Compare to sr
2 using the F test.
![Page 24: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/24.jpg)
Bias
Often “accuracy” must be verifiedTerminology – bias
Can use same data from repeatability If Certified Reference Material is available
![Page 25: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/25.jpg)
Lab Bias
Β
lab bias
Collaborative StudysL
2
sR2 = sL
2 +sr2
Thus
sL2 = sR
2 - sr2
![Page 26: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/26.jpg)
Bias Specification
Follows ISO Guide 33 Δ = m - µ = mean - CRV
|Δ| < 2σD
|Δ| < 2√ (sR2 - sr
2 + sw2/n)
sL2 = sR
2 - sr2
![Page 27: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/27.jpg)
n
Choose n so that the uncertainty of the bias is not significant
choose n such that the uncertainty √sw
2/n < 0.2sR
Good rule of thumb uncertainties less than 0,2 sR lead to changes of
under 0,02 sR in the overall uncertainty estimate.
![Page 28: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/28.jpg)
Σ cix′i Look at equation to identify any source of
uncertainty that was not included in the collaborative study.
It is often convenient to consider each of the three factors the sample, the laboratory and the method when identifying gross uncertainties
![Page 29: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/29.jpg)
Specificity
If your sample is not identical to those included in the collaborative study or method validation, you must assess the impact of the differences.
AOAC Food triangle can be useful
![Page 30: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/30.jpg)
Useful Table 8 in ALACC Method Verification Guide Lists Parameter The difference from the validated method Required Equivalence Study
![Page 31: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/31.jpg)
Useful Table 8
![Page 32: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/32.jpg)
Table 8 Example
![Page 33: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/33.jpg)
Uncertainty
For a collaboratively studied method and if you follow the process from ISO 21748, you will also end up with an estimate of the uncertainty for the method.
![Page 34: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/34.jpg)
Table Summary
y µ δ Β e Σ cix′i
Result Ideal result Method bias Lab bias Repeatability
Sum of effects not included
in collaborative
study
Source of Specification
for the method
Collaborative Study. Note:
the study may not include
this component
CollaborativeStudysL2
sR2 = sL
2 +sr2
ThussL
2 = sR2 - sr
2
CollaborativeStudy
sr2
Examine the equation and
procedure
![Page 35: Method Verification - AOAC Internationalmembers.aoac.org/.../Pubs/MethodVerification...The six categories of chemical analytical methods are: ... Requirements of Method Verification](https://reader030.fdocuments.net/reader030/viewer/2022041019/5ecdb080f764a95c3f267eef/html5/thumbnails/35.jpg)
Examples