Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only]...
Transcript of Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only]...
![Page 1: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/1.jpg)
Sifting for gold dust in a mine of coal
![Page 2: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/2.jpg)
“Fit‐For‐Purpose”Contingent performance in the context of what is needed – Nursing literature – 1978141 peer review reports (24 about nursing)
![Page 3: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/3.jpg)
“Fit‐For‐Purpose”Appeared in association with the term biomarker in 2006Lee et al – “Fit‐for‐purpose method development and validation for successful biomarker measurement”Appears derived from Biomarker Method Validation Workshop – October 2003 (AAPS and CLAS)
![Page 4: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/4.jpg)
Context of ReportConcern that the process of biomarker development and validation replete with uncertainty
Regulatory implicationsScientific requirementsLack of uniform definitions
Appreciation that differences in traditional drug level studies and studies needed for biomarker research
![Page 5: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/5.jpg)
Eight PublicationsDiffering themesCentral premise ‐‐ differing validation methods and criteria for different uses
![Page 6: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/6.jpg)
Wagner ‐‐ 2007Exploration – R & D stageDemonstration – proof of concept stageCharacterization – does it actually work stage and if so how wellSurrogacy – is it good enough to replace traditional outcomes and provide streamlined studies
![Page 7: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/7.jpg)
Pepe ‐ 2001Preclinical exploratory studiesClinical assay and validationRetrospective longitudinalRetrospective screeningDisease
![Page 8: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/8.jpg)
Chau ‐‐ 2008Target discovery and validationLead discovery and optimizationPreclinical studiesClinical trials
![Page 9: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/9.jpg)
Lee et alContinuous and iterative cycle
Pre‐validation Exploratory method validationAdvanced method validationIn‐study method validation
![Page 10: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/10.jpg)
Common Key ElementsReagents and reference materialTarget rangeDynamic rangeSensitivity (analytical)Curve fittingSelectivity and specificity
![Page 11: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/11.jpg)
Common Key ElementsDilution linearityPrecision and accuracy (analytical)Relative accuracy/recovery (biological)Robustness (reagent and change control)Sample handling, collection, processing and storageDocumentation
![Page 12: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/12.jpg)
Startling AssessmentNeed all elements at all stagesMatter of degree of certainty; not a choice to ignore the elementMatter of opinion what the matter of degree might be
![Page 13: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/13.jpg)
Sensitivity (analytical)Preanalytical and method development – define minimum detectable range and requirements of sensitivity (LOQ)Exploratory method validation – estimate sensitivity –consider (LOQ)Advanced method validation – establish sensitivity
![Page 14: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/14.jpg)
Sample Quality CountsHead on and head’s up
“Early, consistent application of predefined sample collection and handling techniques”“Definitive assessment of short‐term, freeze/thaw, bench‐top, and long‐term stability”“A complete set of separate investigations should evaluate the most appropriate conditions for collecting and treating study samples to ensure the sample integrity is maintained”
![Page 15: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/15.jpg)
Sample Quality CountsPrescient – submission July 2005“Patient‐related factors including diurnal, disease‐related, and behavioral effects (i.e., emotional state, posture, food intake, etc.) may necessitate alterations in sampling methods and careful interpretation of biomarker data.”
![Page 16: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/16.jpg)
Sample Quality CountsDefinitive“Deliberate ‘stressing’ of samples may reveal …artifacts… and provide vital sample collection tolerance information.”Gold StarPunch line – need to know what to stress
![Page 17: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/17.jpg)
Specimen CollectionNot exactly a new issue – first report in literature in 1969 (Russian)Mainstream lab requirement with CAP lists in 1970’sSpecimen ‐‐ sample collections referenced in relation to quality in tens of thousands of publications
![Page 18: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/18.jpg)
Preanalytical Laboratory ErrorMajor factor – 46 to 68% of cases of errorErrors noted in chemistry and molecular diagnostic labs ‐‐mundane
Labeling errorWrong containerClotted sampleHemolysis
![Page 19: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/19.jpg)
Preanalytical Laboratory ErrorRecent reports on systemic root causes
Non laboratory collection settingsHigh rate of staff collecting without looking for rules of the game (40%)Pre‐labeling (12%)
![Page 20: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/20.jpg)
Elaborate Risk Management Programs
Process analysisReassessment and rearrangement of quality requirementsDissemination of operating guidelines and best‐practice recommendationsIntroduction of error tracking systems Use of redundancy
![Page 21: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/21.jpg)
Elephant in the RoomEnsure control over preanalytical process a prerequisite is to understand the processUncertainty remains
What questions to askHow to design studies to address the questionsClash between pragmatism and purismStrength of the noise in the context of the strength of the signalUnderlying biology versus underlying chemistry (technology) being employed
![Page 22: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/22.jpg)
Inevitable Tide of Resilient Scientists
Won’t take no for an answerIn cases where there may be degraded or inadequate sample; always someone willing to push the limits and look for analyte retrieval or salvage
![Page 23: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/23.jpg)
Inevitable Tide of Resilient Scientists
More markers than dataMore models than markersPerhaps just a touch of madness in the race for the gold; when you go fishing it is wise to
Know the quality of water you are exploringUse appropriate baitHave a good pole
![Page 24: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/24.jpg)
In this MaelstromFit‐for‐purpose becomes highly relevantHow good is good enough
Understanding underlying biologyUnderstanding confounding factorsUnderstanding interface between technology and these factorsDetermining if the facts of the case make it “fit”
![Page 25: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/25.jpg)
Hard Work at QualifyingDNARNAProteinsMetabolites
![Page 26: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/26.jpg)
Hard Work at QualifyingYieldPurityFreedom from interferenceStabilityBiological stateIf multivariate (inevitable interplay)
![Page 27: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/27.jpg)
End Game Not NewBiomarker that worksHierarchy of knowledge – Fryback and Thornbury in 1991Imaging literature ‐‐ nobody has done it better
![Page 28: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/28.jpg)
End Game Not NewLevel 1 – Technical efficacyLevel 2 – Diagnostic accuracy efficacyLevel 3 – Diagnostic thinking efficacyLevel 4 – Therapeutic efficacyLevel 5 – Patient outcome efficacyLevel 6 – Societal efficacy
![Page 29: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/29.jpg)
Rules ExpandedExquisitely limned in the ACCE Model – used in CDC EGAPP projectsAnalytical validity, Clinical validity, Clinical utility, and associated Ethical, legal and social implications)
![Page 30: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/30.jpg)
Rules Expanded44 Questions or elements for a full scale evaluationAt the base are 9 questions on analytical validityUnderlying these are four central themes
Analytical sensitivity – how well signal is detectedAnalytical specificity – what interferesQuality control – how do you know the procedure is working correctlyAssay robustness – how resistant is the assay to changes in pre‐analytic and analytic variables
![Page 31: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/31.jpg)
Parochial View from Central FloridaWhether you subscribe to the Fryback‐Thornbury model, the ACCE model, or some other modelGame of baseball; cannot get to second base if you don’t get past first base; cannot get a home run with a foul ball
![Page 32: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/32.jpg)
Fit‐For‐PurposeMerits to a contingent approach;Biomarker technology is iterativeInformation on biologic underpinnings is continuously evolvingResources (funds, time, specimens) are limited
![Page 33: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/33.jpg)
Fit‐For‐PurposeHazards to a contingent approachShortcuts up‐front in both analytical and clinical validation may be pragmatic; may also be painful because they can increase downstream risksProbably not public health risks but risks to reputation, riches, and gloryExtent they yield fool’s gold; does hurt the public
![Page 34: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/34.jpg)
House of CardsMinimum standards for preanalytical and analytical validity are needed up‐front to support robust discovery – not inconsistent with fit‐for‐purposeStandardization of both preanalytical and analytical methodology and information sharing is needed to accelerate product development in this arenaStandardization of clinical methodology and information is needed to accelerate product development in this arena.
![Page 35: Ppt0000002 [Read-Only] · 2012. 10. 24. · Title: Microsoft PowerPoint - Ppt0000002 [Read-Only] Author: fbajowski Created Date: 3/24/2009 9:54:43 AM](https://reader034.fdocuments.net/reader034/viewer/2022051322/603efda590a69c37d906d991/html5/thumbnails/35.jpg)
The Disquieting Muses ‐ PlathDay now, night now, at head, side, feet, They stand their vigil in gowns of stone, Faces blank as the day I was born, Their shadows long in the setting sun That never brightens or goes down. And this is the kingdom you bore me to, Mother, mother. But no frown of mine Will betray the company I keep.