Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A...
-
Upload
randolf-mccarthy -
Category
Documents
-
view
215 -
download
0
Transcript of Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A...
![Page 1: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/1.jpg)
Lessons Learned in Initiating Lessons Learned in Initiating and Conducting Risk and Conducting Risk
Assessments within a Risk Assessments within a Risk Analysis Framework: A Analysis Framework: A FDA/CFSAN ApproachFDA/CFSAN Approach
Robert BuchananDHHS Food and Drug AdministrationCenter for Food Safety and Applied
Nutrition
![Page 2: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/2.jpg)
PerspectivePerspective
Risk Assessor vs. Risk Manager
Risk Manager vs. Risk Assessor
![Page 3: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/3.jpg)
The ParadoxThe Paradox
Codex Alimentarius “Principles and Guidelines for the Conduct of Microbial Risk Assessments” Principle #2: There should be a Principle #2: There should be a
functional separation between risk functional separation between risk assessment and risk managementassessment and risk management
Important principle that doesn’t work if you achieve it
![Page 4: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/4.jpg)
Setting the StageSetting the Stage
Experience:Experience: conducted two large quantitative microbial risk assessments Vibrio parahaemolyticus Listeria monocytogenes
Learning:Learning: address the “bumps” encountered to discuss lessons learned to develop a risk analysis framework
for future major risk assessments
![Page 5: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/5.jpg)
The BumpsThe Bumps Resource intensive Setting time frames and
establishing deadlines Establishing why risk assessment is
being done Establishing expectations
What a risk assessment can do? Establishing boundaries
Who is in charge? Who gets to decide? Who settles conflicts?
![Page 6: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/6.jpg)
The BumpsThe Bumps Communicating with risk managers
(Why can’t risk assessors speak English?) Modeling Explaining uncertainty vs. variability
Lack of understanding of risk assessment techniques (Why are risk managers so dense?)
Getting risk managers to pay attention early
![Page 7: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/7.jpg)
The BumpsThe Bumps Presenting the results
Interpretation Transparency Plain language (Who rights the report?) Dealing with unexpected results
Review of risk assessments Impact on risk management programs Protecting the risk assessors against
outside pressure
![Page 8: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/8.jpg)
Risk Analysis Working Risk Analysis Working GroupGroup Senior managers Risk managers Risk assessors
Scientists “Modelers” Project leaders
Risk Communicators Facilitator
![Page 9: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/9.jpg)
Risk Analysis Working Risk Analysis Working GroupGroupOverall Goal:Overall Goal:
To improve the quality and consistency of “major” risk assessments conducted by the Center for Food Safety and Applied Nutrition
![Page 10: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/10.jpg)
What Are ‘Major’ Risk What Are ‘Major’ Risk Assessments?Assessments?
Non-routine, complex, and/or quantitative
Involve multiple program offices and/or cross-cutting in nature
Require a commitment of significant resources to complete
![Page 11: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/11.jpg)
Risk Analysis Working Risk Analysis Working GroupGroup
Specific Tasks:Specific Tasks:1) Identify boundaries and
responsibilities of key participants in the risk analysis process
2) Develop a process for identifying and selecting risk assessments conducted by CFSAN
3) Establish procedures for the conduct of risk assessment within a risk analysis framework
![Page 12: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/12.jpg)
Risk Analysis – The TheoryRisk Analysis – The Theory
Traditional definition: risk analysis is composed of : Risk Risk
ManagementManagement Risk Risk
AssessmentAssessment Risk Risk
CommunicatioCommunicationn
Risk Management
Risk Communication
Risk Assessment
![Page 13: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/13.jpg)
Risk Analysis – The Risk Analysis – The RealityReality In CFSAN risk
analysis is a “stew” of : Center
Management Risk
Management Risk Assessment Risk
Communication Research Etc
Risk
MgmtRisk
Communi-cation
Risk Assess- ment
Research
CFSAN
Mgmt
FDA
Mgnt
FDA
GC
![Page 14: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/14.jpg)
Procedures to Initiate and Procedures to Initiate and Conduct Risk AssessmentsConduct Risk Assessments
INITIATE:INITIATE: A decision-based approach to identify and select all ‘major’ risk assessments Four phase process: concept
generation, problem identification, data feasibility evaluation, disposition
CONDUCT:CONDUCT: A systematic and iterative approach to conducting risk assessments Four step process: Plan, Perform,
Review, Publish
![Page 15: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/15.jpg)
The Identification and The Identification and Selection ProcessSelection Process
![Page 16: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/16.jpg)
Selection of Major Risk Selection of Major Risk AssessmentsAssessments
Select major risk assessments on basis of
Center’s risk management Center’s risk management needsneeds
Center’s resourcesCenter’s resources Data feasibilityData feasibility
![Page 17: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/17.jpg)
Personal ObservationPersonal Observation
If science is complex, there is no consensus among stakeholders, and there are multiples ways of managing the risk – consider a quantitative risk assessment
If science is straight forward, there is general consensus among stakeholders, and there is only one risk management option – do not conduct a quantitative risk assessment
![Page 18: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/18.jpg)
Where do risk Where do risk assessment ideas come assessment ideas come from?from?
Stakeholders (public)
Follow up to completed risk assessment
Regulatory staff Management Researchers Other agencies
![Page 19: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/19.jpg)
A Four Phase A Four Phase Selection ProcessSelection Process
Phase 1:Phase 1: Concept Concept
GenerationGeneration
Phase 2:Phase 2: Problem Problem
FormulationFormulation
Phase 3:Phase 3: Feasibility Feasibility
DeterminationDetermination
Phase 4:Phase 4: Disposition Disposition
![Page 20: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/20.jpg)
Selection ProcessSelection Process
Concept GenerationConcept Generation
Problem Formulation
Feasibility DeterminationDisposition (selection)
Identify and maintain list of potential RM questions for which a RA would assist with policy decisionsIdentify hazards/commodities State the RM question(s)State the RA question(s)
![Page 21: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/21.jpg)
Selection ProcessSelection Process
Concept Generation
Problem FormulationProblem Formulation
Feasibility DeterminationDisposition (selection)
Management reviews list and approves specific RAs for further evaluation (feasibility determination)
![Page 22: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/22.jpg)
Selection ProcessSelection Process
Concept Generation
Problem Formulation
Feasibility Feasibility DeterminationDeterminationDisposition (selection)
Review literature to determine availability of data needed to conduct RA to answer RM questions
Recommend action:More research neededModify RM questionQualitative RA vs. Quantitative RA
![Page 23: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/23.jpg)
Selection ProcessSelection Process
Concept Generation
Problem Formulation
Feasibility DeterminationDisposition (selection)Disposition (selection)
Using the results of the feasibility determination as an aid, management selects RAs to be conducted based on technical merit, resource availability, and other factors and get commitment of resources
![Page 24: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/24.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
![Page 25: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/25.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
A four step process: Step 1: Plan
Step 2: Perform
Step 3: Review
Step 4: Publish
![Page 26: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/26.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
Step 1: PlanningStep 1: Planning Define scope Identify resource needs Assign teams Develop timelines
![Page 27: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/27.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
Step 2: PerformStep 2: Perform Answer risk management
questions
![Page 28: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/28.jpg)
Receive Charge from Risk Managers
Receive Assumptions from RMRefine Assumptions for modeling
Assemble data/model inputsVerify data/model inputs
Develop modelAudit model
Run model/iterations
Review results
New data
Draft Report
Conduct sensitivity analysis
![Page 29: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/29.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
Step 3:Step 3:Review – ongoing process
Advisory CommitteesPeer Review SGE PanelsPublic Comment
ApproveClear
![Page 30: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/30.jpg)
Technical and Scientific Reviews of Technical and Scientific Reviews of the Draft Risk Assessment the Draft Risk Assessment
DocumentsDocuments
Final D ocum ent
D raft D ocum ents for Public C om m entFederal R egister N otice
D ocum ents Available on FD A/C FSAN W ebsitePublic M eeting
Internal and External R eviewD ata and Assum ptions
D raft D ocum entM odel
Request for Data and In form ationFederal R egister N otice
Public M eetingsAdvisory C om m ittee (N AC M C F)
![Page 31: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/31.jpg)
Conducting the Risk Conducting the Risk AssessmentAssessment
Step 4: PublishStep 4: PublishDevelop “roll out” strategyPublic release of documentsHandling commentsPublic comment
![Page 32: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/32.jpg)
Organization of Risk Organization of Risk AnalysisAnalysis Risk analysis should be
conducted by teams: Risk Management TeamRisk Management Team Risk Assessment TeamRisk Assessment Team Risk Communication TeamRisk Communication Team
Meet regularly to discussion process and surface issues
![Page 33: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/33.jpg)
Organization of Risk Organization of Risk AnalysisAnalysis Established three unique Established three unique
positions to help with positions to help with consistency, coordination, and consistency, coordination, and making decisions making decisions Science Advisor for Risk Analysis Risk Analysis Coordinator Risk Assessment Project Manager
![Page 34: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/34.jpg)
Summary of Recommendations Summary of Recommendations ImplementedImplemented
Decision-based approach to identify and select all ‘major’ risk assessments
Procedure for the conduct of risk assessment within risk analysis framework
Established new organizational structure
![Page 35: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/35.jpg)
Summary of Recommendations Summary of Recommendations ImplementedImplemented
Criteria to evaluate data quality Procedures for the approval and
release of risk assessments Formal peer review process Enhance capabilities to conduct
risk assessments and interaction between chemical and microbiological risk assessments
![Page 36: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/36.jpg)
Report AvailableReport Available
“Initiation and Conduct of All ‘Major’ Risk Assessments within a Risk Analysis Framework”
Available on FDA website: http//:www.cfsan.fda.gov/~dms/http//:www.cfsan.fda.gov/~dms/
rafw-toc.htmlrafw-toc.html
![Page 37: Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.](https://reader030.fdocuments.net/reader030/viewer/2022032723/56649cfd5503460f949cdb26/html5/thumbnails/37.jpg)
New TwistsNew Twists
OMB Guidelines on Data Quality
Court decisions of status risk assessment when used as part of a regulatory activity
Security issues when risk assessment used for food security activities