Albuquerque, New Mexico, USA Riyaz Natha · 2018. 4. 5. · Riyaz Natha . Introduction to the Final...
16
30. Introduction to the Final Exercise October 24 – November 11, 2016 Albuquerque, New Mexico, USA Riyaz Natha
Transcript of Albuquerque, New Mexico, USA Riyaz Natha · 2018. 4. 5. · Riyaz Natha . Introduction to the Final...
30. In t roduct ion to the F ina l Exerc i se
October 24 – November 11, 2016 Albuquerque, New Mexico, USA
Riyaz Natha
Introduction to the Final Exercise
S tudent Learning Object ives
After completing this module, you should be able to: • List the three phases of an evaluation process • Recognize that the results of an evaluation should
include recommendations as to how to correct observed deficiencies
• Apply the evaluation team process to design an upgrade of the hypothetical facilty
• Consider IAEA NSS-13 categorization levels and cost during anaylsis
2
Presenter
Presentation Notes
Slide Purpose: Present student learning objectives for the module. Instructor Notes: Recognize that an evaluation team applies the test-and-evaluate-to-requirements philosophy of DEPO to the life cycle of a PPS in its operational (vs. design) phase Recognize the unique aspects of a typical evaluation process as compared to a normal PPS design cycle List the three phases of an evaluation process Recognize that an evaluation process provides a mechanism to evaluate the capability of an existing system against potential changes in mission requirements Recognize that the results of an evaluation should include recommendations as to how to correct observed deficiencies Then you will get to apply the evaluation team process to design an upgrade of the hypothetical neutron burst reactor (NBR)
Introduction to the Final Exercise
What Is the Evaluat ion Team Process?
Evaluation Team Process: A systematic, performance-based process that is used by a team to evaluate the ability of a physical security system to meet performance requirements in terms of system effectiveness
3
Presenter
Presentation Notes
Slide Purpose: Describe evaluation team process. Instructor Notes: The final acceptance metric is system effectiveness.
Introduction to the Final Exercise
Eva luat ion Team Process Phases
1. Planning Phase 2. Conduct Phase (using DEPO)
Defining system requirements Designing or characterizing the system Evaluating the system Re-designing and re-evaluating if necessary
3. Closure Phase Upgrade recommendations Out-brief Report
4
Presenter
Presentation Notes
Slide Purpose: Describe evaluation team process phases. Instructor Notes: 3 phases 1. During planning phase, you need to ensure that you have the necessary authorizations and permissions to conduct this evaluation. You will go through the DEPO process (list bullets). In the closure phase, you will make upgrade recommendations and provide an out-brief. Generally, this is followed by a fully documented report on the evaluation. For this exercise, you will not have to generate a formal report.
Introduction to the Final Exercise
P lanning Phase of an Evaluat ion
• Initiate the evaluation • Determine requirements, goals, and scope for the
evaluation • Select evaluation team • Get authorizations and permissions needed for evaluation • Develop schedule including a site visit • Gather preliminary data • Produce “Evaluation Team Guide”
Information sensitivity Rules for engaging the system Constraints for the evaluation activity
5
Presenter
Presentation Notes
Slide Purpose: Discuss the planning phase of an evaluation. Instructor Notes: During the planning phase of an evaluation you will do the following: (list bullets) As you determine requirements, goals, and scope, be sure to document any assumptions you are making. Do the same as you gather preliminary data. Also be sure to document any constraints imposed on the evaluation (cost, schedule, breadth/depth). Determine what questions you will need to ask as part of the evaluation. It is very important to produce and evaluation team guide. For the purposes of this exercise, this will consist of your work plan and time budget. The exercise is broken into parts to provide some guidelines for the overall project, but your team will need to determine how to use that time to complete the activities.
Introduction to the Final Exercise
Eva luat ion Team Members
• Project Leader (Physical Protection Specialist) • Security System Engineer (Detection and
Communication) • Material Control and Accountability Specialist • Entry control Specialist • Access Delay (Explosives Expert) • Response Expert • Analyst (Evaluation Software Specialist) • Operations Representative • Safety Analyst • Others?
6
Presenter
Presentation Notes
Slide Purpose: Discuss evaluation team members. Instructor Notes: A typical evaluation team consists of the members listed in the slide. You will need to distribute these roles and responsibilities within the evaluation team in order to complete the exercise in the allotted time.
Introduction to the Final Exercise
Conduct Phase of an Evaluat ion
• Conduct the evaluation using DEPO Outline
7
Presenter
Presentation Notes
Slide Purpose: Describe how to conduct the evaluation. Instructor Notes: Using the DEPO Outline on the foldout pages, you may want to check off each item as you consider that element.
Introduction to the Final Exercise
Conduct Phase of an Evaluat ion
• Characterize PPS • Detection • Delay • Response
Tours and observations during a site visit
Document review Interviews Data validation
8
Presenter
Presentation Notes
Slide Purpose: Describe the characterization part of the evaluation. Instructor Notes: Characterize the PPS. Normally you would get to conduct tours and interviews to validate the data you are collecting. For this exercise, everything about the NBR is included in the Hypothetical Facility Book.
Introduction to the Final Exercise
Conduct Phase of an Evaluat ion
• Evaluate PPS Performance-based tools
System effectiveness is final acceptance metric
9
GAT FEN
1 1
PER VEH ISO
1 1 1
DOR DOR SUR
1 1 1
DOR SUR SUR
2 2 4D
DOR SUR
3 3
FLV
1
C | Controlled Room
Isolation Zone
Jump Wall Around Controlled Room
Vehicle Portal
B | Controlled Building Area
West Door
Outer Surface
West Door
Floor Vault: Target Task
Target Enclosure Door
Facility Gate
Personnel Portal
Door into Controlled Room
D | Target Enclosure
0 | Offsite
ZZ | Limited Area
A | Protected Area
Facility Fence
Target Enclosure Wall/Roof
Wall Around Controlled Room
Presenter
Presentation Notes
Slide Purpose: Describe the “Evaluate PPS” part of the evaluation. Instructor Notes: You will then conduct the evaluation of the PPS using the tools provided.
Introduction to the Final Exercise
C losure Phase of Evaluat ion
• PPS recommendations Improve PPS Accept system effectiveness Reduce targets Revise threat Mitigate consequences
• Out-brief Preliminary report Accept input from facility
• Report Final conclusions Include supporting data
10
Presenter
Presentation Notes
Slide Purpose: Discuss evaluation closure. Instructor Notes: The point of this exercise is to make recommendations to enhance the PPS at the NBR. You will need to conduct an out-brief. A normal evaluation team analysis concludes with a report that includes final recommendations and all the data used to determine and evaluate those recommendations.
Introduction to the Final Exercise
Summary
• An evaluation is a performance-based approach for designing and evaluating physical security systems
• The three phases of conducting the evaluation process are Planning Phase Conduct Phase (follow the DEPO process) Closure Phase
• The system effectiveness requirement must be met
11
Presenter
Presentation Notes
Slide Purpose: Summarize this module.
Introduction to the Final Exercise
Process For F inal Exerc ise
• Establish your Evaluation Team • Develop a project plan and assign tasks Everyone cannot do everything and complete the exercise
in time Activities will need to be done in parallel
• Ask questions as needed • Document your assumptions • Develop a 20-minute out-brief showing analysis work,
proposed recommendations, and benefits of proposed recommendations
• Each group member will be required to present a portion of the final exercise report out
12
Presenter
Presentation Notes
Made significant changes to this slide – JRR Slide Purpose: Go over the DEPO process for final exercise. Instructor Notes: These are, more specifically, the steps you will go through as part of the final exercise
Introduction to the Final Exercise
Manage Your T ime
Exercise Activity Estimated Time 1 Define Problem & Determine PPS Requirements 3.5 hrs 2 Design/Characterize PPS 4.5 hrs 3 Evaluate PPS & Possible Upgrades 5.0 hrs 4 Preparing Summary Presentation 1.5 hrs
13
During Exercise 4, each presenter should rehearse their portion of the presentation.
Introduction to the Final Exercise
Use The Tools Provided
14
• Derive baseline PI using VEASI • Derive baseline PN using Neutralization tool • Calculate system effectiveness • Redesign and re-evaluate modified PPS Determine specific system deficiencies Identify potential system enhancements Recalculate system effectiveness (PE) to show how it
improves with proposed recommendations
Introduction to the Final Exercise
Most Vulnerable Paths
1. Select 3 most vulnerable paths on ASD Using Response Force Time, work backwards from “Win Point”
to find Critical Detection Point (CDP)… Pick fastest times after CDP
Pick lowest detection elements before CDP to determine the rest of the “ worst paths ” for you.
2. Apply MP VEASI to these paths 3. Select most vulnerable path (lowest PI)
28
Presenter
Presentation Notes
Slide Purpose: Describe how to calculate probability of system effectiveness using VEASI.
Introduction to the Final Exercise
Summary
• In the final exercise, you will use the evaluation team process to evaluate your groups facility.
• We will spend two days working through the entire evaluation team process DEPO.
• At the end of two days, present your results to a panel of physical protection experts.
• This will be your own work. Your subgroup instructor will only be your consultant.
16
Presenter
Presentation Notes
Slide Purpose: Summarize this module (continued).
