Transformation of Army Test and Evaluationproceedings.ndia.org/487F/brown.pdf · Functional Review...
Transcript of Transformation of Army Test and Evaluationproceedings.ndia.org/487F/brown.pdf · Functional Review...
Developmental Test Command
Transformation of ArmyTest and Evaluation
C. David Brown, PhDDirector, Test and Technology
17 August 2004
Army Views on T&E/SE Interactions
Developmental Test Command
Outline
Systems Engineering and VerificationFuture Combat Systems (FCS) OverviewFCS “V Chart” w/ Tools Links
Combined Test OrganizationSoSILDistributive Test CapabilitySynthetic Test CapabilityBuilt-in Test (BIT) and Training
Highlights
Developmental Test Command
Systems Engineering and VerificationPrevious Implementation
System Level
Design Requirements
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Fabricate
Developmental Test Command
FCS Combat Systems Increment 1 Manned Systems
1,530 735
900 450
270 360
150 435
Unmanned Air Platforms
Class II540
Class III180
Class IV450
• UnattendedMunitions
• NLOS LS - 900• Intelligent
Munitions
Class I810
Armed Robotic VehicleARV R - 405 ARV A - 270
Mule - 900ARV-L - 270
SmallManpackableUGV
1,215
Infantry CombatVehicle
Command andControl Vehicle
MountedCombat System
Non-Line of Sight Cannon Non-Line of Sight Mortar
FCS Maintenanceand Recovery Vehicle
Medical Treatmentand Evacuation
• UnmannedPayloads
Recon andSurveillance
• UnattendedGround Sensors
Spiral
ForwardSpiral
Forward
Spiral
Forward
10 Ton HEMMT
Wrecker
Unmanned Ground Vehicles
Developmental Test Command
FCS Description:Comprised of a Family of Systems
Advanced, networked air- and ground-based maneuver, maneuver support,and sustainment systemsIncludes manned and unmanned platformsNetworked via a C4ISR architecture
Will operate as a System of SystemsNetwork existing systems, systems already under development, and newsystems to be developed to meet the needs of the UA.Network will enable:
improved Information Surveillance Reconnaissance, enhanced analytical tools, jointexchange of blue and red force tracking down to the tactical level, real time sensor-shooterlinkages, and increased synergy between echelons and within small unitsthe UA to connect to UE, joint capabilities, and national assets
Mission Need for Future Combat SystemsValidated 31 Oct 02 (AROC); 23 Jan 03 (JROC)
Developmental Test Command
Missions
enabledby
to perform
Taskscomprise
to accomplish
Materielas supplied by
provides
Capabilities
Army FCS TransformationMission to Capability Trace
* Doctrine, Organization, Training, Materiel, Leadership and Education, Personnel, Facilities
Maintains theSoS
Focus
Developmental Test Command
Missions
enabledby
to perform
Taskscomprise
to accomplish
Materielas supplied by
provides
Capabilities
Answers the“So What?”
Question
Army FCS TransformationMission to Capability Trace
* Doctrine, Organization, Training, Materiel, Leadership and Education, Personnel, Facilities
ORD and AoAs
Systems Engineering& Specifications
Developmental Test
Operational Test
Aligns: Systems Eng,Test, Evaluation,Force Development,Training
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Combined Test Organization (CTO)
Developmental Test Command
Combined Test Organization(CTO)
Equal Partnership – PMO / ATEC / LSI
Supplants PMO Test Management and Augments ATEC and
LSI Top Level Test Management
Strives for Most Efficient Testing Through Integration,
Combination, and Sharing
PMO, ATEC, and LSI have Pledged Commitment and
SupportPlan Together, Test Once, Share the Data
Developmental Test Command
FCS Test & Evaluation Plan
ProductionMS B
Integrated Evaluation Process
System Development & Demonstration
Qualification Testing Verification Testing
FOCUA 1.6a
Integration and Test
Designs, Models
Emulators
Integration and Test
Prototypes
Integration and TestIntegration and Test
Production Items
MS C
Technical Field Testing
USER Testing
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Combined Test Organization (CTO)
Sys of Sys Int Lab (SoSIL)
Developmental Test Command
Viewing Portal
Framework
Test Data Management Center
SoS Integration & Test
Mobile Node
WAN Network Equipment
DRENBackbone
Classified ACE
IRCC
UAMBL
Connection toTRADOC Sites
Connection toATEC Sites
Encryptor and LANInterface Rack
Unclassified Router thatconnects to the Encryptor
and the WAN
6 foot minimum distanceBlackRack
RedRack
Rack, Encryptor, andCisco 3550 Layer 3 Switch
supplied by FCS T&E
UTILSTAT
DUPLEXSPEED
SYSTEMRPS
LINE PWR
CATALYST 3550 INLINE POWER
2
1
3
4
5
6
7
8
9
10
11
12
1
2
15
16
17
18
19
20
21
22
23
24
13
14
Router and WAN InterfaceRack
Encryptor and LANInterface Rack
Unclassified Router thatconnects to the Encryptor
and the WAN
6 foot minimum distanceBlackRack
RedRack
Encryptor and LANInterface Rack
Unclassified Router thatconnects to the Encryptor
and the WAN
6 foot minimum distanceBlackRack
RedRack
Rack, Encryptor, andCisco 3550 Layer 3 Switch
supplied by FCS T&E
UTILSTAT
DUPLEXSPEED
SYSTEMRPS
LINE PWR
CATALYST 3550 INLINE POWER
2
1
Rack, Encryptor, andCisco 3550 Layer 3 Switch
supplied by FCS T&E
UTILSTAT
DUPLEXSPEED
SYSTEMRPS
LINE PWR
CATALYST 3550 INLINE POWER
2
1
3
4
5
6
7
8
9
10
11
12
1
2
3
4
5
6
7
8
9
10
11
12
1
2
15
16
17
18
19
20
21
22
23
24
13
14
Router and WAN InterfaceRack
Data CenterData CenterData CenterData Center
System of SystemsIntegration Lab (SoSIL)
Nationwide Distributed FCS Test Environment
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Distributed Test Capability
Sys of Sys Int Lab (SoSIL)
Combined Test Organization (CTO)
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Distributed Test Capability
Synthetic Test Capability
Sys of Sys Int Lab (SoSIL)
Combined Test Organization (CTO)
Developmental Test Command
Synthetic Test Capabilities
Analysis &Reporting
Test Control
Integrated Synthetic Environment
Scenario Generation
Data Collection
TestFrameworkArchitecture
TestFrameworkArchitecture
FCS Subsystemsand/or Representations
Common Subsystems
Vehicle Consoles
C4I Subsystem
Weapon Subsystem
Sensor Subsystem
Tactical Comm Subsystem Sensor Stimulator
Synthetic Tactical Communications
Terrain Database
WeatherDatabase
SignaturesDatabase
Signature,Environment,
& Terrain Data
EntityStates
Test Run Parameters,Status,Etc
Tactical Msgs,Truth Data, Etc.
EnvironmentEffects
ObjectSignatures
EngagementData
TacticalMessages
FCS System
Weapon SubsystemFramework Interface
Image Generators
Vehicle SimulationDriver
EngagementData
Terrain,Damage,& States
Scene / VehicleData
Scene & EnvironmentData
EnvironmentData
SceneData
TestData
Developmental Test Command
Systems Engineering and Verification
System Level
Design Requirements
Fabr
icat
e, In
tegr
ate
and
Test
System Functional Review
Design
System VerificationReview
Test Readiness Review
PreliminaryDesignReview
CriticalDesignReview
Item Level
Design Requirements
Components
Assemblies
Configuration Items
Subsystems
System
Distributed Test Capability
Synthetic Test Capability
Sys of Sys Int Lab (SoSIL)
Built-inTest and Training
Combined Test Organization (CTO)
Developmental Test Command
Built-in Test and TrainingEmbedded Instrumentation- Design-in test and training instrumentation
Test instrumentation- Data bus capture- Specialized critical test requirements
Training instrumentation- Real-Time Casualty Assessment- Tactical Engagement Simulation- Embedded training
Developmental Test Command
HighlightsHow do we ensure that T&E planning process is integrated intothe SE process?
Early involvement of the tester.How do we integrate the SEP and TEMP?
Build them together using a CTO approach.How do we ensure the tester is part of the SE process?
Get the CTO involved earlyHow do we make T&E support verification of the SE process?
T&E is the verification part of SEImplement the right tools and proactive planning
Are there process changes need by industry and Govt?CTO ensures an effective, integrated T&E strategy
Developmental Test Command
How Much is
To gather information to reducethe risk to a level acceptable tothose responsible for theapplication
Who is really responsible forthe application and candetermine the acceptable risk;tester, evaluator, contractor, PM,developer, user, Congress,media, taxpayer, or acombination of these?
To test until risk has beenadequately reduced
What determines adequatelyreduced risk; resourceconstraints, schedule constraints,environmental and safetyconcerns, a driving requirementto immediately employ thetechnology, political or socialconsiderations?
Testing Enough
Developmental Test Command
How much testing is Enough?
Enough is a function of how Early in thedevelopment cycle testing is accomplished
The Earlier it is accomplished,the less testing is requiredand the greater the value
Developmental Test Command
How much Testing is Enough?Risk are we willing to accept?
Testing must be conscious of, highlight,and explore all risk areas.
Understand the Risk
Program Failure Technological obsolescence Life and Limb
Risk