RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI [email protected] or Bill Watson, Co-PI...

38
Annual SERC Research Review, October 5‐6, 2011 1 By Jon Wade & the RT16 Team Annual SERC Research Review October 5‐6, 2011 University of Maryland MarrioI Inn and ConvenKon Center HyaIsville, MD www.sercuarc.org RT16 Experience Accelerator: Year 1 Summary

Transcript of RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI [email protected] or Bill Watson, Co-PI...

Page 1: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        1    

 By 

Jon Wade  & the RT16 Team   

Annual SERC Research Review October 5‐6, 2011 

University of Maryland MarrioI Inn and ConvenKon Center 

HyaIsville, MD www.sercuarc.org  

RT16 Experience Accelerator:  Year 1 Summary 

Page 2: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        2    

Experience Accelerator Team 

Content: •  Alice Squires – Stevens Tools: •  Jon Wade, PI – Stevens 

Technology: •  Doug Bodner – Georgia Tech •  George Kamberov – Stevens •  Pradeep Jawahar – Georgia Tech •  Brent Cox – Stevens •  Vinnie SimoneP ‐ Stevens •  Remzi Mungan – Purdue 

EvaluaKon: •  Bill Watson, CoPI – Purdue •  Pete Dominick – Stevens •  Dick Reilly – Stevens  SMEs: •  Rick Abell •  John Griffin •  John McKeown 

 

Page 3: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        3    

Overview 

• MoWvaWon 

• Research AcWviWes ―  IdenWfy criWcal SE competencies and maturaWon 

points  ―  Create appropriate learning experiences ―  Define open architecture & technologies ―  Develop & evaluate prototype 

• Future Work 

Page 4: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        4    

Workforce Breakdown by Generation

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

Millenium (1990-present)

Generation Y (1977-1989)

Generation X (1965-1976)

Baby Boomers (1946-1964)

SilentGeneration (born before

1946)

National WorkforceDoD WorkforceCivilian ATL WorkforceNASA Engineers Workforce

Source:”Human Capital Strategy Review”, www.dau.mil/doddacm/dod/Juza; NASA Workforce Profile cube, http://wicn.nssc.nasa.bov/cognos/cgi.bin/ppdscgi.exe

GAP!

Workforce Demographics

Page 5: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        5    

What’s More EffecKve? 

Page 6: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        6    

Transforming SE Development 

We postulate that the new paradigm must be: 

•  Integrated: Provides an integraWon point of mulW‐disciplinary skills and a wide range of Systems Engineering knowledge in a sePng that recreates the essenWal characterisWcs of  the pracWcing environment.  

• Experience Based: Providing accelerated learning opportuniWes through experience‐based interacWve sessions. 

• Agile: Allowing for quality, Wmely development of course material that is most appropriate for the target students. 

• Time/Cost Efficient: Compressing mulW‐year lifecycle experiences into a much shorter period of Wme. 

Page 7: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        7    

Hypothesis 

By using technology we can create a simula3on that will put the learner in an experien3al, emo3onal state and effec3vely compress 3me and greatly accelerate the learning of a systems engineer faster than would 

occur naturally on the job. 

 

Page 8: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        8    

Experience Accelerator Goals 

To build insights and “wisdom” and hone decision making skills by: 

• CreaWng a “safe”, but realisWc environment for decision making 

• Exposing the parWcipants to the “right” scenarios and problems 

• Providing rapid feedback by acceleraWng Wme and experiencing the downstream consequences of the decisions made 

Page 9: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        9    

Research AcKviKes 

•  IdenKfy criKcal SE competencies and maturaKon points  

•  Create appropriate learning experiences 

•  Define open architecture & technologies 

•  Develop & evaluate prototype 

Page 10: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        10    

Taxonomy of SE Competencies 

Page 11: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        11    

Recommended Approach* 

*The user can progress - over time - to increasingly more complex situations (by level) in the simulation and from beginning to advanced stages of capability and understanding in each situational context (level).

Page 12: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        12    

Targeted Learning 

Competencies: • BP8 – Problem Solving and Recovery Approach • TM11 – Product IntegraWon 

Aha’s: • 2.3 – CuPng corners to make short term milestones rather than focusing on end date 

Page 13: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        13    

Research AcKviKes 

•  IdenWfy criWcal SE competencies and maturaWon points  

•  Create appropriate learning experiences 

•  Define open architecture & technologies 

•  Develop & evaluate prototype 

Page 14: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        14    

Learning Process 

Page 15: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        15    

The Experience: A Day in the Life of a PSE 

UAV KPMs: •  Schedule •  Quality •  Range •  Cost •  Sensing* •  Crew size*  * PotenWal Phase 2 work 

UAV System: •  Airframe and Propulsion •  Command and Control •  Ground Support 

Phases: 

  EA IntroducWon   Phase 0: New Employee OrientaWon 

  Experience IntroducWon   Phase 1: New Assignment OrientaWon 

  Experience Body   Phase 2: Pre‐integraWon system development ‐> CDR 

  Phase 3: IntegraWon ‐> FRR   Phase 4: System Field Test ‐> PRR   Phase 5: Limited ProducWon and Deployment ‐> ISR 

  Phase 6: Experience End 

  Experience Conclusion   Phase 6: ReflecWon 

  Each session = 1 day 

Page 16: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        16    

Challenge/Landmines & Linkages 

System Challenge Phase Evidence Situa4on Desired Ac4ons Inputs to Simula4on

S2 range too short P2 MRG

weight during development is too high

RRE ‐ focus resources on weight reduc3on

Change assignment of labor within sub‐system development

          ASP ‐ reallocate weight from S2 to S1 Change weights

          FEC ‐ reduce expecta3ons for range Change range target

S1 range too short P3 MRG

drag is higher than expected in wind tunnel tes3ng

RRE ‐ focus resources on drag reduc3on

Change assignment of labor in S1

S1, S2 schedule P2 MSC produc3vity lower than expected RAD ‐ hire addi3onal labor Hire new personnel

S2 schedule P3 MSC more changes had to be made than an3cipated SCC Change schedule target

S0 schedule P3 MSC unexpected integra3on issues

RAD ‐ hire addi3onal labor and purchase addi3onal test ar3cles/equipment  

          RRE ‐ focus on integra3on, get help from other areas  

S0 schedule P4 MSC range assets are not available

Renego3ate range priori3es (contact customer)  

S2 quality P2, P3 MQS soTware defect rate is too high

RRE ‐ focus resources on design/code reviews

Change labor assignment

Page 17: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        17    

Research AcKviKes 

•  IdenWfy criWcal SE competencies and maturaWon points  

•  Create appropriate learning experiences 

•  Define open architecture & technologies 

•  Develop & evaluate prototype 

Page 18: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        18    

Emphasis on Open System Architecture 

Benefits:

•  Reduced development time and overall life-cycle cost •  Ability to technology as it evolves •  Commonality and reuse of components •  Increased ability to leverage commercial investment

The Experience Accelerator’s emphasis on Open System Architecture is coupled with strong preference for use Open Source

Software products for implementation wherever appropriate

Principles: 1.  Establish an Enabling Environment 2.  Employ Modular Design Principles 3.  Designate Key interfaces 4.  Use Open Standards 5.  Certify Conformance

Page 19: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        19    

Challenges tuned to user needs 

Characters (Q&A) and documents (user 

research) 

Simulated world of DoD program 

The Prototype

Page 20: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        20    

Multi-Threaded Java Server Architecture

20

DoD

Page 21: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        21    

Research AcKviKes 

•  IdenWfy criWcal SE competencies and maturaWon points  

•  Create appropriate learning experiences 

•  Define open architecture & technologies 

•  Develop & evaluate prototype 

Page 22: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        22    

Prototype Feedback Loop 

10/9/11

Systems Dynamics Simulations

   Overall System Schedule:    Confidence Level to Achieve Program Schedule Goals  <H,M,L> AcKons to address issues:       Nothing Required  ⃝    Call in external audit team  ⃝    Add senior/junior design staff  Sr⃝/Jr⃝    Add development equipment  ⃝    Add faciliWes  ⃝    Reduce capabiliWes  ⃝    AnWcipate schedule extension by xx months  <xx>      

Learner Recommendations

Project Impact NPC Dialog

Page 23: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        23    

Login Screen 

10/9/11 23

Page 24: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        24    

EA Control Screen 

10/9/11 24

Page 25: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        25    

Profile Entry 

10/9/11 25

Page 26: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        26    

UAV Backgrounder 

10/9/11 26

Page 27: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        27    

Program Status 

10/9/11 27

Page 28: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        28    

Dialog 

10/9/11 28

Page 29: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        29    

PSE RecommendaKons 

10/9/11 29

Page 30: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        30    

Phase TransiKon 

10/9/11 30

Page 31: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        31    

Approval for ISR 

10/9/11 31

Page 32: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        32    

Program CompleKon 

10/9/11 32

Page 33: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        33    

ReflecKon 

10/9/11 33

Page 34: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        34    

• Assess and improve first‐year prototype to stabilize operaWon and produce desired learning 

• Expand first‐year prototype with addiWonal capabiliWes ― Expand set of challenges and landmines ― Include cost objecWves ― Enrich user profile and competencies addressed ― Enhance simulated world features and character interacWon ― Add features to user desktop 

Future Work: CapabiliKes 

Page 35: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        35    

•  Improve content creaWon and development tools ― Dialog authoring ― ArWfact creaWon ― Event descripWons and triggering 

• Make Open Source Ready ― DocumentaWon ― Source control and defect tracking ― Port to open development environment 

Future Work: ProducKvity 

Page 36: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        36    

Future Work: Evaluate Efficacy 

• User Feedback ― Develop more detailed feedback linked to competency model ― Create competency scores based upon simulaWon performance ― Create a Comprehensive Feedback Report that parWcipants can save/download 

• Outcomes assessment ― Establish outcomes assessment plan ― User reacWons ― Behavior change / performance improvement measures  

• Development Planning ― Provide Development goal sePng and planning tools ― Create a database of development suggesWons 

Page 37: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        37    

QuesKons? 

Page 38: RT16 Experience Accelerator: Year 1 SummaryJon Wade, PI jon.wade@stevens.edu or Bill Watson, Co-PI brwatson@purdue.edu Contact for information: Title Wade RT16 Briefing v2 1.pptx Author

          Annual SERC Research Review, October 5‐6, 2011        38    

Join the Experience Accelerator Team!

Jon Wade, PI [email protected]

or

Bill Watson, Co-PI [email protected]

Contact for information: