SlideShare a Scribd company logo
1 of 36
Download to read offline
Big Picture Thinking


 NASA Project Management Challenge 2008
             Michael Hazen
           Jacobs Engineering
Purpose of this Presentation
Describe the value of ‘big picture thinking’ and
how this relates to a “mandate” for your
project(s)
Review some methods you can use to empower
your big picture thinking
  Processes
  Tips & Techniques
Illustrate the application of big picture thinking
using a Constellation case study.
                                                     2
The Value of Big Picture Thinking
Areas where big picture thinking has proven to
be particularly valuable include:
   Complex problems involving many stakeholders
   Recurring problems
   Issues where an action affects the environment
   Problems with solutions that are not obvious

Ref. 6, Aronson
The Value of Big Picture
       Thinking (cont.)
Risk Reduction: Big picture thinking helps to
identify risks early in the life cycle
Project Success: Big picture thinking can
dramatically reduce a projects likelihood of
becoming a statistic
  Widespread failures common : Projects cancelled /
  over one year late / overruns in excess of 100%
  Catastrophic Failures


                                                      4
Catastrophic Failures
Columbia
Hubble- When it was made, the glass for the mirror was
carefully ground and polished to a near perfect surface. The
problem was, it was ground into the wrong shape!
Mars Observer – Could not establish contact once at Mars
($1 Billion)
Mars Polar Lander - Spurious signals caused the trio of lander
legs to deploy during descent making it think it had landed,
although it was high above the Mars surface.




                                                             5
Genesis – lost 27 months worth of space data
   when it crashed because a sensor was
            designed backwards
Definition of ‘Big Picture Thinking’

                             Tactical ?
   Strategic ?




 Outside the Box ?


                     Attention to Interface Details ?




                                                        7
Michael Griffin on
       Systems Engineering and Big
             Picture Thinking
   True systems engineering is about minimizing the unintended
   consequences of a design.
   Lead Systems Engineers are often buried in the details. Lead
   SEs must understand the big picture and delegate the details.
   Big picture thinking is more of an innate talent possessed by
   some, as opposed to an easily learned competency.
NASA PM Challenge 2006 Presentation Comments




                                                                   8
Enablers
NPR 7123.1 (Ref. 4, NASA Systems
Engineering Processes and Requirements)
NASA Systems Engineering Handbook. (Ref. 5)




                                          9
The Mandate for you and your
            project:
NPR 7123.1 (Ref. 4, NASA Systems Engineering Processes and
   Requirements)
   Systems engineering at NASA requires the application of a
   systematic, disciplined engineering approach that is quantifiable,
   recursive, iterative, and repeatable for the development,
   operation, maintenance, and disposal of systems; integrated into
   a whole throughout the life cycle of a project or program. The
   emphasis of systems engineering is on safely achieving
   stakeholder, functional, physical, and operational
   performance requirements in the intended use
   environments over the system’s planned life within cost and
   schedule constraints.
http://nodis3.gsfc.nasa.gov/displayDir.cfm?Internal_ID=N_PR_7
   123_001A_&page_name=main

                                                                   10
NPR 7123.1 A SE Engine (Ref. 4)




                                  11
NPR 7123.1 Checklists (Ref. 4)
Two checklists (entrance criteria and success criteria)
provided for major milestone reviews:

Mission Concept                   Test Readiness
Systems Requirements              System Acceptance
Mission Definition                Flight Readiness
System Definition                 Operational Readiness
Preliminary Design                Decommissioning
Critical Design

NPR 7123.1A, Appendix G “Checklists”
                                                          12
Enablers (continued)
NASA Systems Engineering Handbook.
(Ref. 5)
http://ntrs.nasa.gov/search.jsp?R=174432&id=2&qs=Ntt%3DNASA%252BS
ystems%252BEnginering%252BHandbook%26Ntk%3DKeywords%26Ntx%3
Dmode%2520matchall%26N%3D0%26Ns%3DHarvestDate%257c1

   Well defined concept of operations (Sect.
   4.1.2.1)
   Well defined interface requirements (Appendix
   F)
   Continuous Risk Management (Section 6.4.2)
                                                                    14
Yes, but ….
I can’t because….
“I’m too busy” working my contractually-defined
effort to worry about someone else’s work.
“I don’t know how” - Lack of familiarity with how
to go about big picture thinking.
“My boss won’t let me” - Project/organization
does not value/encourage big picture thinking.
“I don’t want to” - NIH (not invented here)
syndrome. (Ref. 3, “Launching a Leadership
Revolution” page 46)


                                                16
How Much Big Picture Thinking
       is Too Much?
Some will argue ANY thinking outside of the tasks and
deliverables called out in the project contractual requirements is
too much.
   The real key is looking to see how the big picture affects your project
   decisions, risks, and opportunities. When this kind of ‘Return on
   Investment’ fades, that is probably “enough.”
   Big picture thinking should dare to look beyond your immediate end user
   expectations.
       Downstream iterations of your project
       Reuse Potential
       Planned obsolescence? – space communication systems as an example.




                                                                            17
More Roadblocks

Key elements of the big picture are either not
ready or not willing to collaborate on big picture
issues and topics.
Complex program structures can make big
picture thinking more challenging




                                                 18
The Big Picture –The Management
     Challenge (Ref. 1, Dahlman)
            $                           $
                               $                 $




 Within                      Interdependencies
 Single                      Across
 Organization                Multiple
                             Organizations
Political and Cost Considerations Impact on Technical Issues
                                                          19
Tips for Effective Big Picture
           Thinking
Think like your end user
  Ensure you have an operational concept that shows
  how the end users will operate your system to
  support their needs.
Context is key
  The ability look at the project from various
  stakeholder views is essential.



                                                      20
Big Picture Context
Dr. Joel Sercel, Technical Director of Systems
Engineering at the Caltech Industrial Relations
Center, encourages each enterprise to
understand where projects in their portfolios
fall, with respect to the D2S criteria (aka, Depth,
Disruption and Scale). We must realize that a
one-size-fits-all development process may not
make sense. (Ref. 2)
Archetypical Programs in D2S Portfolio
          Model (Ref. 2, Sercel)                                                                                        Science and
                                                                                                                        Technology
                                                                                                                           Depth


                                                               Pentium          Stealth       Manhattan
                                                             Processor        Fighter       Project

                                                    Denver          Nuclear
                                                                    Manhattan Naval Air
                                                   Airport         Subs
                       Program                                              Power
                                                                          Project
                        Scope
                                            ATF




                                                                                                                 r
                                                                                                               to
                                                                                                         an e
                                                                                                       Tr Th
                                                                                                           si s
                                                                                             an y
                                                                                           Pl 2 Sp
                                  Hoover                    Typical PhD
                         Major




                                                                                               e
                                                                                              U
                                   Dam                      Thesis                                                 ri
                                                                                                                ylo
                          (3)
                                                                                                              P
                                                   Smart          Super                                  H.
                                                   House          House




                                                                                                 AV
                                                                                                                 High
                                  Typical




                                                                                                 U
                       Moderate                                                                                   (3)




                                                                                              o-
                                   Hotel




                                                                                            cr
                         (2)




                                                                                           Mi
                                                                                                 Medium
                                                                                                   (2)
                                  Typical          Enviro           The
                         Small    House            House            PC                    Low
                          (1)                                                              (1)
                                                                                                       Degree of
 Copyright © 2006                 Low             Medium            High                             Disruption of
ICS Associates Inc.                (1)              (2)              (3)                               Key Ideas
All rights reserved.
Big Picture Context (cont.)
The Department of Defense is in the final stages
of releasing a “System of Systems” Systems
Engineering Handbook
The handbook will emphasize tailoring systems
engineering methodology to address big picture
related challenges.
Big Picture Context
 (Ref. 1, Dahlman)




                      24
Constellation Case Study
Crew Exploration
Vehicle (CEV)
Parachute Assembly
System
Government Furnished
Equipment (GFE)




                              25
Forward Bay
               Compartment Layout                            One Confluence
                  FBC Jettison        Three Pilot Mortars
                    Mortars               ~120o separation
                                                             Fitting




                                     +Z


                       Two Drogue Mortars
                       Parallel Deploy


Attach Points
    Drogue
    Pilot (to Main Deployment Bag)                           Three Main
    Main Harness                                             Parachutes
Multi-discipline Risk Identified
    Serious risk identified during early simulations
and flight tests. “Limit Cycle” oscillation under
drogue parachutes, which could result in an
unsafe crew module attitude during descent.
    Designated as a big-picture risk, since timing
of parachute deployment commands from
Guidance, Navigation, and Control (GN&C) and
parachute physical deployment are both key
players in this phenomenon.
Risk Abatement Options
Isolate instability “root cause”
  offset drogue chute attachment points
  Unfavorable rotational rate at drogue cut-away
Minimize root cause effects
  Special bridle (confluence fitting) centralize parachute
  vehicle load interactions
  “Smart” Drogue release (GNC monitors Crew
  Module attitude & rates & releases CM at optimum
  time)
Rethink overall Parachute Architecture
Big Picture View
End User (big picture) view revealed:
  Simpler
     More effective
          Lower cost
                 Lighter weight
                       Safer
                             Alternative
Big Picture Solution




Drogues deploy thru FBC



                          Drogues separate FBC from CM



                                                         FBC deploys mains and
                                                           confluence fitting
                                                                                 CM descending under mains
Big Picture Solution
The Forward Bay Cover (FBC) separation chutes to be
used as a dual purpose parachute – both to slow the
vehicle (in lieu of similar CPAS drogue parachutes)
AND to physically move the separated FBC away from
the descending vehicle.
In lieu of separate mortars to deploy pilot parachute
(which would then deploy main parachutes), the
departing FBC is simply used to deploy the main
parachutes.
Big Picture Thinking Return on
           Investment
Risk ‘probability of occurrence’ dramatically
reduced
Reduced number of parachute-related critical
events by almost 50%
Overall safety increased by an order of magnitude
Approximately 50 pounds lighter
Fewer parachutes and fewer mortars (cheaper)
Parting Words
Reach Higher!
  Welcome interdisciplinary stakeholder views
  Think beyond project current life-cycle phase
  Assess the big picture from the end user
  (validation) view
  Always ask “What could go wrong?”
  When confronted with big picture dilemmas, realize
  that you are your project’s technical conscience.
  Share success stories
                                                   34
References
1.   Department of Defense System of Systems Challenges, JSC Systems
     Engineering Seminar presentation. Dr. Judith Dahlman. August
     2007
2.   Emerging Technical Methods of Intelligence – Critical Disruptors
     for the 21st Century, IEEE Special Presentation. Dr. Joel Sercel.
     March 2008
3.   Launching a Leadership Revolution. Chris Brady and Orrin
     Woodward
4.   NPR 7123.1A, NASA Systems Engineering Processes and
     Requirements. March 2007
5.   SP-2007-6105, NASA Systems Engineering Handbook. Rev. 1.
     December 2007
6.   Using Systems Thinking to Increase the Benefits of Innovation
     Efforts. Daniel Aronson. Innovative Leader newsletter. Volume
     6, No. 2
Questions?




Contact Information
Michael Hazen
Jacobs Engineering
JSC Engineering and Science Contract
281-461-5797
michael.hazen@escg.jacobs.com

                                       36

More Related Content

What's hot

Hunter.h.shinn.s
Hunter.h.shinn.sHunter.h.shinn.s
Hunter.h.shinn.sNASAPMC
 
Chen.tim
Chen.timChen.tim
Chen.timNASAPMC
 
Alfred mecum
Alfred mecumAlfred mecum
Alfred mecumNASAPMC
 
Harvey elliott
Harvey elliottHarvey elliott
Harvey elliottNASAPMC
 
Michelle Richmond IET Qualifying Technicians SFIA
Michelle Richmond IET Qualifying Technicians SFIAMichelle Richmond IET Qualifying Technicians SFIA
Michelle Richmond IET Qualifying Technicians SFIASFIA User Forum
 
Nichols.hornback.moses
Nichols.hornback.mosesNichols.hornback.moses
Nichols.hornback.mosesNASAPMC
 
Valcon Design Robustness Program 2013
Valcon Design Robustness Program 2013Valcon Design Robustness Program 2013
Valcon Design Robustness Program 2013martinebro
 
Design for 6θ by Valcon - an introduction to the process and methods
Design for 6θ by Valcon - an introduction to the process and methodsDesign for 6θ by Valcon - an introduction to the process and methods
Design for 6θ by Valcon - an introduction to the process and methodsmartinebro
 
xel_062006_kingplant
xel_062006_kingplantxel_062006_kingplant
xel_062006_kingplantfinance26
 
Fujieh.maura
Fujieh.mauraFujieh.maura
Fujieh.mauraNASAPMC
 
Newman lengyel dartpm-chal_case
Newman lengyel dartpm-chal_caseNewman lengyel dartpm-chal_case
Newman lengyel dartpm-chal_caseNASAPMC
 
Bilardo vincent
Bilardo vincentBilardo vincent
Bilardo vincentNASAPMC
 
Colaborative Cloud Poster EDUCAUSE12
Colaborative Cloud Poster EDUCAUSE12Colaborative Cloud Poster EDUCAUSE12
Colaborative Cloud Poster EDUCAUSE12Thomas Danford
 
Tpcs risk table.xls
Tpcs risk table.xlsTpcs risk table.xls
Tpcs risk table.xlseriko51
 

What's hot (16)

Hunter.h.shinn.s
Hunter.h.shinn.sHunter.h.shinn.s
Hunter.h.shinn.s
 
Chen.tim
Chen.timChen.tim
Chen.tim
 
Alfred mecum
Alfred mecumAlfred mecum
Alfred mecum
 
Harvey elliott
Harvey elliottHarvey elliott
Harvey elliott
 
Michelle Richmond IET Qualifying Technicians SFIA
Michelle Richmond IET Qualifying Technicians SFIAMichelle Richmond IET Qualifying Technicians SFIA
Michelle Richmond IET Qualifying Technicians SFIA
 
Nichols.hornback.moses
Nichols.hornback.mosesNichols.hornback.moses
Nichols.hornback.moses
 
Valcon Design Robustness Program 2013
Valcon Design Robustness Program 2013Valcon Design Robustness Program 2013
Valcon Design Robustness Program 2013
 
Stargel - Multi-Scale Structural Mechanics and Prognosis - Spring Review 2012
Stargel - Multi-Scale Structural Mechanics and Prognosis - Spring Review 2012Stargel - Multi-Scale Structural Mechanics and Prognosis - Spring Review 2012
Stargel - Multi-Scale Structural Mechanics and Prognosis - Spring Review 2012
 
Value stream mapping
Value stream mapping  Value stream mapping
Value stream mapping
 
Design for 6θ by Valcon - an introduction to the process and methods
Design for 6θ by Valcon - an introduction to the process and methodsDesign for 6θ by Valcon - an introduction to the process and methods
Design for 6θ by Valcon - an introduction to the process and methods
 
xel_062006_kingplant
xel_062006_kingplantxel_062006_kingplant
xel_062006_kingplant
 
Fujieh.maura
Fujieh.mauraFujieh.maura
Fujieh.maura
 
Newman lengyel dartpm-chal_case
Newman lengyel dartpm-chal_caseNewman lengyel dartpm-chal_case
Newman lengyel dartpm-chal_case
 
Bilardo vincent
Bilardo vincentBilardo vincent
Bilardo vincent
 
Colaborative Cloud Poster EDUCAUSE12
Colaborative Cloud Poster EDUCAUSE12Colaborative Cloud Poster EDUCAUSE12
Colaborative Cloud Poster EDUCAUSE12
 
Tpcs risk table.xls
Tpcs risk table.xlsTpcs risk table.xls
Tpcs risk table.xls
 

Viewers also liked

Monex Big Pic Updated
Monex Big Pic UpdatedMonex Big Pic Updated
Monex Big Pic Updatederwinsumargo
 
Rippe.carpio
Rippe.carpioRippe.carpio
Rippe.carpioNASAPMC
 
Coonce.tom
Coonce.tomCoonce.tom
Coonce.tomNASAPMC
 
Neiberding
NeiberdingNeiberding
NeiberdingNASAPMC
 
K.pagel.beene
K.pagel.beeneK.pagel.beene
K.pagel.beeneNASAPMC
 
C null 01-17-2011
C null 01-17-2011C null 01-17-2011
C null 01-17-2011NASAPMC
 
Harrison.g.poole.k
Harrison.g.poole.kHarrison.g.poole.k
Harrison.g.poole.kNASAPMC
 
Backup norm.smith
Backup norm.smithBackup norm.smith
Backup norm.smithNASAPMC
 
Stacy.cusack
Stacy.cusackStacy.cusack
Stacy.cusackNASAPMC
 
Serrato.be be
Serrato.be beSerrato.be be
Serrato.be beNASAPMC
 
Bauer.frank
Bauer.frankBauer.frank
Bauer.frankNASAPMC
 
Wienkoop.glenn
Wienkoop.glennWienkoop.glenn
Wienkoop.glennNASAPMC
 
Patrick.guske.update
Patrick.guske.updatePatrick.guske.update
Patrick.guske.updateNASAPMC
 
Kirsch.mike
Kirsch.mikeKirsch.mike
Kirsch.mikeNASAPMC
 
Inter pech bounds
Inter pech boundsInter pech bounds
Inter pech boundsNASAPMC
 
Michael.aucoin
Michael.aucoinMichael.aucoin
Michael.aucoinNASAPMC
 
B ackroyd
B ackroydB ackroyd
B ackroydNASAPMC
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayfulNASAPMC
 

Viewers also liked (20)

Monex Big Pic Updated
Monex Big Pic UpdatedMonex Big Pic Updated
Monex Big Pic Updated
 
[Presenticcon Pilot] Big picture thinking
[Presenticcon Pilot] Big picture thinking[Presenticcon Pilot] Big picture thinking
[Presenticcon Pilot] Big picture thinking
 
Rippe.carpio
Rippe.carpioRippe.carpio
Rippe.carpio
 
Coonce.tom
Coonce.tomCoonce.tom
Coonce.tom
 
Neiberding
NeiberdingNeiberding
Neiberding
 
K.pagel.beene
K.pagel.beeneK.pagel.beene
K.pagel.beene
 
C null 01-17-2011
C null 01-17-2011C null 01-17-2011
C null 01-17-2011
 
Harrison.g.poole.k
Harrison.g.poole.kHarrison.g.poole.k
Harrison.g.poole.k
 
Backup norm.smith
Backup norm.smithBackup norm.smith
Backup norm.smith
 
Heard
HeardHeard
Heard
 
Stacy.cusack
Stacy.cusackStacy.cusack
Stacy.cusack
 
Serrato.be be
Serrato.be beSerrato.be be
Serrato.be be
 
Bauer.frank
Bauer.frankBauer.frank
Bauer.frank
 
Wienkoop.glenn
Wienkoop.glennWienkoop.glenn
Wienkoop.glenn
 
Patrick.guske.update
Patrick.guske.updatePatrick.guske.update
Patrick.guske.update
 
Kirsch.mike
Kirsch.mikeKirsch.mike
Kirsch.mike
 
Inter pech bounds
Inter pech boundsInter pech bounds
Inter pech bounds
 
Michael.aucoin
Michael.aucoinMichael.aucoin
Michael.aucoin
 
B ackroyd
B ackroydB ackroyd
B ackroyd
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayful
 

Similar to Michael.hazen

A Suite Of Tools For Technology Assessment
A Suite Of Tools For Technology AssessmentA Suite Of Tools For Technology Assessment
A Suite Of Tools For Technology Assessmentjbci
 
Martin Lander 14 Resit Project – Globally Conscious Engineer .docx
Martin Lander 14  Resit Project – Globally Conscious Engineer .docxMartin Lander 14  Resit Project – Globally Conscious Engineer .docx
Martin Lander 14 Resit Project – Globally Conscious Engineer .docxinfantsuk
 
Knowledge Engineering For Automated Planning
Knowledge Engineering For Automated PlanningKnowledge Engineering For Automated Planning
Knowledge Engineering For Automated Planningahmad bassiouny
 
Knowledge Engineering For Automated Planning
Knowledge Engineering For Automated PlanningKnowledge Engineering For Automated Planning
Knowledge Engineering For Automated Planningahmad bassiouny
 
Basics of Software Architecture for .NET Developers
Basics of Software Architecture for .NET DevelopersBasics of Software Architecture for .NET Developers
Basics of Software Architecture for .NET DevelopersDan Douglas
 
Mi 291 chapter 2 (engineering analsysis)
Mi 291 chapter 2 (engineering analsysis)Mi 291 chapter 2 (engineering analsysis)
Mi 291 chapter 2 (engineering analsysis)varun teja G.V.V
 
Introduction to SEPAM
Introduction to SEPAMIntroduction to SEPAM
Introduction to SEPAMandreasboon
 
Reverse Engineering
Reverse EngineeringReverse Engineering
Reverse Engineeringsiddu019
 
Thoughts On Architecting V4 2
Thoughts On Architecting V4 2Thoughts On Architecting V4 2
Thoughts On Architecting V4 2bmercer
 
SDSC_Innovators_2015_may-aug_1
SDSC_Innovators_2015_may-aug_1SDSC_Innovators_2015_may-aug_1
SDSC_Innovators_2015_may-aug_1Ron Hawkins
 
A suite of tools for technology assessment
A suite of tools for technology assessmentA suite of tools for technology assessment
A suite of tools for technology assessmentNitish Mahajan
 
Hazen michael
Hazen michaelHazen michael
Hazen michaelNASAPMC
 
LIFT: A Legacy InFormation retrieval Tool
LIFT: A Legacy InFormation retrieval ToolLIFT: A Legacy InFormation retrieval Tool
LIFT: A Legacy InFormation retrieval ToolKellyton Brito
 
Rework: Anticipating What May Go Wrong
Rework: Anticipating What May Go WrongRework: Anticipating What May Go Wrong
Rework: Anticipating What May Go Wrongpedlove
 
Seminar VU Amsterdam 2015
Seminar VU Amsterdam 2015Seminar VU Amsterdam 2015
Seminar VU Amsterdam 2015Philipp Leitner
 
"We are doing it wrong."
"We are doing it wrong.""We are doing it wrong."
"We are doing it wrong."weissgraeber
 
Managing Complexity and Change with Scalable Software Design
Managing Complexity and Change with Scalable Software DesignManaging Complexity and Change with Scalable Software Design
Managing Complexity and Change with Scalable Software Designlbergmans
 
Hoffman.ed
Hoffman.edHoffman.ed
Hoffman.edNASAPMC
 
Cs 1023 lec 4 (week 1)
Cs 1023 lec 4 (week 1)Cs 1023 lec 4 (week 1)
Cs 1023 lec 4 (week 1)stanbridge
 
Application of linear programming techniques to practical
Application of linear programming techniques to practicalApplication of linear programming techniques to practical
Application of linear programming techniques to practicalAlexander Decker
 

Similar to Michael.hazen (20)

A Suite Of Tools For Technology Assessment
A Suite Of Tools For Technology AssessmentA Suite Of Tools For Technology Assessment
A Suite Of Tools For Technology Assessment
 
Martin Lander 14 Resit Project – Globally Conscious Engineer .docx
Martin Lander 14  Resit Project – Globally Conscious Engineer .docxMartin Lander 14  Resit Project – Globally Conscious Engineer .docx
Martin Lander 14 Resit Project – Globally Conscious Engineer .docx
 
Knowledge Engineering For Automated Planning
Knowledge Engineering For Automated PlanningKnowledge Engineering For Automated Planning
Knowledge Engineering For Automated Planning
 
Knowledge Engineering For Automated Planning
Knowledge Engineering For Automated PlanningKnowledge Engineering For Automated Planning
Knowledge Engineering For Automated Planning
 
Basics of Software Architecture for .NET Developers
Basics of Software Architecture for .NET DevelopersBasics of Software Architecture for .NET Developers
Basics of Software Architecture for .NET Developers
 
Mi 291 chapter 2 (engineering analsysis)
Mi 291 chapter 2 (engineering analsysis)Mi 291 chapter 2 (engineering analsysis)
Mi 291 chapter 2 (engineering analsysis)
 
Introduction to SEPAM
Introduction to SEPAMIntroduction to SEPAM
Introduction to SEPAM
 
Reverse Engineering
Reverse EngineeringReverse Engineering
Reverse Engineering
 
Thoughts On Architecting V4 2
Thoughts On Architecting V4 2Thoughts On Architecting V4 2
Thoughts On Architecting V4 2
 
SDSC_Innovators_2015_may-aug_1
SDSC_Innovators_2015_may-aug_1SDSC_Innovators_2015_may-aug_1
SDSC_Innovators_2015_may-aug_1
 
A suite of tools for technology assessment
A suite of tools for technology assessmentA suite of tools for technology assessment
A suite of tools for technology assessment
 
Hazen michael
Hazen michaelHazen michael
Hazen michael
 
LIFT: A Legacy InFormation retrieval Tool
LIFT: A Legacy InFormation retrieval ToolLIFT: A Legacy InFormation retrieval Tool
LIFT: A Legacy InFormation retrieval Tool
 
Rework: Anticipating What May Go Wrong
Rework: Anticipating What May Go WrongRework: Anticipating What May Go Wrong
Rework: Anticipating What May Go Wrong
 
Seminar VU Amsterdam 2015
Seminar VU Amsterdam 2015Seminar VU Amsterdam 2015
Seminar VU Amsterdam 2015
 
"We are doing it wrong."
"We are doing it wrong.""We are doing it wrong."
"We are doing it wrong."
 
Managing Complexity and Change with Scalable Software Design
Managing Complexity and Change with Scalable Software DesignManaging Complexity and Change with Scalable Software Design
Managing Complexity and Change with Scalable Software Design
 
Hoffman.ed
Hoffman.edHoffman.ed
Hoffman.ed
 
Cs 1023 lec 4 (week 1)
Cs 1023 lec 4 (week 1)Cs 1023 lec 4 (week 1)
Cs 1023 lec 4 (week 1)
 
Application of linear programming techniques to practical
Application of linear programming techniques to practicalApplication of linear programming techniques to practical
Application of linear programming techniques to practical
 

More from NASAPMC

Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk boNASAPMC
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski johnNASAPMC
 
Yew manson
Yew mansonYew manson
Yew mansonNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Wessen randi (cd)
Wessen randi (cd)Wessen randi (cd)
Wessen randi (cd)NASAPMC
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joeNASAPMC
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuartNASAPMC
 
Stock gahm
Stock gahmStock gahm
Stock gahmNASAPMC
 
Snow lee
Snow leeSnow lee
Snow leeNASAPMC
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandraNASAPMC
 
Seftas krage
Seftas krageSeftas krage
Seftas krageNASAPMC
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marcoNASAPMC
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mikeNASAPMC
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karleneNASAPMC
 
Rackley mike
Rackley mikeRackley mike
Rackley mikeNASAPMC
 
Paradis william
Paradis williamParadis william
Paradis williamNASAPMC
 
Osterkamp jeff
Osterkamp jeffOsterkamp jeff
Osterkamp jeffNASAPMC
 
O'keefe william
O'keefe williamO'keefe william
O'keefe williamNASAPMC
 
Muller ralf
Muller ralfMuller ralf
Muller ralfNASAPMC
 

More from NASAPMC (20)

Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk bo
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski john
 
Yew manson
Yew mansonYew manson
Yew manson
 
Wood frank
Wood frankWood frank
Wood frank
 
Wood frank
Wood frankWood frank
Wood frank
 
Wessen randi (cd)
Wessen randi (cd)Wessen randi (cd)
Wessen randi (cd)
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joe
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuart
 
Stock gahm
Stock gahmStock gahm
Stock gahm
 
Snow lee
Snow leeSnow lee
Snow lee
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandra
 
Seftas krage
Seftas krageSeftas krage
Seftas krage
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marco
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mike
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karlene
 
Rackley mike
Rackley mikeRackley mike
Rackley mike
 
Paradis william
Paradis williamParadis william
Paradis william
 
Osterkamp jeff
Osterkamp jeffOsterkamp jeff
Osterkamp jeff
 
O'keefe william
O'keefe williamO'keefe william
O'keefe william
 
Muller ralf
Muller ralfMuller ralf
Muller ralf
 

Recently uploaded

Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsAndrey Dotsenko
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

Michael.hazen

  • 1. Big Picture Thinking NASA Project Management Challenge 2008 Michael Hazen Jacobs Engineering
  • 2. Purpose of this Presentation Describe the value of ‘big picture thinking’ and how this relates to a “mandate” for your project(s) Review some methods you can use to empower your big picture thinking Processes Tips & Techniques Illustrate the application of big picture thinking using a Constellation case study. 2
  • 3. The Value of Big Picture Thinking Areas where big picture thinking has proven to be particularly valuable include: Complex problems involving many stakeholders Recurring problems Issues where an action affects the environment Problems with solutions that are not obvious Ref. 6, Aronson
  • 4. The Value of Big Picture Thinking (cont.) Risk Reduction: Big picture thinking helps to identify risks early in the life cycle Project Success: Big picture thinking can dramatically reduce a projects likelihood of becoming a statistic Widespread failures common : Projects cancelled / over one year late / overruns in excess of 100% Catastrophic Failures 4
  • 5. Catastrophic Failures Columbia Hubble- When it was made, the glass for the mirror was carefully ground and polished to a near perfect surface. The problem was, it was ground into the wrong shape! Mars Observer – Could not establish contact once at Mars ($1 Billion) Mars Polar Lander - Spurious signals caused the trio of lander legs to deploy during descent making it think it had landed, although it was high above the Mars surface. 5
  • 6. Genesis – lost 27 months worth of space data when it crashed because a sensor was designed backwards
  • 7. Definition of ‘Big Picture Thinking’ Tactical ? Strategic ? Outside the Box ? Attention to Interface Details ? 7
  • 8. Michael Griffin on Systems Engineering and Big Picture Thinking True systems engineering is about minimizing the unintended consequences of a design. Lead Systems Engineers are often buried in the details. Lead SEs must understand the big picture and delegate the details. Big picture thinking is more of an innate talent possessed by some, as opposed to an easily learned competency. NASA PM Challenge 2006 Presentation Comments 8
  • 9. Enablers NPR 7123.1 (Ref. 4, NASA Systems Engineering Processes and Requirements) NASA Systems Engineering Handbook. (Ref. 5) 9
  • 10. The Mandate for you and your project: NPR 7123.1 (Ref. 4, NASA Systems Engineering Processes and Requirements) Systems engineering at NASA requires the application of a systematic, disciplined engineering approach that is quantifiable, recursive, iterative, and repeatable for the development, operation, maintenance, and disposal of systems; integrated into a whole throughout the life cycle of a project or program. The emphasis of systems engineering is on safely achieving stakeholder, functional, physical, and operational performance requirements in the intended use environments over the system’s planned life within cost and schedule constraints. http://nodis3.gsfc.nasa.gov/displayDir.cfm?Internal_ID=N_PR_7 123_001A_&page_name=main 10
  • 11. NPR 7123.1 A SE Engine (Ref. 4) 11
  • 12. NPR 7123.1 Checklists (Ref. 4) Two checklists (entrance criteria and success criteria) provided for major milestone reviews: Mission Concept Test Readiness Systems Requirements System Acceptance Mission Definition Flight Readiness System Definition Operational Readiness Preliminary Design Decommissioning Critical Design NPR 7123.1A, Appendix G “Checklists” 12
  • 13.
  • 14. Enablers (continued) NASA Systems Engineering Handbook. (Ref. 5) http://ntrs.nasa.gov/search.jsp?R=174432&id=2&qs=Ntt%3DNASA%252BS ystems%252BEnginering%252BHandbook%26Ntk%3DKeywords%26Ntx%3 Dmode%2520matchall%26N%3D0%26Ns%3DHarvestDate%257c1 Well defined concept of operations (Sect. 4.1.2.1) Well defined interface requirements (Appendix F) Continuous Risk Management (Section 6.4.2) 14
  • 16. I can’t because…. “I’m too busy” working my contractually-defined effort to worry about someone else’s work. “I don’t know how” - Lack of familiarity with how to go about big picture thinking. “My boss won’t let me” - Project/organization does not value/encourage big picture thinking. “I don’t want to” - NIH (not invented here) syndrome. (Ref. 3, “Launching a Leadership Revolution” page 46) 16
  • 17. How Much Big Picture Thinking is Too Much? Some will argue ANY thinking outside of the tasks and deliverables called out in the project contractual requirements is too much. The real key is looking to see how the big picture affects your project decisions, risks, and opportunities. When this kind of ‘Return on Investment’ fades, that is probably “enough.” Big picture thinking should dare to look beyond your immediate end user expectations. Downstream iterations of your project Reuse Potential Planned obsolescence? – space communication systems as an example. 17
  • 18. More Roadblocks Key elements of the big picture are either not ready or not willing to collaborate on big picture issues and topics. Complex program structures can make big picture thinking more challenging 18
  • 19. The Big Picture –The Management Challenge (Ref. 1, Dahlman) $ $ $ $ Within Interdependencies Single Across Organization Multiple Organizations Political and Cost Considerations Impact on Technical Issues 19
  • 20. Tips for Effective Big Picture Thinking Think like your end user Ensure you have an operational concept that shows how the end users will operate your system to support their needs. Context is key The ability look at the project from various stakeholder views is essential. 20
  • 21. Big Picture Context Dr. Joel Sercel, Technical Director of Systems Engineering at the Caltech Industrial Relations Center, encourages each enterprise to understand where projects in their portfolios fall, with respect to the D2S criteria (aka, Depth, Disruption and Scale). We must realize that a one-size-fits-all development process may not make sense. (Ref. 2)
  • 22. Archetypical Programs in D2S Portfolio Model (Ref. 2, Sercel) Science and Technology Depth Pentium Stealth Manhattan Processor Fighter Project Denver Nuclear Manhattan Naval Air Airport Subs Program Power Project Scope ATF r to an e Tr Th si s an y Pl 2 Sp Hoover Typical PhD Major e U Dam Thesis ri ylo (3) P Smart Super H. House House AV High Typical U Moderate (3) o- Hotel cr (2) Mi Medium (2) Typical Enviro The Small House House PC Low (1) (1) Degree of Copyright © 2006 Low Medium High Disruption of ICS Associates Inc. (1) (2) (3) Key Ideas All rights reserved.
  • 23. Big Picture Context (cont.) The Department of Defense is in the final stages of releasing a “System of Systems” Systems Engineering Handbook The handbook will emphasize tailoring systems engineering methodology to address big picture related challenges.
  • 24. Big Picture Context (Ref. 1, Dahlman) 24
  • 25. Constellation Case Study Crew Exploration Vehicle (CEV) Parachute Assembly System Government Furnished Equipment (GFE) 25
  • 26.
  • 27. Forward Bay Compartment Layout One Confluence FBC Jettison Three Pilot Mortars Mortars ~120o separation Fitting +Z Two Drogue Mortars Parallel Deploy Attach Points Drogue Pilot (to Main Deployment Bag) Three Main Main Harness Parachutes
  • 28. Multi-discipline Risk Identified Serious risk identified during early simulations and flight tests. “Limit Cycle” oscillation under drogue parachutes, which could result in an unsafe crew module attitude during descent. Designated as a big-picture risk, since timing of parachute deployment commands from Guidance, Navigation, and Control (GN&C) and parachute physical deployment are both key players in this phenomenon.
  • 29. Risk Abatement Options Isolate instability “root cause” offset drogue chute attachment points Unfavorable rotational rate at drogue cut-away Minimize root cause effects Special bridle (confluence fitting) centralize parachute vehicle load interactions “Smart” Drogue release (GNC monitors Crew Module attitude & rates & releases CM at optimum time) Rethink overall Parachute Architecture
  • 30. Big Picture View End User (big picture) view revealed: Simpler More effective Lower cost Lighter weight Safer Alternative
  • 31. Big Picture Solution Drogues deploy thru FBC Drogues separate FBC from CM FBC deploys mains and confluence fitting CM descending under mains
  • 32. Big Picture Solution The Forward Bay Cover (FBC) separation chutes to be used as a dual purpose parachute – both to slow the vehicle (in lieu of similar CPAS drogue parachutes) AND to physically move the separated FBC away from the descending vehicle. In lieu of separate mortars to deploy pilot parachute (which would then deploy main parachutes), the departing FBC is simply used to deploy the main parachutes.
  • 33. Big Picture Thinking Return on Investment Risk ‘probability of occurrence’ dramatically reduced Reduced number of parachute-related critical events by almost 50% Overall safety increased by an order of magnitude Approximately 50 pounds lighter Fewer parachutes and fewer mortars (cheaper)
  • 34. Parting Words Reach Higher! Welcome interdisciplinary stakeholder views Think beyond project current life-cycle phase Assess the big picture from the end user (validation) view Always ask “What could go wrong?” When confronted with big picture dilemmas, realize that you are your project’s technical conscience. Share success stories 34
  • 35. References 1. Department of Defense System of Systems Challenges, JSC Systems Engineering Seminar presentation. Dr. Judith Dahlman. August 2007 2. Emerging Technical Methods of Intelligence – Critical Disruptors for the 21st Century, IEEE Special Presentation. Dr. Joel Sercel. March 2008 3. Launching a Leadership Revolution. Chris Brady and Orrin Woodward 4. NPR 7123.1A, NASA Systems Engineering Processes and Requirements. March 2007 5. SP-2007-6105, NASA Systems Engineering Handbook. Rev. 1. December 2007 6. Using Systems Thinking to Increase the Benefits of Innovation Efforts. Daniel Aronson. Innovative Leader newsletter. Volume 6, No. 2
  • 36. Questions? Contact Information Michael Hazen Jacobs Engineering JSC Engineering and Science Contract 281-461-5797 michael.hazen@escg.jacobs.com 36