The document provides an overview of the Commercial Orbital Transportation Services (COTS) program, including summaries of SpaceX's and Orbital's demonstration missions. Key lessons learned from the program and the companies include: fixing price milestones incentivized cost control; minimum requirements with government oversight fostered innovation; and commercial-friendly IP policies encouraged private investment. SpaceX benefited from design-test iterations and using commercial parts, while Orbital's independent design reviews and standard component designs reduced risk. The COTS model showed public-private partnerships can successfully develop new space capabilities.
MARINET – National Technology Initiative (NTI) is a key long-term program of the public-private partnership in the development of promising new markets based on high-tech solutions that will determine development of the global and Russian economy in the next 15-20 years.
MARINET was established in 2015 and involves a wide range of organizations providing advanced technologies for the maritime industry – from the leading corporations and universities to startup companies and research teams. Currently it joins several hundreds representatives from technology companies, leading universities, research and scientific centers, development institutions, business associations, ministries and government agencies.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
The Art of the Pitch: WordPress Relationships and Sales
COTS lessons learned_2013_nov13
1. National Aeronautics and Space Administration
Commercial Orbital Transportation
Services (COTS) Program
Lessons Learned
HEOMD Knowledge Sharing Forum
November 13, 2013
NASA HQ
Alan Lindenmoyer
Program Manager
Mike Horkachuck
COTS Project Executive for SpaceX
Gwynne Shotwell
President, SpaceX
Bruce Manners
COTS Project Executive for Orbital
Frank Culbertson
Executive VP and General Manager, Orbital
3. SpaceX COTS Summary
•
•
COTS Space Act Agreement awarded
August 2006 and amended in December
2010 with additional risk reduction
milestones
All 40 milestones completed in August
2012 for payments totaling $396M
–
December 8, 2010
–
•
Demo Mission 1:
Demo Mission 2/3:
May 22-31, 2012
Key Facts:
–
–
New autonomous Dragon cargo
spacecraft capable of carrying cargo to
and from the ISS and LEO
–
ISS Capture of Dragon
New Falcon 9 U.S. launch vehicle
New commercial launch facility at
CCAFS, FL
Falcon 9
Cape Canaveral Launch Site
3
4. SpaceX C2+ Launch
SpaceX COTS Demonstration Launches
May 22, 2012
C1 Launch
December 8, 2010
C2+ Launch
May 22, 2012
4
5. SpaceX COTS Demo Mission C2+
Cargo Return
Dragon splashdown in Pacific May 31,2012
Dragon in McGregor, TX
On recovery ship
Returned ISS cargo
5
6. SpaceX COTS Milestones
$M
Milestones
$M
2006
2007
2008
2009
2010
2011
2012
Total Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
278.0
1
Project Mgmt Plan
2
23.1
23.1
Demo 1 SRR
5.0
28.1
3
Demo 1 PDR
18.1
46.2
4
Financing Round 1
10.0
56.2
Mar 1
5
Demo 2 SRR
31.1
87.4
Mar 15
6
Demo 1 CDR
8.1
95.5
7
Demo 3 SRR
22.3 117.8
8
Demo 2 PDR
21.1 139.0
9
Draco Init. Hot fire
Sep 15
Nov 29
Feb 8
Aug 22
Oct 29
Dec 19
6.0 145.0
Mar 21
10 Financing Round 2
10.0 155.0
Mar 21
11 Demo 3 PDR
22.0 177.0
12 Multi-Engine Test
22.0 199.0
13 Demo 2/3 CDR
25.0 224.0
14 Financing Round 3
10.0 234.0
15 Demo 1 RR
5.0 263.0
20 Cargo Int. Demo
5.0 273.0
22 Demo 3 Mission
5.0 278.0
Jan
Mar
5.0 268.0
21 Demo 3 RR
Feb 8
5.0 258.0
19 Demo 2 Mission
Dec 18
5.0 253.0
18 Demo 2 RR
Sep
9.0 248.0
17 Demo 1 Mission
Jun 27
Aug 4
5.0 239.0
16 CUCU Flight Unit
Apr
Current Plan
Actual Completion Date
Feb
Jun 8
Mar
May
Jul 23
Sep
Dec 15
Jun
Dec
Mar 9
Sep
Jun
Jun 7
Nov
Dec 18
Jan
Jul
Dec
Sep
Jan
Aug 22
Jun 7
Initial SAA Plan
08-27-12
6
7. SpaceX Augmented COTS Milestones
$M
Milestones
$M
Total Q1
2007
Q2
Q3
2008
Q4
Q1
Q2
Q3
2009
Q4
Q1
Q2
Q3
2010
Q4
Q1
Q2
Q3
2011
Q4
Q1
Q2
2012
Q3
Q4
Q1
Q2
Q3
Q4
118.0
23 Modal Test Plan
5.0
5.0
Dec 16
24 Modal Test
5.0
10.0
Dec 16
25 LIDAR Test (open loop)
5.0
15.0
Dec 16
26 Solar Array Deploy Test
5.0
20.0
5.0
25.0
5.0
30.0
Mar
29 Infrastructure Plan
10.0
40.0
Mar
30 Thermal Vacuum Test
20.0
60.0
5.0
65.0
Jun 23
10.0
75.0
Jun 23
5.0
80.0
5.0
85.0
Aug 24
5.0
90.0
Aug 24
27
LIDAR Test Plan
(closed loop)
Thermal Vacuum Test
28 Plan
31
32
33
34
35
36
37
38
39
40
Test site Infrastructure
Implementation
Dragon Trunk Acoustic
Test
LIDAR Test 6 DOF
(closed loop)
Design Rev. Enhanced
Powered Cargo Accom.
Design Rev. Pressurized
Cargo Vol Increase
Dragon EMI/EMC Test
(HITL)
Dragon Cargo Racks &
Hatch Simulator
Ground Demo Enhanced
Powered Cargo
Launch site Infrastructure
Implementation
Production Infrastructure
Implementation
SAA Total
Current Plan
Actual Completion Date
10.0 100.0
Dec 16
Mar 31
Apr 6
May 10
Jul
Sep 14
Aug
Jul
Oct 26
Sep 20
3.0 103.0
Aug 26
5.0 108.0
Sep
Oct 26
5.0 113.0
Sep
Oct 26
5.0 118.0
Sep
Oct 26
396.0 396.0
Initial SAA Plan
10-27-11
7
8. Orbital COTS Summary
•
•
Space Act Agreement awarded February
2008 and amended in December 2010
with additional risk reduction milestones
All 29 milestones completed in November
2013 for payments totaling $288M
–
April 21, 2013
–
•
Maiden Test Flight:
ISS Demo Mission:
Sep. 18-23, 2013
Key Facts:
–
New Antares U.S. launch vehicle
–
New autonomous Cygnus cargo spacecraft
capable of carrying cargo to the ISS and
disposing cargo from the ISS
–
New commercial launch facility at Wallops
Island, VA
Cygnus Approaching ISS
Antares
MARS/Wallops Launch Site
8
10. Orbital D-1 ISS Demonstration Mission
D-1
Orb-1
D-1
Cygnus
10
11. Orbital COTS Milestones
$M
Milestones
$M
Total Q1
2008
Q2
2009
Q3
Q4
Q1
Q2
2010
Q3
Q4
Q1
Q2
2011
Q3
Q4
Q1
Q2
Q3
2012
Q4
Q1
Q2
Q3
2013
Q4
Q1
Q2
Q3
Q4
170.0
1
Program Plan Review
10.0
10.0
Mar 31
2
Demo Mission SRR
20.0
30.0
Jun
3
UCM PDR
10.0
40.0
Jul
4
DELETED
5
COTS Int/Ops Facility
10.0
50.0
Sep 22
6
PCM PDR
10.0
60.0
7
DELETED
8
IP&CL Submission
10.0
70.0
9
ISS Phase 1 SRP
10.0
80.0
10
COTS System PDR
20.0 100.0
11
PCM CDR
10.0 110.0
12
Cygnus Avionics Test
10.0 120.0
13
ISS Phase 2 SRP
10.0 130.0
14
10.0 140.0
15
COTS System CDR
SM Core Assembly
Complete
16
SM Test Readiness Review
7.5 155.0
17
SM Initial CPT
5.0 160.0
18
LV Stage I Assy. Complete
2.5 162.5
19
Cargo Int. Demo
2.5 165.0
20
Mission Readiness Review
2.5 167.5
21
System Demo Flight
2.5 170.0
Current Plan
Actual Completion Date
Jul 17
Aug 14
Oct 9
Oct
Nov
Feb 18
Mar 27
Sep
7.5 147.5
Apr
May 22
Jul 31
Aug 13
Jun
Nov 6
Aug
Mar
Mar 23
Sep
Dec
Oct
Jan
Aug 30
Apr
Nov 17
May
Jun
Sep
Dec 14
Jul 11
Sep
Dec 6
Oct
Jul 27
Oct
Dec
Dec
Nov 6
Initial SAA Plan
08-05-13
11
12. Orbital Augmented COTS Milestones
$M
Milestones
$M
Total Q1
2008
Q2
Q3
2009
Q4
Q1
Q2
Q3
2010
Q4
Q1
Q2
Q3
2011
Q4
Q1
Q2
2012
Q3
Q4
Q1
Q2
Q3
2013
Q4
Q1
Q2
Q3
Q4
118.0
22
Test Flight Mission Review
20.0
20.0
23
10.0
30.0
10.0
40.0
25
Test Flight Mission Analys.
Cygnus Mass Sim. (CMS)
Design Review
Install Add’l PITL
Simulators
5.0
45.0
26
PROX FEU Test Unit
5.0
50.0
27
Maiden Flt Stg 1 Core Del.
24.0
74.0
28
Maiden Flt Uppr Stage Del.
20.0
94.0
Jun 21
29
Maiden Flt CMS Delivered
10.0 104.0
Jun 20
30
Maiden Flt Stage 1 Assy.
10.0 114.0
Jul
31
Maiden Test Flight
4.0 118.0
Oct
24
SAA Total
Current Plan
Actual Completion Date
Dec 15
Feb 23
Mar 03
Apr
May
May 6
Jun 17
Apr 28
Sep 17
May 9
288.0 280.5
Initial SAA Plan
05-16-13
12
13. Key Lessons Learned from Program
•
Government seed money was highly leveraged
–
•
•
Commercial partners funded over 50% of COTS development costs
Fixed price milestone payments maximized incentive to control cost and minimize
schedule delays
Minimum firm requirements along with commensurate Government oversight were key to
fostering innovation and reducing life cycle development costs
–
–
Firm requirements were identified only where necessary to assure the safety of the ISS and crew
–
•
Goals (vs. requirements) were established to open trade space and optimize design
ISS interface requirements evolved over time and were coordinated in a collaborative manner with
the commercial partners
A portfolio of multiple partners with different capabilities assured a balanced approach to
technical and business risks
–
–
•
Increased the chances of at least one successful partner
Market forces kept development and operational costs in check
Commercial friendly intellectual property/data rights and limited termination liability
encouraged investment of private capital
13
14. Lessons Learned from Program
•
•
NASA commitment to purchase operational services greatly improves the ability for
companies to raise funds
NASA does not have the statutory authority to provide Government Furnished Equipment
(GFE) under a SAA
–
•
(Cont.)
Even though originally contemplated in the SAA and in the best interest of the Government, COTS
had to revert to loan agreements and cumbersome GSA excess procedures to transfer equipment
to facilitate berthing with the ISS
Augmentation of funding late in the program enabled additional risk reduction testing not
initially affordable
–
–
•
Directly contributed to the successful first attempt berthing of SpaceX Dragon to ISS
Would be difficult to predict how much, if any, to hold in reserve during program formulation and
initialization to protect for such milestone adjustments
COTS model for public-private partnerships worked!
14
15. Key Lessons Learned from SpaceX
•
Design, Test and Repeat (engineering units prior to qualification)
–
–
•
This philosophy can be better than just detailed analysis and only one test –learn much more
Need to have a team that can react and make changes quickly
Use of COTS electronics parts is feasible (instead of all S-level parts) thru use of some
radiation screening/tests and better architecture decisions (redundancy and reboot
capability)
–
Saves significant cost and schedule over traditional avionics
–
Previous Cost "GE Price" modeling experience was ”No matter how many runs done with varying
complexity, similarity vs new design, etc– the cost and schedule of the Avionics and software
drove the project cost.” Much more expensive than even massive structure or thermal systems.
–
•
Note: if total length of a project can be reduced 6-12 months by using readily available parts and
processes, you really save the monthly burn rate of the whole project for that many months.
Just gets projects done faster, so NASA could be more responsive and can do more things
Design with cost in mind
–
SpaceX paid much more attention to the cost of parts and component in the initial design phases
than NASA contractors traditionally do; to the point of building many things in house, because it
was perceived to be too expensive to buy vendor part. They always questioned why it can’t be
done less expensively and pushed back on costly requirements.
–
In-house production has the added benefit of allowing better schedule control than from sub-tier
suppliers and allows a streamlined change/update process.
15
16. Key Lessons Learned from SpaceX
•
(Cont.)
NASA observed SpaceX’s use of “WIKI tools” for multiple critical business and
engineering processes saves time—trying to move to a paperless environment.
–
Microsoft SharePoint and Confluence primarily for team processes and general info that they want
teams to have instead of some team meetings
–
Provided models instead of large documents in some cases (FEM models and summary vs
structural analysis report)
–
TRAC tickets are being used for issues, changes and risks by many teams.
–
Provides a "virtual" meeting to ask questions and throw out ideas. Tracks all the comments for others to
look at. Eventually, bringing them to closure and having all the managers and responsible engineers
sign off on it.
Saves time (schedule) by letting people look at ticket when they can fit it in their schedule and not have
to wait for a meeting to be called when everyone can attend. a Virtual board/review if you will.
NASA use suggested for simple issues, changes and risk (identify them as such), but move quickly
to a meeting if not coming to timely closure or unclear questions arise.
16
17. Key Lessons Learned from Orbital
•
Design Review Process – Independent Review Teams
–
–
IRT typically not bound by cost or schedule and can serve as a common sense sounding board for
design and programmatic decisions
–
Membership of team should remain consistent throughout program (to the extent practical)
–
•
Use of independent review team (IRT) of “experienced” experts to serve as design review team can
be very effective
Review team findings should go to level of management above program manager for
disposition/review
Use of “standard building block” designs
–
–
Lowers technical risk due to vast experience with designs/components
–
Could also potentially lower cost & schedule due to potentially eliminating the need for additional
qualification testing (where applicable)
–
•
NASA standard practices typically utilize custom or first use designs, whereas commercial
leverages existing “product line” designs
Does not come without risk however…
Leveraging common goals with all constituents (i.e. States, local governments, DOD,…)
–
NASA frequently “goes it alone” on programs and supplies all funding
–
Commercial industry realizes the benefits of competition and synergistic desires
Example – State of Virginia had interests in developing spaceport (i.e. MARS) and supplied significant
funding
Example – Industry partners, in some cases, provided funding for unique hardware in exchange for IP
rights
17
18. Key Lessons Learned from Orbital
•
NASA can embrace cultural shift of working with “Commercial” partners, but it is a
continuing challenge
–
–
NASA needs to understand partner challenges, both technical and programmatic
–
NASA needs to avoid “grading” systems designs and offer solutions that consider partner
challenges
–
•
NASA has immense technical capability
If we show value, industry will “open up”
Communication & trust is essential
–
–
Regular tag-ups
–
Talk often and early…
–
•
Partners, not customers or “suppliers”
Relationship should be built to last and therefore needs to be protected and nurtured
Breaking interfaces/systems which were not designed for multi-party use is difficult and
needs careful thought & consideration
18