This document summarizes a presentation given at the 2016 International Applied Reliability Symposium. The presentation discusses using structured reliability engineering to achieve cost reduction in a product through component substitution, while maintaining reliability. It presents a case study where a lower cost motor was evaluated as a replacement component for an extruder motor. A six-step process is outlined: gathering data on the original component and requirements; modeling and predicting reliability; developing a demonstration reliability test plan; executing the plan; and publishing results. The presentation walks through applying this process to evaluate the proposed motor replacement and verify it meets reliability requirements through testing.
1. Blue Room, Session 7
2016 ARS North America
Begins at 10:30 AM, Wednesday, June 22nd
Cost Reduction by Structured Reliability Engineering
Creating Raving Fans!
Michael Rioux
Stratasys, Inc.
Reliability Matters
3. Michael Rioux, Stratasys Slide Number: 2Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Agenda
Introduction 5 min
Case Study: Reliable cost reduction strategy 10 min
Structured Reliability Engineering 30 min
Gather the Data
Model & Predict
Develop the D.R.T.P.
Execute the Plan
Publish Results
Summary 5 min
Questions 10 min
4. Michael Rioux, Stratasys Slide Number: 3Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Acronyms
D.R.T.P. : Demonstrated Reliability Test Plan
VE : Value Engineering
NPI : New Product Introduction
FDM : Fused Deposition Modeling
MIC/s : Micro Inch Cubed/second. Volumetric flow rate
UUT : Unit Under Test
CRU : Customer Replacement Unit
CAR : Corrective Action Request
RCA : Root Cause Analysis
OEM : Original Equipment Manufacturer
TTT : Total Test Time
5. Michael Rioux, Stratasys Slide Number: 4Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Introduction
Michael Rioux: Sr. Systems Reliability Engineer
Defining the process required to meet reliability goals
Stratasys Inc.: 3D Printing Solution Company
3D printing is a way to create physical objects directly from digital files.
Technologies
FDM creates parts layer-by-layer with engineering-grade
thermoplastics
PolyJet is a process that jets and cures thin layers of liquid
photopolymers with UV energy
6. Michael Rioux, Stratasys Slide Number: 5Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Case Study: Reliability and Cost Reduction
Once a new product has been released to
production, the next step is to launch a cost
reduction initiative (VE).
VE techniques
Redesign
Decrease Existing Component Cost
Component Substitution
Re-source/Out-Source
De-Feature
We will explore a reliability–focused plan for
reducing cost by component substitution.
7. Michael Rioux, Stratasys Slide Number: 6Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Case Study: Reducing cost w/o sacrificing reliability
Common industry part types, technology and
competition do not guarantee rise to equally reliable
parts.
If component substitution is left in the hands of the
procurement organization, the end result could be the
purchasing of inexpensive parts w/o sufficient
consideration to the impact on product reliability.
Using a systematic structured reliability engineering
approach to achieve cost reduction not only yields
cost improvements, but creates customer loyalty.
8. Michael Rioux, Stratasys Slide Number: 7Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Case Study: Cost Reduction by Reliability Engineering
Challenge:
Purchasing has identified a lower cost
replacement motor w/encoder for the NPI FDM
extruder.
Objective:
Evaluate the proposed replacement component’s ability
to meet the allocated reliability, and performance
requirements as specified in the “Product Market Design
Requirements” document.
9. Michael Rioux, Stratasys Slide Number: 8Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 1:
Understand the use case
Review the Market Requirements Document
o MTTF, Allocation, Utilization, BX% Life…
Review the original DFMEA
Check the 3-F’s (Form, Fit, and Function)
Review Component datasheet and Application notes
Audit OEM Quality
[ 6 tasks ]
10. Michael Rioux, Stratasys Slide Number: 9Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Understand the use case
[ 1 : 6 ]
11. Michael Rioux, Stratasys Slide Number: 10Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Review the Market Requirements Document
The FDM extruder shall be a consumable item/CRU which is
easily replaced by the customer after 1100 build hours. The
extruder shall not be attached to either the model or support
material consumable.
The FDM extruder motor must not exceed a B15%(CL 80%) Life
requirement, ideal would a B10%, allowing for future reliability
growth in the head assembly.
FDM extruder shall operate at 7VDC (+/-2v), 50°C (+/-3°C), and
provide 8lbs push force at 1600MICS with an acceleration of
100,000 MICS/s.
[ 2 : 6 ]
12. Michael Rioux, Stratasys Slide Number: 11Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Review the original DFMEA
Any Failure Mode(s) that would over stress the replacement motor life or
performance?
• No-load speed
• No-load current
• Stall torque
• Stall current
[ 3 : 6 ]
13. Michael Rioux, Stratasys Slide Number: 12Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Check the 3-F’s (Form, Fit, and Function)
Form: shape, size, dimensions, mass, and weight
Fit: ability of part to physically interface with, connect to, or
become an integral part of another part
Function: ability to perform as required
In this case study the replacement motor
was an exact copy, drop-in replacement.
Any change in the 3-F’s that constitutes a
modification of the extruder assembly would
have required a battery of qualification tests
for various components and sub-assemblies
[ 4 : 6 ]
14. Michael Rioux, Stratasys Slide Number: 13Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Review component Data sheet(s) and Application notes
We are interested in comparing the differences between the component’s
parameters (Present vs. Suggested):
Data sheet
• Voltage range
• Current response
• Power consumption
• Operating temperature limits
• Performance chart
• Reliability data
Application notes
• Factors affecting motor performance
• Application use case
• Testing
[ 5 : 6 ]
15. Michael Rioux, Stratasys Slide Number: 14Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Audit OEM Quality
Review the following:
1. Compatible w/design application & manufacturing process?
2. Continuous Reliability improvement program implemented?
3. Feedback & corrective action program in place?
4. Device families prequalified periodically?
5. Qualified and approved manufacturer?
6. Early Life Reliability Control?
7. Lot-to-Lot controls in place?
How will these answers impact
the motor’s predicted
reliability?
[ 6 : 6 ]
16. Michael Rioux, Stratasys Slide Number: 15Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
This step is a preliminary evaluation to determine if suggested substitution component,
the motor, is a plausible candidate. Only then is it worth investing time and resources to
perform reliability testing.
Fishbone Diagram: identify possible causes for any effect on the motor.
Predict MTBF: utilized ReliaSoft Lambda Predict.
Calculate BX%: based on prediction.
Conclusion: does the results support moving forward?
[ 4 tasks ]Step 2:
18. Michael Rioux, Stratasys Slide Number: 17Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 2:
MTBF
Adjustment factors were best
concluded by working with the
OEM of the motor in question,
researching historical data,
and/or provided by the results
of an internal study.
[ 2 : 4 ]
19. Michael Rioux, Stratasys Slide Number: 18Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 2:
Does the predicted MTBF support the BX% requirement?
Case 2: future Tr requirement for extended replacement period.
Tr = 1500hrs
m = 9.978E+03 (predicted MTBF)
؞R = /
= 0.8604
؞BX% = 100% – 86.04% ≈ 14%
؞LIFE = B14%
Case 1: specification requirement for Tr .
Tr = 1100hrs (rounded up from 1095)
m = 9.978E+03 (predicted MTBF)
؞R = /
= 0.8956
؞BX% = 100% – 89.56% ≈ 10%
؞LIFE = B10%
[ 3 : 4 ]
20. Michael Rioux, Stratasys Slide Number: 19Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 2:
CONCLUSION
The preliminary model, and predicted BX%, does satisfy the desired reliability
requirements. However, the model must be verified by performing a demonstrated
reliability test. Nonetheless, the preliminary results do indicate the motor is plausibly a
candidate to support the cost reduction initiative, and therefore worth the time and
resources for further assessment.
Moreover, this study has identified plausible components of high risk: the motor
brushes and encoder disk. Said components shall be closely monitored during the
demonstrated reliability test to determine the overall impact on the motor’s ability to
meet the life/performance requirement.
In closing, may it be clearly understood that during the demonstrated reliability test
execution, both electrical and mechanical parameters are tested to their intended use
requirements. This assures all concerned parties that the UUT meets the intended
use case reliability specifications; however, it will not provide information outside the
use case.
[ 4 : 4 ]
21. Michael Rioux, Stratasys Slide Number: 20Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Baseline component: functional test, quality review.
Dissect motor to evaluate/measure internal components
Calculate sample size & total time to test: Weibull++ ReliaSoft Test design.
Design test strategy: Test methodology, configuration, thermal profile,
electrical/mechanical parameters, motor load, test profile, data collection.
Define fail criteria: work with design team.
Define test resources: equipment, materials, and time line.
[ 5 tasks ]
22. Michael Rioux, Stratasys Slide Number: 21Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Baseline component: Prior to test commencement all motors shall be functionally tested to
baseline performance characteristics. Furthermore, a motor shall be dissected to evaluate initial
quality, and measure the DC commutating brushes and bushings at run time equal to zero.
Bench top set-up Encoder output signal Waveform Signature
Equipment List
UUT: ACME motor w/encoder (PN: AB20100)
DAQ: Tektronix :: MSO4104B-L Mixed Signal O-scope
PS: Topward model 6303D (property ID: 0223)
Load: ULTEM
Brushes
Brass Bushing
[ 1 : 5 ]
23. Michael Rioux, Stratasys Slide Number: 22Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Brushes
As the motor will be replaced before entering wearout, the distribution was governed by
a 1P Exponential distribution.
[ 2 : 5 ]
24. Michael Rioux, Stratasys Slide Number: 23Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Brushes
Test Strategy Designed to evaluate the proposed motor’s ability to meet the
reliability as predicted in the preliminary motor evaluation.
• Electrically terminated to 7VDC source
• Dressed with thermocouples
• Chamber set to 60°C (design margin) w/ 55%RH
• Motor shafts shall be fixed with a load inertial disk
• Encoder output signal shall be captured
• Input V/I, and case temperature captured
• Motor enclosed in an enclosure as in use case
• Motor exercised in repetitive CW/CCW direction
• 20 UUTs executing
• 5 extra UUTs for random interval internal inspections
• Internal inspection: brush/bushing wear, contamination,
insulation breakdown
TTT min = 1530hrs/UUT (CL = 80% w/1failure)
Test Configuration
[ 3 : 5 ]
25. Michael Rioux, Stratasys Slide Number: 24Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Brushes
Fail Criteria: Critical to work closely with the design engineers to understand
performance limitations. If available, review customer surveys.
• Motor seizes
• Wire insulation breakdown
• Motor temperature exceeds 100°C (impacts motor performance)
• Missing output encoder count signals during TTT
• Encoder noise to signal ratio greater than 5% during TTT
• Brush wear greater than 80% after 1500 hours of execution (worst case in population)
• Encoder output signal degrades by more than 10% over TTT
• Bushing wear greater than 1% after 1500 hours of execution (worst case in population)
• Motor fails to maintain commanded acceleration performance signal (drift > 1%)
[ 4 : 5 ]
26. Michael Rioux, Stratasys Slide Number: 25Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 3:
Brushes
Schedule & Resources
UUT: motor (25pcs)
Enclosures: (25pcs)
Load Disks: (25pcs)
TC DAQ: Agilent 34970A
TC: Type K :: (50pcs)
DC Sources: BK Precision 1900
Test Chamber: Despatch
Encoder DAQ: NI
[ 5 : 5 ]
Test extended to 3416hrs
27. Michael Rioux, Stratasys Slide Number: 26Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 4:
Brushes
Set-up test
Perform RCA on any undesirable event
Update Weibull++ folio
Perform Interval audits: Brush and bushing wear, contamination buildup
Review captured data daily: Motor case temp, velocity, acceleration, etc.
[ 5 tasks ]
28. Michael Rioux, Stratasys Slide Number: 27Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 4:
Brushes
Think safety, durability, and serviceability.
Your data is only as reliable as your test set-up.
[ 1 : 5 ]
30. Michael Rioux, Stratasys Slide Number: 29Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 4:
Discovery :: Perform Random Interval Audits ::1 motor/audit
Contamination
(Brush dust build up)
Bushing wear after 550hrs
Encoder disk discoloration
Motor brush/bushing assembly
Brushes
Bushing
Motor brush wear after 550hrs
[ 3 : 5 ]
31. Michael Rioux, Stratasys Slide Number: 30Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 4:
Brushes
Folio :: Extruder Motor :: Total sample space = 25
In this study the folio was built on ReliaSoft’s Weibull++. The LDA was modeled with an
exponential function since the design of the complete sub-assembly would be replaced
prior to entering wearout.
[ 4 : 5 ]
32. Michael Rioux, Stratasys Slide Number: 31Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 4:
Brushes
RCA :: Extruder Motor :: 5 Whys & the Fishbone
In this study three undesirable events occurred. Utilizing the 5 Whys & the Fishbone
diagram, along with working with the OEM to understand how all the undesirable events
occurred. The following root cause was concluded.
Dorado
Motor
Failure
Winding
Bushing
Motor Failure Components
VOLTAGE SURGES
OVERHEAT
OPEN/SHORTED
CONTAMINATION
Motor Insulation
Stator
Encoder
Rotor
OVERHEATING
OVERLOADING
VIBRATION
AGING
VIBRATION
CORROSION
Enclosure
CORROSION
INCORRECT FITTING
MANUFACTURING ASSEMBLY
VIBRATION
ASSEMBLY
CONTAMINATION
MIS-WIRED
LOOSE MAGNET
CORROSION
IMBALANCE
Shaft
IMPROPER ASSEMBLY
MISALIGNMENT
OVERLOADING
CONTAMINATION
THERMAL STRESS
MOISTURE
Connector
VIBRATION
MISALIGNMENT
HIGH TEMPERATURE
CONTAMINATION
DISK FAILURE
OV/OC
CABLE FAULT
HEAT
OVERHEAT
CONTAMINATION
HIGH VIBRATION
HIGH VIBRATION
PHYSICAL DAMAGE
PHYSICAL DAMAGE
VIBRATION
CORROSION
OV/OC
brushes
VIBRATION
CORROSION
PHYSICAL DAMAGE
HIGH TEMP
MOTOR SPEED
DIRECTION
CONTAMINATION
“5 Whys”
1. Why did the motor stop?
Not enough torque
2. Why not enough torque?
Too much friction
3. Why too much friction?
Shaft misalignment (2), bushing to shaft seized (1)
4. Why shaft misaligned, and seized?
Shaft bent(2), contamination(1)
5. Why bent shaft, and contamination?
Improper assembly in all cases,
Load disk press force too high(2)
Overfill of epoxy(1)
[ 5 : 5 ]
33. Michael Rioux, Stratasys Slide Number: 32Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Index
Demonstrated MTTF & BX%
Functional Test Results
Internal Component Review
RCA /CAR
Final Conclusion
[ 5 tasks ]
34. Michael Rioux, Stratasys Slide Number: 33Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
LDA :: MTTF:: BX%
After executing the test for 3416hrs, all surviving UUTs were suspended, then the
final results were analyzed to determine the MTTF and BX%.
F= 3/S= 22
Demonstrated MTTF exceeds the predicted!
B15% >> 1100hrs
BX% (1100hrs) = 4.9%
[ 1 : 5 ]
35. Michael Rioux, Stratasys Slide Number: 34Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
Functional Test Results
It can be seen below that the motor's velocity and acceleration performed reliably
to the commanded test control signal. We can also observe that output signal had
been stable and repeatable throughout the total test period.
Measurements below are from the seam stress part test, which is our best measurement
of the motor’s ability to accurately/reliably control the extrusion volumetric.
[ 2 : 5 ]
36. Michael Rioux, Stratasys Slide Number: 35Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
Internal component review :: BUSHING REVIEW
Prior to executing test, a sacrificial motor was disassembled to learn of the bushing
quality and initial dimensions. These dimensions were utilized to understand the wear
out. The measurements weren’t used to perform a degradation analysis. But merely to
observe if any unexpected wear surfaced that may jeopardize the motor’s predicted
reliability. Furthermore, this exercise had assisted in understanding plausible failure
modes. Note below for a before/after picture of the bushing.
Wearout < 1%
[ 3a : 5 ]
37. Michael Rioux, Stratasys Slide Number: 36Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
Internal component review :: BRUSH REVIEW
If we assume all the brushes at t = 0 are of the same length (+/-.01%) ,the worst case brush
wear rate in our sample space was 6.0E-5in/hour (+/-.01%). This would lead to a total wear of
0.09” after 1500 hours of run time.
؞(0.139” t = 0) – (0.09” t = 1500) = 0.049”wear ؞ 35.3% wear out at 1500 hours < 80%
Motor 21 3416.000 hrs
[ 3b : 5 ]
38. Michael Rioux, Stratasys Slide Number: 37Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
RCA/CAR result
• Total of 3 failures occurred during the total test period.
• All assembly induced failures.
Overstressing the motor shaft
Contamination
Corrective Action Request:
• In production the use of a gear press tool
shall be utilized, and the edges of the shafts
and the gear holes will be chambered
helping to distribute the force evenly around
the circumference.
• Work instructions, and training on how to
properly use gear press and applying
Loctite after the gear is pressed onto the
shaft.
[ 4 : 5 ]
39. Michael Rioux, Stratasys Slide Number: 38Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Step 5:
Brushes
Final Conclusion
All conducted tests have demonstrated that the suggested motor exceeds the allocated
extruder reliability requirements. Therefore said motor is an approved direct drop-in
replacement to support the VE cost reduction by component substitution initiative.
However, this case study shall not be considered to provide any reliability information
outside the extruder use case.
[ 5 : 5 ]
40. Michael Rioux, Stratasys Slide Number: 39Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Structured Reliability Engineering
Summary
Brushes
• Don’t assume that common industry part types and market competition gives
rise to parts of equal reliability.
• Executing the VE initiative: component substitution; without sufficient
consideration to the impact on product reliability, could lead to loss of profits
and customer loyalty.
• To sustain customer loyalty a Structured Reliability Engineering Evaluation
Process must be integrated into the Value Engineering Strategy.
• Question everything!
41. Michael Rioux, Stratasys Slide Number: 40Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Michael Rioux, Sr. Systems Reliability Engineer
michael.rioux@stratasys.com
Michael Rioux is a Senior Systems Reliability Engineer at Stratasys, Inc.
supporting design and test engineering. In this role he is responsible for defining
the process required to meet reliability goals for New Product Development.
Michael received his Baccalaureate of Science from Northeastern University,
Boston, Massachusetts. He began his engineering career at MIT designing
electrical/electronic hardware for analyzing Plasma Fusion. For 25+ years he
continued to design hardware for various projects supported by the DoD, DoE, as
well as various commercial Industries.
Over the last five years he has transitioned into the role of Reliability Engineering.
Michael is not only providing product reliability analysis, with his experience in
design engineering, he is reviewing system designs to propose design
modifications that have a direct impact on improving product reliability.
42. Michael Rioux, Stratasys Slide Number: 41Session 7
AppliedReliabilitySymposium,NorthAmerica2016
Blue Room
Questions
Thank you for your attention.
Do you have any questions?