SlideShare a Scribd company logo
Preparing Your Site
for Holidays and
Major Events
Gopal Brugalette – Senior Applied Architect
Tammy Everts – Senior Researcher & Evangelist
Gopal Brugalette
Senior Architect, Performance Engineering
Tammy Everts
@tameverts
Performance affects every (?)
business KPI
Revenue
Conversions/downloads
User satisfaction
User retention
Time on site
Page views
Bounce rate
Organic search traffic
Brand perception
Source: SOASTA
Source: SOASTA
Average revenue loss per
hour of downtime
Average revenue loss due
to one hour of performance
slowdown (slower than 4.4s)
$21,000
$4,100
Source: TRAC Research
Permanent abandonment rate
Outage Slow performance
9% 28%
Source: Akamai
Source: comScore
2015 holiday
ecommerce sales
could hit $60B
Average holiday order value
Source: IBM Digital Analytics Benchmark
Impact of a 1-second delay
A site that earns $100K per
day could lose $2.5M in sales
in one year
Source: Aberdeen Group
1901 founded
63,000 employees
118 Nordstrom stores
167 Nordstrom Rack
stores
Our customer is our guide
Performance impacts the customer experience
Nordstrom’s major events
HolidayEarly
access
How do we prepare?
We are always
getting ready
This wasn’t always the
case
Performance is a feature
Instrumentation and data
Continuous improvement
Embrace a cultural shift
Analyze - Test - Monitor
Every feature
at development
How are we always getting ready?
• Study the past
• Understand the present
• Model the future
Analyze Test Monitor
What is the…
…customer impact?
…technical impact?
Analyze Test Monitor
Analyze Test Monitor
Analyze Test Monitor
Early, often, everywhere
Projections & contingencies
Support your results
Analyze Test Monitor
Worst case vs. realistic case
Understand the costs associated
with supporting your worst case
Analyze Test Monitor
• Development and
test environments
• Production at
deployment
• Production regularly
Build a feedback loop to
Product Management and
Engineering
Analyze Test Monitor
During the event
Monitor:
• experience
• load
• health
Contingency planning
Coordinate with
vendors
During the event
Mobile sign-ins 9x greater than projected
Issues happen where unanticipated
Preparing your site
Cultural shift
• Performance is a feature
• Instrumentation & data focus
• Continuous improvement
Always be preparing
• Analyze
• Test
• Monitor
The future…
• Customer focus
• Continuous
delivery
• Cloud
• Continuous
improvement
soasta.com/holiday-readiness
Complimentary mPulse real user monitoring through 2015
Site performance analysis with an expert
Performance Consultant
Baseline performance test using SOASTA CloudTest
Summary report with test results and optimization
suggestions




FREE Holiday
Performance Readiness
Assessment

More Related Content

What's hot

What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceSOASTA
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing
SOASTA
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
SOASTA
 
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
SOASTA
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
Jennifer Finney
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
Jennifer Finney
 
SOASTA mPulse update webinar
SOASTA mPulse update webinarSOASTA mPulse update webinar
SOASTA mPulse update webinar
CloudBees
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide shareFinal tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
SOASTA
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
SOASTA
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak SeasonWebinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
SOASTA
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
SOASTA
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
SOASTA
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real World
SOASTA
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
Jennifer Finney
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Jennifer Finney
 

What's hot (20)

What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
 
SOASTA mPulse update webinar
SOASTA mPulse update webinarSOASTA mPulse update webinar
SOASTA mPulse update webinar
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide shareFinal tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak SeasonWebinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real World
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
 

Similar to O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events

Driving Growth and Profitability through Customer Experience & Process Trans...
Driving Growth and Profitability through Customer Experience & Process Trans...Driving Growth and Profitability through Customer Experience & Process Trans...
Driving Growth and Profitability through Customer Experience & Process Trans...
Brad Power
 
AI Planning Workshop overview
AI Planning Workshop overviewAI Planning Workshop overview
AI Planning Workshop overview
Value Amplify Consulting
 
Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)
Imaginet
 
Business Process Management - Building The BPM Balanced Scorecard
Business Process Management - Building The BPM Balanced ScorecardBusiness Process Management - Building The BPM Balanced Scorecard
Business Process Management - Building The BPM Balanced Scorecard
Steve Towers, CEO and CPP Champion
 
Devops maturity model
Devops maturity modelDevops maturity model
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
Optimizely
 
Web Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate OptimizationWeb Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate Optimization
Workshop Digital
 
Cost Cutting Conundrum Final
Cost Cutting Conundrum FinalCost Cutting Conundrum Final
Cost Cutting Conundrum FinalCoupa Software
 
Who Owns the “S” in S&OP?
Who Owns the “S” in S&OP?Who Owns the “S” in S&OP?
Who Owns the “S” in S&OP?
Steelwedge
 
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
DMC, Inc.
 
Website Testing WINS!
Website Testing WINS!Website Testing WINS!
Website Testing WINS!
Joanne Rigby (Richardson)
 
Shifting Left Using Sauce Analytics
Shifting Left Using Sauce AnalyticsShifting Left Using Sauce Analytics
Shifting Left Using Sauce Analytics
Sauce Labs
 
Show Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business ResultsShow Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business Results
Correlsense
 
ISV App Lab
ISV App LabISV App Lab
ISV App Lab
CodeScience
 
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Melissa Luongo
 
Iq Generic Show Ppt
Iq Generic Show PptIq Generic Show Ppt
Iq Generic Show Pptsbruce
 
High Tech Forecasting Planning Summit Presentation
High Tech Forecasting Planning Summit PresentationHigh Tech Forecasting Planning Summit Presentation
High Tech Forecasting Planning Summit Presentation
Avnet Electronics Marketing
 
Delivering on Personalization with the Power of APIs
Delivering on Personalization with the Power of APIsDelivering on Personalization with the Power of APIs
Delivering on Personalization with the Power of APIs
Akana
 
DevOps: Why Culture Matters
DevOps:  Why Culture MattersDevOps:  Why Culture Matters
DevOps: Why Culture Matters
G2G3 Americas
 
Improving Accuracy and Confidence in Workload Models
Improving Accuracy and Confidence in Workload ModelsImproving Accuracy and Confidence in Workload Models
Improving Accuracy and Confidence in Workload Models
TechWell
 

Similar to O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events (20)

Driving Growth and Profitability through Customer Experience & Process Trans...
Driving Growth and Profitability through Customer Experience & Process Trans...Driving Growth and Profitability through Customer Experience & Process Trans...
Driving Growth and Profitability through Customer Experience & Process Trans...
 
AI Planning Workshop overview
AI Planning Workshop overviewAI Planning Workshop overview
AI Planning Workshop overview
 
Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)
 
Business Process Management - Building The BPM Balanced Scorecard
Business Process Management - Building The BPM Balanced ScorecardBusiness Process Management - Building The BPM Balanced Scorecard
Business Process Management - Building The BPM Balanced Scorecard
 
Devops maturity model
Devops maturity modelDevops maturity model
Devops maturity model
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Web Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate OptimizationWeb Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate Optimization
 
Cost Cutting Conundrum Final
Cost Cutting Conundrum FinalCost Cutting Conundrum Final
Cost Cutting Conundrum Final
 
Who Owns the “S” in S&OP?
Who Owns the “S” in S&OP?Who Owns the “S” in S&OP?
Who Owns the “S” in S&OP?
 
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
DMC: Use Microsoft SharePoint Technology You Already Own to Operate Efficient...
 
Website Testing WINS!
Website Testing WINS!Website Testing WINS!
Website Testing WINS!
 
Shifting Left Using Sauce Analytics
Shifting Left Using Sauce AnalyticsShifting Left Using Sauce Analytics
Shifting Left Using Sauce Analytics
 
Show Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business ResultsShow Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business Results
 
ISV App Lab
ISV App LabISV App Lab
ISV App Lab
 
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
 
Iq Generic Show Ppt
Iq Generic Show PptIq Generic Show Ppt
Iq Generic Show Ppt
 
High Tech Forecasting Planning Summit Presentation
High Tech Forecasting Planning Summit PresentationHigh Tech Forecasting Planning Summit Presentation
High Tech Forecasting Planning Summit Presentation
 
Delivering on Personalization with the Power of APIs
Delivering on Personalization with the Power of APIsDelivering on Personalization with the Power of APIs
Delivering on Personalization with the Power of APIs
 
DevOps: Why Culture Matters
DevOps:  Why Culture MattersDevOps:  Why Culture Matters
DevOps: Why Culture Matters
 
Improving Accuracy and Confidence in Workload Models
Improving Accuracy and Confidence in Workload ModelsImproving Accuracy and Confidence in Workload Models
Improving Accuracy and Confidence in Workload Models
 

More from SOASTA

DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
SOASTA
 
Optimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenueOptimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenue
SOASTA
 
Using JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous TestingUsing JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous Testing
SOASTA
 
Velocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & SyntheticVelocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & Synthetic
SOASTA
 
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
SOASTA
 
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
SOASTA
 
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave MurphyVelocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
SOASTA
 
Radial | SOASTA IR Webinar
Radial | SOASTA IR WebinarRadial | SOASTA IR Webinar
Radial | SOASTA IR Webinar
SOASTA
 
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
SOASTA
 
Ann Ruckstuhl eTail West
Ann Ruckstuhl eTail WestAnn Ruckstuhl eTail West
Ann Ruckstuhl eTail West
SOASTA
 
Webinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTestWebinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTest
SOASTA
 
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
SOASTA
 
Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations
SOASTA
 
Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?) Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
SOASTA
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash SalesWebinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
SOASTA
 
Business Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOCBusiness Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOC
SOASTA
 
eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation
SOASTA
 
State of the Union - Mobile Performance
State of the Union - Mobile PerformanceState of the Union - Mobile Performance
State of the Union - Mobile Performance
SOASTA
 
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
SOASTA
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
SOASTA
 

More from SOASTA (20)

DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
 
Optimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenueOptimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenue
 
Using JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous TestingUsing JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous Testing
 
Velocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & SyntheticVelocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & Synthetic
 
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
 
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
 
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave MurphyVelocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
 
Radial | SOASTA IR Webinar
Radial | SOASTA IR WebinarRadial | SOASTA IR Webinar
Radial | SOASTA IR Webinar
 
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
 
Ann Ruckstuhl eTail West
Ann Ruckstuhl eTail WestAnn Ruckstuhl eTail West
Ann Ruckstuhl eTail West
 
Webinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTestWebinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTest
 
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
 
Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations
 
Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?) Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash SalesWebinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
 
Business Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOCBusiness Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOC
 
eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation
 
State of the Union - Mobile Performance
State of the Union - Mobile PerformanceState of the Union - Mobile Performance
State of the Union - Mobile Performance
 
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
 

Recently uploaded

Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 

Recently uploaded (20)

Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 

O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events

Editor's Notes

  1. +Leading Upscale Fashion Retailer + Brick and Mortar US, Canada, PR +online and mobile for an omni-channel offering
  2. +goal: to deliver the Best Customer Experience possible + customer expectations are constantly changing +constantly evolve to server them better
  3. Our customers clearly tell us what they expect –
  4. +matters all year long, always want a great customer experience +Anniversary is more worrisome – new features-new flows +disproportionately large amount of revunue
  5. Anything that goes into production has to support anniversary and holiday Anything that ships is ready to support our peak load
  6. +4 years didn’t have same focus on the customer experience +just worried about would the site crash? + and customer experience suffered all year +csat scores dropped
  7. + joint effort – Product Management- everyone owns it + APM tools – need the tools – when where what RCA + Continuous Improvement –Kaizens, Value Stream Mapping, 7 wastes of lean +, incremental improvements, automation, new tools, new processes
  8. +As part of that cultural shift – performance is embedded – everyone is thinking about performance – about the big events +Anything that ships supports our peak loads
  9. +Product management and technology +how are things changing + EX – Password Reset,+EX +How are user behaviors changing over time?
  10. Contrast Anniv and Cyber Monday
  11. - Anniv – customers coming to Shop! - Cyber Monday adding to cart, adding to wishlist early in the day – at work, comparing sales - and then checkout in the evening
  12. + Dev, Perf, Prod + How to project and contingency – test what’s different +You wouldn’t ship functional defects, don’t ship performance defects +Mini-bag – too crazy – should have accepted sooner –past freeze dates
  13. You can’t test everything but you can monitor – APM tools– password reset Monitoring plan in place – identify it early +PO support- it takes time – build it into your capacity Use your monitoring plan in testing – practice and perfect it Look for trends Feedback loop- prioritize those performance defects
  14. +Monitoring every deployment for trends, know what is normal
  15. + not just dollar metrics, system +customer experience metrics - CULTURE -EX BOPUS- may need to turn off – personalizations - QPS +3rd Parties – Fraud Alerts/ COM
  16. Failures happen where you don’t anticipate customer behavior
  17. Manage the customer experience
  18. Cloud – how do things change?