SlideShare a Scribd company logo
1
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Sharing the keys to retail performance success
TODAY’S SOASTA PRESENTERS






Peter Galvin: 
 
Brad Johnson: 
 
Mike Ostenberg

SVP Marketing 
 
VP Product Marketing 
Dir. Systems Engineering

Agenda: 
•  Retail case studies
•  Key considerations gleaned from retail performance optimization
•  SOASTA’s solutions for measuring and testing user performance

Questions: 
Submit in chat box during event
Poll Question
3
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
4
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
o  Inspection to Prevention
o  Approximation to Reality


o  Periodic to Continuous
5
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
6
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
7
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Tested to 7x Initial load test goals


Reached 9x previous year’s peak

 


 Validated dynamic caching investment

 
 


 Reduced hardware capacity needs

 


 
 Validated Akamai to 4x beyond peak

 
 
 
 

“One of the best investments
to our website this year .” 
Nancy Jordan,
IT Middleware 
& Integration 
Manager
8
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
9
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
“We are 100% focused 
on our consumer
satisfaction…Given the
revenue it’s protecting for
us, it’s money very well
spent.”
Michael Hart, Bonobos
CTO

Iterative testing of purchase cycle

Easy test creation and results


Systematically tuned app to infrastructure



 Compares test/test, year/year

 
 
 
 
 


 
 Revenue Protection

 
 


 
 64x normal traffic, 15X sales, no issues
10
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
11
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Tests for flash sales with unknown spikes

mPulse analyzes real user performance


Continuous tests of mobile and web traffic

 


 
 50% mobile traffic – 160% more visitors

 


 
 $5M AUD in one flash sale – zero issues

 
 




 

“SOASTA was very
easy to work with
and could
accommodate our 
requirements in a
four-week
timeframe.”
Gavin Cliffe, 
OZSale CTO.
12
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
13
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
“Website performance really
affects your brand image
when you have problems…
The inherent savings to our
brand by using CloudTest is
priceless.”
—Cheryl Davis, 
digital technical 
operations manager
Hallmark Cards, Inc.
Tested to 120% of expected load


Saved 50% on testing expenses



 
 Reduced staff costs by 66%

 


 Eliminated test software and hardware costs
14
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
2008
 2013
15
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
16
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Meaningful scale &
appropriate concurrency
Most accurate models
of real user behavior
Control to start, stop & modify
tests without delays
Test on your schedule
17
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Failover Scenarios
Success Disasters
End to End
18
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
19
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
20
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Memory leaks
Test Scale
Stage/Team
Dev
& Test
Release
& Deploy
Network
& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Continuous tuning for full-scale…and well beyond
21
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
ü Build and modify your tests based on real usage
ü Test for spikes with the cloud
ü Test what you don’t think you need to
ü Measure, test and act in real time
ü Test more (compress processes)
ü Test in production
22
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Mike Ostenberg
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:

twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES

Retail Readiness Page: http://www.soasta.com/retail-readiness/

Case studies: http://www.soasta.com/customers/ecommerce/

Webinars future and past: http://www.soasta.com/knowledge-center/webinars/

Need a test, fast? CloudTest On-Demand.
- email info@soasta.com
- You’ll hear from us by tomorrow
www.SOASTA.com

More Related Content

Similar to What Retailers Know About Performance and User Experience

Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
SOASTA
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
SOASTA
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
SOASTA
 
Capgemini Leap Data Transformation Framework with Cloudera
Capgemini Leap Data Transformation Framework with ClouderaCapgemini Leap Data Transformation Framework with Cloudera
Capgemini Leap Data Transformation Framework with Cloudera
Capgemini
 
Sensitel TrackAware for Asset, Shipment and Package Tracking
Sensitel  TrackAware for Asset, Shipment and Package TrackingSensitel  TrackAware for Asset, Shipment and Package Tracking
Sensitel TrackAware for Asset, Shipment and Package Tracking
msikka
 
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
SAP Analytics
 
Trends in the quality assurance area
Trends in the quality assurance areaTrends in the quality assurance area
Trends in the quality assurance areaSvitlana Dubyk
 
NoSQL Databases for Enterprises - NoSQL Now Conference 2013
NoSQL Databases for Enterprises  - NoSQL Now Conference 2013NoSQL Databases for Enterprises  - NoSQL Now Conference 2013
NoSQL Databases for Enterprises - NoSQL Now Conference 2013
Dave Segleau
 
Finance Technologies: Buy or Rent
Finance Technologies: Buy or RentFinance Technologies: Buy or Rent
Finance Technologies: Buy or Rent
ScottMadden, Inc.
 
Performance Testing: Eliminate System Outages and Save Millions
Performance Testing: Eliminate System Outages and Save MillionsPerformance Testing: Eliminate System Outages and Save Millions
Performance Testing: Eliminate System Outages and Save Millions
Method360
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!
Dan Boutin
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
SOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
SOASTA
 
Virtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise ScaleVirtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise Scale
Denodo
 
Functional and Non-functional Test automation
Functional and Non-functional Test automationFunctional and Non-functional Test automation
Functional and Non-functional Test automation
Dr Ganesh Iyer
 
Monitoring in the DevOps Era
Monitoring in the DevOps EraMonitoring in the DevOps Era
Monitoring in the DevOps Era
Mike Kavis
 
Introduction To Saa S Tech Ba Apr 2009
Introduction To Saa S   Tech Ba   Apr 2009Introduction To Saa S   Tech Ba   Apr 2009
Introduction To Saa S Tech Ba Apr 2009
ScioSales
 
Top 10 Benefits of Automated Release Management
Top 10 Benefits of Automated Release ManagementTop 10 Benefits of Automated Release Management
Top 10 Benefits of Automated Release Management
AutoRABIT
 

Similar to What Retailers Know About Performance and User Experience (20)

Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
 
Capgemini Leap Data Transformation Framework with Cloudera
Capgemini Leap Data Transformation Framework with ClouderaCapgemini Leap Data Transformation Framework with Cloudera
Capgemini Leap Data Transformation Framework with Cloudera
 
Sensitel TrackAware for Asset, Shipment and Package Tracking
Sensitel  TrackAware for Asset, Shipment and Package TrackingSensitel  TrackAware for Asset, Shipment and Package Tracking
Sensitel TrackAware for Asset, Shipment and Package Tracking
 
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
#askSAP GRC Innovations Community Call: Cybersecurity Risk and Governance
 
Trends in the quality assurance area
Trends in the quality assurance areaTrends in the quality assurance area
Trends in the quality assurance area
 
NoSQL Databases for Enterprises - NoSQL Now Conference 2013
NoSQL Databases for Enterprises  - NoSQL Now Conference 2013NoSQL Databases for Enterprises  - NoSQL Now Conference 2013
NoSQL Databases for Enterprises - NoSQL Now Conference 2013
 
Finance Technologies: Buy or Rent
Finance Technologies: Buy or RentFinance Technologies: Buy or Rent
Finance Technologies: Buy or Rent
 
Performance Testing: Eliminate System Outages and Save Millions
Performance Testing: Eliminate System Outages and Save MillionsPerformance Testing: Eliminate System Outages and Save Millions
Performance Testing: Eliminate System Outages and Save Millions
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Virtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise ScaleVirtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise Scale
 
Functional and Non-functional Test automation
Functional and Non-functional Test automationFunctional and Non-functional Test automation
Functional and Non-functional Test automation
 
Monitoring in the DevOps Era
Monitoring in the DevOps EraMonitoring in the DevOps Era
Monitoring in the DevOps Era
 
Introduction To Saa S Tech Ba Apr 2009
Introduction To Saa S   Tech Ba   Apr 2009Introduction To Saa S   Tech Ba   Apr 2009
Introduction To Saa S Tech Ba Apr 2009
 
Top 10 Benefits of Automated Release Management
Top 10 Benefits of Automated Release ManagementTop 10 Benefits of Automated Release Management
Top 10 Benefits of Automated Release Management
 

More from SOASTA

Mobile Performance: State of the Union
Mobile Performance: State of the UnionMobile Performance: State of the Union
Mobile Performance: State of the Union
SOASTA
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
SOASTA
 
Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)
SOASTA
 
Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
SOASTA
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
SOASTA
 
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & MobileWebinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
SOASTA
 
Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing
SOASTA
 
Building a Performance A-Team
Building a Performance A-TeamBuilding a Performance A-Team
Building a Performance A-Team
SOASTA
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
SOASTA
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
SOASTA
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
SOASTA
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
SOASTA
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performance
SOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
SOASTA
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing Checklist
SOASTA
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
SOASTA
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
SOASTA
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014SOASTA
 

More from SOASTA (20)

Mobile Performance: State of the Union
Mobile Performance: State of the UnionMobile Performance: State of the Union
Mobile Performance: State of the Union
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
 
Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)
 
Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
 
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & MobileWebinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
 
Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing Get Ready for Changes To Load Testing
Get Ready for Changes To Load Testing
 
Building a Performance A-Team
Building a Performance A-TeamBuilding a Performance A-Team
Building a Performance A-Team
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performance
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing Checklist
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
 

Recently uploaded

Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
CatarinaPereira64715
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 

Recently uploaded (20)

Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 

What Retailers Know About Performance and User Experience

  • 1. 1 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Sharing the keys to retail performance success TODAY’S SOASTA PRESENTERS Peter Galvin: Brad Johnson: Mike Ostenberg SVP Marketing VP Product Marketing Dir. Systems Engineering Agenda: •  Retail case studies •  Key considerations gleaned from retail performance optimization •  SOASTA’s solutions for measuring and testing user performance Questions: Submit in chat box during event
  • 3. 3 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 4. 4 © 2013 SOASTA CONFIDENTIAL - All rights reserved. o  Inspection to Prevention o  Approximation to Reality o  Periodic to Continuous
  • 5. 5 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 6. 6 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 7. 7 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Tested to 7x Initial load test goals Reached 9x previous year’s peak Validated dynamic caching investment Reduced hardware capacity needs Validated Akamai to 4x beyond peak “One of the best investments to our website this year .” Nancy Jordan, IT Middleware & Integration Manager
  • 8. 8 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 9. 9 © 2013 SOASTA CONFIDENTIAL - All rights reserved. “We are 100% focused on our consumer satisfaction…Given the revenue it’s protecting for us, it’s money very well spent.” Michael Hart, Bonobos CTO Iterative testing of purchase cycle Easy test creation and results Systematically tuned app to infrastructure Compares test/test, year/year Revenue Protection 64x normal traffic, 15X sales, no issues
  • 10. 10 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 11. 11 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Tests for flash sales with unknown spikes mPulse analyzes real user performance Continuous tests of mobile and web traffic 50% mobile traffic – 160% more visitors $5M AUD in one flash sale – zero issues “SOASTA was very easy to work with and could accommodate our requirements in a four-week timeframe.” Gavin Cliffe, OZSale CTO.
  • 12. 12 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 13. 13 © 2013 SOASTA CONFIDENTIAL - All rights reserved. “Website performance really affects your brand image when you have problems… The inherent savings to our brand by using CloudTest is priceless.” —Cheryl Davis, digital technical operations manager Hallmark Cards, Inc. Tested to 120% of expected load Saved 50% on testing expenses Reduced staff costs by 66% Eliminated test software and hardware costs
  • 14. 14 © 2013 SOASTA CONFIDENTIAL - All rights reserved. 2008 2013
  • 15. 15 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 16. 16 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Meaningful scale & appropriate concurrency Most accurate models of real user behavior Control to start, stop & modify tests without delays Test on your schedule
  • 17. 17 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Failover Scenarios Success Disasters End to End
  • 18. 18 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 19. 19 © 2013 SOASTA CONFIDENTIAL - All rights reserved.
  • 20. 20 © 2013 SOASTA CONFIDENTIAL - All rights reserved. s Memory leaks Test Scale Stage/Team Dev & Test Release & Deploy Network & Ops CDN file placement Load Balancer configuration Network bandwidth Network configuration DNS routing Inadequate server resources Default configuration settings Unbalanced web serversAuto-scaling failures Latency between systems Slow third-party plug-ins Garbage collection Database thread counts Inefficient database queriesSlow pages Conflict with other apps Test Lab Staging Production (100% +++) Search technology limits Method-level tuning Max sockets exceeded Firewall max capacity Global latency variance Security bottlenecks Continuous tuning for full-scale…and well beyond
  • 21. 21 © 2013 SOASTA CONFIDENTIAL - All rights reserved. ü Build and modify your tests based on real usage ü Test for spikes with the cloud ü Test what you don’t think you need to ü Measure, test and act in real time ü Test more (compress processes) ü Test in production
  • 22. 22 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Mike Ostenberg
  • 23. Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest RESOURCES Retail Readiness Page: http://www.soasta.com/retail-readiness/ Case studies: http://www.soasta.com/customers/ecommerce/ Webinars future and past: http://www.soasta.com/knowledge-center/webinars/ Need a test, fast? CloudTest On-Demand. - email info@soasta.com - You’ll hear from us by tomorrow