SlideShare a Scribd company logo
W14
Test Techniques
10/15/2014 3:00:00 PM
Testing the New Disney World
Website
Presented by:
Leslie Honniball
Walt Disney Parks and Resorts Technology
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Les Honniball
Walt Disney Parks and Resorts Technology
As manager of quality assurance for Walt Disney Parks and Resorts Technology, Les
Honniball leads a team of QA engineers responsible for testing the web sites of Walt Disney
World Resort in Florida, Disneyland Resort in California, the Disney Cruise Line, and the Walt
Disney Paris and Hong Kong theme parks and resorts. A twenty-three year veteran of the
testing field with experience working for companies large and small, Les has worked with
remote QA teams in India, the Philippines, Argentina, and the US using the agile development
process. Les works closely with various automation teams at Disney to help define the core
automation tests needed to launch a successful website.
Introduction
• Testing the web user interface for a large high-volume
global web-site has a unique and complex set of
challenges
• Testing the content, meta tags, pages, products and
url’s requires attention to detail and careful
consideration of changes
• Testing a technical and functional software platform
that can handle all of this is:
– Complicated
– Challenging
– Multi-disciplinary
– FUN!
Agenda
• Challenges
• Pages, URLs & SEO
• Analytics
• User Experience (UX)
• Designing a global Web Platform
• Testing a global Web Platform
• Take-aways
Unique Challenges for Public Sites
Pages, SEO and URLs
Analytics, pages and page flows
Going global: i18n + channel + market + store
A/B Testing and revenue optimization
Availability (someone is always browsing):
- 24x7x365
- Rolling deployments
- Reduced functionality when system x down
User Experience & Accessibility
Some Characteristics of an SEO
friendly site
Well known pages with targeted content for search engines
that will resolve in multiple languages
Well-formed URL’s that can be easily bookmarked, indexed by
crawlers and mapped onto
pages/channels/stores/languages/markets
Make sure each major searchable entity has a page indexed
for search
If you are international, Google is not the only search engine
(Yahoo is bigger than Google in Japan)
Mapping page URLs to Language and
Region
Analytics
Analytics
• Small changes in our commerce flows can
affect conversion rates and revenue
• Revenue Management and Optimization for
online channel requires extensive tracking and
analysis of users as they interact with the
website
UX (User Experience)
• Our Guests deserve the best
• Comps, Approvals, Feedback
• Responsive? Adaptive? Redaptive?
Testing a Global Web Platform
a Multi-Brand Multi-Lingual Web
Platform requires:
• Site (URL) Management & determining a users
context
• Personalized Pages
• Context-aware services
• Application Configurability
• Technology Platform
Determining a Guests Context
A guest’s context
Destination Market/AffiliationGuest Store/Channel Pass-holder?
A guest’s context
Personalized, targeted Web Site
Offer 1 Offer 2 Offer n
Web
Store 1
Web
Store 2
Web
Store n
Content
a
Content
b
Content
z
QA for the Global Web Platform
• Test management
• Multi-device/Browser/OS testing
• Automation
Test management & Process
The following process and tools are used for
managing a Sprint:
• Agile Development Process
• JIRA for entry and tracking
• ALM
• Google Doc’s
Testing Approach
• Testing begins at the Studio level in the Latest environment
with Acceptance and Functional testing performed during
the sprint. Once promoted to the Stage environment,
initial smoke testing will be conducted by Studio Testers
and the Central QA Team.
• Central QA Team may also perform additional ad-hoc tests
not detailed in the plan but must remain relevant and
within the scope of the project, and done only when all
prioritized test scenarios have passed.
• Progress will be communicated based on the percentage of
executed test cases and other relevant testing activities.
Test results will be captured and stored in HP ALM.
Defect Life Cycle
Defect found by
Tester
Defect created in
JIRA and assigned
to PDM
Defect Prioritized
by PDM
Defect
prioritized for
current
release?
Defect assigned to
Studio backlog
Defect resolved by
Development
Defect verified
by Tester
No
Yes
No
Defect closed by
Tester
Yes
Multi-device/Browser/OS testing
• PC Browsers:
• Chrome (Windows 7)
• Firefox (Windows 7) – All test automation runs
primarily on this platform
• IE8 (Windows 7)
• IE9 (Windows 7)
• IE10 (Windows 7)
• Mac Chrome (OS X Lion)
• Mac Safari (OS X Lion)
Multi-device/Browser/OS testing
• Mobile Devices:
• iPad (iOS6 / iOS7)
• iPad Mini (iOS7)
• iPhone 4s (iOS6)
• iPhone 5 (iOS6 / iOS7)
• iPod Touch (iOS6)
• HTC One S (Android 4.0.4)
• HTC One X (Android 4.0.3)
• HTC 5435 (Android 4.1.1)
• DNA HTC (Android 4.1.1)
• Galaxy S3 (Android 4.1.2)
• Galaxy S4 (Android 4.2.2 / 4.3)
• Nexus 7 (Android 4.3)
Test Automation
Test Management and Reporting
In Closing
• Testing the user interface for a large high-volume
global web-site has a unique and complex set of
challenges:
– We have to design,code and Test for everyone who wants
to access the site(s) from anywhere on any channel/device
– Small changes have large impacts (page flows, UX …)
• Testing a technical and functional software platform
that can handle all of this is:
– Complicated
– Challenging
– Multi-disciplinary
– FUN!
Q&A

More Related Content

Viewers also liked

Essential Test Management and Planning
Essential Test Management and PlanningEssential Test Management and Planning
Essential Test Management and Planning
TechWell
 
Mobile App Testing: The Good, the Bad, and the Ugly
Mobile App Testing: The Good, the Bad, and the UglyMobile App Testing: The Good, the Bad, and the Ugly
Mobile App Testing: The Good, the Bad, and the Ugly
TechWell
 
Risk-Based Testing for Agile Projects
Risk-Based Testing for Agile ProjectsRisk-Based Testing for Agile Projects
Risk-Based Testing for Agile Projects
TechWell
 
Survival Guide: Taming the Data Quality Beast
Survival Guide: Taming the Data Quality BeastSurvival Guide: Taming the Data Quality Beast
Survival Guide: Taming the Data Quality Beast
TechWell
 
The Internet of Things and You
The Internet of Things and YouThe Internet of Things and You
The Internet of Things and You
TechWell
 
Innovation for Existing Software Product: An R&D Approach
Innovation for Existing Software Product: An R&D ApproachInnovation for Existing Software Product: An R&D Approach
Innovation for Existing Software Product: An R&D Approach
TechWell
 
Why Agile Fails in Large Enterprises—and What to Do about It
Why Agile Fails in Large Enterprises—and What to Do about ItWhy Agile Fails in Large Enterprises—and What to Do about It
Why Agile Fails in Large Enterprises—and What to Do about It
TechWell
 
Mindmaps: Lightweight Documentation for Testing
Mindmaps: Lightweight Documentation for TestingMindmaps: Lightweight Documentation for Testing
Mindmaps: Lightweight Documentation for Testing
TechWell
 
Crafting Smaller User Stories: Examples and Exercises
Crafting Smaller User Stories: Examples and ExercisesCrafting Smaller User Stories: Examples and Exercises
Crafting Smaller User Stories: Examples and Exercises
TechWell
 
Successful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s ViewSuccessful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s View
TechWell
 
Building on Existing Infrastructure for Mobile Applications
Building on Existing Infrastructure for Mobile ApplicationsBuilding on Existing Infrastructure for Mobile Applications
Building on Existing Infrastructure for Mobile Applications
TechWell
 
Metrics Program Implementation: Pitfalls and Successes
Metrics Program Implementation: Pitfalls and SuccessesMetrics Program Implementation: Pitfalls and Successes
Metrics Program Implementation: Pitfalls and Successes
TechWell
 
Quality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of TestingQuality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of Testing
TechWell
 

Viewers also liked (13)

Essential Test Management and Planning
Essential Test Management and PlanningEssential Test Management and Planning
Essential Test Management and Planning
 
Mobile App Testing: The Good, the Bad, and the Ugly
Mobile App Testing: The Good, the Bad, and the UglyMobile App Testing: The Good, the Bad, and the Ugly
Mobile App Testing: The Good, the Bad, and the Ugly
 
Risk-Based Testing for Agile Projects
Risk-Based Testing for Agile ProjectsRisk-Based Testing for Agile Projects
Risk-Based Testing for Agile Projects
 
Survival Guide: Taming the Data Quality Beast
Survival Guide: Taming the Data Quality BeastSurvival Guide: Taming the Data Quality Beast
Survival Guide: Taming the Data Quality Beast
 
The Internet of Things and You
The Internet of Things and YouThe Internet of Things and You
The Internet of Things and You
 
Innovation for Existing Software Product: An R&D Approach
Innovation for Existing Software Product: An R&D ApproachInnovation for Existing Software Product: An R&D Approach
Innovation for Existing Software Product: An R&D Approach
 
Why Agile Fails in Large Enterprises—and What to Do about It
Why Agile Fails in Large Enterprises—and What to Do about ItWhy Agile Fails in Large Enterprises—and What to Do about It
Why Agile Fails in Large Enterprises—and What to Do about It
 
Mindmaps: Lightweight Documentation for Testing
Mindmaps: Lightweight Documentation for TestingMindmaps: Lightweight Documentation for Testing
Mindmaps: Lightweight Documentation for Testing
 
Crafting Smaller User Stories: Examples and Exercises
Crafting Smaller User Stories: Examples and ExercisesCrafting Smaller User Stories: Examples and Exercises
Crafting Smaller User Stories: Examples and Exercises
 
Successful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s ViewSuccessful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s View
 
Building on Existing Infrastructure for Mobile Applications
Building on Existing Infrastructure for Mobile ApplicationsBuilding on Existing Infrastructure for Mobile Applications
Building on Existing Infrastructure for Mobile Applications
 
Metrics Program Implementation: Pitfalls and Successes
Metrics Program Implementation: Pitfalls and SuccessesMetrics Program Implementation: Pitfalls and Successes
Metrics Program Implementation: Pitfalls and Successes
 
Quality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of TestingQuality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of Testing
 

Similar to Testing the New Disney World Website

Musharraf_Syed_Resume
Musharraf_Syed_ResumeMusharraf_Syed_Resume
Musharraf_Syed_Resume
Syed Musharraf Ali Zaidi
 
Marlabs Capability Overview: Web Development, Usability Engineering Services
Marlabs Capability Overview: Web Development, Usability Engineering ServicesMarlabs Capability Overview: Web Development, Usability Engineering Services
Marlabs Capability Overview: Web Development, Usability Engineering Services
Marlabs
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
RapidValue
 
CV
CVCV
CV_Nishanthi_shanmugasundaram
CV_Nishanthi_shanmugasundaramCV_Nishanthi_shanmugasundaram
CV_Nishanthi_shanmugasundaram
cafinde s
 
Abhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization TestingAbhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar
 
Trivial works.com introduction
Trivial works.com introductionTrivial works.com introduction
Trivial works.com introduction
TrivialWorks
 
Final_Presentation (2)
Final_Presentation (2)Final_Presentation (2)
Final_Presentation (2)
Amy Reed
 
Resume
ResumeResume
Compliance Automation: detect & correct
Compliance Automation: detect & correctCompliance Automation: detect & correct
Compliance Automation: detect & correct
Kangaroot
 
The journey to Continuous Automation - Chef Automate
The journey to Continuous Automation - Chef AutomateThe journey to Continuous Automation - Chef Automate
The journey to Continuous Automation - Chef Automate
Kangaroot
 
Navin Latest
Navin LatestNavin Latest
Navin Latest
Navin Singh
 
Jgayatri-QA-Profile
Jgayatri-QA-ProfileJgayatri-QA-Profile
Jgayatri-QA-Profile
Gayatridevi Jonnalgada
 
Royal Cyber Inc. IBM DevOps® Expertise
Royal Cyber Inc. IBM DevOps® ExpertiseRoyal Cyber Inc. IBM DevOps® Expertise
Royal Cyber Inc. IBM DevOps® Expertise
Noman Butt
 
Arnab Chakraborty CV
Arnab Chakraborty CVArnab Chakraborty CV
Arnab Chakraborty CV
Arnab chakraborty
 
Quality Analyst - Niharika
Quality Analyst - NiharikaQuality Analyst - Niharika
Quality Analyst - Niharika
niharikasinghal2526
 
Anil_kumar_Resume
Anil_kumar_ResumeAnil_kumar_Resume
Anil_kumar_Resume
kotekal anil
 
Abey_Thomas_Resume
Abey_Thomas_ResumeAbey_Thomas_Resume
Abey_Thomas_Resume
Abey Thomas
 
Walter_resume_PTM
Walter_resume_PTMWalter_resume_PTM
Walter_resume_PTM
Walter Whitaker
 
Tuli eServices_Magento portfolio
Tuli eServices_Magento portfolioTuli eServices_Magento portfolio
Tuli eServices_Magento portfolio
TULI eServices Inc.
 

Similar to Testing the New Disney World Website (20)

Musharraf_Syed_Resume
Musharraf_Syed_ResumeMusharraf_Syed_Resume
Musharraf_Syed_Resume
 
Marlabs Capability Overview: Web Development, Usability Engineering Services
Marlabs Capability Overview: Web Development, Usability Engineering ServicesMarlabs Capability Overview: Web Development, Usability Engineering Services
Marlabs Capability Overview: Web Development, Usability Engineering Services
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
 
CV
CVCV
CV
 
CV_Nishanthi_shanmugasundaram
CV_Nishanthi_shanmugasundaramCV_Nishanthi_shanmugasundaram
CV_Nishanthi_shanmugasundaram
 
Abhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization TestingAbhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization Testing
 
Trivial works.com introduction
Trivial works.com introductionTrivial works.com introduction
Trivial works.com introduction
 
Final_Presentation (2)
Final_Presentation (2)Final_Presentation (2)
Final_Presentation (2)
 
Resume
ResumeResume
Resume
 
Compliance Automation: detect & correct
Compliance Automation: detect & correctCompliance Automation: detect & correct
Compliance Automation: detect & correct
 
The journey to Continuous Automation - Chef Automate
The journey to Continuous Automation - Chef AutomateThe journey to Continuous Automation - Chef Automate
The journey to Continuous Automation - Chef Automate
 
Navin Latest
Navin LatestNavin Latest
Navin Latest
 
Jgayatri-QA-Profile
Jgayatri-QA-ProfileJgayatri-QA-Profile
Jgayatri-QA-Profile
 
Royal Cyber Inc. IBM DevOps® Expertise
Royal Cyber Inc. IBM DevOps® ExpertiseRoyal Cyber Inc. IBM DevOps® Expertise
Royal Cyber Inc. IBM DevOps® Expertise
 
Arnab Chakraborty CV
Arnab Chakraborty CVArnab Chakraborty CV
Arnab Chakraborty CV
 
Quality Analyst - Niharika
Quality Analyst - NiharikaQuality Analyst - Niharika
Quality Analyst - Niharika
 
Anil_kumar_Resume
Anil_kumar_ResumeAnil_kumar_Resume
Anil_kumar_Resume
 
Abey_Thomas_Resume
Abey_Thomas_ResumeAbey_Thomas_Resume
Abey_Thomas_Resume
 
Walter_resume_PTM
Walter_resume_PTMWalter_resume_PTM
Walter_resume_PTM
 
Tuli eServices_Magento portfolio
Tuli eServices_Magento portfolioTuli eServices_Magento portfolio
Tuli eServices_Magento portfolio
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 

Recently uploaded (20)

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 

Testing the New Disney World Website

  • 1. W14 Test Techniques 10/15/2014 3:00:00 PM Testing the New Disney World Website Presented by: Leslie Honniball Walt Disney Parks and Resorts Technology Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Les Honniball Walt Disney Parks and Resorts Technology As manager of quality assurance for Walt Disney Parks and Resorts Technology, Les Honniball leads a team of QA engineers responsible for testing the web sites of Walt Disney World Resort in Florida, Disneyland Resort in California, the Disney Cruise Line, and the Walt Disney Paris and Hong Kong theme parks and resorts. A twenty-three year veteran of the testing field with experience working for companies large and small, Les has worked with remote QA teams in India, the Philippines, Argentina, and the US using the agile development process. Les works closely with various automation teams at Disney to help define the core automation tests needed to launch a successful website.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8. Introduction • Testing the web user interface for a large high-volume global web-site has a unique and complex set of challenges • Testing the content, meta tags, pages, products and url’s requires attention to detail and careful consideration of changes • Testing a technical and functional software platform that can handle all of this is: – Complicated – Challenging – Multi-disciplinary – FUN!
  • 9. Agenda • Challenges • Pages, URLs & SEO • Analytics • User Experience (UX) • Designing a global Web Platform • Testing a global Web Platform • Take-aways
  • 10. Unique Challenges for Public Sites Pages, SEO and URLs Analytics, pages and page flows Going global: i18n + channel + market + store A/B Testing and revenue optimization Availability (someone is always browsing): - 24x7x365 - Rolling deployments - Reduced functionality when system x down User Experience & Accessibility
  • 11. Some Characteristics of an SEO friendly site Well known pages with targeted content for search engines that will resolve in multiple languages Well-formed URL’s that can be easily bookmarked, indexed by crawlers and mapped onto pages/channels/stores/languages/markets Make sure each major searchable entity has a page indexed for search If you are international, Google is not the only search engine (Yahoo is bigger than Google in Japan)
  • 12. Mapping page URLs to Language and Region
  • 14. Analytics • Small changes in our commerce flows can affect conversion rates and revenue • Revenue Management and Optimization for online channel requires extensive tracking and analysis of users as they interact with the website
  • 15. UX (User Experience) • Our Guests deserve the best • Comps, Approvals, Feedback • Responsive? Adaptive? Redaptive?
  • 16. Testing a Global Web Platform
  • 17. a Multi-Brand Multi-Lingual Web Platform requires: • Site (URL) Management & determining a users context • Personalized Pages • Context-aware services • Application Configurability • Technology Platform
  • 19. A guest’s context Destination Market/AffiliationGuest Store/Channel Pass-holder?
  • 20. A guest’s context Personalized, targeted Web Site Offer 1 Offer 2 Offer n Web Store 1 Web Store 2 Web Store n Content a Content b Content z
  • 21. QA for the Global Web Platform • Test management • Multi-device/Browser/OS testing • Automation
  • 22. Test management & Process The following process and tools are used for managing a Sprint: • Agile Development Process • JIRA for entry and tracking • ALM • Google Doc’s
  • 23. Testing Approach • Testing begins at the Studio level in the Latest environment with Acceptance and Functional testing performed during the sprint. Once promoted to the Stage environment, initial smoke testing will be conducted by Studio Testers and the Central QA Team. • Central QA Team may also perform additional ad-hoc tests not detailed in the plan but must remain relevant and within the scope of the project, and done only when all prioritized test scenarios have passed. • Progress will be communicated based on the percentage of executed test cases and other relevant testing activities. Test results will be captured and stored in HP ALM.
  • 24. Defect Life Cycle Defect found by Tester Defect created in JIRA and assigned to PDM Defect Prioritized by PDM Defect prioritized for current release? Defect assigned to Studio backlog Defect resolved by Development Defect verified by Tester No Yes No Defect closed by Tester Yes
  • 25. Multi-device/Browser/OS testing • PC Browsers: • Chrome (Windows 7) • Firefox (Windows 7) – All test automation runs primarily on this platform • IE8 (Windows 7) • IE9 (Windows 7) • IE10 (Windows 7) • Mac Chrome (OS X Lion) • Mac Safari (OS X Lion)
  • 26. Multi-device/Browser/OS testing • Mobile Devices: • iPad (iOS6 / iOS7) • iPad Mini (iOS7) • iPhone 4s (iOS6) • iPhone 5 (iOS6 / iOS7) • iPod Touch (iOS6) • HTC One S (Android 4.0.4) • HTC One X (Android 4.0.3) • HTC 5435 (Android 4.1.1) • DNA HTC (Android 4.1.1) • Galaxy S3 (Android 4.1.2) • Galaxy S4 (Android 4.2.2 / 4.3) • Nexus 7 (Android 4.3)
  • 28. Test Management and Reporting
  • 29. In Closing • Testing the user interface for a large high-volume global web-site has a unique and complex set of challenges: – We have to design,code and Test for everyone who wants to access the site(s) from anywhere on any channel/device – Small changes have large impacts (page flows, UX …) • Testing a technical and functional software platform that can handle all of this is: – Complicated – Challenging – Multi-disciplinary – FUN!
  • 30. Q&A