The document discusses the challenge of providing customer experience testing across key UK venues and the need for a new solution. It proposed using a dedicated crowd that could test networks 24/7 using a real-time app-based system that measures both voice and data. The system would have flexible deployment, simple API-driven reporting on a web portal, spreadsheets and app.
Disaster recovery projects centered on recovery point and recovery time objectives are inherently broken. For decades companies have been taking that same approach to disaster recovery, asking the same questions, delivering the same message and investing countless dollars while expecting (but rarely achieving) better results. Find out how you can permanently change the way your organization approaches JD Edwards disaster recovery, where every dollar spent and every decision made finally produces an ROI with tangible results.
Your company requires more than an alternate site contract with redundant equipment. When analyzing your current recovery solution, you may find your organization has no documented DR plan or process, no recovery facility, equipment constraints, or human resource limitations. A managed disaster recovery service provides your organization a backup and recovery assessment, a full recovery as part of the assessment, documentation for your businesses recovery plan, and equipment for future recovery needs, plus a recovery test each year and staff to perform the full recovery in the event of a disaster. Your disaster recovery solution will reduce risk and exposure, meet your corporate disaster recovery objectives, provide recovery time and recovery point assurance, and demonstrate a successful, documented test in a geographic diverse recovery center.
The document discusses the role of automated testers in both waterfall and agile projects. It notes that while test automation was seen as essential in waterfall, the high costs of licenses, support, and maintenance often outweighed the benefits. In agile, test automation is more effective when developers implement and "pass" acceptance tests themselves rather than delegating testing to separate testers. Having dedicated automated testers risks silos, miscommunication, testers falling behind and an uncritical approach. The document argues developers should automate tests through BDD/ATDD to find defects early and refactor confidently. While testers can help pair and extend tests, developers don't need dedicated automated testers to write good automated tests.
The document outlines an objectives for a weight loss program called "Lost It & Move It". The objective is to teach healthy eating habits and promote physical activity to help with weight loss. The program goal is to introduce healthy eating by increasing fruit and vegetable intake while reducing fatty foods, and incorporating 30-90 minutes of exercise per day. The participants' stage of readiness is contemplation, as they are considering action but have not taken it yet. The document provides recommendations for healthy eating, such as making half your plate fruits and vegetables, as well as physical activity guidelines of 30 minutes per day or 60-90 minutes for weight loss. It suggests using online resources and food journals, and having monthly team meetings and biannual health checkups
This document proposes wellness programs to address stress and nutrition issues at JM & ArK, Inc. It begins by outlining current claims data related to stress and nutrition problems. Environmental assessments of the workplace identify stress and unhealthy eating as areas of concern. The proposed programs have 5 phases: awareness, training, incentives, implementation, and evaluation. They aim to reduce stress claims by 15% and nutrition claims by 15% through activities like stress management training, healthy eating options, and physical activity incentives. The estimated annual costs are $5,314 for the stress program and $3,229 for the nutrition program. The benefits are projected to outweigh the costs within 2 years for both programs.
The document is a presentation on applying Lean principles in the context of human behavior and decision-making. It discusses cognitive biases and irrational tendencies that influence human reasoning. It then explains how Lean can help individuals and organizations overcome these biases to make more rational decisions through processes like validating hypotheses, gathering customer feedback, and embracing experimentation. In the end, Lean is presented as a way for irrational people to make rational decisions through these evidence-based practices while still maintaining good interpersonal relationships.
The document provides an organizational overview of The Gazette newspaper. It outlines the major departments including circulation, production, newsroom, business, and advertising. For each department, it identifies both the biggest challenges and recent successes. The biggest challenges include declining circulation trends, aging equipment, staff reductions, and economic pressures. Recent successes include emphasis on quality service, operational efficiencies, growth of online and combo subscriptions, coverage of major news events, and increased revenue from niche products and online advertising.
The document summarizes a presentation about using dedicated crowd sourcing to test mobile network quality of experience in real time during the 2012 London Olympics. It describes challenges in testing at the Olympics, how a dedicated crowd with test devices was deployed across the UK to continuously test networks, and how Epitiro's solution provided real-time data and reporting through a smartphone app and cloud backend to meet testing needs for the major event.
Disaster recovery projects centered on recovery point and recovery time objectives are inherently broken. For decades companies have been taking that same approach to disaster recovery, asking the same questions, delivering the same message and investing countless dollars while expecting (but rarely achieving) better results. Find out how you can permanently change the way your organization approaches JD Edwards disaster recovery, where every dollar spent and every decision made finally produces an ROI with tangible results.
Your company requires more than an alternate site contract with redundant equipment. When analyzing your current recovery solution, you may find your organization has no documented DR plan or process, no recovery facility, equipment constraints, or human resource limitations. A managed disaster recovery service provides your organization a backup and recovery assessment, a full recovery as part of the assessment, documentation for your businesses recovery plan, and equipment for future recovery needs, plus a recovery test each year and staff to perform the full recovery in the event of a disaster. Your disaster recovery solution will reduce risk and exposure, meet your corporate disaster recovery objectives, provide recovery time and recovery point assurance, and demonstrate a successful, documented test in a geographic diverse recovery center.
The document discusses the role of automated testers in both waterfall and agile projects. It notes that while test automation was seen as essential in waterfall, the high costs of licenses, support, and maintenance often outweighed the benefits. In agile, test automation is more effective when developers implement and "pass" acceptance tests themselves rather than delegating testing to separate testers. Having dedicated automated testers risks silos, miscommunication, testers falling behind and an uncritical approach. The document argues developers should automate tests through BDD/ATDD to find defects early and refactor confidently. While testers can help pair and extend tests, developers don't need dedicated automated testers to write good automated tests.
The document outlines an objectives for a weight loss program called "Lost It & Move It". The objective is to teach healthy eating habits and promote physical activity to help with weight loss. The program goal is to introduce healthy eating by increasing fruit and vegetable intake while reducing fatty foods, and incorporating 30-90 minutes of exercise per day. The participants' stage of readiness is contemplation, as they are considering action but have not taken it yet. The document provides recommendations for healthy eating, such as making half your plate fruits and vegetables, as well as physical activity guidelines of 30 minutes per day or 60-90 minutes for weight loss. It suggests using online resources and food journals, and having monthly team meetings and biannual health checkups
This document proposes wellness programs to address stress and nutrition issues at JM & ArK, Inc. It begins by outlining current claims data related to stress and nutrition problems. Environmental assessments of the workplace identify stress and unhealthy eating as areas of concern. The proposed programs have 5 phases: awareness, training, incentives, implementation, and evaluation. They aim to reduce stress claims by 15% and nutrition claims by 15% through activities like stress management training, healthy eating options, and physical activity incentives. The estimated annual costs are $5,314 for the stress program and $3,229 for the nutrition program. The benefits are projected to outweigh the costs within 2 years for both programs.
The document is a presentation on applying Lean principles in the context of human behavior and decision-making. It discusses cognitive biases and irrational tendencies that influence human reasoning. It then explains how Lean can help individuals and organizations overcome these biases to make more rational decisions through processes like validating hypotheses, gathering customer feedback, and embracing experimentation. In the end, Lean is presented as a way for irrational people to make rational decisions through these evidence-based practices while still maintaining good interpersonal relationships.
The document provides an organizational overview of The Gazette newspaper. It outlines the major departments including circulation, production, newsroom, business, and advertising. For each department, it identifies both the biggest challenges and recent successes. The biggest challenges include declining circulation trends, aging equipment, staff reductions, and economic pressures. Recent successes include emphasis on quality service, operational efficiencies, growth of online and combo subscriptions, coverage of major news events, and increased revenue from niche products and online advertising.
The document summarizes a presentation about using dedicated crowd sourcing to test mobile network quality of experience in real time during the 2012 London Olympics. It describes challenges in testing at the Olympics, how a dedicated crowd with test devices was deployed across the UK to continuously test networks, and how Epitiro's solution provided real-time data and reporting through a smartphone app and cloud backend to meet testing needs for the major event.
Verhaert Innovation Day - Product roadshows in an early development stage: P...Jef Aernouts
Talk given at Verhaert Innovation Day 2013, 18th October 2013, in Kruibeke, Belgium.
Abstract:
Generally, clients want to see finished products that suit their application perfectly. However, the product developer is sometimes forced to perform road shows in an early development stage. In this presentation, the opportunities and drawbacks of product demonstrations in an early design stage are discussed, based upon our experience in the development of a high-tech and challenging device for the aviation industry.
Easing Cloud Migrations with Software Pipelines as a Service - Christopher J...AWS Chicago
This document discusses Morningstar's efforts to implement "Software Pipelines as a Service" (SPaaS) to help product teams migrate applications to AWS more efficiently. It describes how Morningstar developed centralized pipelines using tools like Jenkins, Chef, and Terraform that teams could use rather than building their own. While initial results were mixed, Morningstar is now taking a second pass at SPaaS using a pipeline generator that defines the structure in a declarative domain-specific language processed by ANTLR. This approach aims to provide flexibility while enforcing standard processes across teams.
RIPE Atlas is a proposed large-scale measurement network using small, low-cost probes that are easily deployable anywhere with USB power. The goal is to build a common infrastructure through community participation that serves both private and public interests, providing unprecedented network visibility through aggregated measurement data. Individuals and organizations can host probes to earn credits for measurements, while sponsorship supports further deployments.
This document discusses the pros and cons of conducting product roadshows in the early development stage. It provides an example of a company called HQMS that conducted early-stage demonstrations of their borehole measurement system. Early demonstrations can provide valuable feedback to help focus product development, identify desired features, detect risks, and reduce costs. However, products in the early stage may be unfinished and lead to overspecification from users. The document emphasizes managing expectations and having a clear value proposition when conducting early demonstrations.
Production System Design Support - Accialini Training & ConsultingNicola Accialini
Accialini Training & Consulting provides support in Production System Design. Please visit our website www.accialiniconsulting.com or send us an email at info@accialiniconsulting.com for additional info.
Please don't forget to subscribe to our newsletter!
Canary Analyze All The Things: How We Learned to Keep Calm and Release OftenC4Media
Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1ph8Rq1.
Roy Rapoport discusses canary analysis deployment and observability patterns he believes that are generally useful, and talks about the difference between manual and automated canary analysis. Filmed at qconnewyork.com.
Roy Rapoport manages the Insight Engineering group at Netflix, responsible for building Netflix's Operational Insight platforms, including cloud telemetry, alerting, and real-time analytics. He originally joined Netflix as part of its datacenter-based IT/Ops group, and prior to transferring over to Product Engineering, was managing Service Delivery for IT/Ops.
This document discusses the need to rethink the role of testers in agile and structured projects. It argues that changes in business demands and development practices are squeezing testers and that many current testing roles and skills may disappear. Specifically, it predicts that half of onshore testing roles will be eliminated in 5 years. It recommends testers focus on more strategic roles like business analysis, requirements management, and assurance rather than traditional testing tasks.
Some people use the cloud. Others build one. This talk will be about building your own enteprise cloud.
When running a cloud 3 things are important: scaling, easy (cost effective) maintenance, and stability. These 3 points are very closely related through one subject: automation. Thanks to the easy automation tools like pxe boot (for booting a new setup) and puppet (for configuring a new system) setting up a new server was never this easy. But how can we use these tools to create a scalable infrastructure that is cost effective, stable and easy to maintain?
In this talk you will learn about how to design a scalable secure architecture and how to make the right tools work for you without going into to much detail.
The document provides an overview of process excellence models and standards. It begins by discussing how every morning animals like deer and lions must run to survive, demonstrating the importance of processes. It then provides quotes about quality and the need for organizations to change and improve processes. The document outlines challenges modern businesses face like increasing competition, innovation speed, and customer demands. It argues that businesses must focus on people, technology, processes, and partners to succeed. The document then discusses what processes are, why they are important for delivering quality, improving productivity and reducing risks. It emphasizes that quality is determined by the quality of processes used. The document outlines challenges organizations face in implementing multiple standards and provides an overview of Adaptive's approach to developing integrated management
A collaborative approach to the quality in the agile enterprise by Jaco ViljoenIndigoCube
The document discusses challenges with quality and collaboration in different software development systems like waterfall, water-scrum-fall, and continuous delivery. It proposes shifting user acceptance testing left to the development phase and implementing acceptance test driven development with the whole team. The solution is to prevent defects through early testing, collaborate around quality, automate acceptance and regression testing, and build a continuous delivery pipeline to enable frequent releases. The implementation involved shifting processes from "water-scrum-fall" to "continuous delivery" with a phased approach to minimize impact.
Weaning Legagy Platform From Offshore Qad215steinberg
This document outlines a three-step plan to transition a legacy platform away from relying on traditional offshore QA to an agile development model where the development team takes ownership of quality. The first step is to establish the development team as a quality organization by having a QA lead, co-owned Selenium test suite, and having developers do QA tasks. The second step is to establish the development team as a "Quality Assurance" organization. The third step is to retrain the offshore QA team to take on value-adding roles like performance testing and user-centric regression testing to make their current role irrelevant but not make them irrelevant.
Maintaining lean and agile principles in a fixed date/budget/scope projectCorecom Consulting
The document outlines the agenda for an evening networking event hosted by Corecom Consulting. The schedule includes an introduction, two keynote speakers on maintaining agile principles in fixed projects, a buffet and refreshments, and three lightning discussion topics on attractive IT benefits, creating agile client relationships, and security/GDPR preparation. The event aims to provide networking, presentations, and discussions relevant to IT professionals.
Star west 2011 manoj narayanan presentation 1.0manoj7698
Crowdsourced testing, also known as crowd testing, leverages a global community to accomplish business goals such as product testing. It has become relevant for testing due to the need to test large numbers of scenarios. Crowd testing can be utilized for web, mobile, and game applications. Organizations are exploring various options to integrate crowd testing into their overall testing strategy including using it as an add-on, for specialized testing scenarios, based on risk and priority, or fully integrating it. As the crowd testing market matures, players are expanding their services, forming partnerships, and differentiating their offerings.
Kanban is a tool used to visualize and limit work in progress to help maximize efficiency. It uses a board to visualize workflow and implements work in progress limits to avoid bottlenecks and encourage continuous flow. The document discusses how kanban originated from the Toyota Production System and lean principles. It also contrasts kanban with agile methods and argues that kanban's concrete tools help with cultural adoption.
David Tarbox, Litle & Co. presentations from MassTLC seminar on taking your a...MassTLC
This document provides an overview of MTLC Litle, including its size, history, industry, offerings, and culture. It discusses that MTLC Litle has about 220 employees total, with about 75 in engineering and 55 in software development. It was founded in 2001 and started with 12 employees. It also discusses the greatest challenge of continuing to scale the engineering group. The culture focuses on making the right way the easiest, using successive approximation to succeed, and having engineers understand the business through tours of duty.
This document discusses pragmatic software innovation and value creation in software teams. It advocates for opportunistically pursuing innovation in everyday projects through a learning process across knowledge areas. Pragmatic software innovation involves inquiring into problem domain needs and finding valuable ways to meet those needs. The document presents examples of how means and ends are inseparable and change through iterations as new opportunities and understandings emerge.
The document discusses the services of an operations management consultant called "The Ops Man" who can assist organizations with processes like cost reduction, process development, and interim management to improve the bottom line with minimal cost and risk. Popular quick wins mentioned include stock and process improvements, synergy analysis, and leadership and personnel reviews. The consultant's process involves an on-site assessment to identify value that could be delivered through an appropriate solution.
WQD2011 - INNOVATION - EMAL - SRSS Weigh Scale OptimisationDubai Quality Group
Innovation case study submitted by Emirates Aluminium during 3rd Continual Improvement & Innovation Symposium organized by Dubai Quality Group's Continual Improvement Subgroup to celebrate World Quality Day 2011.
The document discusses various software development process models including waterfall, iterative, spiral, win-win spiral, cleanroom, and hacking. It notes limitations of the waterfall model and how iterative models address risk by coding incrementally, gathering feedback, and reworking. The spiral model specifically focuses on risk assessment at each stage. Win-win spiral seeks to reconcile stakeholder objectives. Cleanroom aims to prevent defects through rigorous testing and reviews. Hacking works for small, low-risk projects.
Verhaert Innovation Day - Product roadshows in an early development stage: P...Jef Aernouts
Talk given at Verhaert Innovation Day 2013, 18th October 2013, in Kruibeke, Belgium.
Abstract:
Generally, clients want to see finished products that suit their application perfectly. However, the product developer is sometimes forced to perform road shows in an early development stage. In this presentation, the opportunities and drawbacks of product demonstrations in an early design stage are discussed, based upon our experience in the development of a high-tech and challenging device for the aviation industry.
Easing Cloud Migrations with Software Pipelines as a Service - Christopher J...AWS Chicago
This document discusses Morningstar's efforts to implement "Software Pipelines as a Service" (SPaaS) to help product teams migrate applications to AWS more efficiently. It describes how Morningstar developed centralized pipelines using tools like Jenkins, Chef, and Terraform that teams could use rather than building their own. While initial results were mixed, Morningstar is now taking a second pass at SPaaS using a pipeline generator that defines the structure in a declarative domain-specific language processed by ANTLR. This approach aims to provide flexibility while enforcing standard processes across teams.
RIPE Atlas is a proposed large-scale measurement network using small, low-cost probes that are easily deployable anywhere with USB power. The goal is to build a common infrastructure through community participation that serves both private and public interests, providing unprecedented network visibility through aggregated measurement data. Individuals and organizations can host probes to earn credits for measurements, while sponsorship supports further deployments.
This document discusses the pros and cons of conducting product roadshows in the early development stage. It provides an example of a company called HQMS that conducted early-stage demonstrations of their borehole measurement system. Early demonstrations can provide valuable feedback to help focus product development, identify desired features, detect risks, and reduce costs. However, products in the early stage may be unfinished and lead to overspecification from users. The document emphasizes managing expectations and having a clear value proposition when conducting early demonstrations.
Production System Design Support - Accialini Training & ConsultingNicola Accialini
Accialini Training & Consulting provides support in Production System Design. Please visit our website www.accialiniconsulting.com or send us an email at info@accialiniconsulting.com for additional info.
Please don't forget to subscribe to our newsletter!
Canary Analyze All The Things: How We Learned to Keep Calm and Release OftenC4Media
Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1ph8Rq1.
Roy Rapoport discusses canary analysis deployment and observability patterns he believes that are generally useful, and talks about the difference between manual and automated canary analysis. Filmed at qconnewyork.com.
Roy Rapoport manages the Insight Engineering group at Netflix, responsible for building Netflix's Operational Insight platforms, including cloud telemetry, alerting, and real-time analytics. He originally joined Netflix as part of its datacenter-based IT/Ops group, and prior to transferring over to Product Engineering, was managing Service Delivery for IT/Ops.
This document discusses the need to rethink the role of testers in agile and structured projects. It argues that changes in business demands and development practices are squeezing testers and that many current testing roles and skills may disappear. Specifically, it predicts that half of onshore testing roles will be eliminated in 5 years. It recommends testers focus on more strategic roles like business analysis, requirements management, and assurance rather than traditional testing tasks.
Some people use the cloud. Others build one. This talk will be about building your own enteprise cloud.
When running a cloud 3 things are important: scaling, easy (cost effective) maintenance, and stability. These 3 points are very closely related through one subject: automation. Thanks to the easy automation tools like pxe boot (for booting a new setup) and puppet (for configuring a new system) setting up a new server was never this easy. But how can we use these tools to create a scalable infrastructure that is cost effective, stable and easy to maintain?
In this talk you will learn about how to design a scalable secure architecture and how to make the right tools work for you without going into to much detail.
The document provides an overview of process excellence models and standards. It begins by discussing how every morning animals like deer and lions must run to survive, demonstrating the importance of processes. It then provides quotes about quality and the need for organizations to change and improve processes. The document outlines challenges modern businesses face like increasing competition, innovation speed, and customer demands. It argues that businesses must focus on people, technology, processes, and partners to succeed. The document then discusses what processes are, why they are important for delivering quality, improving productivity and reducing risks. It emphasizes that quality is determined by the quality of processes used. The document outlines challenges organizations face in implementing multiple standards and provides an overview of Adaptive's approach to developing integrated management
A collaborative approach to the quality in the agile enterprise by Jaco ViljoenIndigoCube
The document discusses challenges with quality and collaboration in different software development systems like waterfall, water-scrum-fall, and continuous delivery. It proposes shifting user acceptance testing left to the development phase and implementing acceptance test driven development with the whole team. The solution is to prevent defects through early testing, collaborate around quality, automate acceptance and regression testing, and build a continuous delivery pipeline to enable frequent releases. The implementation involved shifting processes from "water-scrum-fall" to "continuous delivery" with a phased approach to minimize impact.
Weaning Legagy Platform From Offshore Qad215steinberg
This document outlines a three-step plan to transition a legacy platform away from relying on traditional offshore QA to an agile development model where the development team takes ownership of quality. The first step is to establish the development team as a quality organization by having a QA lead, co-owned Selenium test suite, and having developers do QA tasks. The second step is to establish the development team as a "Quality Assurance" organization. The third step is to retrain the offshore QA team to take on value-adding roles like performance testing and user-centric regression testing to make their current role irrelevant but not make them irrelevant.
Maintaining lean and agile principles in a fixed date/budget/scope projectCorecom Consulting
The document outlines the agenda for an evening networking event hosted by Corecom Consulting. The schedule includes an introduction, two keynote speakers on maintaining agile principles in fixed projects, a buffet and refreshments, and three lightning discussion topics on attractive IT benefits, creating agile client relationships, and security/GDPR preparation. The event aims to provide networking, presentations, and discussions relevant to IT professionals.
Star west 2011 manoj narayanan presentation 1.0manoj7698
Crowdsourced testing, also known as crowd testing, leverages a global community to accomplish business goals such as product testing. It has become relevant for testing due to the need to test large numbers of scenarios. Crowd testing can be utilized for web, mobile, and game applications. Organizations are exploring various options to integrate crowd testing into their overall testing strategy including using it as an add-on, for specialized testing scenarios, based on risk and priority, or fully integrating it. As the crowd testing market matures, players are expanding their services, forming partnerships, and differentiating their offerings.
Kanban is a tool used to visualize and limit work in progress to help maximize efficiency. It uses a board to visualize workflow and implements work in progress limits to avoid bottlenecks and encourage continuous flow. The document discusses how kanban originated from the Toyota Production System and lean principles. It also contrasts kanban with agile methods and argues that kanban's concrete tools help with cultural adoption.
David Tarbox, Litle & Co. presentations from MassTLC seminar on taking your a...MassTLC
This document provides an overview of MTLC Litle, including its size, history, industry, offerings, and culture. It discusses that MTLC Litle has about 220 employees total, with about 75 in engineering and 55 in software development. It was founded in 2001 and started with 12 employees. It also discusses the greatest challenge of continuing to scale the engineering group. The culture focuses on making the right way the easiest, using successive approximation to succeed, and having engineers understand the business through tours of duty.
This document discusses pragmatic software innovation and value creation in software teams. It advocates for opportunistically pursuing innovation in everyday projects through a learning process across knowledge areas. Pragmatic software innovation involves inquiring into problem domain needs and finding valuable ways to meet those needs. The document presents examples of how means and ends are inseparable and change through iterations as new opportunities and understandings emerge.
The document discusses the services of an operations management consultant called "The Ops Man" who can assist organizations with processes like cost reduction, process development, and interim management to improve the bottom line with minimal cost and risk. Popular quick wins mentioned include stock and process improvements, synergy analysis, and leadership and personnel reviews. The consultant's process involves an on-site assessment to identify value that could be delivered through an appropriate solution.
WQD2011 - INNOVATION - EMAL - SRSS Weigh Scale OptimisationDubai Quality Group
Innovation case study submitted by Emirates Aluminium during 3rd Continual Improvement & Innovation Symposium organized by Dubai Quality Group's Continual Improvement Subgroup to celebrate World Quality Day 2011.
The document discusses various software development process models including waterfall, iterative, spiral, win-win spiral, cleanroom, and hacking. It notes limitations of the waterfall model and how iterative models address risk by coding incrementally, gathering feedback, and reworking. The spiral model specifically focuses on risk assessment at each stage. Win-win spiral seeks to reconcile stakeholder objectives. Cleanroom aims to prevent defects through rigorous testing and reviews. Hacking works for small, low-risk projects.
7. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
Monday, 24 September 12
8. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
Monday, 24 September 12
9. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
Monday, 24 September 12
10. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
• Crowd sourcing is great, but is too
random, and relies on a large
number people testing randomly.
Monday, 24 September 12
11. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
• Crowd sourcing is great, but is too
random, and relies on a large
number people testing randomly.
• What we needed was a new
approach...
Monday, 24 September 12
13. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
Monday, 24 September 12
14. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
Monday, 24 September 12
15. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
Monday, 24 September 12
16. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
• What we needed was a
dedicated crowd... A crowd
which would be happy to work
24/7 and stand around all day.
Monday, 24 September 12
17. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
• What we needed was a
dedicated crowd... A crowd
which would be happy to work
24/7 and stand around all day.
• So that was it ‘Dedicated Crowd
Sourcing’ was the answer...
Monday, 24 September 12
19. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
Monday, 24 September 12
20. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
Monday, 24 September 12
21. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
Monday, 24 September 12
22. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
Monday, 24 September 12
23. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
Monday, 24 September 12
24. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
• See the results in realtime...
Monday, 24 September 12
25. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
• See the results in realtime...
• An interface that would allow full
diagnostics when required...
Monday, 24 September 12
26. A Cloud based solution...
JSON api to enable
Backend server in Cloud realtime excel reporting
JSON api to enable reporting
on mobile devices
Root cause analysis tool
Smartphone testing app
Monday, 24 September 12
27. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
Monday, 24 September 12
28. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
Monday, 24 September 12
29. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
30. Comparison Of Existing systems
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
31. Comparison Of Existing systems
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
32. Dashboard & JSON api Specification provided
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
strength% data% collected% over%
the%measurement%period.% %And%
JSON%api%Dashboard% legend.% % This% should% a%
simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
33. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
strength% data% collected% over%
the%measurement%period.% %And%
JSON%api%Dashboard% legend.% % This% should% a%
simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
34. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
• Writing a test API interface
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
to ensure that the product
JSON%api%Dashboard%
would interface with our
strength% data% collected% over% legend.% % This% should% a%
the%measurement%period.% %And% simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
internal tools when it was
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
delivered...
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
35. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
• Writing a test API interface
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
to ensure that the product
JSON%api%Dashboard%
would interface with our
strength% data% collected% over% legend.% % This% should% a%
the%measurement%period.% %And% simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
internal tools when it was
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
delivered...
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area% • We wanted to support web-
portal, excel spreadsheet,
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
and apps which would all run
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
off the same JSON API...
97.6%%
Monday, 24 September 12
57. ats-group.co.uk Est. 1992
Tom Bryer
Managing Director
Monday, 24 September 12
58. Est.
1992
London 2012 Games
Benchmarking the Mobile
Operators
Working With:
Monday, 24 September 12
59. During the Summer of 2012 – ATS&RO pioneered the CET bike!
Giving unprecedented access to London during busy times of the day..
Monday, 24 September 12
60. From the initial concept… To Reality…
Production Engineering from ATS…
Monday, 24 September 12
61. Creating the static units for the London 2012 Games…
Monday, 24 September 12
62. Deploying the static units for the London 2012 Games…
Intelligent Communication Solutions
Rigging and Installation Services
• Took delivery of 20 static benchmark units
on Friday morning
• Work very hard to get to the key locations
in the Olympic park
• Deadline for installation within the Olympic
park was Sunday evening
• All boxes were installed, activated &
commissioned on time
Monday, 24 September 12
63. 152 test units deployed across the UK…
Monday, 24 September 12
64. Our
Benchmark
Test
Kit
Range…
Sta'c,
24
by
7
at
key
locaDons
Walk,
able
to
provide
access
to
key
areas
Cycle,
provide
great
access
to
urban
areas
Bike,
great
for
central
London
or
other
urban
areas
Car,
great
for
all
round
balance
of
TesDng
and
Mileage
Monday, 24 September 12
69. We
are
so
Impressed
with
realTime
CET…
We
have
set-‐up
a
new
company
to
drive
this
forward:
Currently Working With:
Monday, 24 September 12
70. On the way to completing a UK coverage map
Encouraging Mobile choice
Monday, 24 September 12
71. Est. 2000
Gavin Johns
Chief Operating Officer
Monday, 24 September 12
72. www.epitiro.com
iPQ TM
Real-Time Insight
Gavin Johns
Epitiro Group Limited
CEO, Epitiro
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12
73. About Epitiro
www.epitiro.com
‘Quality of Experience’
Monitoring Solutions for Mobile Operators
§ Epitiro provides leading Mobile Operators with network
monitoring systems to ensure they can measure and manage
Quality of Experience
§ Real-time insight of QoE helps address service-affecting
issues in their infancy
§ We help operators achieve;
§ Efficient Network Expansion
§ Reduced Support Calls
§ Higher Customer Satisfaction / Reduced Churn
ipQTM
§ Established 2000, Cardiff
Epitiro Group Limited
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12
74. Our Clients
www.epitiro.com
Monday, 24 September 12
75. Challenges for Mobile Operators
www.epitiro.com
Coverage - Capacity – Capability - Performance - Reliability
The Five Pillars of Customer Experience…
“Does it work when I want it?”
Coverage “Is there service where I need it?”
“Can I make a call when I want to, for
as longa as I want to?”
Does the Network
Capability Performance “Does it perform as I expect?”
support the latest
technology • Voice, text and Data
How does the network cope at Availability of Voice and Data
times of peak demand Services 24/7
Capacity Reliability
Monday, 24 September 12
77. AT50M Software Probe Test App
www.epitiro.com
OTA Android Smartphones
• Overview
– Targeted measurement of mobile network – based on
cell, bearer etc.
– Test Scheduling event based, time based, push-to-
test
– Active & Passive testing
AT50M
• Device Support Software
– Android 2.1+ and iOS 4.0+
Client
– Consolidated approach for future device support with
RIM and Windows
• Network and Bearer support
– 2G, 3G UMTS and CDMA, 4G WiMAX and LTE
– Wi-Fi
Monday, 24 September 12
78. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
79. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
80. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
81. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs
Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
82. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
83. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
84. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
85. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests
Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
86. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests
Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
87. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
88. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
89. Summary of KPIs and Ancillary Data
www.epitiro.com
A Full Range of Measurement Capability
IP Data Measurements Passive Measurements Network Interfaces
• TCP Throughput • Data Connection State • IEEE 802.3 Ethernet
• TCP Echo • Cellular Service State • IEEE 802.11 Wireless
• TCP 3-way Handshake Latency • Application Throughput
• UDP Network Quality • Application Bandwidth Consumption
Internet Protocols
– Packet Loss • Web Browser Throughput
• IPv4
– Jitter • TCP / UDP Network Traffic
• IPv6
– Two-way latency
One-way latency (OWAMP) Geolocation
– Echo IP QoS Control
• GPS
• ICMP Latency • DiffServ DSCP
• Triangulation
• DNS Lookup • IPv6 Flow Label
• IP Geolocation
• Application Measurements Test Scheduling
• ITU-T G.107 E-model • Fixed
• Call Success Rate (Dropped Calls) • Periodic
• UDP Gaming • Window based
• P2P Bandwidth • Event based
• HTTP Web Browsing • On idle
Monday, 24 September 12
90. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
versions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
91. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
92. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
93. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
94. In Summary
www.epitiro.com
Benefits of iPQ…
§ Programmable warning and critical thresholds
means is instantly alerted when baseline thresholds
are breached
§ Full access to testing allows to control the frequency
and the number of KPIs
§ Benchmarking competitor MNOs highlights
opportunities to improve service..
§ Instantly see the impact of any changes on the
network…
Monday, 24 September 12
95. ipQTM Performance Monitoring Solution
www.epitiro.com
Product and Services
§ Real-Time Reporting Interface Mobile Operators
§ Full ‘On-Demand’ Management of data collection
probe testing
§ Support Services to ensure installation, configuration,
maintenance and further data analysis ipQTM
Epitiro Group Limited
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12