The presentation on Performance Testing and Non-Functional Testing Strategy for Big Data Applications was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Abhinav Gupta
The presentation on Blockchain Based Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Yogesh Mokase, Vaibhav Karajgaonkar
The presentation on HikeRunner: Load Test Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Harsh Verma
The presentation on Batch Workload Modelling and Performance Optimization was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Ashish Powar
ATAGTR2017 Test Approach for Re-engineering Legacy Applications based on Micr...Agile Testing Alliance
The presentation on Test Approach for Re-engineering Legacy Applications based on Micro-service Architecture was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Sandhya S
ATAGTR2017 Differentiation using Testing Tools and Automation in the BFS COTS...Agile Testing Alliance
The presentation on Differentiation using Testing Tools and Automation in the BFS COTS Product World was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Vrushal Palyekar
FLIGHT WEST 2018 Presentation - Continuous Monitoring of Open Source Componen...Black Duck by Synopsys
Basma Shahadat, Lead Research Engineer presented at Black Duck Flight West 2018. Security checking in the early stages of the SDLC is critical. This session will demonstrate how Proofpoint is taking proactive steps to reduce risk by integrating Black Duck into Proofpoint’s continuous integration pipeline to detect open source vulnerabilities during the product build. For more information, please visit us at https://www.blackducksoftware.com/
The presentation on Blockchain Based Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Yogesh Mokase, Vaibhav Karajgaonkar
The presentation on HikeRunner: Load Test Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Harsh Verma
The presentation on Batch Workload Modelling and Performance Optimization was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Ashish Powar
ATAGTR2017 Test Approach for Re-engineering Legacy Applications based on Micr...Agile Testing Alliance
The presentation on Test Approach for Re-engineering Legacy Applications based on Micro-service Architecture was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Sandhya S
ATAGTR2017 Differentiation using Testing Tools and Automation in the BFS COTS...Agile Testing Alliance
The presentation on Differentiation using Testing Tools and Automation in the BFS COTS Product World was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Vrushal Palyekar
FLIGHT WEST 2018 Presentation - Continuous Monitoring of Open Source Componen...Black Duck by Synopsys
Basma Shahadat, Lead Research Engineer presented at Black Duck Flight West 2018. Security checking in the early stages of the SDLC is critical. This session will demonstrate how Proofpoint is taking proactive steps to reduce risk by integrating Black Duck into Proofpoint’s continuous integration pipeline to detect open source vulnerabilities during the product build. For more information, please visit us at https://www.blackducksoftware.com/
Continuous Testing- A Key Ingredient for Success in Agile & DevOpsSmartBear
Cigniti discusses how continuous testing can help your organization be successful in Agile and DevOps. Their original presentation was given as a part of our first annual user conference, SmartBear Connect
Keynote: Making search better, faster, easierElasticsearch
The way we work, shop, and consume content has shifted in 2020. Unsurprisingly, search has become the cornerstone of those activities. Get to know the team behind Elastic Enterprise Search and hear how we’ve taken a different approach to enabling you to deliver new search experiences for your customers and teams. We’ll also show how some of our customers have thrived during the Covid 19 pandemic by leveraging the scalability and flexibility of Enterprise Search on Elastic Cloud. Plus, we’ll take you on a guided tour of the latest innovations and what’s new in our latest releases.
Accelerate Agile Development with Service Virtualization - Czech TestParasoft
Process deadlocks are endemic to parallel and Agile development environments, where different teams are simultaneously working on interconnected system components—and each team needs to access the others' components in order to complete its own tasks. But when a team ends up waiting for access to dependencies, agility is stifled. One way to break free of these constraints is to use service virtualization to simulate interactions between the application under test and the dependencies that are unavailable or difficult-to-access for dev/test purposes. This presentation explains how service virtualization can help you eliminate the delays created by unavailable and evolving dependencies so you can save time, money, and effort. It will also share case studies that show specific cases where service virtualization helped organizations compress their testing cycles to keep pace with the demands of Agile development.
Datadog is a cloud monitoring solution that brings metrics from all of your apps, tools, servers & services into one place. It brings servers, clouds, metrics, apps, and team together by seamlessly aggregating metrics and events across the full devops stack.
Get full visibility and find hidden security issuesElasticsearch
When even basic threats can be multi-staged and complex, limited visibility into your security data just doesn’t cut it. Whether you’re performing investigations or hunting for threats, you need all security-relevant context. Learn key practices in data collection and normalisation and see how you can use Elastic Security to quickly and accurately triage, verify, and scope issues.
Microsoft: Enterprise search for cloud native applicationsElasticsearch
Not everything should go into a container, and the heavy lifting of enterprise search is no exception to this. In this talk, we will explore Elastic Cloud on Azure, discussing its benefits and showing how Elastic fits within the cloud native ecosystem outside of the ELK Stack.
Devops security-An Insight into Secure-SDLCSuman Sourav
The integration of Security into DevOps is already happening out of necessity. DevOps is a powerful paradigm shift and companies often don’t understand how security fits. Aim of this session is to give an overview of DevOps security and How security can be integrated and automated into each phases of software development life-cycle.
Application Security in a DevOps World: Three Methods for Shifting Left Operations has always resided clearly outside of development. Release candidates are tossed over the fence by development and operations was expected to “just make it work.” The same can be said about many other activities, including application security. This isn’t intended to be derision aimed at development—it’s just a feature of how processes have historically been demarcated. But with the emergence of the DevOps movement, organizations are beginning to apply the “shift-left” principle associated with early testing toward other facets of application development. Security, which has been treated as something you can test into an application, should be built into an application according to DevOps principles. In this presentation, we discuss how to get development and operations working together to build security into the application. We’ll outline three methods and discuss their merits and drawbacks:
• Penetration testing: This is the approach most commonly used.
• Hybrid testing: By applying flow (dynamic analysis) early in the process, you can that look for possible paths through the code that lead to security flaws.
• Preventative testing: By taking a standards-based approach and implementing a set of activities that target defects that lead to security vulnerabilities, you are able to get ahead of security issues that diminish the effectiveness of DevOps approaches.
Norse Live Attack Map http://map.ipviking.com/
8,000,000 sensors in 200 data centers in 50 countries – designed to look like everything
The top 5,000,000 worst IPs on the internet
"There are very rarely attacks against Canada, for whatever reason. I guess they're just too nice."
See also http://www.digitalattackmap.com/#anim=1&color=0&country=ALL&list=0&time=16447&view=map for DDOS live
DevOps is powering the computing environments of tomorrow. When properly configured, the Splunk platform allows us to gain real-time visibility into the velocity, quality, and business impact of DevOps-driven application delivery across all roles, departments, process, and systems. Splunk can be used by DevOps practitioners to provide continuous integration/deployment and the real-time feedback to help the organization with their operational intelligence. Join us for a exciting talk about Splunk’s current approach to DevOps, and for examples of how Splunk is being used by customers today to transform DevOps initiatives.
Automate Your Container Deployments SecurelyDevOps.com
Operations seeking to make their apps and APIs both performant and available to their users must bake effective application security tooling into their processes and infrastructure configurations. How can development and operations teams release at increasing velocity with app protection built into their CI/CD pipeline?
A true next-generation, holistic web application and API protection platform does just that: operations teams can integrate security into their workflows and ensure new infrastructure and app code released to production is both effective and secure in any environment from cloud using containers to datacenters to a hybrid of these.
Join application security expert Aneel Dadani from Signal Sciences to learn how your team can automate, deploy at scale safely while gaining layer 7 visibility in production environments.
Attendees will learn:
What constitutes effective application security within the context of cloud adoption and an ever expanding threat landscape
How development teams can gain visibility into how their apps and APIs are being used in production and what vulnerabilities may exist that they overlooked
How DevOps teams can scale their application footprint to meet demand while securing your codebase in production
How to inspect request traffic at the API gateway or the ingress
SAST vs. DAST: What’s the Best Method For Application Security Testing?Cigital
High profile security breaches are leading to heightened organizational security concerns. Firms around the world are now observing the consequences of security breaches that are becoming more widespread and more advanced. Due to this, firms are ready to identify vulnerabilities in their applications and mitigate the risks.
Two ways to go about this are static application security testing (SAST) and dynamic application security testing (DAST). These application security testing methodologies are used to find the security vulnerabilities that make your organization’s applications susceptible to attack.
The two methodologies approach applications very differently. They are most effective at different phases of the software development life cycle (SDLC) and find different types of vulnerabilities. For example, SAST detects critical vulnerabilities such as cross-site scripting (XSS), SQL injection, and buffer overflow earlier in the SDLC. DAST, on the other hand, uses an outside-in penetration testing approach to identify security vulnerabilities while web applications are running.
Let us guide you through your application security testing journey with more key differences between SAST and DAST:
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)DevOps.com
As containers and Kubernetes are adopted in production, security is a critical concern and DevOps teams need to go beyond image scanning. Use cases such as runtime security, network visibility and segmentation, incident response and compliance become priorities as your Kubernetes security framework matures.
In this talk, we’ll share an overview of runtime security, discuss approaches used by open source and commercial tools, and hear how users are getting started quickly without impacting developer productivity.
The industry move towards wearables is all the rage and taking advantage of these new devices doesn’t have to mean learning a whole new platform. For example the Microsoft Band is a multi-function wearable device that works with your smart phone to help you track heart rate, steps, calorie burn, sleep quality and be productive with email and calendar alerts and more. While you can quickly and easily build an app for the Band in just a few minutes how can you be sure the back end is up to the scale you’d need to support potential massive growth if it were to take off? Enter the cloud and tools available that we can use to load test and explore the performance characteristics of the solution. In this session we’ll take a look at what’s possible and walk thru the scenario to see first hand how it is done.
Centralized logging in a changing environment at the UK’s DVLAElasticsearch
The UK's Driver and Vehicle Licensing Agency (DVLA) maintains more than 80 million driver and vehicle records and collects billions a year in Vehicle Excise Duty. Hear how Elastic plays a critical role in the agency’s self-service developer platform that runs alongside Kubernetes and leverages machine learning and alerting capabilities. You’ll also learn about their migration to Elastic Cloud and their goals for SIEM.
Data-Drive DevOps: Mining Machine Data for "Metrics that Matter"Splunk
Splunk's Andi Mann addresses what he refers to as the real core of DevOps: increasing collaboration, communication, integration and delivery of better, faster software; the human side of DevOps, combined with the business impacts.
Implementing DevOps at Scale Using Dynamic EnvironmentsSauce Labs
While many tech startups have adopted modern devops practices, mid-size and large enterprises are still barely scratching the surface. They have the management mandate and some resources, but the results are less than convincing when the rubber hits the road: small scale initiatives seems to be the norm, but often have encountered difficulties when trying to expand beyond their initial scope.
How do you start this journey on the right footing?
Join Pascal Joly, Director of Technology Partnerships at Quali, as he discusses DevOps and what it really means when it comes to implementing and managing it for complex application architectures. Using case studies and real world experiences, he will cover how to move beyond the first project to get all of your Dev and Test teams to embrace DevOps concepts. He will also run a live demo.
In this session you can expect to learn about:
-The pitfalls organizations typically encounter as they deploy DevOps
-A practical approach to implementing DevOps at scale for an entire organization
-Managing dozens of application environments to certify through your pipeline
-Defining how much resources can be used by your development and test team
-How automated testing platforms such as Sauce Labs can be integrated in this process
Can’t make the webinar? Register anyway and we’ll send out an email with a link to the recording and slides after the event.
The presentation on An Innovative Take on Versa Test was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Amruta Dungarwal
ATAGTR2017 Machine Learning telepathy for Shift Right approach of testingAgile Testing Alliance
The presentation on Machine Learning telepathy for Shift Right approach of testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Santhosh GS
Continuous Testing- A Key Ingredient for Success in Agile & DevOpsSmartBear
Cigniti discusses how continuous testing can help your organization be successful in Agile and DevOps. Their original presentation was given as a part of our first annual user conference, SmartBear Connect
Keynote: Making search better, faster, easierElasticsearch
The way we work, shop, and consume content has shifted in 2020. Unsurprisingly, search has become the cornerstone of those activities. Get to know the team behind Elastic Enterprise Search and hear how we’ve taken a different approach to enabling you to deliver new search experiences for your customers and teams. We’ll also show how some of our customers have thrived during the Covid 19 pandemic by leveraging the scalability and flexibility of Enterprise Search on Elastic Cloud. Plus, we’ll take you on a guided tour of the latest innovations and what’s new in our latest releases.
Accelerate Agile Development with Service Virtualization - Czech TestParasoft
Process deadlocks are endemic to parallel and Agile development environments, where different teams are simultaneously working on interconnected system components—and each team needs to access the others' components in order to complete its own tasks. But when a team ends up waiting for access to dependencies, agility is stifled. One way to break free of these constraints is to use service virtualization to simulate interactions between the application under test and the dependencies that are unavailable or difficult-to-access for dev/test purposes. This presentation explains how service virtualization can help you eliminate the delays created by unavailable and evolving dependencies so you can save time, money, and effort. It will also share case studies that show specific cases where service virtualization helped organizations compress their testing cycles to keep pace with the demands of Agile development.
Datadog is a cloud monitoring solution that brings metrics from all of your apps, tools, servers & services into one place. It brings servers, clouds, metrics, apps, and team together by seamlessly aggregating metrics and events across the full devops stack.
Get full visibility and find hidden security issuesElasticsearch
When even basic threats can be multi-staged and complex, limited visibility into your security data just doesn’t cut it. Whether you’re performing investigations or hunting for threats, you need all security-relevant context. Learn key practices in data collection and normalisation and see how you can use Elastic Security to quickly and accurately triage, verify, and scope issues.
Microsoft: Enterprise search for cloud native applicationsElasticsearch
Not everything should go into a container, and the heavy lifting of enterprise search is no exception to this. In this talk, we will explore Elastic Cloud on Azure, discussing its benefits and showing how Elastic fits within the cloud native ecosystem outside of the ELK Stack.
Devops security-An Insight into Secure-SDLCSuman Sourav
The integration of Security into DevOps is already happening out of necessity. DevOps is a powerful paradigm shift and companies often don’t understand how security fits. Aim of this session is to give an overview of DevOps security and How security can be integrated and automated into each phases of software development life-cycle.
Application Security in a DevOps World: Three Methods for Shifting Left Operations has always resided clearly outside of development. Release candidates are tossed over the fence by development and operations was expected to “just make it work.” The same can be said about many other activities, including application security. This isn’t intended to be derision aimed at development—it’s just a feature of how processes have historically been demarcated. But with the emergence of the DevOps movement, organizations are beginning to apply the “shift-left” principle associated with early testing toward other facets of application development. Security, which has been treated as something you can test into an application, should be built into an application according to DevOps principles. In this presentation, we discuss how to get development and operations working together to build security into the application. We’ll outline three methods and discuss their merits and drawbacks:
• Penetration testing: This is the approach most commonly used.
• Hybrid testing: By applying flow (dynamic analysis) early in the process, you can that look for possible paths through the code that lead to security flaws.
• Preventative testing: By taking a standards-based approach and implementing a set of activities that target defects that lead to security vulnerabilities, you are able to get ahead of security issues that diminish the effectiveness of DevOps approaches.
Norse Live Attack Map http://map.ipviking.com/
8,000,000 sensors in 200 data centers in 50 countries – designed to look like everything
The top 5,000,000 worst IPs on the internet
"There are very rarely attacks against Canada, for whatever reason. I guess they're just too nice."
See also http://www.digitalattackmap.com/#anim=1&color=0&country=ALL&list=0&time=16447&view=map for DDOS live
DevOps is powering the computing environments of tomorrow. When properly configured, the Splunk platform allows us to gain real-time visibility into the velocity, quality, and business impact of DevOps-driven application delivery across all roles, departments, process, and systems. Splunk can be used by DevOps practitioners to provide continuous integration/deployment and the real-time feedback to help the organization with their operational intelligence. Join us for a exciting talk about Splunk’s current approach to DevOps, and for examples of how Splunk is being used by customers today to transform DevOps initiatives.
Automate Your Container Deployments SecurelyDevOps.com
Operations seeking to make their apps and APIs both performant and available to their users must bake effective application security tooling into their processes and infrastructure configurations. How can development and operations teams release at increasing velocity with app protection built into their CI/CD pipeline?
A true next-generation, holistic web application and API protection platform does just that: operations teams can integrate security into their workflows and ensure new infrastructure and app code released to production is both effective and secure in any environment from cloud using containers to datacenters to a hybrid of these.
Join application security expert Aneel Dadani from Signal Sciences to learn how your team can automate, deploy at scale safely while gaining layer 7 visibility in production environments.
Attendees will learn:
What constitutes effective application security within the context of cloud adoption and an ever expanding threat landscape
How development teams can gain visibility into how their apps and APIs are being used in production and what vulnerabilities may exist that they overlooked
How DevOps teams can scale their application footprint to meet demand while securing your codebase in production
How to inspect request traffic at the API gateway or the ingress
SAST vs. DAST: What’s the Best Method For Application Security Testing?Cigital
High profile security breaches are leading to heightened organizational security concerns. Firms around the world are now observing the consequences of security breaches that are becoming more widespread and more advanced. Due to this, firms are ready to identify vulnerabilities in their applications and mitigate the risks.
Two ways to go about this are static application security testing (SAST) and dynamic application security testing (DAST). These application security testing methodologies are used to find the security vulnerabilities that make your organization’s applications susceptible to attack.
The two methodologies approach applications very differently. They are most effective at different phases of the software development life cycle (SDLC) and find different types of vulnerabilities. For example, SAST detects critical vulnerabilities such as cross-site scripting (XSS), SQL injection, and buffer overflow earlier in the SDLC. DAST, on the other hand, uses an outside-in penetration testing approach to identify security vulnerabilities while web applications are running.
Let us guide you through your application security testing journey with more key differences between SAST and DAST:
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)DevOps.com
As containers and Kubernetes are adopted in production, security is a critical concern and DevOps teams need to go beyond image scanning. Use cases such as runtime security, network visibility and segmentation, incident response and compliance become priorities as your Kubernetes security framework matures.
In this talk, we’ll share an overview of runtime security, discuss approaches used by open source and commercial tools, and hear how users are getting started quickly without impacting developer productivity.
The industry move towards wearables is all the rage and taking advantage of these new devices doesn’t have to mean learning a whole new platform. For example the Microsoft Band is a multi-function wearable device that works with your smart phone to help you track heart rate, steps, calorie burn, sleep quality and be productive with email and calendar alerts and more. While you can quickly and easily build an app for the Band in just a few minutes how can you be sure the back end is up to the scale you’d need to support potential massive growth if it were to take off? Enter the cloud and tools available that we can use to load test and explore the performance characteristics of the solution. In this session we’ll take a look at what’s possible and walk thru the scenario to see first hand how it is done.
Centralized logging in a changing environment at the UK’s DVLAElasticsearch
The UK's Driver and Vehicle Licensing Agency (DVLA) maintains more than 80 million driver and vehicle records and collects billions a year in Vehicle Excise Duty. Hear how Elastic plays a critical role in the agency’s self-service developer platform that runs alongside Kubernetes and leverages machine learning and alerting capabilities. You’ll also learn about their migration to Elastic Cloud and their goals for SIEM.
Data-Drive DevOps: Mining Machine Data for "Metrics that Matter"Splunk
Splunk's Andi Mann addresses what he refers to as the real core of DevOps: increasing collaboration, communication, integration and delivery of better, faster software; the human side of DevOps, combined with the business impacts.
Implementing DevOps at Scale Using Dynamic EnvironmentsSauce Labs
While many tech startups have adopted modern devops practices, mid-size and large enterprises are still barely scratching the surface. They have the management mandate and some resources, but the results are less than convincing when the rubber hits the road: small scale initiatives seems to be the norm, but often have encountered difficulties when trying to expand beyond their initial scope.
How do you start this journey on the right footing?
Join Pascal Joly, Director of Technology Partnerships at Quali, as he discusses DevOps and what it really means when it comes to implementing and managing it for complex application architectures. Using case studies and real world experiences, he will cover how to move beyond the first project to get all of your Dev and Test teams to embrace DevOps concepts. He will also run a live demo.
In this session you can expect to learn about:
-The pitfalls organizations typically encounter as they deploy DevOps
-A practical approach to implementing DevOps at scale for an entire organization
-Managing dozens of application environments to certify through your pipeline
-Defining how much resources can be used by your development and test team
-How automated testing platforms such as Sauce Labs can be integrated in this process
Can’t make the webinar? Register anyway and we’ll send out an email with a link to the recording and slides after the event.
The presentation on An Innovative Take on Versa Test was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Amruta Dungarwal
ATAGTR2017 Machine Learning telepathy for Shift Right approach of testingAgile Testing Alliance
The presentation on Machine Learning telepathy for Shift Right approach of testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Santhosh GS
The presentation on Wearable App Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Himansha Tyagi
The presentation on ChatBot was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Medha Garg
ATAGTR2017 Cost-effective Security Testing Approaches for Web, Mobile & Enter...Agile Testing Alliance
The presentation on Cost-effective Security Testing Approaches for Web, Mobile & Enterprise Application was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Varadarajan V. G.
The presentation on Detect Layout Bugs by Simulating Human Eye was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Surendran Ethiraj
ATAGTR2017 Bee-Hive approach for Big Data Testing [End to End Continuous Test...Agile Testing Alliance
The presentation on Bee-Hive approach for Big Data Testing [End to End Continuous Test Automation solution for Big Data] was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Usharani Subramanian
The presentation on Security Test Driven Development (STDD) was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Surendran Ethiraj
The presentation on Be a User first, then a tester! was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Yogesh Khairnar
The presentation on Test the REST was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Varun Deshpande
ATAGTR2017 The way to recover the issue faced in IoT regression TestingAgile Testing Alliance
The presentation on The way to recover the issue faced in IoT regression Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Anuradha Band
ATAGTR2017 Estimation in Agile Testing - Not a big deal rather it's FunAgile Testing Alliance
The presentation on Estimation in Agile Testing - Not a big deal rather it's Fun was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Manoj Tiwari
ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...Agile Testing Alliance
The presentation on Static and dynamic code analysis for mobile applications - Act early to find hidden test issues was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Sumit Mundhada
The presentation on Testing in DevOps Culture was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Arshi Nazneen
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...Agile Testing Alliance
The presentation on Unified APM: The new age performance monitoring for production systems was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Kaushik Raghavan
ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...Agile Testing Alliance
The presentation on Keeping pace with Product Evolution: UI Automation Framework Guidelines was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Narayan Raman
The presentation on Performance Automation in Dev-Ops was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Sandeep Patil, Gorakshnath Dorge
ATAGTR2017 Artificial Intelligence in Software Testing – DemystifiedAgile Testing Alliance
The presentation on Artificial Intelligence in Software Testing – Demystified was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Ramakrishnan Venkatasubramanian
The presentation on Performance Testing of Big Data Application was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Harpreet Kaur Kahai
All You Need To Know About Big Data Testing - Bahaa Al Zubaidi.pdfBahaa Al Zubaidi
Bahaa Al Zubaidi refers big data to a massive collection of data. It is enormous in variety, volume and velocity. Any standalone traditional computing technique is capable of managing Big Data.
This presentation will describe the analytics-to-cloud migration initiative underway at Fannie Mae. The goal of this effort is threefold: (1) build a sustainable process for data lake hydration on the cloud and (2) modernize the Fannie Mae enterprise data warehouse infrastructure and (3) retire Netezza.
Fannie Mae partnered with Impetus for modernization of its Netezza legacy analytics platform. This involved the use of the Impetus Workload Migration solution—a sophisticated translation engine that automated the migration of their complex Netezza stored procedures, shell and scheduler scripts to Apache Spark compatible scripts. This delivered substantial savings in time, effort and cost, while reducing overall project risk.
Included in the scope of the automation project was an automated assessment capability to perform detailed profiling of the current workloads. The output from the assessment stage was a data-driven offloading blueprint and roadmap for which workloads to migrate. A hybrid cloud-based big data solution was designed based on that. In addition to fulfilling the essential requirement of historical (and incremental) data migration and automated logic translation, the solution also recommends optimal storage formats for the data in the cloud, performing SCD Type 1 and Type 2 for mission-critical parameters and reloading the transformed data back for reporting/analytical consumption.
This will include the following topics:
i. Fannie Mae analytics overview
ii. Why cloud migration for analytics?
iii. Approach, major challenges, lessons learned
Speaker
Kevin Bates, Vice President for Enterprise Data Strategy Execution, Fannie Mae
CSC - Presentation at Hortonworks Booth - Strata 2014Hortonworks
Come hear about how companies are kick-starting their big data projects without having to find good people, hire them, and get IT to prioritize it to get your project off the ground. Remove risk from your project, ensure scalability , and pay for just the nodes you use in a monthly utility pricing model. Worried about Data Governance, Security, want it in the cloud, can’t have it in the cloud….eliminate the hurdles with a fully managed service backed by CSC. Get your modern data architecture up and running in as little as 30 days with the Big Data Platform As A Service offering from CSC. Computer Science Corporation is a Certified Technology Partner of Hortonworks and is a Global System Integrator with over 80,000 employees globally.
Data summit connect fall 2020 - rise of data opsRyan Gross
Data governance teams attempt to apply manual control at various points for consistency and quality of the data. By thinking of our machine learning data pipelines as compilers that convert data into executable functions and leveraging data version control, data governance and engineering teams can engineer the data together, filing bugs against data versions, applying quality control checks to the data compilers, and other activities. This talk illustrates how innovations are poised to drive process and cultural changes to data governance, leading to order-of-magnitude improvements.
Maximizing Oil and Gas (Data) Asset Utilization with a Logical Data Fabric (A...Denodo
Watch full webinar here: https://bit.ly/3g9PlQP
It is no news that Oil and Gas companies are constantly faced with immense pressure to stay competitive, especially in the current climate while striving towards becoming data-driven at the heart of the process to scale and gain greater operational efficiencies across the organization.
Hence, the need for a logical data layer to help Oil and Gas businesses move towards a unified secure and governed environment to optimize the potential of data assets across the enterprise efficiently and deliver real-time insights.
Tune in to this on-demand webinar where you will:
- Discover the role of data fabrics and Industry 4.0 in enabling smart fields
- Understand how to connect data assets and the associated value chain to high impact domain areas
- See examples of organizations accelerating time-to-value and reducing NPT
- Learn best practices for handling real-time/streaming/IoT data for analytical and operational use cases
Strengthening the Quality of Big Data ImplementationsCognizant
The increasing volume of big data has also increased the need to assure the quality of these critical assets. It is now essential for organizations to deploy customizable testing platforms and frameworks. An open, robust validation framework like Hadoop can significantly improve high-volume big data testing.
Implement Big Data Testing in Order to Successfully Generate Analytics. This Blog is ideal for software testers and anyone else who wants to understand big data testing.
Horses for Courses: Database RoundtableEric Kavanagh
The blessing and curse of today's database market? So many choices! While relational databases still dominate the day-to-day business, a host of alternatives has evolved around very specific use cases: graph, document, NoSQL, hybrid (HTAP), column store, the list goes on. And the database tools market is teeming with activity as well. Register for this special Research Webcast to hear Dr. Robin Bloor share his early findings about the evolving database market. He'll be joined by Steve Sarsfield of HPE Vertica, and Robert Reeves of Datical in a roundtable discussion with Bloor Group CEO Eric Kavanagh. Send any questions to info@insideanalysis.com, or tweet with #DBSurvival.
7 Emerging Data & Enterprise Integration Trends in 2022Safe Software
2021 was a year full of unexpected data integration challenges, but one thing that didn’t change was the continued growth of the importance and value of data. By watching our customers adapt and cope through the consistent application of technology, we’ve learned that the future can be quickly adjusted to if we have up-to-date and readily available data to make decisions.
As we consider the data integration landscape and look forward into 2022, we see a set of trends (some new, some old) that data leaders will need to consider as they work to provide competitive business value to their organizations:
- The Continued Importance of Spatial
- Data Ops as a Practice
- Rising Data Volumes Demand Data Quality
- Ubiquitous Hardware Supporting Augmented Reality
- Agile Enterprise Integration Effortlessly Connects Systems
- Real-Time Data Stream Processing
- Flexible, Hybrid Deployment Options
- Cost effective ARM based processing
In this webinar, join co-founders Don Murray and Dale Lutz as they offer insight and predictions on what’s to come in these areas. To follow, they’ll host a Q&A session where you can get feedback and advice on solutions to your data challenges.
Cassandra Summit 2014: Internet of Complex Things Analytics with Apache Cassa...DataStax Academy
Speaker: Mohammed Guller, Application Architect & Lead Developer at Glassbeam.
Learn how Cassandra can be used to build a multi-tenant solution for analyzing operational data from Internet of Complex Things (IoCT). IoCT includes complex systems such as computing, storage, networking and medical devices. In this session, we will discuss why Glassbeam migrated from a traditional RDBMS-based architecture to a Cassandra-based architecture. We will discuss the challenges with our first-generation architecture and how Cassandra helped us overcome those challenges. In addition, we will share our next-gen architecture and lessons learned.
Webinar: Faster Big Data Analytics with MongoDBMongoDB
Learn how to leverage MongoDB and Big Data technologies to derive rich business insight and build high performance business intelligence platforms. This presentation includes:
- Uncovering Opportunities with Big Data analytics
- Challenges of real-time data processing
- Best practices for performance optimization
- Real world case study
This presentation was given in partnership with CIGNEX Datamatics.
Comcast Labs Connect - PHLAI Conference Philadelphia 2018 Open Data Group
Open Data Group's Product Manager Rehgan Avon Speaks about Achieving AI and ML Operational Excellence at the Comcast Labs Connect - Artificial Intelligence And Machine Learning Conference in Philadelphia 2018.
Similar to ATAGTR2017 Performance Testing and Non-Functional Testing Strategy for Big Data Applications (20)
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...Agile Testing Alliance
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to Great: Enhancing Testability in Software Testing " at ATAGTR2023
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In T...Agile Testing Alliance
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In The Age of AI? " at ATAGTR2023
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Per...Agile Testing Alliance
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Performance: Leveraging Grafana and Selenium for Real-Time Issue Alerts" at ATAGTR2023
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...Agile Testing Alliance
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigating the IoT Performance Testing Landscape" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...Agile Testing Alliance
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.Agile Testing Alliance
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...Agile Testing Alliance
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test coverage" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...Agile Testing Alliance
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificial Intelligence" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...Agile Testing Alliance
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...Agile Testing Alliance
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to automate performance test script development using Jmeter" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...Agile Testing Alliance
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Quality Engineering in Remote IoT System" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...Agile Testing Alliance
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Testing Oversight Using Environment Automation" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...Agile Testing Alliance
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...Agile Testing Alliance
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance – Journey from Centralized to Decentralized, Distributed Blockchain/Web3 testing" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...Agile Testing Alliance
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.Agile Testing Alliance
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...Agile Testing Alliance
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolutionizing Security Testing with AI" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Dat...Agile Testing Alliance
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Datta, "A Holistic Testing Methodology for Immersive Experience in AR, VR, and the Metaverse" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...Agile Testing Alliance
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functional Testing with Support Vector Machines: An Experimental Journey" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
2. Agile Testing Alliance Global Testing Retreat 2017
What is BigData
Motivation
Data Acquisition HDFS ARCHITECTURE
Why Performance testing
Performance testing approach
Security
Summary
Content
3. Agile Testing Alliance Global Testing Retreat 2017
In pioneer days they used oxen for heavy pulling, and when one ox couldn’t budge a log, they didn’t try to grow a larger ox. We shouldn’t be trying for bigger computers, but
for more systems of computers.
—Grace Hopper
What is BigData?
4. Agile Testing Alliance Global Testing Retreat 2017
Resilient to failure
Highly scalable
Cost Effective
Flexible
Fast to process massive volumes of data
Resilient to failure
SAMPLE
EXPLORE
MODIFY
MODEL
ASSESS
Motivation
With the advent of Digital platform, data creation has outgrown
data storage and processing capabilities of single server. This has led
to design new frameworks and tools to keep pace with the data
generation and use it for competitive advantage.
5. Agile Testing Alliance Global Testing Retreat 2017
Apache Flume
SinkSource Channel
SinkChannel
SinkChannel
Source
Source
Agent
Agent
App
Logs Name Node
Data Node
Teradata Sqoop
HDFS clients talk to NameNode
for metadata-related activities,
and DataNodes to read and write
files
The HDFS NameNode keeps in memory the
metadata about the filesystem, such as
which DataNodes manage the blocks for
each file
DataNodes communicate with each
other for pipeline file reads and
writes
Data is split and stored
on the HDFS
Data in the HDFS
distributed over many
nodes for fault
tolerance
HDFS has 1-2 name
node and many
slave/data nodes
Name nodes and data
Nodes reside on
commodity servers
Each node/server
offers local storage and
computation
Data Acquisition & HDFS
Structured Data
Unstructured Data
Concept of Hadoop is to move the processing to data store and not move the data to the processing system
6. Agile Testing Alliance Global Testing Retreat 2017
Why Performance Testing?
Rise in digital platforms to engage
customers has generate massive
volumes of data
Increase in compliance cost due
to regulatory demand
Upsurge in competition
Numerous technologies with high
interactions
Minimal application downtime
Need
Increase customer base by harnessing data from digital
channels (Mobile, Website, Social)
Reduce compliance and operational cost in maintaining
data
Faster decisions using advanced data analytics
High availability of systems and reduced down time
Low Maintenance cost
Minimal Data loss
Benefits
Opportunity
7. Agile Testing Alliance Global Testing Retreat 2017
7
Performance Testing Approach
Setup BigData
Application
Identify and Design
Workload
Prepare Individual
Client
Execution and
Analysis
Optimum
Configuration
Tune Components and
Deployment
Performance testing for big data application involves testing of huge volumes of structured and unstructured data, and it requires a specific testing
approach to test such massive data.
Level of Parallelism
Serialization Format
Memory Management
User Code
Hardware Provisioning
Key Performance Considerations
Key Performance Indicators
HDFS metrics
Namenode metrics:
• Capacity Remaining
• Corrupt Blocks/Missing Blocks
• Volume Failures Total
• Num Live Data Node/Num Dead Data Node
• Files Total
• Total Load
• Block Capacity/Block Total
• Under Replicated Block
• Num Stale Data Nodes
Data Node Metrics:
• Remaining
• Num Failed Volumes
Key Performance Indicators
Yarn Metrics
Cluster Metrics:
• Unhealthy Nodes
• Active Nodes
• Lost Nodes
• Apps Failed
• Total MB/allocated MB
Application Metrics :
• Progress
Node Manager Metrics:
• Containers Failed
8. Agile Testing Alliance Global Testing Retreat 2017
8
Security
• File permission system in HDFS prevents one user from
accidently wiping out the whole filesystem.
• It doesn’t prevent a malicious user from assuming root’s
identity to access or delete any data in the cluster.
• To meet regulatory requirements for data protection,
secure authentication must be in place for shared cluster.
• This let to implementation of Kerberos, a mature open
source network authentication protocol to authenticate
the user.
Source : Hadoop the Definitive Guide
hadoop fs –rmr /
9. Agile Testing Alliance Global Testing Retreat 2017
Customer Needs
Data loading in Hadoop for
various scenarios
Transform unstructured data
into Structure data
Workload models using Hive
The Solution
• Cognizant helped finalize the Non-functional requirements and the data loading strategy during planning.
• A performance monitoring strategy was defined
• Team provided recommendations to resolve the issues related to scalability, memory and improve e2e execution timings
• Recommendations were implemented and framework was successfully operationalised in production setting
Cognizant needed to define
approach for testing, identify
monitoring tool for Hadoop,
provide recommendation for
data loading and create
performance testing strategy.
Due to huge data-volume,
performance monitoring on
Hadoop was required to
inspire stakeholder’s
confidence in performance
Challenges
• Historical Data Retention
• Delay in getting the required
results from data mining
• New technology
• NFT enabled successful testing
of the framework and provided
various solutions for tuning the
framework
• An enhanced approach was
created from the lessons learnt
Client decided to move to Bigdata
Hadoop. Huge volume of
transactions data (multi terabytes)
from production was moved onto
Hadoop platform.
Case Study
• The client – a U.S. insurer, is a major writer of commercial property casualty and personal insurance
• The Personal Insurance Line of Business developed a framework to consume all the application logs and DB
data and to use the data to troubleshoot production issues, understand user pattern, forecast transactions
and create workload model.
Case Study
11. Agile Testing Alliance Global Testing Retreat 2017
• There is no doubt that performance testing of Big Data applications is a pressing need. It not only is necessary to
validate applications’ reliability under massive data flow and several computations, but also is essential to validate
applications’ robustness and minimal data loss.
• Some of the benefits of the above performance testing approach:
is to validate application stability under heavy data load
achieve high code efficiency which transforms and take action on the data.
Establish a framework for validating infrastructure and
Drives any server related changes, should there are memory or CPU related errors.
• This has also paved a way for us to explore various other areas such as
forecasting transaction response time from current operation metrics,
predicting efficient workload models across IT infrastructure and
predicting production bottlenecks.
Summary