Exactpro Non-Functional Testing at London Stock Exchange

•Download as PPT, PDF•

1 like•274 views

QA-Financial Forum in London 5 April 2017 Iosif Itkin, Exactpro CEO & Co-Founder London Stock Exchange Group Non-Functional Testing at London Stock Exchange Exactpro is the specialist testing subsidiary of the London Sock Exchange Group. Iosif Itkin, CEO, will cover the wide range of testing requirements beyond the requirements of function al testing that confront client firms including broker-dealers, exchanges and banks. Following his presentation, QA Financial will interview Jeremy Norwood, Director PMO at Tradition, the leading IDB, along with Iosif Itkin, and dive into the detail of some of those challenges. http://exactpro.com

Non-Functional Testing at
London Stock Exchange
5 April 2017
Iosif Itkin, Exactpro CEO & Co-Founder
London Stock Exchange Group
Open Access Quality Assurance & Related Software Development for Financial Markets
Tel: +7 495 640 2460, +1 415 830 38 49
www.exactpro.com

2
Clients
Worldwide:
Software Quality Assurance
experts for global financial
markets enjoying steady
growth thanks to expertise
and unparalleled service
Exactpro is:

3
London Stock Exchange Group
1/8 of employees
working in QA
128m of
transactions
per day near Brexit
and US elections
84 microseconds
equity markets
roundtrip times

4
No Trust
No Fear
No Begging
Question Everything. Keep Calm. Be Confident.

7
Heavy Load - Easy
Finding Functional Problems - Difficult

10
Testing Methods
1.
3.
Simulate real trading participants
2.

11
Diverse and Relevant Load / Validation
1. Random load “Pace Maker” 2. Variety of Passive Liquidity
3. “Aggressors” try to interact with
the market to increase the number
of test cases happening in the
environment
4. Analyze the situation in retrospect. Make
sure that what happened is correct. Tick
checkboxes against tests that were actually
executed
Updated
test
library

12
Failover Tests and Catching
In-Flight Transactions

14
Keep Calm
• Unrealistic Scenarios
• Annihilate the System Under Test
• Repeat the Same Tests Many Times
• Load Levels that Exceed Presumed Production

16
• Test Tools
• Confirmation that PROD is Configured as TEST
• Max Load Figure
• Load Scenarios for Existing Production System
• All Test Scenarios in Advance
• Constant Support
Do Not Beg For:

17
“Train Hard, Fight Easy” (A. Suvorov)
http://img-fotki.yandex.ru/get/31286/15397073.5e9/0_167068_902ac8e_XL
http://gsvu.mvd.ru/upload/site142/folder_page/temp/__1429820772_866/fb3fa781009c14
b1cfb62847cf9f9485.jpg
Suvorov battling his way through the snow-capped Alps

18
Open Access Software Testing
www.exactpro.com

19
Questions & Answers
https://ru.linkedin.com/in/iosifitkin
The seventh EXTENT conference will take place in
London, UK.
Find out more:
www.extentconf.com
– LSEG Technology and Quality Assurance
– Risk controls and FPGA
– Market Surveillance systems
– Blockchain and trading technology trends
– Artificial intelligence

16 October 2017 Sibos Toronto Presentation by Iosif Itkin, Exactpro CEO and co-founder London Stock Exchange Group Disruptive functional testing - the next frontier in post-trade systems verification The operators of complex back office and post-trade systems interconnected by SWIFT and other communication protocols are trying to keep pace with the front office technology advances, rising data volumes and changing regulatory landscape. The industry actively adopts flexible development methodologies to speed up the software delivery process. What aspects of software quality are not covered by regular performance / failover testing and the agile development life cycle? Disruptive functional testing is a way to prepare your mission-critical infrastructure for any challenges the future may bring. Ideas for this presentation are drawn from our work with LCH, T2S, clearing and settlement systems worldwide.

FIX EMEA Conference 2018 - Post Trade Software Testing Challenges

Iosif Itkin

Integration front to back - Mr. Custodian tear down that wall The scope of the application level has been continuous extended over the years, albeit with a focus on the area of pre-trade and trade. Recently, there has been an increased interest to move further into the area of post-trade which is predominantly driven by the ISO 20022 standard. Is there really a need for new FIX messages in areas such as payments and what are the integration problems needing a resolution? Panellists - Iosif Itkin, CEO, Exactpro - Jim Northey, Co-Chair Global Technical Committee, Americas Region, FIX Trading Community, Chair Elect, ISO TC68 Financial Services Technical Committee, and Consultant and Industry Standards Liaison, Itiviti - Barry Young, Director, Aladdin Product Manager, BlackRock

EXTENT-2017: Independent QA in Agile

Iosif Itkin

EXTENT-2017: Software Testing & Trading Technology Trends Conference 29 June, 2017, 10 Paternoster Square, London Independent QA in Agile Anton Sitnikov, Chief Software Architect, Exactpro, LSEG Would like to know more? Visit our website: extentconf.com Follow us: https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym https://twitter.com/exactpro #extentconf #exactpro

EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework

Iosif Itkin

EXTENT-2016: Software Testing & Trading Technology Trends 22 June, 2016, 10 Paternoster Square, London Managing QA for Complex Systems in Agile Development Framework Alexey Zverev, CEO, Exactpro, LSEG Would like to know more? Visit our website: extentconf.com Follow us: https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym https://twitter.com/exactpro #extent2016 #exactpro

Using Cluster Analysis for Characteristics Detection in Software Defect Reports

Iosif Itkin

Anna Gromova and Olga Moskaleva, Exactpro Researchers, participated in the Sixth International Conference on Analysis of Images, Social Networks and Texts, AIST 2017 AIST is a conference on the Analysis of Images, Social Networks, and Texts. This year, it was held at Moscow Polytechnic University on June 27-29. The conference is intended for computer scientists and industry professionals whose research interests involve applications of data mining and machine learning techniques to various problem domains: image processing, analysis of social networks, and natural language processing. AIST boasts its interdisciplinary nature, bridging the gap between researchers and practitioners. All research papers submitted to the conference went through a double-blind reviewing process and were reviewed by at least three program committee members. The accepted papers were presented by their authors on July 27 and 28. Anna Gromova’s research on Using Cluster Analysis for Characteristics Detection in Software Defect Reports was among this year’s accepted papers. Anna, who is an Exactpro researcher, presented her work in the General Topics of Data Analysis section of the conference. Anna’s research focuses on the metrics and predictions of defect reports. In her research paper, Anna explores the workings of how extended bug attribute analysis can effectively reveal software weaknesses and improve the testing strategy, and how machine learning techniques can facilitate the process of building an automated recommendation system for project managers and QA team leads. Such a system would help them get a better picture of the risks associated with software defects, as well as obtain more accurate information about a bug's lifecycle. “In future, we are planning to build an automated recommendation system based on the cluster analysis of our defect reports. A system like that could be used by all QA team members to improve the existing processes of developing the testing strategies and plans”, says Anna Gromova, Exactpro Researcher.

Иосиф Иткин, Exactpro - TBA

AIST

EXTENT-2015: A Test Harness for Algo Trading Systems

Iosif Itkin

Difficulties in coping with functional complexity experienced by the project team: • Aligning tests correctly in batches that correspond to events in the daily life cycle, including multiple days • Accelerating the daily life cycle to speed up test execution and to cover Settlement Failure processes in testing within a reasonable timeframe • Accurately simulating and controlling test inputs from upstream systems and outputs to downstream systems • Management of complex Reference Data setup • Involvement of complex components such as Risk Management and Collateral Management systems • Test cycle turnaround time, client certification and test automation Keynote Speakers: Alyona Lamash FRM Head of Risk Management Practice, Exactpro Systems Mark Ryland Financial Markets Technology Consultant, Independent Consulting, United Kingdom

QA management at Exactpro (5)Alexey Zverev

Continuous Delivery for people who do not write code - Matthew Skelton - Conflux

Matthew Skelton

Continuous Delivery is a proven set of practices for reliable software releases through build, test, and deployment automation. Organisations around the world have adopted Continuous Delivery (CD) to increase speed and safety of software changes whilst reducing errors and problems in Production. This talk is an overview of Continuous Delivery for people who do not write code. If you are a delivery manager, project manager, release manager, operations person, business analyst, or anyone else involved in the building, testing, releasing, and running of software systems, this talk will give you an understanding of what Continuous Delivery is about and how it feels to be part of a CD organisation. (From a talk given in Leeds, UK on 24 Sept 2018)

Testistanbul 2016 - Formula 1, Continuous Integration, Continuous Delivery an...

Turkish Testing Board

EXTENT-2016: The Future of Software Testing

Iosif Itkin

Barabanov iccc 2014 (2)

Alexander Barabanov

Non-Functional Testing at London Stock Exchange

Iosif Itkin

29 November 2016 Harvard Club, New York, QA-Financial Forum Exactpro is the specialist testing subsidiary of the London Stock Exchange Group. In this presentation, Iosif Itkin will cover the wide range of testing requirements faced by broker-dealers, banks and exchanges beyond the requirements of functional testing. Plus: In Conversation with Yann L’Huillier, CIO, Tradition and Iosif Itkin, CEO, Exactpro - Iosif Itkin: Exactpro CEO – The London Stock Exchance Group - Yann L’Huillier: Group Chief Information Officer – Tradition

Верификация технологических платформ Лондонской фондовой биржи

Iosif Itkin

Technology Risk Modeling and Analysis Seminar - Exchange Trading

Iosif Itkin

EXTENT-2015: Big Button 2.0

Iosif Itkin

ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...

Iosif Itkin

FinTester - Test Your Call Put Options Strategies

FinIdeas Management Solutions Pvt. Ltd.

Innovation in Quality Assurance – What is the Impact on Trading technology?

Iosif Itkin

Realising the true value of DevOps

tlevey

FAPI / Open Banking Conformance #fapisum - Japan/UK Open Banking and APIs Sum...

FinTechLabs.io

OpenChain Germany Work Group Meeting 1

Shane Coughlan

EXTENT-2015: LSEG Technology Overview

Iosif Itkin

Capital MarketsThinksoft Global

Solving the 3 Biggest Questions in Continuous Testing

Perfecto by Perforce

Software testing tools are evolving. More testing frameworks are emerging through the open source community and commercial vendors. In addition, we’re starting to see the rise of machine-learning (ML) and artificial intelligence (AI) in testing solutions. Given this evolution, it is important to map the tools that match both the practitioners’ skills and their testing types. When referring to the testing practitioners, we mainly look at three different personas: -The business tester -The software developer in test (SDET) -The software developer These practitioners are tasked with creating, maintaining, and executing unit tests, build acceptance tests, integration, regression, and other nonfunctional tests. In this webinar led by Perfecto’s Chief Evangelist, Eran Kinsbruner, you will learn the following: -How should testing types be dispersed among the three personas and throughout the DevOps pipeline? -What tools should each of these three personas use for the creation and execution of tests? -What are the key benefits to continuous testing when mapped correctly?

Open Source Security: How to Lay the Groundwork for a Secure Culture

WhiteSource

Open-source components are prevalent in approximately 97% of modern applications and dominate anywhere between 60-80% of their codebases. This is hardly surprising given how integrating open source accelerates software development and enables organizations to keep up with today's frantic release pace and standards of constantly supplying new features and improvements. However, taking into consideration the fact that recent years have seen an upsurge in reported open-source vulnerabilities, whose details and exploits are publicly available, it's no wonder that organizations are increasingly directing focus towards ensuring that their open-source components are securely integrated into their software. Join Guy Bar-Gil, Product Manager at WhiteSource, as he discusses: 1. The four layers of open-source security 2. How to integrate continuous security into your SDLC 3. Best practices for organizations to own and execute the security process

Open Source Security: How to Lay the Groundwork for a Secure Culture

DevOps.com

Open-source components are prevalent in approximately 97% of modern applications and dominate anywhere between 60-80% of their codebases. This is hardly surprising given how integrating open source accelerates software development and enables organizations to keep up with today's frantic release pace and standards of constantly supplying new features and improvements. However, taking into consideration the fact that recent years have seen an upsurge in reported open-source vulnerabilities, whose details and exploits are publicly available, it's no wonder that organizations are increasingly directing focus towards ensuring that their open-source components are securely integrated into their software. Join Guy Bar-Gil, Product Manager at WhiteSource, as he discusses: The four layers of open-source security; How to integrate continuous security into your SDLC; Best practices for organizations to own and execute the security process.

The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder

tlevey

What's hot

Delivering Large Post-Trade Initiatives: Quality Assurance and Key Challenges

Iosif Itkin

QA management at Exactpro (5)Alexey Zverev

Continuous Delivery for people who do not write code - Matthew Skelton - Conflux

Matthew Skelton

Testistanbul 2016 - Formula 1, Continuous Integration, Continuous Delivery an...

Turkish Testing Board

EXTENT-2016: The Future of Software Testing

Iosif Itkin

Barabanov iccc 2014 (2)

Alexander Barabanov

What's hot (6)

Delivering Large Post-Trade Initiatives: Quality Assurance and Key Challenges

QA management at Exactpro (5)

Continuous Delivery for people who do not write code - Matthew Skelton - Conflux

Testistanbul 2016 - Formula 1, Continuous Integration, Continuous Delivery an...

EXTENT-2016: The Future of Software Testing

Barabanov iccc 2014 (2)

Similar to Exactpro Non-Functional Testing at London Stock Exchange

Non-Functional Testing at London Stock Exchange

Iosif Itkin

Верификация технологических платформ Лондонской фондовой биржи

Iosif Itkin

Technology Risk Modeling and Analysis Seminar - Exchange Trading

Iosif Itkin

EXTENT-2015: Big Button 2.0

Iosif Itkin

ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...

Iosif Itkin

FinTester - Test Your Call Put Options Strategies

FinIdeas Management Solutions Pvt. Ltd.

Innovation in Quality Assurance – What is the Impact on Trading technology?

Iosif Itkin

Realising the true value of DevOps

tlevey

FAPI / Open Banking Conformance #fapisum - Japan/UK Open Banking and APIs Sum...

FinTechLabs.io

OpenChain Germany Work Group Meeting 1

Shane Coughlan

EXTENT-2015: LSEG Technology Overview

Iosif Itkin

Capital MarketsThinksoft Global

Solving the 3 Biggest Questions in Continuous Testing

Perfecto by Perforce

Open Source Security: How to Lay the Groundwork for a Secure Culture

WhiteSource

Open Source Security: How to Lay the Groundwork for a Secure Culture

DevOps.com

Open-source components are prevalent in approximately 97% of modern applications and dominate anywhere between 60-80% of their codebases. This is hardly surprising given how integrating open source accelerates software development and enables organizations to keep up with today's frantic release pace and standards of constantly supplying new features and improvements. However, taking into consideration the fact that recent years have seen an upsurge in reported open-source vulnerabilities, whose details and exploits are publicly available, it's no wonder that organizations are increasingly directing focus towards ensuring that their open-source components are securely integrated into their software. Join Guy Bar-Gil, Product Manager at WhiteSource, as he discusses: The four layers of open-source security; How to integrate continuous security into your SDLC; Best practices for organizations to own and execute the security process.

The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder

tlevey

Six cigma AJAL

AJAL A J

Fundamentals of Testing

Code95

Testing Is How You Avoid Looking Stupid

Steve Branam

Presented at With The Best IOT online conference, Oct 14 2017: As IOT products become more pervasive, they have an increasing ability to adversely affect the lives of their users and those around them. Testing is the due diligence that closes the engineering loop to verify proper behavior. This presents an introductory overview to testing for IOT products, covering the IOT triad: embedded IOT devices, backend servers, and frontend apps. I talk about the consequences of inadequate testing for companies and individual contributors, and levels and types of testing.

Hgch1

PUise Thitalampoon

Similar to Exactpro Non-Functional Testing at London Stock Exchange (20)

Non-Functional Testing at London Stock Exchange

Верификация технологических платформ Лондонской фондовой биржи

Technology Risk Modeling and Analysis Seminar - Exchange Trading

EXTENT-2015: Big Button 2.0

ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...

FinTester - Test Your Call Put Options Strategies

Innovation in Quality Assurance – What is the Impact on Trading technology?

Realising the true value of DevOps

FAPI / Open Banking Conformance #fapisum - Japan/UK Open Banking and APIs Sum...

OpenChain Germany Work Group Meeting 1

EXTENT-2015: LSEG Technology Overview

Capital Markets

Solving the 3 Biggest Questions in Continuous Testing

Open Source Security: How to Lay the Groundwork for a Secure Culture

The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder

Six cigma AJAL

Fundamentals of Testing

Testing Is How You Avoid Looking Stupid

Hgch1

More from Iosif Itkin

Foundations of Software Testing Lecture 4

Iosif Itkin

This lecture is a part of the online course on Software Testing for Complex Intelligent Systems and Autonomous Vehicles. The course lectures provide the theoretical basics of testing autonomous systems based on artificial intelligence. The fourth lecture of the course entitled Foundations of Software Testing reviews the ‘absence-of-errors fallacy’ and other principles of software testing, as well as the types and levels of software testing. The lecture also provides a fuller picture of the understanding of test objectives and methodologies by different schools of thought within the software testing domain.

QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...

Iosif Itkin

Speaker: Iosif Itkin, co-CEO & co-founder, Exactpro Systems 9th November 2021 Hilton Canary Wharf Exactpro is an independent software testing business focused on mission-critical financial market infrastructures, primarily exchanges and clearing houses. In his presentation, Iosif will give a brief overview of research on the concept of model-based testing and the principal challenges of its application while testing complex distributed systems. He will also outline the broader context of interaction between humans and complex computer models.

Exactpro FinTech Webinar - Global Exchanges Test Oracles

Iosif Itkin

Global Exchanges series webinar to discuss Test Oracles. A test oracle is a mechanism for determining whether a test has passed or failed. The use of oracles involves comparing the output(s) of the system under test for a given test-case input, to the output(s) that the oracle determines the product should have. We will review various types of test oracles using examples from Exactpro’s Global Exchanges division projects and protocol-based interactions in trading systems.

Exactpro FinTech Webinar - Global Exchanges FIX Protocol

Iosif Itkin

Operational Resilience in Financial Market Infrastructures

Iosif Itkin

A4Q World Congress 13-16 April 2021 Iosif Itkin Exactpro provides independent software testing services for mission critical technology that underpins global financial markets – exchanges and clearing houses. Half of the top 20 global exchange groups on all continents around the globe rely on processes, platforms and people from Exactpro to improve their quality and reliability. The company has spent the last 11 years studying operational resilience in this crucial sector. The presentation will outline the key principles for software testing of the systems that process hundreds of millions of orders per day with roundtrip latencies below one hundred microseconds.

20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season

Iosif Itkin

Testing the Intelligence of your AI

Iosif Itkin

QA-Financial Forum 2019 in New York 13 November Iosif Itkin, CEO and co-founder Elena Treshcheva, Business Development Manager and Researcher An October 2019 survey by BoE and FCA found that ML in financial organizations has already passed an initial development phase, and the usage of live ML applications is about to dramatically increase over the next three years. Artificial Intelligence systems are used in market surveillance, they are providing intellectual analysis of news feeds, and they are an important part of the conversational agents facing users and helping them with their business needs from identity verification to trading and portfolio management. How to ensure that an AI-powered system is up to its task? And what would that mean from the software testing perspective?

EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures

Iosif Itkin

On Complex Software Systems Testing — Alexey Zverev, co-CEO & co-founder, Exactpro Software Testing and Machine Learning Mind the Gap. Applying Process Mining Learning from Failure is not just for Humans Dancing with Whales. Adaptive Log Classification System On Traceability and the Illusion of Control Building Partnerships Demystifying DLT Testing One Network at a Time Get the MOST from FIX Georgia on My Mind Build Software to Test Software — Iosif Itkin, co-CEO & co-founder, Exactpro

EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai

Iosif Itkin

EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open

Iosif Itkin

EXTENT Talks is a meeting place for IT specialists working in various industries and seeking professional growth, practitioners from IT firms, as well as Quality Assurance enthusiasts of all backgrounds interested in actively participating in local IT events. The first EXTENT Talks were held in Tbilisi on 22 February 2019, initiating the creation a QA Community in Tbilisi and laying a foundation for an international platform for exchanging experience and knowledge in the field of software testing, development and IT. The program of the inaugural event included presentations on ISTQB, Software Testing, and Agile methodology from senior specialists. The next EXTENT Talks in Tbilisi will take place on 20 April 2019.

User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...

Iosif Itkin

QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and...

Iosif Itkin

Speakers: Iosif Itkin, CEO and Co-Founder and Elena Treshcheva, Business Development Manager and Researcher - Exactpro Exactpro provides software testing services for mission-critical technology that underpins global financial markets. Exactpro clients are regulated by FCA, Bank of England and their counterparts from other countries. During this session, Elena and Iosif will talk about end-to-end software testing for post-trade systems in financial market infrastructures. What are the key challenges in quality assurance at this scale? What kind of cognitive biases affect SDLC? How precise is the knowledge about the systems under test? What constitutes good test evidence? How to deal with complexity in regulated environments?

QA Community Saratov: Past, Present, Future (2019-02-08)

Iosif Itkin

Machine Learning and RoboCop Testing

Iosif Itkin

Behaviour Driven Development: Oltre i limiti del possibile

Iosif Itkin

The QA Financial Forum: Milan 2019 23 January at the Excelsior Hotel Gallia. Anna-Maria Lukina, Exactpro Business Development Director The QA Financial Forum: Milan is one of the leading fintech conferences in Italy. The event focuses on the latest achievements in software risk management and automation of software testing. The predominant theme of the Milan event will be Quality Assurance for the entire Software Development Life Cycle (SDLC). The topics under discussion will feature: - Technologies for Automation & AI - DevOps & CI/CD - Value Stream Management - Test Data Management - Regulatory Compliance - App Security & DevSecOps - Testing and quality assurance of Blockchain platforms The official language of the event is Italian.

2018 - Exactpro Year in Review

Iosif Itkin

Exactpro Discussion about Joy and Strategy

Iosif Itkin

BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)

Iosif Itkin

Exactpro is supporting the 3rd annual IT-conference YouCon to take place on 14th October in Saratov, Russia. Over 900 programmers, systems engineers and architects, software QA engineers, and marketing specialists will gather to discuss the latest trends in programming technology. It is the largest IT industry event in Saratov. Iosif Itkin, CEO of Exactpro, part of London Stock Exchange Group, will deliver a "BDD. The Outer Limits" presentation named after Iosif's favorite Sci-Fi series. The topics to be covered are: Behavior Driven Development concepts Applying BDD in trading and clearing systems Specification by Example and using production data Combining Model-based testing and BDD The Outer Limits There will be an opportunity to ask questions, share thoughts and expertise in BDD, or just chat with a representative at the Exactpro stand at any time during the event. Don't miss out, stop by and ask how you can get your Exactpro souvenir :) We look forward to meeting you there! #Exactpro #Youconsaratov

EXTENT-2017: Testing in Distributed Ledger Systems

Iosif Itkin

EXTENT-2017: Software Testing & Trading Technology Trends Conference 29 June, 2017, 10 Paternoster Square, London Testing in Distributed Ledger Systems Arne Brutschy, CTO, RISE Financial Technologies Would like to know more? Visit our website: extentconf.com Follow us: https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym https://twitter.com/exactpro #extentconf #exactpro

EXTENT-2017: Re-Engineering Capital Market Business Models to Use Different T...

Iosif Itkin

EXTENT-2017: Software Testing & Trading Technology Trends Conference 29 June, 2017, 10 Paternoster Square, London Re-Engineering Capital Market Business Models to Use Different Technologies Brian Taylor, Managing Director, BTA Consulting Limited Would like to know more? Visit our website: extentconf.com Follow us: https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym https://twitter.com/exactpro #extentconf #exactpro

More from Iosif Itkin (20)

Foundations of Software Testing Lecture 4

QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...

Exactpro FinTech Webinar - Global Exchanges Test Oracles

Exactpro FinTech Webinar - Global Exchanges FIX Protocol

Operational Resilience in Financial Market Infrastructures

20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season

Testing the Intelligence of your AI

EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures

EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai

EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open

User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...

QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and...

QA Community Saratov: Past, Present, Future (2019-02-08)

Machine Learning and RoboCop Testing

Behaviour Driven Development: Oltre i limiti del possibile

2018 - Exactpro Year in Review

Exactpro Discussion about Joy and Strategy

BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)

EXTENT-2017: Testing in Distributed Ledger Systems

EXTENT-2017: Re-Engineering Capital Market Business Models to Use Different T...

Recently uploaded

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

Ramesh Iyer

In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Accelerate your Kubernetes clusters with Varnish Caching

Thijs Feryn

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Product School

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Recently uploaded (20)

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

When stars align: studies in data quality, knowledge graphs, and machine lear...

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Securing your Kubernetes cluster_ a step-by-step guide to success !

Accelerate your Kubernetes clusters with Varnish Caching

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Epistemic Interaction - tuning interfaces to provide information for AI support

Assuring Contact Center Experiences for Your Customers With ThousandEyes

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

JMeter webinar - integration with InfluxDB and Grafana

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

PCI PIN Basics Webinar from the Controlcase Team

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

UiPath Test Automation using UiPath Test Suite series, part 3

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Exactpro Non-Functional Testing at London Stock Exchange

1. Non-Functional Testing at London Stock Exchange 5 April 2017 Iosif Itkin, Exactpro CEO & Co-Founder London Stock Exchange Group Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com

2. 2 Clients Worldwide: Software Quality Assurance experts for global financial markets enjoying steady growth thanks to expertise and unparalleled service Exactpro is:

3. 3 London Stock Exchange Group 1/8 of employees working in QA 128m of transactions per day near Brexit and US elections 84 microseconds equity markets roundtrip times

4. 4 No Trust No Fear No Begging Question Everything. Keep Calm. Be Confident.

5. 5 Build Software to Test Software

6. 6 Heavy Load - Easy

7. 7 Heavy Load - Easy Finding Functional Problems - Difficult

8. 8 Latency Measurement

9. 9 Latency Measurement

10. 10 Testing Methods 1. 3. Simulate real trading participants 2.

11. 11 Diverse and Relevant Load / Validation 1. Random load “Pace Maker” 2. Variety of Passive Liquidity 3. “Aggressors” try to interact with the market to increase the number of test cases happening in the environment 4. Analyze the situation in retrospect. Make sure that what happened is correct. Tick checkboxes against tests that were actually executed Updated test library

12. 12 Failover Tests and Catching In-Flight Transactions

13. 13 Have No Fear

14. 14 Keep Calm • Unrealistic Scenarios • Annihilate the System Under Test • Repeat the Same Tests Many Times • Load Levels that Exceed Presumed Production

15. 15 Multiple Failover Scenarios

16. 16 • Test Tools • Confirmation that PROD is Configured as TEST • Max Load Figure • Load Scenarios for Existing Production System • All Test Scenarios in Advance • Constant Support Do Not Beg For:

17. 17 “Train Hard, Fight Easy” (A. Suvorov) http://img-fotki.yandex.ru/get/31286/15397073.5e9/0_167068_902ac8e_XL http://gsvu.mvd.ru/upload/site142/folder_page/temp/__1429820772_866/fb3fa781009c14 b1cfb62847cf9f9485.jpg Suvorov battling his way through the snow-capped Alps

18. 18 Open Access Software Testing www.exactpro.com

19. 19 Questions & Answers https://ru.linkedin.com/in/iosifitkin The seventh EXTENT conference will take place in London, UK. Find out more: www.extentconf.com – LSEG Technology and Quality Assurance – Risk controls and FPGA – Market Surveillance systems – Blockchain and trading technology trends – Artificial intelligence

Exactpro Non-Functional Testing at London Stock Exchange

Recommended

Recommended

More Related Content

What's hot

What's hot (6)

Similar to Exactpro Non-Functional Testing at London Stock Exchange

Similar to Exactpro Non-Functional Testing at London Stock Exchange (20)

More from Iosif Itkin

More from Iosif Itkin (20)

Recently uploaded

Recently uploaded (20)

Exactpro Non-Functional Testing at London Stock Exchange