Innovation in Quality Assurance – What is the Impact on Trading technology?Iosif Itkin
Agile methodologies and the death of software testing.
Can finance industry adopt the same formal methods that allowed NASA to reach Pluto?
Lessons learned from the Terminator/BS Galactica and the next generation of risk controls.
What is crowd-sourced verification in the age when machines rule the market?
Cognitive technologies and building test harness for algo trading systems.
High Frequency Trading Infrastructure and Quality AssuranceIosif Itkin
This document discusses high frequency trading infrastructure and quality assurance. It covers various issues that can arise such as "fat finger" errors, flash crashes, and system failures. It provides examples of past events like the Facebook IPO mishap on NASDAQ and Knight Capital's $460 million loss due to a software bug. Ensuring system reliability, monitoring for risks, and having proper safeguards in place like circuit breakers are important topics covered.
Technical User Group
Paris, 6 October 2016
Agenda
• Introduction
• London Stock Exchange Derivatives Market & IDEM - New Version for SOLA
• London Stock Exchange Group - GTP Updates
• Borsa Italiana - MIT R9.0 (incl. RFQs)
• London Stock Exchange / Turquoise Equities - MIT R9.1 (incl. RFQs)
• London Stock Exchange Group – TRADEcho
• London Stock Exchange - MITCH Decommissioning
• Exactpro - Overview
• Q & A Session
Tellefsen and Exactpro Systems Team Up to Help Clients with REG SCI
Meeting the demanding new requirements imposed upon firms by SEC Regulation SCI
is a key issue for many firms, especially in the areas of independent systems testing
and certification. Tellefsen and Company, L.L.C. (Tellefsen) and Exactpro Systems,
LLC (Exactpro) have today announced a marketing partnership in which both firms will
collaborate to provide key industry constituents with market structure consulting, financial
technology infrastructure testing and software quality assurance testing services.
Tellefsen is a management consulting firm founded in 1984 to provide counsel and
professional services to meet the growing needs of the financial services industry. The
firm’s principals and consultants have a wealth of experience in regulatory compliance
and U.S. market infrastructure (exchanges, ATS, dark pools etc). One of Tellefsen’s core
competencies has been is assisting firms with their regulatory compliance requirements
through technology analysis, planning, testing, and evidencing.
Exactpro is a rapidly growing quality assurance services firm specializing in market
infrastructure. Exactpro provides both functional and non-functional testing for global
exchanges, dark pools and clearing houses using a range of sophisticated in-house built
testing and evidencing tools.
John Rapa, President and CEO of Tellefsen, indicates: “The implementation of Reg SCI
is another example of market regulations where market participants must provide evidence
of their comprehensive infrastructure testing, policies and procedures and market oversight
compliance. We are delighted to team up with Exactpro whom we know from other customer
engagements. We are very impressed by their capabilities, diligence and effectiveness in
planning, executing and evidencing tests that prove regulatory compliance”.
Iosif Itkin, Co-Founder of Exactpro, says: “Our firm has a great set of tools and services that
we believe can help clients meet Regulation SCI in a cost effective manner. We are very
conversant with this domain and are delighted to be working with Tellefsen on this; our two
firms’ capabilities are entirely complementary”.
Reconciliation Testing Aspects
Elena Moiseeva, QA, Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
Innovation in Quality Assurance – What is the Impact on Trading technology?Iosif Itkin
Agile methodologies and the death of software testing.
Can finance industry adopt the same formal methods that allowed NASA to reach Pluto?
Lessons learned from the Terminator/BS Galactica and the next generation of risk controls.
What is crowd-sourced verification in the age when machines rule the market?
Cognitive technologies and building test harness for algo trading systems.
High Frequency Trading Infrastructure and Quality AssuranceIosif Itkin
This document discusses high frequency trading infrastructure and quality assurance. It covers various issues that can arise such as "fat finger" errors, flash crashes, and system failures. It provides examples of past events like the Facebook IPO mishap on NASDAQ and Knight Capital's $460 million loss due to a software bug. Ensuring system reliability, monitoring for risks, and having proper safeguards in place like circuit breakers are important topics covered.
Technical User Group
Paris, 6 October 2016
Agenda
• Introduction
• London Stock Exchange Derivatives Market & IDEM - New Version for SOLA
• London Stock Exchange Group - GTP Updates
• Borsa Italiana - MIT R9.0 (incl. RFQs)
• London Stock Exchange / Turquoise Equities - MIT R9.1 (incl. RFQs)
• London Stock Exchange Group – TRADEcho
• London Stock Exchange - MITCH Decommissioning
• Exactpro - Overview
• Q & A Session
Tellefsen and Exactpro Systems Team Up to Help Clients with REG SCI
Meeting the demanding new requirements imposed upon firms by SEC Regulation SCI
is a key issue for many firms, especially in the areas of independent systems testing
and certification. Tellefsen and Company, L.L.C. (Tellefsen) and Exactpro Systems,
LLC (Exactpro) have today announced a marketing partnership in which both firms will
collaborate to provide key industry constituents with market structure consulting, financial
technology infrastructure testing and software quality assurance testing services.
Tellefsen is a management consulting firm founded in 1984 to provide counsel and
professional services to meet the growing needs of the financial services industry. The
firm’s principals and consultants have a wealth of experience in regulatory compliance
and U.S. market infrastructure (exchanges, ATS, dark pools etc). One of Tellefsen’s core
competencies has been is assisting firms with their regulatory compliance requirements
through technology analysis, planning, testing, and evidencing.
Exactpro is a rapidly growing quality assurance services firm specializing in market
infrastructure. Exactpro provides both functional and non-functional testing for global
exchanges, dark pools and clearing houses using a range of sophisticated in-house built
testing and evidencing tools.
John Rapa, President and CEO of Tellefsen, indicates: “The implementation of Reg SCI
is another example of market regulations where market participants must provide evidence
of their comprehensive infrastructure testing, policies and procedures and market oversight
compliance. We are delighted to team up with Exactpro whom we know from other customer
engagements. We are very impressed by their capabilities, diligence and effectiveness in
planning, executing and evidencing tests that prove regulatory compliance”.
Iosif Itkin, Co-Founder of Exactpro, says: “Our firm has a great set of tools and services that
we believe can help clients meet Regulation SCI in a cost effective manner. We are very
conversant with this domain and are delighted to be working with Tellefsen on this; our two
firms’ capabilities are entirely complementary”.
Reconciliation Testing Aspects
Elena Moiseeva, QA, Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
1) Exactpro is a specialist QA firm focused on testing financial systems that was acquired by the London Stock Exchange Group in 2015.
2) The London Stock Exchange Group is a leading international exchange group that traces its history back to 1698 and has over 5,500 employees.
3) Exactpro uses automated testing tools like Sailfish and ClearTH to test systems, as well as techniques like formal verification, crowd-sourced testing, and machine learning.
EXTENT-2015: The Four Essential Elements of LSEG QA SolutionsIosif Itkin
The Four Essential Elements of LSEG QA Solutions
QA, Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
Quantlogic product & services offeringDileep Jacob
Quantlogic is a formidable player in the algorithmic trading space having developed in-house:-
• 3,500 automated strategies covering most asset classes.
• 2,500 Trading ideas in the forms of studies
• Powerful development tools in the form of multiple proprietary databases.
Our resources enable us to provide our Partners including Banks, Hedge Funds, Prop Traders, Brokers and CTA’s with a very wide range of strategies sorted into diversified Portfolios.
Quantlogic also has a unique Outsourcing model operated from our offices in India, providing access to its own vast IP, Enabling technologies, and in-house specialists. The Company provides dedicated access to Programmers, Quant’s and Strategy developers, enabling clients to enhance exponentially their own capability; whilst simultaneously delivering significant cost savings.
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...Iosif Itkin
EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London
Key Challenges and Lessons Learned from Testing a New Trading System
Dr. Matthias Burghardt, Head of Business Development, Boerse Stuttgart
Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro
EXTENT-2016: MiFID 2 Requirements for testing and business clocksIosif Itkin
EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London
MiFID 2 Requirements for testing and business clocks
Dr. Sandra Bramhoff, Senior VP, Deutsche Börse
Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro
Trading Systems: Testing at the Confluence of FT and NFTIosif Itkin
EXTENT Trading Technology Trends & Quality Assurance Conference in Obninsk, 2 March, 2013
Trading Systems:
Testing at the Confluence of FT & NFT
Alexey Zverev, Managing Director
Alyona Bulda, QA Project Lead
Ivan Bobrov, HFT Analyst
EXTENT October 2011 - Test Automation for Trading SystemsIosif Itkin
The document discusses topics related to financial modeling including BDD simulators, exchange high-frequency trading, operability panels, commercial test tools, test automation, and verification of financial and risk models. It also welcomes participants to a conference on these topics held in Kostroma.
This document discusses how a software testing company tests software. It builds software to test other software and has an excellent team equipped with good tools. The company has a relentless and attentive work ethic and culture that is difficult to replicate. It is willing to put in substantial extra effort, at least 20% more, on every project to help clients achieve competitive advantage through quality and efficient platforms.
EXTENT Trading Test Tools Evolution TheoryIosif Itkin
EXTENT Trading Technology Trends & Quality Assurance Conference in Obninsk, 2 March, 2013
Trading Test Tools: Evolution Theory
Alexander Barch, Technical Analyst, Exactpro Systems
Anastasia Matveeva, QA Manager, Exactpro Systems
The next generation of testing tools for exchangesIosif Itkin
The document discusses the evolution of financial exchange testing tools, from generic tools with limited functionality to next-generation tools that integrate more advanced testing methods. It provides examples of several next-generation testing tools that have been developed, including ClearTH, Minirobots, Dolphin, Shsha, Load Injector, and Sailfish. Each tool has unique features for testing different aspects of exchanges, such as order entry, market data connections, post-trade processing, and system load and performance. The document emphasizes that next-generation tools allow more comprehensive testing through integrated testing of multiple functions and automated generation of test scenarios and reports.
Trading Clearing Systems Test AutomationIosif Itkin
The document describes Exactpro's recommended approach to test automation, which involves progressively building up test automation capabilities over 6 steps: 1) Testing server functionality via standard protocols, 2) 'GUI bypass' testing, 3) Connecting to the GUI, 4) Semi-automated GUI testing, 5) Fully automated GUI testing, and 6) Creating a 'Big Button' test framework. It then provides explanations and details of Exactpro's bespoke test automation tools that implement different aspects of this approach, including Sailfish, Shsha, ClearTH, and MiniRobots. Key principles for effective test automation design are also outlined.
This document discusses non-functional testing approaches for financial markets software. It describes the structure of non-functional testing teams, how to prepare tests by configuring load injectors and defining load shapes, and the types of non-functional tests performed, including latency measurements, capacity tests, DLC testing, failover testing, and other approaches to evaluate system performance under stress conditions.
Delivering Large Post-Trade Initiatives: Quality Assurance and Key ChallengesIosif Itkin
Difficulties in coping with functional complexity
experienced by the project team:
• Aligning tests correctly in batches that correspond to events in
the daily life cycle, including multiple days
• Accelerating the daily life cycle to speed up test execution and to cover
Settlement Failure processes in testing within a reasonable timeframe
• Accurately simulating and controlling test inputs from upstream systems
and outputs to downstream systems
• Management of complex Reference Data setup
• Involvement of complex components such as Risk Management
and Collateral Management systems
• Test cycle turnaround time, client certification and test automation
Keynote Speakers:
Alyona Lamash FRM Head of Risk Management Practice, Exactpro Systems
Mark Ryland Financial Markets Technology Consultant, Independent Consulting, United Kingdom
EXTENT Conference - October 2011
Test Automation for Trading Systems
Verification of Financial Models:Duplication of Development Efforts?
Alyona Lamash, Head of Risk Management Systems Practice Innovative Trading Systems
Boris Rabinovich, Senior QA Analyst ITS
Behavior Driven Development Pros and ConsIosif Itkin
The Cons of Behavior Driven Development (BDD)
Ivan Bobrov, ClubQA Co-Founder, Kostroma
The Pros of Behavior Driven Development (BDD): Business User Scenarios
Natalia Zaitseva, Exchange Functional Test Automation Lead Innovative Trading Systems
EXTENT Conference.
October 29-30, 2011
Test Automation for Trading Systems
Renaissance Hotel Moscow
Software Development for Market Surveillance systemsIosif Itkin
Основные вопросы лекции:
- London Stock Exchange Group и компания Exactpro;
- представительство в Костроме и возможности трудоустройства;
- характеристики биржевой платформы и обязанности по поддержанию упорядоченного рынка;
- виды финансовых преступлений;
- анализ данных - профессия будущего;
- программное обеспечение систем отслеживания финансовых манипуляций.
1) Exactpro is a specialist QA firm focused on testing financial systems that was acquired by the London Stock Exchange Group in 2015.
2) The London Stock Exchange Group is a leading international exchange group that traces its history back to 1698 and has over 5,500 employees.
3) Exactpro uses automated testing tools like Sailfish and ClearTH to test systems, as well as techniques like formal verification, crowd-sourced testing, and machine learning.
EXTENT-2015: The Four Essential Elements of LSEG QA SolutionsIosif Itkin
The Four Essential Elements of LSEG QA Solutions
QA, Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
Quantlogic product & services offeringDileep Jacob
Quantlogic is a formidable player in the algorithmic trading space having developed in-house:-
• 3,500 automated strategies covering most asset classes.
• 2,500 Trading ideas in the forms of studies
• Powerful development tools in the form of multiple proprietary databases.
Our resources enable us to provide our Partners including Banks, Hedge Funds, Prop Traders, Brokers and CTA’s with a very wide range of strategies sorted into diversified Portfolios.
Quantlogic also has a unique Outsourcing model operated from our offices in India, providing access to its own vast IP, Enabling technologies, and in-house specialists. The Company provides dedicated access to Programmers, Quant’s and Strategy developers, enabling clients to enhance exponentially their own capability; whilst simultaneously delivering significant cost savings.
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...Iosif Itkin
EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London
Key Challenges and Lessons Learned from Testing a New Trading System
Dr. Matthias Burghardt, Head of Business Development, Boerse Stuttgart
Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro
EXTENT-2016: MiFID 2 Requirements for testing and business clocksIosif Itkin
EXTENT-2016: Software Testing & Trading Technology Trends
22 June, 2016, 10 Paternoster Square, London
MiFID 2 Requirements for testing and business clocks
Dr. Sandra Bramhoff, Senior VP, Deutsche Börse
Would like to know more?
Visit our website: extentconf.com
Follow us:
https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym
https://twitter.com/exactpro
#extent2016
#exactpro
Trading Systems: Testing at the Confluence of FT and NFTIosif Itkin
EXTENT Trading Technology Trends & Quality Assurance Conference in Obninsk, 2 March, 2013
Trading Systems:
Testing at the Confluence of FT & NFT
Alexey Zverev, Managing Director
Alyona Bulda, QA Project Lead
Ivan Bobrov, HFT Analyst
EXTENT October 2011 - Test Automation for Trading SystemsIosif Itkin
The document discusses topics related to financial modeling including BDD simulators, exchange high-frequency trading, operability panels, commercial test tools, test automation, and verification of financial and risk models. It also welcomes participants to a conference on these topics held in Kostroma.
This document discusses how a software testing company tests software. It builds software to test other software and has an excellent team equipped with good tools. The company has a relentless and attentive work ethic and culture that is difficult to replicate. It is willing to put in substantial extra effort, at least 20% more, on every project to help clients achieve competitive advantage through quality and efficient platforms.
EXTENT Trading Test Tools Evolution TheoryIosif Itkin
EXTENT Trading Technology Trends & Quality Assurance Conference in Obninsk, 2 March, 2013
Trading Test Tools: Evolution Theory
Alexander Barch, Technical Analyst, Exactpro Systems
Anastasia Matveeva, QA Manager, Exactpro Systems
The next generation of testing tools for exchangesIosif Itkin
The document discusses the evolution of financial exchange testing tools, from generic tools with limited functionality to next-generation tools that integrate more advanced testing methods. It provides examples of several next-generation testing tools that have been developed, including ClearTH, Minirobots, Dolphin, Shsha, Load Injector, and Sailfish. Each tool has unique features for testing different aspects of exchanges, such as order entry, market data connections, post-trade processing, and system load and performance. The document emphasizes that next-generation tools allow more comprehensive testing through integrated testing of multiple functions and automated generation of test scenarios and reports.
Trading Clearing Systems Test AutomationIosif Itkin
The document describes Exactpro's recommended approach to test automation, which involves progressively building up test automation capabilities over 6 steps: 1) Testing server functionality via standard protocols, 2) 'GUI bypass' testing, 3) Connecting to the GUI, 4) Semi-automated GUI testing, 5) Fully automated GUI testing, and 6) Creating a 'Big Button' test framework. It then provides explanations and details of Exactpro's bespoke test automation tools that implement different aspects of this approach, including Sailfish, Shsha, ClearTH, and MiniRobots. Key principles for effective test automation design are also outlined.
This document discusses non-functional testing approaches for financial markets software. It describes the structure of non-functional testing teams, how to prepare tests by configuring load injectors and defining load shapes, and the types of non-functional tests performed, including latency measurements, capacity tests, DLC testing, failover testing, and other approaches to evaluate system performance under stress conditions.
Delivering Large Post-Trade Initiatives: Quality Assurance and Key ChallengesIosif Itkin
Difficulties in coping with functional complexity
experienced by the project team:
• Aligning tests correctly in batches that correspond to events in
the daily life cycle, including multiple days
• Accelerating the daily life cycle to speed up test execution and to cover
Settlement Failure processes in testing within a reasonable timeframe
• Accurately simulating and controlling test inputs from upstream systems
and outputs to downstream systems
• Management of complex Reference Data setup
• Involvement of complex components such as Risk Management
and Collateral Management systems
• Test cycle turnaround time, client certification and test automation
Keynote Speakers:
Alyona Lamash FRM Head of Risk Management Practice, Exactpro Systems
Mark Ryland Financial Markets Technology Consultant, Independent Consulting, United Kingdom
EXTENT Conference - October 2011
Test Automation for Trading Systems
Verification of Financial Models:Duplication of Development Efforts?
Alyona Lamash, Head of Risk Management Systems Practice Innovative Trading Systems
Boris Rabinovich, Senior QA Analyst ITS
Behavior Driven Development Pros and ConsIosif Itkin
The Cons of Behavior Driven Development (BDD)
Ivan Bobrov, ClubQA Co-Founder, Kostroma
The Pros of Behavior Driven Development (BDD): Business User Scenarios
Natalia Zaitseva, Exchange Functional Test Automation Lead Innovative Trading Systems
EXTENT Conference.
October 29-30, 2011
Test Automation for Trading Systems
Renaissance Hotel Moscow
Software Development for Market Surveillance systemsIosif Itkin
Основные вопросы лекции:
- London Stock Exchange Group и компания Exactpro;
- представительство в Костроме и возможности трудоустройства;
- характеристики биржевой платформы и обязанности по поддержанию упорядоченного рынка;
- виды финансовых преступлений;
- анализ данных - профессия будущего;
- программное обеспечение систем отслеживания финансовых манипуляций.
Non-Functional Testing at London Stock ExchangeIosif Itkin
29 November 2016
Harvard Club, New York, QA-Financial Forum
Exactpro is the specialist testing subsidiary of the London Stock Exchange Group. In this presentation,
Iosif Itkin will cover the wide range of testing requirements faced by broker-dealers, banks and
exchanges beyond the requirements of functional testing. Plus: In Conversation with Yann L’Huillier,
CIO, Tradition and Iosif Itkin, CEO, Exactpro
- Iosif Itkin: Exactpro CEO – The London Stock Exchance Group
- Yann L’Huillier: Group Chief Information Officer – Tradition
EXTENT-2015: A Test Harness for Algo Trading Systems Iosif Itkin
A Test Harness for Algo Trading Systems
Victoria Leonchik, Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...Iosif Itkin
This document discusses quality assurance and testing tools for financial trading systems. It describes the characteristics of trading systems, components of exchange platforms, and various testing tools from Exactpro including Sailfish for automated functional testing, ClearTH for post-trade testing, Dolphin for market surveillance testing, and Load Injector for performance testing. It provides examples of test script configuration and reports generated by the tools.
Millennium Surveillance™ – Achieving Excellence
Anton Kryukov,Exactpro
11 November 2015
Trading Technology Trends & Quality Assurance Conference in St. Petersburg
This document discusses quality assurance (QA) management principles and common anti-patterns. It outlines seven fundamental QA principles, including continuously learning about a system's behavior and developing test tools through iterations. It then describes seven common "anti-patterns," such as assuming requirements traceability or test automation are necessary upfront. The document concludes by contrasting the principles with the anti-patterns, such as emphasizing iterative test design over predefining a test library or taking an agile approach over test planning in waterfall model.
ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...Iosif Itkin
Synchronize Europe
18th June 2019
Iosif Itkin, co-CEO and co-founder, Exactpro
Using the ISDA CDM Swaps application, simultaneously execute multiple end-to-end scenarios for DAML applications in capital markets - validate with actual contract data on ledger.
Using Cluster Analysis for Characteristics Detection in Software Defect ReportsIosif Itkin
Anna Gromova and Olga Moskaleva, Exactpro Researchers, participated in the Sixth International Conference on Analysis of Images, Social Networks and Texts, AIST 2017
AIST is a conference on the Analysis of Images, Social Networks, and Texts. This year, it was held at Moscow Polytechnic University on June 27-29. The conference is intended for computer scientists and industry professionals whose research interests involve applications of data mining and machine learning techniques to various problem domains: image processing, analysis of social networks, and natural language processing. AIST boasts its interdisciplinary nature, bridging the gap between researchers and practitioners.
All research papers submitted to the conference went through a double-blind reviewing process and were reviewed by at least three program committee members. The accepted papers were presented by their authors on July 27 and 28.
Anna Gromova’s research on Using Cluster Analysis for Characteristics Detection in Software Defect Reports was among this year’s accepted papers. Anna, who is an Exactpro researcher, presented her work in the General Topics of Data Analysis section of the conference.
Anna’s research focuses on the metrics and predictions of defect reports. In her research paper, Anna explores the workings of how extended bug attribute analysis can effectively reveal software weaknesses and improve the testing strategy, and how machine learning techniques can facilitate the process of building an automated recommendation system for project managers and QA team leads. Such a system would help them get a better picture of the risks associated with software defects, as well as obtain more accurate information about a bug's lifecycle.
“In future, we are planning to build an automated recommendation system based on the cluster analysis of our defect reports. A system like that could be used by all QA team members to improve the existing processes of developing the testing strategies and plans”, says Anna Gromova, Exactpro Researcher.
EXTENT-2016: Managing QA for Complex Systems in Agile Development FrameworkIosif Itkin
Alexey Zverev, CEO of Exactpro, presented on testing complex systems within agile development frameworks. The presentation outlined fundamental principles of QA management, including continuously learning about the system and improving test design through iterations. It then discussed common "anti-patterns" such as over-relying on requirements traceability matrices or test plans. Finally, it summarized Exactpro's principles, such as developing team knowledge, versus these anti-patterns.
QA Financial Singapore: Deliberate Practice of Software Testing in Agile WorldIosif Itkin
QA Financial Forum Singapore 2017. Event is fully dedicated to quality assurance in financial services software.
25 May 2017
Iosif Itkin, Exactpro CEO
London Stock Exchange Group
This document discusses challenges in quality assurance testing for clearing and settlement platforms, and Exactpro's approach to addressing them. It outlines several complexities: participant structure complexity, trade/position/account lifecycles, risk calculation variety, asset class complexity, dependencies on upstream/downstream systems, varied API access, and large test libraries. Exactpro has developed an integrated automation test framework to holistically test these complex post-trade infrastructures through simulated scenarios. Case studies of projects for ClearTH, Risk Analyzer, and HiVAT monitoring are also presented.
Sibos 2017: Disruptive functional testing - the next frontier in post-trade s...Iosif Itkin
16 October 2017
Sibos Toronto
Presentation by Iosif Itkin, Exactpro CEO and co-founder
London Stock Exchange Group
Disruptive functional testing - the next frontier in post-trade systems verification
The operators of complex back office and post-trade systems interconnected by SWIFT and other communication protocols are trying to keep pace with the front office technology advances, rising data volumes and changing regulatory landscape. The industry actively adopts flexible development methodologies to speed up the software delivery process. What aspects of software quality are not covered by regular performance / failover testing and the agile development life cycle? Disruptive functional testing is a way to prepare your mission-critical infrastructure for any challenges the future may bring. Ideas for this presentation are drawn from our work with LCH, T2S, clearing and settlement systems worldwide.
Defects mining in exchanges - medvedev, klimakov, yamkoviDataFest Tbilisi
This document discusses Exactpro's approach to testing exchange trading systems. It provides an overview of Exactpro as a company focused on functional and non-functional testing of financial market infrastructures. It then discusses Exactpro's testing approach, including creating load profiles, performance testing, resilience testing, automation of resilience testing, and defects mining from test data. Specific techniques covered include monitoring tools deployment, data collection, storage and analysis to identify issues and ensure system resilience.
Exactpro Non-Functional Testing at London Stock ExchangeIosif Itkin
QA-Financial Forum in London
5 April 2017
Iosif Itkin, Exactpro CEO & Co-Founder
London Stock Exchange Group
Non-Functional Testing at London Stock Exchange
Exactpro is the specialist testing subsidiary of the London Sock Exchange Group. Iosif Itkin, CEO, will cover the wide range of testing requirements beyond the requirements of function al testing that confront client firms including broker-dealers, exchanges and banks.
Following his presentation, QA Financial will interview Jeremy Norwood, Director PMO at Tradition, the leading IDB, along with Iosif Itkin, and dive into the detail of some of those challenges.
http://exactpro.com
This document discusses the development of a single-page web application for a student markbook using Akka actors and HTTP. Key points discussed include:
- Using multiple Akka actors to retrieve student, schedule, subject and mark data from various data services.
- A worker actor that processes the retrieved data and returns student week marks.
- A REST API with routes to get lists of students and individual student week marks.
- The application server is initialized by binding the API routes to an HTTP server.
How to Drive and Win with Innovation Initiatives in Government InstitutionsAIIM International
The European Court of Human Rights was set up in Strasbourg by the Council of Europe Member States in 1959 to deal with alleged violations of the 1950 European Convention on Human Rights. Hear how John Hunter went about creating visibility and value for the public through innovative technology.
20 Simple Questions from Exactpro for Your Enjoyment This Holiday SeasonIosif Itkin
Warmest wishes for a happy holiday season and a wonderful New Year!
We look forward to our continued collaboration in 2020. Thank you for your support.
This document summarizes an event on API foundation development using the Anypoint Platform that took place in Manchester, UK on July 4th, 2019. It includes presentations from Kevin Jervis of Ricston, Ryan Young of Open Answers, and Dave Felcey and David Morris of MuleSoft. The presentations covered topics such as API security, OAuth authentication, JSON web tokens, API management with Anypoint Platform, and integrating the NHS organ donor register using the HL7 FHIR standard. Examples and case studies were provided on developing API foundations and accelerating integrations using reusable assets from Anypoint Exchange.
Thomson Reuters is the world’s leading source of intelligent information for businesses and professionals. It combines industry expertise and innovative technology to deliver critical information to leading decision makers. A large, global company, Thomson Reuters operates in more than 100 countries and has annual revenue exceeding 12 billion dollars. The company’s operations include four large business units: Financial & Risk, Legal, Tax & Accounting and IP & Science. This session will review its strategic project to centralize its many separate customer identity systems, with a goal of improving our customers’ experience, simplifying our technology footprint, and increasing our understanding of our customers.
Similar to Верификация технологических платформ Лондонской фондовой биржи (20)
Foundations of Software Testing Lecture 4Iosif Itkin
This lecture is a part of the online course on Software Testing for Complex Intelligent Systems and Autonomous Vehicles. The course lectures provide the theoretical basics of testing autonomous systems based on artificial intelligence.
The fourth lecture of the course entitled Foundations of Software Testing reviews the ‘absence-of-errors fallacy’ and other principles of software testing, as well as the types and levels of software testing. The lecture also provides a fuller picture of the understanding of test objectives and methodologies by different schools of thought within the software testing domain.
QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...Iosif Itkin
Speaker: Iosif Itkin, co-CEO & co-founder, Exactpro Systems
9th November 2021
Hilton Canary Wharf
Exactpro is an independent software testing business focused on mission-critical financial market infrastructures, primarily exchanges and clearing houses. In his presentation, Iosif will give a brief overview of research on the concept of model-based testing and the principal challenges of its application while testing complex distributed systems. He will also outline the broader context of interaction between humans and complex computer models.
Exactpro FinTech Webinar - Global Exchanges Test OraclesIosif Itkin
The document discusses test oracles, which are mechanisms for determining whether a test has passed or failed. It describes how oracles work by comparing the actual output of a system under test to the expected output determined by the oracle. Several types of oracles are discussed, including hand-crafted oracles, specification-based oracles, and independent implementation oracles. The document emphasizes that all oracles are partial, as it is impossible to create a perfect oracle that evaluates all possible outputs of a system.
Exactpro FinTech Webinar - Global Exchanges FIX ProtocolIosif Itkin
Exactpro’s Global Exchanges Division training session on FIX Trading Protocol.
The essence of the FIX protocol and its place in the overall structure of network protocols, FIX message attributes and the internal data types of the protocol.
Operational Resilience in Financial Market InfrastructuresIosif Itkin
A4Q World Congress 13-16 April 2021
Iosif Itkin
Exactpro provides independent software testing services for mission critical technology that underpins global financial markets – exchanges and clearing houses. Half of the top 20 global exchange groups on all continents around the globe rely on processes, platforms and people from Exactpro to improve their quality and reliability. The company has spent the last 11 years studying operational resilience in this crucial sector. The presentation will outline the key principles for software testing of the systems that process hundreds of millions of orders per day with roundtrip latencies below one hundred microseconds.
QA-Financial Forum 2019 in New York
13 November
Iosif Itkin, CEO and co-founder
Elena Treshcheva, Business Development Manager and Researcher
An October 2019 survey by BoE and FCA found that ML in financial organizations has already passed an initial development phase, and the usage of live ML applications is about to dramatically increase over the next three years. Artificial Intelligence systems are used in market surveillance, they are providing intellectual analysis of news feeds, and they are an important part of the conversational agents facing users and helping them with their business needs from identity verification to trading and portfolio management. How to ensure that an AI-powered system is up to its task? And what would that mean from the software testing perspective?
EXTENT 2019: Exactpro Quality Assurance for Financial Market InfrastructuresIosif Itkin
On Complex Software Systems Testing — Alexey Zverev, co-CEO & co-founder, Exactpro
Software Testing and Machine Learning
Mind the Gap. Applying Process Mining
Learning from Failure is not just for Humans
Dancing with Whales. Adaptive Log Classification System
On Traceability and the Illusion of Control
Building Partnerships
Demystifying DLT Testing One Network at a Time
Get the MOST from FIX
Georgia on My Mind
Build Software to Test Software — Iosif Itkin, co-CEO & co-founder, Exactpro
EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan ShamraiIosif Itkin
Ivan Shamray, Senior NFT Analyst, Exactpro
20 April 2019 EXTENT Talks, Tbilisi, Georgia
Tbilisi QA Community
EXTENT Talks is a meeting place for IT specialists working in various industries and seeking professional growth, practitioners from IT firms, as well as Quality Assurance enthusiasts of all backgrounds interested in actively participating in local IT events.
EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference OpenIosif Itkin
The document summarizes the agenda for the QA Community Tbilisi event on April 20, 2019 in Tbilisi, Georgia. The agenda included presentations on topics like principles of deep testing, quality in space, behavior driven development, test automation, and obstacles of software testing in Georgia. There was also information provided about Exactpro and their history, tools and methods for testing financial systems, and test automation for distributed ledger technology. The document encouraged participants to provide feedback and announced an upcoming prize drawing for those who engaged on the event's Facebook page.
User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...Iosif Itkin
The First IEEE International Conference On Artificial Intelligence Testing (2019 IEEE AITest)
Iosif Itkin, Anna Gromova, Anton Sitnikov, Elena Treshcheva, Rostislav Yavorskiy, Evgenii Tsymbalov, Andrey Novikov and Kirill Rudakov
1 Exactpro, UK, Georgia, USA, Russia
2 Skolkovo Institute of Science and Technology, Russia
3 Higher School of Economics, Russia
Speakers: Iosif Itkin, CEO and Co-Founder and Elena Treshcheva, Business Development Manager and Researcher - Exactpro
Exactpro provides software testing services for mission-critical technology that underpins global financial markets. Exactpro clients are regulated by FCA, Bank of England and their counterparts from other countries. During this session, Elena and Iosif will talk about end-to-end software testing for post-trade systems in financial market infrastructures. What are the key challenges in quality assurance at this scale? What kind of cognitive biases affect SDLC? How precise is the knowledge about the systems under test? What constitutes good test evidence? How to deal with complexity in regulated environments?
Behaviour Driven Development: Oltre i limiti del possibileIosif Itkin
The QA Financial Forum: Milan 2019
23 January at the Excelsior Hotel Gallia.
Anna-Maria Lukina, Exactpro Business Development Director
The QA Financial Forum: Milan is one of the leading fintech conferences in Italy. The event focuses on the latest achievements in software risk management and automation of software testing. The predominant theme of the Milan event will be Quality Assurance for the entire Software Development Life Cycle (SDLC).
The topics under discussion will feature:
- Technologies for Automation & AI
- DevOps & CI/CD
- Value Stream Management
- Test Data Management
- Regulatory Compliance
- App Security & DevSecOps
- Testing and quality assurance of Blockchain platforms
The official language of the event is Italian.
On 17th January 2018 Exactpro successfully completed a management buyout from London Stock Exchange Group (LSEG), signed a new multi-year master services agreement with LSEG, and opened its head office in London.
What else has happened in 2018?
I wanted to take the opportunity to reflect on what has been an unusual year for Exactpro.
Integration front to back - Mr. Custodian tear down that wall
The scope of the application level has been continuous extended over the years, albeit with a focus on the area of pre-trade and trade.
Recently, there has been an increased interest to move further into the area of post-trade which is predominantly driven by the ISO 20022 standard. Is there really a need for new FIX messages in areas such as payments and
what are the integration problems needing a resolution?
Panellists
- Iosif Itkin, CEO, Exactpro
- Jim Northey, Co-Chair Global Technical Committee, Americas Region, FIX Trading Community, Chair Elect, ISO TC68 Financial
Services Technical Committee, and Consultant and Industry Standards Liaison, Itiviti
- Barry Young, Director, Aladdin Product Manager, BlackRock
BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)Iosif Itkin
Exactpro is supporting the 3rd annual IT-conference YouCon to take place on 14th October in Saratov, Russia. Over 900 programmers, systems engineers and architects, software QA engineers, and marketing specialists will gather to discuss the latest trends in programming technology. It is the largest IT industry event in Saratov.
Iosif Itkin, CEO of Exactpro, part of London Stock Exchange Group, will deliver a "BDD. The Outer Limits" presentation named after Iosif's favorite Sci-Fi series.
The topics to be covered are:
Behavior Driven Development concepts
Applying BDD in trading and clearing systems
Specification by Example and using production data
Combining Model-based testing and BDD
The Outer Limits
There will be an opportunity to ask questions, share thoughts and expertise in BDD, or just chat with a representative at the Exactpro stand at any time during the event.
Don't miss out, stop by and ask how you can get your Exactpro souvenir :)
We look forward to meeting you there!
#Exactpro #Youconsaratov
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
1. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com1
Верификация технологических платформ
Лондонской фондовой биржи
Open Access Quality Assurance & Related Software Development for Financial Markets
Tel: +7 495 640 2460, +1 415 830 38 49
www.exactpro.com
Иосиф Иткин, Exactpro CEO, London Stock Exchange Group
8 октября 2016
2. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com2
Exactpro Systems
Page
2
• A specialist firm focused on functional and non functional
testing of systems that process wholesale financial products,
particularly market infrastructure
• A UK company with operations in the US and four QA &
software development centres in Russia
• Part of London Stock Exchange Group as of May 29, 2015
• Incorporated in 2009 with 10 people, our company has
experienced significant growth as satisfied clients require
more services; now employing over 400 specialists
3. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com3
London Stock Exchange Group
Trading 23.3%
Clearing 33.8%
Information 36.5%
Technology 5.7%
4. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com4
London Stock Exchange Group
• A leading diversified international exchange and infrastructure group with assets across the entire exchange value chain
• The Group can trace its history back to 1698
• Headquartered in the United Kingdom, with significant global operations, the Group employs approximately 3,500 people
• Post trade and risk management services are a significant part of the Group’s business operations
• Through FTSE Russell, the Group is a global leader in financial indexing, benchmarking and analytic services with
approximately $10 trillion benchmarked to its indexes
5. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com5
Information Services
The May 6, 2010, Flash Crash, was a United States trillion-dollar stock market crash,
which started at 2:32 p.m. and lasted for approximately 36 minutes.
Event is attributed to HFT, large directional sell, index arbitrage and market manipulation
6. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com6
Information Services
Through FTSE Russell, the Group is a global leader in financial indexing, benchmarking
and analytic services with approximately $10 trillion benchmarked to its indexes. The
Group also provides customers with an extensive range of real time and reference data
products, including SEDOL, UnaVista, and RNS.
7. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com7
Information Services
8. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com8
Clearing
9. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com9
Clearing
February 1995 - Following the discovery of substantial trading losses on
overseas the house account closed out at a gross loss of approximately
£6k, compared with total margin cover held by LCH of approximately £11m
September 2008 - LCH successfully resolved $9 trillion of Lehman Brothers
OTC interest rate swap defaults
10. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com10
Характеристики биржевой системы
Время обработки заявки: < 100 микросекунд
Это в 3000 раз быстрее мгновения ока
Луч света успевает пройти 30 километров
Самолет успевает пролететь 3 сантиметра
Заявок в секунду: десятки тысяч
Заявок в день: сотни миллионов
11. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com11
Характеристики биржевой системы
“There are three ways to make a living in this
business: be first, be smarter, or cheat”
12. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com12
Задачи биржевой системы
Обеспечить упорядоченное, справедливое и
отказоустойчивое функционирование финансовых рынков
Не допустить:
• Манипуляция ценами
• Переигрывание объемами
• Уход от налогов
• Финансирование зла
• Инсайдерская торговля
• Проскальзывание перед клиентом
Часто легитимная активность выглядит как злоупотребление, и наоборот
Анализ данных:
• Нечеткая логика
• Гибкая конфигурируемость сценариев
• Формальные критерии сами по себя не являются доказательством манипуляции
• Операторам системы предоставляется возможность восстановить события и
складывать доказательства по каждому случаю потенциального нарушения
13. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com13
Компоненты биржевой системы
14. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com14
Компоненты биржевой системы
15. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com15
Automated testing
Compares intended and received
results
Automated end 2 end
clearing system testing
Automated monitoring,
analysis and reporting
75K messages / second from a single CPU core
Measures latencies in microsecond range
A variety of algoes simulating end-clients
will run and see how system performs
Build Software to Test Software
16. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com16
Инструменты для Тестирования
Execute a test regression and make it:
as extensive as possible
as efficient as possible
17. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com17
A set of Minirobots Algorithms allowing to perform a complete test
regression of a trading system within a few hours
All Robots work concurrently against the test environment
Robots are independent from each other, and their actions are based
on current conditions on the order books
Robots use an abstract Test Library and their main goal is to cover all
test cases within the library
Инструменты для Тестирования
18. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com18
Нагрузочное Тестирование
System
Under Test
Production
Connectivity
Test
Tools
Infrastructure:
≈ 10 - 100 servers
infrastructure:
thousands of servers
infrastructure:
1 - 4 servers
19. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com19
Нагрузочное Тестирование
20. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com20
Нагрузочное Тестирование
21. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com21
Измерение Задержек
22. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com22
Измерение Задержек
23. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com23
Нефункциональное Тестирование
24. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com24
Тестирование Алгоритмов
25. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com25
• Competing conference papers go through a review by a number of leading software
development and analysis experts and scientists
• The best papers are recommended for their inclusion in Russia’s leading professional and
scientific publications
The fourth TMPA conference in March, Moscow, Russia
Find out more: www.tmpaconf.org
Renowned experts in program engineering speaking on:
• software test automation
• static program analysis
• verification
• dynamic methods of program analysis
• analysis of parallel and distributed systems
• testing and analysis of high-availability systems
• analysis of hardware and software systems
• methods of building quality software
• tools for software analysis, testing and verification
Software Engineering Conferences
26. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com26
Офис в Саратове
ул. Рабочая, д.145А (12 этаж)
27. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com27
Toronto
New York
Tysons Corner
Montreal
Portland
Seattle
Dubai
Colombo
Johannesburg
Sydney
Singapore
Hong Kong
Moscow
Oslo
Paris
Milan
Athens
Vienna
London Amsterdam
A specialist firm operating an open access model
with focus on functional and operational testing for global financial markets worldwide
A UK company with operations in the US and four QA & software
development centres in Russia
Part of LSEG Since May 29, 2015
Incorporated in 2009 with 10 people, our company has
experienced significant growth as satisfied clients require more
services;
Now employing over 400 specialists
A Global Client Network
28. Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 24 60 , +1 415 830 38 49
www.exactpro.com28
The sixth EXTENT conference will be held in
London, UK .
Find out more:
www.extentconf.com
– LSEG Technology and Quality Assurance
– Risk controls and FPGA
– Market Surveillance systems
– Blockchain and trading technology trends
– Artificial intelligence
Thank You
Software Testing Conferences