SlideShare a Scribd company logo
1 of 17
DATABASE SCALE OUT
Optimal approach to insure high level control and
performance of information system
DATA
CLUSTER
OBJECTIVES OF THE INNOVATION DEVELOPMENT
IS scale option?
Scale Up – increases servers
characteristics, such as memory,
number of cores, drive speed and etc.
Scale Out – designs database nodes
cluster by the way of the addition of
new nodes and load balancing
Increase of IS* load
The number of users grows
Intensive growth of IS
Prerequisites of IS scale out
Variants of IS scale out
What to do?
*-here is and after “IS” means “information system”
IS Scaling options
Scale Up
 Simplicity, scale out speed;
 Early or later the scale out achieves the technical limit in terms of cores numbers,
memory, disks subsystem and then does NOT give a valid performance growth.
Scale Out
 Valid effect of load balancing. The number of nodes in cluster is not limited;
 Setting and adaptation difficulties for a particular application. As a rule, a change
in IS architecture and application code are required . That is complex and non-
trivial task with significant many-sided expenses: finances, time and technology,
including the application support services.
Cluster Solutions for MS SQL SERVER
SCALE OUT
Variant #1. Common model of IT- system with DBMS cluster
Common Case
 Users are working with data base through
single server MS SQL IS;
 Systems of Back-Up, mirroring, replicating
are realized for the security purpose;
 Failover Cluster is created to provide fault
tolerance.
NEEDS
 To effectively distribute IS load through existing
hardware;
 To increase combined IS performance by prompt
server scale out;
 To optimally leverage back-ups and fault
tolerance.
Users
Terminal Servers
Servers Applications
Cluster DBMS controller
DATA BASE
Node #1 Node #2
Switching option in case of dropout
Variant #2. AlwaysOn technology in SQL Server cluster
What did change?
 Actual copy DB is kept on each
additional node, replicating with
main node;
 It is possible promptly to
transfer a work to another
DBMS sever in case of dropout.
What is worth to work on?
 To use all the hardware resources
Cluster DBMS controller Cluster work
control panel
DATA BASE #1
Node #1 Node #2
Switching option in case of dropout
DATA BASE #2Data replication
Fact
 Only master-node is working
while others are «off-line».
Innovative Solution for MS SQL SERVER 2014/2012
DATA CLUSTER
Scale Out
 To balance load between cluster master –node and secondary-nodes;
 To increase IS fault tolerance in case of software/hardware dropout or overload on
cluster node without any decrease in IS performance;
 To provide constant 24x7 availability of database for prompt users work, as well as
for overloaded by-the-book procedure with distribution between DB severs in
DBMS cluster;
 To increase data processing rate.
MAIN TASKS OF DATA CLUSTER SOLUTION:
DATA CLUSTER
DATA CLUSTER ARCHITECTURE
AlwaysOn was added,
allowing to make analysis of
DB requests and distribute
them between cluster nodes
in depends on their load
USERS USERSAPPLICATION/WEB APPLICATION
ASYNCHRONOUS DATA BASE
EXCHANGE (ALWAYSON)
ASYNCHRONOUS DATA BASE
EXCHANGE (ALWAYSON)
FILE STORE BD1FILE STORE BD1FILE STORE BD1
MS SQL 2012/2014
NODE 1 (MASTER)
MS SQL 2012/2014
NODE 2 (SLAVE)
MS SQL 2012/2014
NODE 3 (SLAVE)
DATA CLUSTER DATA CLUSTER DATA CLUSTER
CONSOLE
DATA CLUSTER ARCHITECTURE
 It analyses current load of hardware and makes decision regarding request
balancing on data reading between master- and secondary-nodes;
 It is tracking DB servers unsynchronization time and making decision regarding
requests balancing on data reading between master- and secondary-servers cluster;
 It directs all the queries only on master-node DB;
 In case of IS dropout it promptly switches to secondary-node and it becomes
master-node.
PRINCIPLES OF WORK PERFORMANCE
 Can be adapted on any application on MS SQL base, without any changes in the
application code;
 It is easy to learn («coach hints» goes from application code depends on server
choice for query performance) to increase the data processing effectivity.
ARCHITECTURE PRINCIPLES
DATA CLUSTER. CONTROL CONSOLE.
INTERESTING FACTS
DATA CLUSTER
SCALE OUT
DATA CLUSTER. LOAD TESTING
IN MICROSOFT TECHNOLOGY CENTER
IS: 1С 8.2.16
DB: > 1 TB
Testing scenario:
~90% - data reading
~10% - data changes
Queries SQL Intensity:
-to 25000 requests/second
Testing scenario:
For 125 sessions
For 250 sessions
For 250 sessions with increased
intensity
LOAD SERVERS
Virtual data base servers
Load server #1 Load server #3
License
server 1C
Application Server 1C
GYSTELL 1 coordinator
D
B
S
E
R
V
E
R
SHELVES OF
DB SYSTEM
GYSTELL
coordinator 1
GYSTELL
coordinator 2
GYSTELL
coordinator 3
Main Server
SQL
Additional Server
SQL
Additional Server
SQL
DATA CLUSTER. LOAD TESTING
IN MICROSOFT TECHNOLOGY CENTER
Facts:
Real performance growth, in case of one or two
additional nodes, composes 90-95% and 180-185%,
correspondingly. While the balanced load
distribution occurs between physical servers/cluster
nodes and lineal time performance decrease of the
main operations (proportionally to the number of
additional nodes in cluster).
High Effective Load balance
according to analytical operations between server nodes
in cluster, flexible system of setting up of load
distribution rules
IS fault tolerance
in peak moments with load distribution
IS reliability
with reserve base data in servers cluster,
having minimum deviation from main database
Average operation performance time
(in comparison with testing data on one node)
more than 250 users250 users150 users
1 node 2 node (AlwaysOn + SPDC) 3 node (AlwaysOn + SPDC)
DATA CLUSTER. Implementation in “Enter - Sviaznoy”
Business description:
- It stays in the TOP 10 of e-commercecompanies;
- It has more than 100 branches.
Information systemdescription:
- More than 1000 information system users;
- Data Base server MS SQL 2012 with AlwaysOn technology ;
- Data Base capacity is more than 1 TB;
- Transactionsnumber to 40-50 per second;
- Number of servers DBMS cluster nodes – 3 (1 – main, 2 – secondary).
Effect of DATA CLUSTERimplementation – high IS availabilityin the seasonal sales period:
- More 50% of the composedload is redirectedto the additional server DBMS cluster;
- In the moments of overloads (pre-holiday days and retail discounts) system performance quality
and response were improved in several times;
- The possibility of cluster SDC command usage is provided in the application code, so the client got
the possibility to make an additional increase of cluster performanceindependently.
Thank you!

More Related Content

What's hot

Rha cluster suite wppdf
Rha cluster suite wppdfRha cluster suite wppdf
Rha cluster suite wppdfprojectmgmt456
 
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done RightWebinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done RightContinuent
 
Sql Server Performance Tuning
Sql Server Performance TuningSql Server Performance Tuning
Sql Server Performance TuningBala Subra
 
The Power of Determinism in Database Systems
The Power of Determinism in Database SystemsThe Power of Determinism in Database Systems
The Power of Determinism in Database SystemsDaniel Abadi
 
Continuent webinar 02-19-2015
Continuent webinar 02-19-2015Continuent webinar 02-19-2015
Continuent webinar 02-19-2015Continuent
 
SQL Server Performance Tuning Baseline
SQL Server Performance Tuning BaselineSQL Server Performance Tuning Baseline
SQL Server Performance Tuning Baseline► Supreme Mandal ◄
 
Sql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paperSql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paperKlaudiia Jacome
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Managementguest2e11e8
 
2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-queryAshnikbiz
 
Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...deepalk
 
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...Microsoft Technet France
 
Ms sql server architecture
Ms sql server architectureMs sql server architecture
Ms sql server architectureAjeet Singh
 
Load Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware SolutionLoad Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware SolutionImperva Incapsula
 
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...Microsoft Technet France
 
How Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work TogetherHow Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work TogetherCompellent Technologies
 
Sql server’s high availability technologies
Sql server’s high availability technologiesSql server’s high availability technologies
Sql server’s high availability technologiesvenkatchs
 
Introduction to Threading in .Net
Introduction to Threading in .NetIntroduction to Threading in .Net
Introduction to Threading in .Netwebhostingguy
 
Oracle Database Overview
Oracle Database OverviewOracle Database Overview
Oracle Database Overviewhonglee71
 

What's hot (20)

Rha cluster suite wppdf
Rha cluster suite wppdfRha cluster suite wppdf
Rha cluster suite wppdf
 
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done RightWebinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
 
Sql Server Performance Tuning
Sql Server Performance TuningSql Server Performance Tuning
Sql Server Performance Tuning
 
The Power of Determinism in Database Systems
The Power of Determinism in Database SystemsThe Power of Determinism in Database Systems
The Power of Determinism in Database Systems
 
Load balancing
Load balancingLoad balancing
Load balancing
 
Continuent webinar 02-19-2015
Continuent webinar 02-19-2015Continuent webinar 02-19-2015
Continuent webinar 02-19-2015
 
SQL Server Performance Tuning Baseline
SQL Server Performance Tuning BaselineSQL Server Performance Tuning Baseline
SQL Server Performance Tuning Baseline
 
Sql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paperSql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paper
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Management
 
NoSQL Evolution
NoSQL EvolutionNoSQL Evolution
NoSQL Evolution
 
2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query
 
Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...
 
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
 
Ms sql server architecture
Ms sql server architectureMs sql server architecture
Ms sql server architecture
 
Load Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware SolutionLoad Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware Solution
 
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
 
How Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work TogetherHow Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work Together
 
Sql server’s high availability technologies
Sql server’s high availability technologiesSql server’s high availability technologies
Sql server’s high availability technologies
 
Introduction to Threading in .Net
Introduction to Threading in .NetIntroduction to Threading in .Net
Introduction to Threading in .Net
 
Oracle Database Overview
Oracle Database OverviewOracle Database Overview
Oracle Database Overview
 

Viewers also liked

Viewers also liked (20)

Tahreem e muta
Tahreem e mutaTahreem e muta
Tahreem e muta
 
Produção de minidocumentários 1
Produção de minidocumentários 1Produção de minidocumentários 1
Produção de minidocumentários 1
 
VK
VKVK
VK
 
Project 3 pres
Project 3 presProject 3 pres
Project 3 pres
 
Bab 12-periode-madinah
Bab 12-periode-madinahBab 12-periode-madinah
Bab 12-periode-madinah
 
1600 University Drive Rezoning
1600 University Drive Rezoning1600 University Drive Rezoning
1600 University Drive Rezoning
 
How did you attract/ address your audience?
How did you attract/ address your audience?How did you attract/ address your audience?
How did you attract/ address your audience?
 
Johanna
JohannaJohanna
Johanna
 
Syed Shafiullah CV
Syed Shafiullah CVSyed Shafiullah CV
Syed Shafiullah CV
 
Portada de computo
Portada de computoPortada de computo
Portada de computo
 
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaatrabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
 
Operations
OperationsOperations
Operations
 
Test
TestTest
Test
 
Nikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreemNikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreem
 
1
11
1
 
Webfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra PedrialiWebfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra Pedriali
 
Doc6
Doc6Doc6
Doc6
 
las drogas
las drogas las drogas
las drogas
 
Intel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informaticaIntel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informatica
 
Blearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto finalBlearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto final
 

Similar to DataCluster

Best Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon RedshiftBest Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon RedshiftSnapLogic
 
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)Trivadis
 
Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810Boni Bruno
 
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als DatenplattformRalph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als DatenplattformInformatik Aktuell
 
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl osIEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl osIEEEFINALYEARSTUDENTPROJECTS
 
Whats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwWhats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwEduardo Castro
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Eduardo Castro
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerMicrosoft Tech Community
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data SharingSurekha Parekh
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperDavid Walker
 
10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point PerformanceChristopher Bunn
 
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...cscpconf
 
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data AnalyticsStrata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data AnalyticsSingleStore
 
Tuning database performance
Tuning database performanceTuning database performance
Tuning database performanceBinay Acharya
 
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility PresentationMicrosoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility PresentationMicrosoft Private Cloud
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Dataexponential-inc
 
Compare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL ServerCompare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL ServerAlexDepo
 
SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks Thavash Govender
 
A stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
A stochastic approach to analysis of energy aware dvs-enabled cloud datacentersA stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
A stochastic approach to analysis of energy aware dvs-enabled cloud datacentersieeepondy
 

Similar to DataCluster (20)

Best Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon RedshiftBest Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon Redshift
 
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
 
Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810
 
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als DatenplattformRalph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
 
AZURE Data Related Services
AZURE Data Related ServicesAZURE Data Related Services
AZURE Data Related Services
 
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl osIEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
 
Whats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwWhats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 Cw
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layer
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data Sharing
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - Paper
 
10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance
 
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
 
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data AnalyticsStrata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
 
Tuning database performance
Tuning database performanceTuning database performance
Tuning database performance
 
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility PresentationMicrosoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Data
 
Compare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL ServerCompare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL Server
 
SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks
 
A stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
A stochastic approach to analysis of energy aware dvs-enabled cloud datacentersA stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
A stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
 

Recently uploaded

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 

Recently uploaded (20)

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 

DataCluster

  • 1. DATABASE SCALE OUT Optimal approach to insure high level control and performance of information system DATA CLUSTER
  • 2. OBJECTIVES OF THE INNOVATION DEVELOPMENT
  • 3. IS scale option? Scale Up – increases servers characteristics, such as memory, number of cores, drive speed and etc. Scale Out – designs database nodes cluster by the way of the addition of new nodes and load balancing Increase of IS* load The number of users grows Intensive growth of IS Prerequisites of IS scale out Variants of IS scale out What to do? *-here is and after “IS” means “information system”
  • 4. IS Scaling options Scale Up  Simplicity, scale out speed;  Early or later the scale out achieves the technical limit in terms of cores numbers, memory, disks subsystem and then does NOT give a valid performance growth. Scale Out  Valid effect of load balancing. The number of nodes in cluster is not limited;  Setting and adaptation difficulties for a particular application. As a rule, a change in IS architecture and application code are required . That is complex and non- trivial task with significant many-sided expenses: finances, time and technology, including the application support services.
  • 5. Cluster Solutions for MS SQL SERVER SCALE OUT
  • 6. Variant #1. Common model of IT- system with DBMS cluster Common Case  Users are working with data base through single server MS SQL IS;  Systems of Back-Up, mirroring, replicating are realized for the security purpose;  Failover Cluster is created to provide fault tolerance. NEEDS  To effectively distribute IS load through existing hardware;  To increase combined IS performance by prompt server scale out;  To optimally leverage back-ups and fault tolerance. Users Terminal Servers Servers Applications Cluster DBMS controller DATA BASE Node #1 Node #2 Switching option in case of dropout
  • 7. Variant #2. AlwaysOn technology in SQL Server cluster What did change?  Actual copy DB is kept on each additional node, replicating with main node;  It is possible promptly to transfer a work to another DBMS sever in case of dropout. What is worth to work on?  To use all the hardware resources Cluster DBMS controller Cluster work control panel DATA BASE #1 Node #1 Node #2 Switching option in case of dropout DATA BASE #2Data replication Fact  Only master-node is working while others are «off-line».
  • 8. Innovative Solution for MS SQL SERVER 2014/2012 DATA CLUSTER Scale Out
  • 9.  To balance load between cluster master –node and secondary-nodes;  To increase IS fault tolerance in case of software/hardware dropout or overload on cluster node without any decrease in IS performance;  To provide constant 24x7 availability of database for prompt users work, as well as for overloaded by-the-book procedure with distribution between DB severs in DBMS cluster;  To increase data processing rate. MAIN TASKS OF DATA CLUSTER SOLUTION: DATA CLUSTER
  • 10. DATA CLUSTER ARCHITECTURE AlwaysOn was added, allowing to make analysis of DB requests and distribute them between cluster nodes in depends on their load USERS USERSAPPLICATION/WEB APPLICATION ASYNCHRONOUS DATA BASE EXCHANGE (ALWAYSON) ASYNCHRONOUS DATA BASE EXCHANGE (ALWAYSON) FILE STORE BD1FILE STORE BD1FILE STORE BD1 MS SQL 2012/2014 NODE 1 (MASTER) MS SQL 2012/2014 NODE 2 (SLAVE) MS SQL 2012/2014 NODE 3 (SLAVE) DATA CLUSTER DATA CLUSTER DATA CLUSTER CONSOLE
  • 11. DATA CLUSTER ARCHITECTURE  It analyses current load of hardware and makes decision regarding request balancing on data reading between master- and secondary-nodes;  It is tracking DB servers unsynchronization time and making decision regarding requests balancing on data reading between master- and secondary-servers cluster;  It directs all the queries only on master-node DB;  In case of IS dropout it promptly switches to secondary-node and it becomes master-node. PRINCIPLES OF WORK PERFORMANCE  Can be adapted on any application on MS SQL base, without any changes in the application code;  It is easy to learn («coach hints» goes from application code depends on server choice for query performance) to increase the data processing effectivity. ARCHITECTURE PRINCIPLES
  • 14. DATA CLUSTER. LOAD TESTING IN MICROSOFT TECHNOLOGY CENTER IS: 1С 8.2.16 DB: > 1 TB Testing scenario: ~90% - data reading ~10% - data changes Queries SQL Intensity: -to 25000 requests/second Testing scenario: For 125 sessions For 250 sessions For 250 sessions with increased intensity LOAD SERVERS Virtual data base servers Load server #1 Load server #3 License server 1C Application Server 1C GYSTELL 1 coordinator D B S E R V E R SHELVES OF DB SYSTEM GYSTELL coordinator 1 GYSTELL coordinator 2 GYSTELL coordinator 3 Main Server SQL Additional Server SQL Additional Server SQL
  • 15. DATA CLUSTER. LOAD TESTING IN MICROSOFT TECHNOLOGY CENTER Facts: Real performance growth, in case of one or two additional nodes, composes 90-95% and 180-185%, correspondingly. While the balanced load distribution occurs between physical servers/cluster nodes and lineal time performance decrease of the main operations (proportionally to the number of additional nodes in cluster). High Effective Load balance according to analytical operations between server nodes in cluster, flexible system of setting up of load distribution rules IS fault tolerance in peak moments with load distribution IS reliability with reserve base data in servers cluster, having minimum deviation from main database Average operation performance time (in comparison with testing data on one node) more than 250 users250 users150 users 1 node 2 node (AlwaysOn + SPDC) 3 node (AlwaysOn + SPDC)
  • 16. DATA CLUSTER. Implementation in “Enter - Sviaznoy” Business description: - It stays in the TOP 10 of e-commercecompanies; - It has more than 100 branches. Information systemdescription: - More than 1000 information system users; - Data Base server MS SQL 2012 with AlwaysOn technology ; - Data Base capacity is more than 1 TB; - Transactionsnumber to 40-50 per second; - Number of servers DBMS cluster nodes – 3 (1 – main, 2 – secondary). Effect of DATA CLUSTERimplementation – high IS availabilityin the seasonal sales period: - More 50% of the composedload is redirectedto the additional server DBMS cluster; - In the moments of overloads (pre-holiday days and retail discounts) system performance quality and response were improved in several times; - The possibility of cluster SDC command usage is provided in the application code, so the client got the possibility to make an additional increase of cluster performanceindependently.

Editor's Notes

  1. Везде перенос предлога на новую строку. Окно комментария сделать крупнее
  2. Где-то крупнее шрифт, где то меньше.
  3. Где-то крупнее шрифт, где то меньше.
  4. Где-то крупнее шрифт, где то меньше.
  5. Где-то крупнее шрифт, где то меньше.
  6. Где-то крупнее шрифт, где то меньше.
  7. Где-то крупнее шрифт, где то меньше.
  8. Где-то крупнее шрифт, где то меньше.
  9. Где-то крупнее шрифт, где то меньше.