SlideShare a Scribd company logo
DATABASE SCALE OUT
Optimal approach to insure high level control and
performance of information system
DATA
CLUSTER
OBJECTIVES OF THE INNOVATION DEVELOPMENT
IS scale option?
Scale Up – increases servers
characteristics, such as memory,
number of cores, drive speed and etc.
Scale Out – designs database nodes
cluster by the way of the addition of
new nodes and load balancing
Increase of IS* load
The number of users grows
Intensive growth of IS
Prerequisites of IS scale out
Variants of IS scale out
What to do?
*-here is and after “IS” means “information system”
IS Scaling options
Scale Up
 Simplicity, scale out speed;
 Early or later the scale out achieves the technical limit in terms of cores numbers,
memory, disks subsystem and then does NOT give a valid performance growth.
Scale Out
 Valid effect of load balancing. The number of nodes in cluster is not limited;
 Setting and adaptation difficulties for a particular application. As a rule, a change
in IS architecture and application code are required . That is complex and non-
trivial task with significant many-sided expenses: finances, time and technology,
including the application support services.
Cluster Solutions for MS SQL SERVER
SCALE OUT
Variant #1. Common model of IT- system with DBMS cluster
Common Case
 Users are working with data base through
single server MS SQL IS;
 Systems of Back-Up, mirroring, replicating
are realized for the security purpose;
 Failover Cluster is created to provide fault
tolerance.
NEEDS
 To effectively distribute IS load through existing
hardware;
 To increase combined IS performance by prompt
server scale out;
 To optimally leverage back-ups and fault
tolerance.
Users
Terminal Servers
Servers Applications
Cluster DBMS controller
DATA BASE
Node #1 Node #2
Switching option in case of dropout
Variant #2. AlwaysOn technology in SQL Server cluster
What did change?
 Actual copy DB is kept on each
additional node, replicating with
main node;
 It is possible promptly to
transfer a work to another
DBMS sever in case of dropout.
What is worth to work on?
 To use all the hardware resources
Cluster DBMS controller Cluster work
control panel
DATA BASE #1
Node #1 Node #2
Switching option in case of dropout
DATA BASE #2Data replication
Fact
 Only master-node is working
while others are «off-line».
Innovative Solution for MS SQL SERVER 2014/2012
DATA CLUSTER
Scale Out
 To balance load between cluster master –node and secondary-nodes;
 To increase IS fault tolerance in case of software/hardware dropout or overload on
cluster node without any decrease in IS performance;
 To provide constant 24x7 availability of database for prompt users work, as well as
for overloaded by-the-book procedure with distribution between DB severs in
DBMS cluster;
 To increase data processing rate.
MAIN TASKS OF DATA CLUSTER SOLUTION:
DATA CLUSTER
DATA CLUSTER ARCHITECTURE
AlwaysOn was added,
allowing to make analysis of
DB requests and distribute
them between cluster nodes
in depends on their load
USERS USERSAPPLICATION/WEB APPLICATION
ASYNCHRONOUS DATA BASE
EXCHANGE (ALWAYSON)
ASYNCHRONOUS DATA BASE
EXCHANGE (ALWAYSON)
FILE STORE BD1FILE STORE BD1FILE STORE BD1
MS SQL 2012/2014
NODE 1 (MASTER)
MS SQL 2012/2014
NODE 2 (SLAVE)
MS SQL 2012/2014
NODE 3 (SLAVE)
DATA CLUSTER DATA CLUSTER DATA CLUSTER
CONSOLE
DATA CLUSTER ARCHITECTURE
 It analyses current load of hardware and makes decision regarding request
balancing on data reading between master- and secondary-nodes;
 It is tracking DB servers unsynchronization time and making decision regarding
requests balancing on data reading between master- and secondary-servers cluster;
 It directs all the queries only on master-node DB;
 In case of IS dropout it promptly switches to secondary-node and it becomes
master-node.
PRINCIPLES OF WORK PERFORMANCE
 Can be adapted on any application on MS SQL base, without any changes in the
application code;
 It is easy to learn («coach hints» goes from application code depends on server
choice for query performance) to increase the data processing effectivity.
ARCHITECTURE PRINCIPLES
DATA CLUSTER. CONTROL CONSOLE.
INTERESTING FACTS
DATA CLUSTER
SCALE OUT
DATA CLUSTER. LOAD TESTING
IN MICROSOFT TECHNOLOGY CENTER
IS: 1С 8.2.16
DB: > 1 TB
Testing scenario:
~90% - data reading
~10% - data changes
Queries SQL Intensity:
-to 25000 requests/second
Testing scenario:
For 125 sessions
For 250 sessions
For 250 sessions with increased
intensity
LOAD SERVERS
Virtual data base servers
Load server #1 Load server #3
License
server 1C
Application Server 1C
GYSTELL 1 coordinator
D
B
S
E
R
V
E
R
SHELVES OF
DB SYSTEM
GYSTELL
coordinator 1
GYSTELL
coordinator 2
GYSTELL
coordinator 3
Main Server
SQL
Additional Server
SQL
Additional Server
SQL
DATA CLUSTER. LOAD TESTING
IN MICROSOFT TECHNOLOGY CENTER
Facts:
Real performance growth, in case of one or two
additional nodes, composes 90-95% and 180-185%,
correspondingly. While the balanced load
distribution occurs between physical servers/cluster
nodes and lineal time performance decrease of the
main operations (proportionally to the number of
additional nodes in cluster).
High Effective Load balance
according to analytical operations between server nodes
in cluster, flexible system of setting up of load
distribution rules
IS fault tolerance
in peak moments with load distribution
IS reliability
with reserve base data in servers cluster,
having minimum deviation from main database
Average operation performance time
(in comparison with testing data on one node)
more than 250 users250 users150 users
1 node 2 node (AlwaysOn + SPDC) 3 node (AlwaysOn + SPDC)
DATA CLUSTER. Implementation in “Enter - Sviaznoy”
Business description:
- It stays in the TOP 10 of e-commercecompanies;
- It has more than 100 branches.
Information systemdescription:
- More than 1000 information system users;
- Data Base server MS SQL 2012 with AlwaysOn technology ;
- Data Base capacity is more than 1 TB;
- Transactionsnumber to 40-50 per second;
- Number of servers DBMS cluster nodes – 3 (1 – main, 2 – secondary).
Effect of DATA CLUSTERimplementation – high IS availabilityin the seasonal sales period:
- More 50% of the composedload is redirectedto the additional server DBMS cluster;
- In the moments of overloads (pre-holiday days and retail discounts) system performance quality
and response were improved in several times;
- The possibility of cluster SDC command usage is provided in the application code, so the client got
the possibility to make an additional increase of cluster performanceindependently.
Thank you!

More Related Content

What's hot

Rha cluster suite wppdf
Rha cluster suite wppdfRha cluster suite wppdf
Rha cluster suite wppdf
projectmgmt456
 
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done RightWebinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
Continuent
 
Sql Server Performance Tuning
Sql Server Performance TuningSql Server Performance Tuning
Sql Server Performance Tuning
Bala Subra
 
The Power of Determinism in Database Systems
The Power of Determinism in Database SystemsThe Power of Determinism in Database Systems
The Power of Determinism in Database Systems
Daniel Abadi
 
Load balancing
Load balancingLoad balancing
Load balancing
ankur bhalla
 
Continuent webinar 02-19-2015
Continuent webinar 02-19-2015Continuent webinar 02-19-2015
Continuent webinar 02-19-2015
Continuent
 
SQL Server Performance Tuning Baseline
SQL Server Performance Tuning BaselineSQL Server Performance Tuning Baseline
SQL Server Performance Tuning Baseline
► Supreme Mandal ◄
 
Sql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paperSql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paper
Klaudiia Jacome
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Management
guest2e11e8
 
NoSQL Evolution
NoSQL EvolutionNoSQL Evolution
NoSQL Evolution
Abdul Manaf
 
2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query
Ashnikbiz
 
Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...
deepalk
 
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Microsoft Technet France
 
Ms sql server architecture
Ms sql server architectureMs sql server architecture
Ms sql server architecture
Ajeet Singh
 
Load Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware SolutionLoad Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware Solution
Imperva Incapsula
 
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Microsoft Technet France
 
How Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work TogetherHow Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work Together
Compellent Technologies
 
Sql server’s high availability technologies
Sql server’s high availability technologiesSql server’s high availability technologies
Sql server’s high availability technologies
venkatchs
 
Introduction to Threading in .Net
Introduction to Threading in .NetIntroduction to Threading in .Net
Introduction to Threading in .Net
webhostingguy
 
Oracle Database Overview
Oracle Database OverviewOracle Database Overview
Oracle Database Overview
honglee71
 

What's hot (20)

Rha cluster suite wppdf
Rha cluster suite wppdfRha cluster suite wppdf
Rha cluster suite wppdf
 
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done RightWebinar Slides: MySQL Multi-Site Multi-Master Done Right
Webinar Slides: MySQL Multi-Site Multi-Master Done Right
 
Sql Server Performance Tuning
Sql Server Performance TuningSql Server Performance Tuning
Sql Server Performance Tuning
 
The Power of Determinism in Database Systems
The Power of Determinism in Database SystemsThe Power of Determinism in Database Systems
The Power of Determinism in Database Systems
 
Load balancing
Load balancingLoad balancing
Load balancing
 
Continuent webinar 02-19-2015
Continuent webinar 02-19-2015Continuent webinar 02-19-2015
Continuent webinar 02-19-2015
 
SQL Server Performance Tuning Baseline
SQL Server Performance Tuning BaselineSQL Server Performance Tuning Baseline
SQL Server Performance Tuning Baseline
 
Sql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paperSql server 2008 replication and database mirroring white paper
Sql server 2008 replication and database mirroring white paper
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Management
 
NoSQL Evolution
NoSQL EvolutionNoSQL Evolution
NoSQL Evolution
 
2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query2016 may-countdown-to-postgres-v96-parallel-query
2016 may-countdown-to-postgres-v96-parallel-query
 
Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...Variations in Performance and Scalability when Migrating n-Tier Applications ...
Variations in Performance and Scalability when Migrating n-Tier Applications ...
 
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
Exchange 2013 Haute disponibilité et tolérance aux sinistres (Session 1/2 pre...
 
Ms sql server architecture
Ms sql server architectureMs sql server architecture
Ms sql server architecture
 
Load Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware SolutionLoad Balancing from the Cloud - Layer 7 Aware Solution
Load Balancing from the Cloud - Layer 7 Aware Solution
 
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
Exchange Server 2013 : les mécanismes de haute disponibilité et la redondance...
 
How Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work TogetherHow Data Instant Replay and Data Progression Work Together
How Data Instant Replay and Data Progression Work Together
 
Sql server’s high availability technologies
Sql server’s high availability technologiesSql server’s high availability technologies
Sql server’s high availability technologies
 
Introduction to Threading in .Net
Introduction to Threading in .NetIntroduction to Threading in .Net
Introduction to Threading in .Net
 
Oracle Database Overview
Oracle Database OverviewOracle Database Overview
Oracle Database Overview
 

Viewers also liked

Tahreem e muta
Tahreem e mutaTahreem e muta
Tahreem e muta
Muhammad Tariq
 
Produção de minidocumentários 1
Produção de minidocumentários 1Produção de minidocumentários 1
Produção de minidocumentários 1
Erica Frau
 
VK
VKVK
Project 3 pres
Project 3 presProject 3 pres
Project 3 pres
Adrienne Caminer
 
Bab 12-periode-madinah
Bab 12-periode-madinahBab 12-periode-madinah
Bab 12-periode-madinahDarul Muttaqin
 
1600 University Drive Rezoning
1600 University Drive Rezoning1600 University Drive Rezoning
1600 University Drive Rezoning
City of College Station
 
How did you attract/ address your audience?
How did you attract/ address your audience?How did you attract/ address your audience?
How did you attract/ address your audience?
millieiron
 
Johanna
JohannaJohanna
Johanna
Chikita JoHis
 
Syed Shafiullah CV
Syed Shafiullah CVSyed Shafiullah CV
Syed Shafiullah CV
Syed Shafiullah
 
Portada de computo
Portada de computoPortada de computo
Portada de computo
SilviaGomez_
 
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaatrabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
Danilo Lima
 
Operations
OperationsOperations
Operations
Sherin Sunny
 
Nikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreemNikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreem
Muhammad Tariq
 
Webfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra PedrialiWebfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra Pedriali
Sandra Pedriali
 
Doc6
Doc6Doc6
las drogas
las drogas las drogas
las drogas
Debora Mendez
 
Intel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informaticaIntel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informatica
karlacarriongia
 
Blearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto finalBlearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto final
Darwin Miguel Núñez Hernández
 

Viewers also liked (20)

Tahreem e muta
Tahreem e mutaTahreem e muta
Tahreem e muta
 
Produção de minidocumentários 1
Produção de minidocumentários 1Produção de minidocumentários 1
Produção de minidocumentários 1
 
VK
VKVK
VK
 
Project 3 pres
Project 3 presProject 3 pres
Project 3 pres
 
Bab 12-periode-madinah
Bab 12-periode-madinahBab 12-periode-madinah
Bab 12-periode-madinah
 
1600 University Drive Rezoning
1600 University Drive Rezoning1600 University Drive Rezoning
1600 University Drive Rezoning
 
How did you attract/ address your audience?
How did you attract/ address your audience?How did you attract/ address your audience?
How did you attract/ address your audience?
 
Johanna
JohannaJohanna
Johanna
 
Syed Shafiullah CV
Syed Shafiullah CVSyed Shafiullah CV
Syed Shafiullah CV
 
Portada de computo
Portada de computoPortada de computo
Portada de computo
 
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaatrabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
trabalho chato de educação fisicaaaaaaaaaaaaaaaaaa
 
Operations
OperationsOperations
Operations
 
Test
TestTest
Test
 
Nikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreemNikah ul muta bain al ibahat wal tahreem
Nikah ul muta bain al ibahat wal tahreem
 
1
11
1
 
Webfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra PedrialiWebfólio oficina alunos Sandra Pedriali
Webfólio oficina alunos Sandra Pedriali
 
Doc6
Doc6Doc6
Doc6
 
las drogas
las drogas las drogas
las drogas
 
Intel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informaticaIntel core i3 e intel core i5 informatica
Intel core i3 e intel core i5 informatica
 
Blearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto finalBlearning en los procesos de postgrados proyecto final
Blearning en los procesos de postgrados proyecto final
 

Similar to DataCluster

Best Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon RedshiftBest Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon Redshift
SnapLogic
 
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Trivadis
 
Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810
Boni Bruno
 
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als DatenplattformRalph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Informatik Aktuell
 
AZURE Data Related Services
AZURE Data Related ServicesAZURE Data Related Services
AZURE Data Related Services
Ruslan Drahomeretskyy
 
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl osIEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEEFINALYEARSTUDENTPROJECTS
 
Whats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwWhats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 Cw
Eduardo Castro
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
Eduardo Castro
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layer
Microsoft Tech Community
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data Sharing
Surekha Parekh
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - Paper
David Walker
 
10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance
Christopher Bunn
 
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
cscpconf
 
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data AnalyticsStrata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
SingleStore
 
Tuning database performance
Tuning database performanceTuning database performance
Tuning database performance
Binay Acharya
 
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility PresentationMicrosoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft Private Cloud
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Data
exponential-inc
 
Compare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL ServerCompare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL Server
AlexDepo
 
SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks
Thavash Govender
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
ScyllaDB
 

Similar to DataCluster (20)

Best Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon RedshiftBest Practices for Supercharging Cloud Analytics on Amazon Redshift
Best Practices for Supercharging Cloud Analytics on Amazon Redshift
 
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
Azure Days 2019: Grösser und Komplexer ist nicht immer besser (Meinrad Weiss)
 
Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810Using SAS GRID v 9 with Isilon F810
Using SAS GRID v 9 with Isilon F810
 
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als DatenplattformRalph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
Ralph Kemperdick – IT-Tage 2015 – Microsoft Azure als Datenplattform
 
AZURE Data Related Services
AZURE Data Related ServicesAZURE Data Related Services
AZURE Data Related Services
 
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl osIEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
IEEE 2014 JAVA DATA MINING PROJECTS Towards multi tenant performance sl os
 
Whats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 CwWhats New Sql Server 2008 R2 Cw
Whats New Sql Server 2008 R2 Cw
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layer
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data Sharing
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - Paper
 
10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance10 Steps Optimize Share Point Performance
10 Steps Optimize Share Point Performance
 
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
MIGRATION OF AN OLTP SYSTEM FROM ORACLE TO MYSQL AND COMPARATIVE PERFORMANCE ...
 
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data AnalyticsStrata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
Strata+Hadoop 2015 NYC End User Panel on Real-Time Data Analytics
 
Tuning database performance
Tuning database performanceTuning database performance
Tuning database performance
 
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility PresentationMicrosoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
Microsoft SQL Server - Reduce Your Cost and Improve your Agility Presentation
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Data
 
Compare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL ServerCompare Clustering Methods for MS SQL Server
Compare Clustering Methods for MS SQL Server
 
SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks SQL in the cloud performance benchmarks
SQL in the cloud performance benchmarks
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 

Recently uploaded

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 

Recently uploaded (20)

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 

DataCluster

  • 1. DATABASE SCALE OUT Optimal approach to insure high level control and performance of information system DATA CLUSTER
  • 2. OBJECTIVES OF THE INNOVATION DEVELOPMENT
  • 3. IS scale option? Scale Up – increases servers characteristics, such as memory, number of cores, drive speed and etc. Scale Out – designs database nodes cluster by the way of the addition of new nodes and load balancing Increase of IS* load The number of users grows Intensive growth of IS Prerequisites of IS scale out Variants of IS scale out What to do? *-here is and after “IS” means “information system”
  • 4. IS Scaling options Scale Up  Simplicity, scale out speed;  Early or later the scale out achieves the technical limit in terms of cores numbers, memory, disks subsystem and then does NOT give a valid performance growth. Scale Out  Valid effect of load balancing. The number of nodes in cluster is not limited;  Setting and adaptation difficulties for a particular application. As a rule, a change in IS architecture and application code are required . That is complex and non- trivial task with significant many-sided expenses: finances, time and technology, including the application support services.
  • 5. Cluster Solutions for MS SQL SERVER SCALE OUT
  • 6. Variant #1. Common model of IT- system with DBMS cluster Common Case  Users are working with data base through single server MS SQL IS;  Systems of Back-Up, mirroring, replicating are realized for the security purpose;  Failover Cluster is created to provide fault tolerance. NEEDS  To effectively distribute IS load through existing hardware;  To increase combined IS performance by prompt server scale out;  To optimally leverage back-ups and fault tolerance. Users Terminal Servers Servers Applications Cluster DBMS controller DATA BASE Node #1 Node #2 Switching option in case of dropout
  • 7. Variant #2. AlwaysOn technology in SQL Server cluster What did change?  Actual copy DB is kept on each additional node, replicating with main node;  It is possible promptly to transfer a work to another DBMS sever in case of dropout. What is worth to work on?  To use all the hardware resources Cluster DBMS controller Cluster work control panel DATA BASE #1 Node #1 Node #2 Switching option in case of dropout DATA BASE #2Data replication Fact  Only master-node is working while others are «off-line».
  • 8. Innovative Solution for MS SQL SERVER 2014/2012 DATA CLUSTER Scale Out
  • 9.  To balance load between cluster master –node and secondary-nodes;  To increase IS fault tolerance in case of software/hardware dropout or overload on cluster node without any decrease in IS performance;  To provide constant 24x7 availability of database for prompt users work, as well as for overloaded by-the-book procedure with distribution between DB severs in DBMS cluster;  To increase data processing rate. MAIN TASKS OF DATA CLUSTER SOLUTION: DATA CLUSTER
  • 10. DATA CLUSTER ARCHITECTURE AlwaysOn was added, allowing to make analysis of DB requests and distribute them between cluster nodes in depends on their load USERS USERSAPPLICATION/WEB APPLICATION ASYNCHRONOUS DATA BASE EXCHANGE (ALWAYSON) ASYNCHRONOUS DATA BASE EXCHANGE (ALWAYSON) FILE STORE BD1FILE STORE BD1FILE STORE BD1 MS SQL 2012/2014 NODE 1 (MASTER) MS SQL 2012/2014 NODE 2 (SLAVE) MS SQL 2012/2014 NODE 3 (SLAVE) DATA CLUSTER DATA CLUSTER DATA CLUSTER CONSOLE
  • 11. DATA CLUSTER ARCHITECTURE  It analyses current load of hardware and makes decision regarding request balancing on data reading between master- and secondary-nodes;  It is tracking DB servers unsynchronization time and making decision regarding requests balancing on data reading between master- and secondary-servers cluster;  It directs all the queries only on master-node DB;  In case of IS dropout it promptly switches to secondary-node and it becomes master-node. PRINCIPLES OF WORK PERFORMANCE  Can be adapted on any application on MS SQL base, without any changes in the application code;  It is easy to learn («coach hints» goes from application code depends on server choice for query performance) to increase the data processing effectivity. ARCHITECTURE PRINCIPLES
  • 14. DATA CLUSTER. LOAD TESTING IN MICROSOFT TECHNOLOGY CENTER IS: 1С 8.2.16 DB: > 1 TB Testing scenario: ~90% - data reading ~10% - data changes Queries SQL Intensity: -to 25000 requests/second Testing scenario: For 125 sessions For 250 sessions For 250 sessions with increased intensity LOAD SERVERS Virtual data base servers Load server #1 Load server #3 License server 1C Application Server 1C GYSTELL 1 coordinator D B S E R V E R SHELVES OF DB SYSTEM GYSTELL coordinator 1 GYSTELL coordinator 2 GYSTELL coordinator 3 Main Server SQL Additional Server SQL Additional Server SQL
  • 15. DATA CLUSTER. LOAD TESTING IN MICROSOFT TECHNOLOGY CENTER Facts: Real performance growth, in case of one or two additional nodes, composes 90-95% and 180-185%, correspondingly. While the balanced load distribution occurs between physical servers/cluster nodes and lineal time performance decrease of the main operations (proportionally to the number of additional nodes in cluster). High Effective Load balance according to analytical operations between server nodes in cluster, flexible system of setting up of load distribution rules IS fault tolerance in peak moments with load distribution IS reliability with reserve base data in servers cluster, having minimum deviation from main database Average operation performance time (in comparison with testing data on one node) more than 250 users250 users150 users 1 node 2 node (AlwaysOn + SPDC) 3 node (AlwaysOn + SPDC)
  • 16. DATA CLUSTER. Implementation in “Enter - Sviaznoy” Business description: - It stays in the TOP 10 of e-commercecompanies; - It has more than 100 branches. Information systemdescription: - More than 1000 information system users; - Data Base server MS SQL 2012 with AlwaysOn technology ; - Data Base capacity is more than 1 TB; - Transactionsnumber to 40-50 per second; - Number of servers DBMS cluster nodes – 3 (1 – main, 2 – secondary). Effect of DATA CLUSTERimplementation – high IS availabilityin the seasonal sales period: - More 50% of the composedload is redirectedto the additional server DBMS cluster; - In the moments of overloads (pre-holiday days and retail discounts) system performance quality and response were improved in several times; - The possibility of cluster SDC command usage is provided in the application code, so the client got the possibility to make an additional increase of cluster performanceindependently.

Editor's Notes

  1. Везде перенос предлога на новую строку. Окно комментария сделать крупнее
  2. Где-то крупнее шрифт, где то меньше.
  3. Где-то крупнее шрифт, где то меньше.
  4. Где-то крупнее шрифт, где то меньше.
  5. Где-то крупнее шрифт, где то меньше.
  6. Где-то крупнее шрифт, где то меньше.
  7. Где-то крупнее шрифт, где то меньше.
  8. Где-то крупнее шрифт, где то меньше.
  9. Где-то крупнее шрифт, где то меньше.