This document summarizes key concepts around high availability and disaster recovery in SQL Server. It defines availability and recovery objectives like RTO and RPO. It describes Always On technologies in SQL Server for unplanned downtime including database mirroring, log shipping, replication, and failover clustering. It also covers planned downtime solutions like online operations and database snapshots. Finally, it discusses how these different technologies can be combined based on high availability requirements like system administration, user errors, site disaster protection, and database scale out with redundancy.
Apache HBase is the Hadoop opensource, distributed, versioned storage manager well suited for random, realtime read/write access. This talk will give an overview on how HBase achieve random I/O, focusing on the storage layer internals. Starting from how the client interact with Region Servers and Master to go into WAL, MemStore, Compactions and on-disk format details. Looking at how the storage is used by features like snapshots, and how it can be improved to gain flexibility, performance and space efficiency.
Apache HBase is the Hadoop opensource, distributed, versioned storage manager well suited for random, realtime read/write access. This talk will give an overview on how HBase achieve random I/O, focusing on the storage layer internals. Starting from how the client interact with Region Servers and Master to go into WAL, MemStore, Compactions and on-disk format details. Looking at how the storage is used by features like snapshots, and how it can be improved to gain flexibility, performance and space efficiency.
HBase 2.0 is the next stable major release for Apache HBase scheduled for early 2017. It is the biggest and most exciting milestone release from the Apache community after 1.0. HBase-2.0 contains a large number of features that is long time in the development, some of which include rewritten region assignment, perf improvements (RPC, rewritten write pipeline, etc), async clients, C++ client, offheaping memstore and other buffers, Spark integration, shading of dependencies as well as a lot of other fixes and stability improvements. We will go into technical details on some of the most important improvements in the release, as well as what are the implications for the users in terms of API and upgrade paths. Existing users of HBase/Phoenix as well as operators managing HBase clusters will benefit the most where they can learn about the new release and the long list of features. We will also briefly cover earlier 1.x release lines and compatibility and upgrade paths for existing users and conclude by giving an outlook on the next level of initiatives for the project.
SQL Server 2014 In-Memory Tables (XTP, Hekaton)Tony Rogerson
Semi-advanced presentation on SQL Server 2014 in-memory tables which is part of the Extreme Transaction Processing feature (project: Hekaton).
Deck and demo can be found: http://sdrv.ms/1dvWouN
Red Stack Tech Ltd is a global Oracle Technology brand specialising in the provision of Oracle software, Hardware, Managed and professional services across the entire Oracle Technology stack. Established in the mid 90’s, Red Stack Tech have developed through R&D and investment in new technologies, a brand which is highly regarded within the Oracle landscape. Red Stack Tech are able to deliver full end-to-end solutions that encompass all Oracle technologies with a strong focus on Oracle Engineered Systems, Database Management Services and Business Analytics.
Virtual private catalog will allow you to maintain only one recovery catalog repository by securing boundaries between administrators of various databases or between DBAs, as well as allowing you to separate their duties.
Join the Webinar to learn about Virtual Private Catalog and Demo.
Overview of RMAN
Overview of Recovery Catalog
About Virtual Private Catalog
Benefits of Virtual Private Catalog
Create Virtual Private Catalog
Manage Virtual Private Catalog
RMAN stored Script
Q& A
RMAN - New Features in Oracle 12c - IOUG Collaborate 2017Andy Colvin
Every DBA should know how to back up and recover a database - their job may depend on it one day. In order to make backup and recovery easier, Oracle gives DBAs RMAN. In Oracle 12c, RMAN includes many new features to make backup and recovery simpler and more robust. This session will cover 5 of the top new features introduced in RMAN for Oracle 12c, coming from more than four years of experience with the product. Discussion of each new feature will explain how it can be used by normal DBAs in their everyday work life - not just abstract discussions on features that will never actually be used in the real world.
Oracle Database 12c offers new enhancements and additions in Recovery Manager (RMAN). The features listed in this article will help you transport data across platforms and reduce downtime by 8x versus tradition migration approach, recover table and table partitions to point-in-time without affecting other objects in the database, and audit RMAN-related events using unified auditing. Take advantage of these new features for efficient backup and recovery.
This presentation by Bruce Momjian. Co-Founder of the Global PostgreSQL Development team and a Senior Architect at EDB. He demonstrates how to use arrays, geometry and JSON for NoSQL data types to overcome restrictions of relational storage to support new innovative applications, specifically by storing and indexing multiple values, even unrelated ones, in a single database field. Such storage allows for greater efficiency and access simplicity, and can also avoid the negatives of entity-attribute-value (eav) storage.
Postgres has always had strong support for relational storage. However, there are some cases where relational storage might be inefficient or overly restrictive.
HBase has been in production in hundreds of clusters across the HDP customer base. In this talk, we will go over the best practices and lessons learned in supporting these clusters over the years. We will cover top 10 recurring issues like ZooKeeper, GC, number of regions, HBCK, operating system and coprocessor related issues and more across 1000+ support tickets. We will also cover common solutions and lessons learned and go into details of how to tune, monitor and operate your clusters. We will then cover some of the improvements that we have been adding to HBase and Ambari for easing up some of the pain.
Leveraging Open Source to Manage SAN Performancebrettallison
Scope - The primary focus of this presentation is how to leverage open source software to help in managing Shared Storage performance. The storage server will be the focus with particular emphasis on ESS. This solution is a small one-off solution.
HBase 2.0 is the next stable major release for Apache HBase scheduled for early 2017. It is the biggest and most exciting milestone release from the Apache community after 1.0. HBase-2.0 contains a large number of features that is long time in the development, some of which include rewritten region assignment, perf improvements (RPC, rewritten write pipeline, etc), async clients, C++ client, offheaping memstore and other buffers, Spark integration, shading of dependencies as well as a lot of other fixes and stability improvements. We will go into technical details on some of the most important improvements in the release, as well as what are the implications for the users in terms of API and upgrade paths. Existing users of HBase/Phoenix as well as operators managing HBase clusters will benefit the most where they can learn about the new release and the long list of features. We will also briefly cover earlier 1.x release lines and compatibility and upgrade paths for existing users and conclude by giving an outlook on the next level of initiatives for the project.
SQL Server 2014 In-Memory Tables (XTP, Hekaton)Tony Rogerson
Semi-advanced presentation on SQL Server 2014 in-memory tables which is part of the Extreme Transaction Processing feature (project: Hekaton).
Deck and demo can be found: http://sdrv.ms/1dvWouN
Red Stack Tech Ltd is a global Oracle Technology brand specialising in the provision of Oracle software, Hardware, Managed and professional services across the entire Oracle Technology stack. Established in the mid 90’s, Red Stack Tech have developed through R&D and investment in new technologies, a brand which is highly regarded within the Oracle landscape. Red Stack Tech are able to deliver full end-to-end solutions that encompass all Oracle technologies with a strong focus on Oracle Engineered Systems, Database Management Services and Business Analytics.
Virtual private catalog will allow you to maintain only one recovery catalog repository by securing boundaries between administrators of various databases or between DBAs, as well as allowing you to separate their duties.
Join the Webinar to learn about Virtual Private Catalog and Demo.
Overview of RMAN
Overview of Recovery Catalog
About Virtual Private Catalog
Benefits of Virtual Private Catalog
Create Virtual Private Catalog
Manage Virtual Private Catalog
RMAN stored Script
Q& A
RMAN - New Features in Oracle 12c - IOUG Collaborate 2017Andy Colvin
Every DBA should know how to back up and recover a database - their job may depend on it one day. In order to make backup and recovery easier, Oracle gives DBAs RMAN. In Oracle 12c, RMAN includes many new features to make backup and recovery simpler and more robust. This session will cover 5 of the top new features introduced in RMAN for Oracle 12c, coming from more than four years of experience with the product. Discussion of each new feature will explain how it can be used by normal DBAs in their everyday work life - not just abstract discussions on features that will never actually be used in the real world.
Oracle Database 12c offers new enhancements and additions in Recovery Manager (RMAN). The features listed in this article will help you transport data across platforms and reduce downtime by 8x versus tradition migration approach, recover table and table partitions to point-in-time without affecting other objects in the database, and audit RMAN-related events using unified auditing. Take advantage of these new features for efficient backup and recovery.
This presentation by Bruce Momjian. Co-Founder of the Global PostgreSQL Development team and a Senior Architect at EDB. He demonstrates how to use arrays, geometry and JSON for NoSQL data types to overcome restrictions of relational storage to support new innovative applications, specifically by storing and indexing multiple values, even unrelated ones, in a single database field. Such storage allows for greater efficiency and access simplicity, and can also avoid the negatives of entity-attribute-value (eav) storage.
Postgres has always had strong support for relational storage. However, there are some cases where relational storage might be inefficient or overly restrictive.
HBase has been in production in hundreds of clusters across the HDP customer base. In this talk, we will go over the best practices and lessons learned in supporting these clusters over the years. We will cover top 10 recurring issues like ZooKeeper, GC, number of regions, HBCK, operating system and coprocessor related issues and more across 1000+ support tickets. We will also cover common solutions and lessons learned and go into details of how to tune, monitor and operate your clusters. We will then cover some of the improvements that we have been adding to HBase and Ambari for easing up some of the pain.
Leveraging Open Source to Manage SAN Performancebrettallison
Scope - The primary focus of this presentation is how to leverage open source software to help in managing Shared Storage performance. The storage server will be the focus with particular emphasis on ESS. This solution is a small one-off solution.
Introduction to Sqoop Aaron Kimball Cloudera Hadoop User Group UKSkills Matter
In this talk of Hadoop User Group UK meeting, Aaron Kimball from Cloudera introduces Sqoop, the open source SQL-to-Hadoop tool. Sqoop helps users perform efficient imports of data from RDBMS sources to Hadoop's distributed file system, where it can be processed in concert with other data sources. Sqoop also allows users to export Hadoop-generated results back to an RDBMS for use with other data pipelines.
After this session, users will understand how databases and Hadoop fit together, and how to use Sqoop to move data between these systems. The talk will provide suggestions for best practices when integrating Sqoop and Hadoop in your data processing pipelines. We'll also cover some deeper technical details of Sqoop's architecture, and take a look at some upcoming aspects of Sqoop's development roadmap.
»Spring 3« ist da. Vieles ist geblieben, manches verschwunden, manches neu. Spring 3 verspricht eine verbesserte und dynamischere Konfiguration, einen leistungsfähigen und mächtigen REST-Support und viele kleine Verbesserungen. Parallel zu dem Spring 3-Release wurden auch andere Tools und Projekte aktualisiert, auf die wir ebenfalls einen Blick werfen wollen:
* Wichtige Änderungen
* Java Configuration
* Spring Expression Language
* Spring MVC und Rest
* Embedded Database
* SpringSource Toolsuite
* Spring Roo
* Grails
Big Data and New Challenges for DBAs (Michael Naumov, LivePerson)
Hadoop has become a popular platform for managing large datasets of structured and unstructured data. It does not replace existing infrastructures, but instead augments them. Most companies will still use relational databases for transactional processing and low-latency queries, but can benefit from Hadoop for reporting, machine learning or ETL. This session will cover:
What is Hadoop and why do I care?
What do people do with Hadoop?
How can SQL Server DBAs add Hadoop to their architecture?
Since late 2009 there is Spring 3 published. Some things are new, something keep and something was removed.
Thos talk discuss the changes of the 3rd edition of Spring and introduce Spring Roo, Grails and the SpringSource Toolsuite.
SF Big Analytics 20190612: Building highly efficient data lakes using Apache ...Chester Chen
Building highly efficient data lakes using Apache Hudi (Incubating)
Even with the exponential growth in data volumes, ingesting/storing/managing big data remains unstandardized & in-efficient. Data lakes are a common architectural pattern to organize big data and democratize access to the organization. In this talk, we will discuss different aspects of building honest data lake architectures, pin pointing technical challenges and areas of inefficiency. We will then re-architect the data lake using Apache Hudi (Incubating), which provides streaming primitives right on top of big data. We will show how upserts & incremental change streams provided by Hudi help optimize data ingestion and ETL processing. Further, Apache Hudi manages growth, sizes files of the resulting data lake using purely open-source file formats, also providing for optimized query performance & file system listing. We will also provide hands-on tools and guides for trying this out on your own data lake.
Speaker: Vinoth Chandar (Uber)
Vinoth is Technical Lead at Uber Data Infrastructure Team
Spark Streaming makes it easy to build scalable fault-tolerant streaming applications. In this webinar, developers will learn:
*How Spark Streaming works - a quick review.
*Features in Spark Streaming that help prevent potential data loss.
*Complementary tools in a streaming pipeline - Kafka and Akka.
*Design and tuning tips for Reactive Spark Streaming applications.
Replicate from Oracle to data warehouses and analyticsContinuent
Analyzing transactional data residing in Oracle databases is becoming increasingly common, especially as the data sizes and complexity increase and transactional stores are no longer to keep pace with the ever-increasing storage. Although there are many techniques available for loading Oracle data, getting up-to-date data into your data warehouse store is a more difficult problem. VMware Continuent provides provides data replication from Oracle to data warehouses and analytics engines, to derive insight from big data for better business decisions. Learn practical tips on how to get your data warehouse loading projects off the ground quickly and efficiently when replicating from Oracle into Hadoop, Amazon Redshift, and HP Vertica.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
3. Who is Amit Bansal?
CTO, eDominer Systems & Peopleware India
Conducted more than 200 workshops on SQL Server &
BI for top notch IT companies world wide
Microsoft MVP for SQL Server
Microsoft Certified Trainer Advisory Council member
Speaker at TechED India, TechED US & TechED Europe
Technical Reviewer – MSL courses on SQL Server
SME – SQL Server 2008 certifications
UG Lead (Delhi NCR) – Culminis
Manager –
www.WeTogether.in, www.DelhiDevs.com, www.BlogB
oard.in
4. Agenda? --- TODO
Intro to High-Availability/DR
Key Terms
Always On Technologies
Overview, Planned / Unplanned downtime
When to use
Enhancements in SQL Server 2008
Combining Technologies
Summing it up
5. What is Availability?
Availability is defined by an implicit or explicit
application specific Service Level Agreement
Example
The ordering system is considered available when orders can
complete in less than one minute. The maximum downtime
acceptable is five minutes per month.
Downtime = the amount of time when the SLA is not met
Typically uptime is tracked (i.e. 99.993%), which doesn’t
include the “planned” downtime
The SLA should be used during
design, deployment, and production monitoring
phases of the application lifecycle
6. Intro to Disaster Recovery
Processes and procedures designed to restore
business operations due to a natural or human-
induced disaster
Typically involves providing redundancy spanning
multiple sites or across geographic regions
7. Key Terms
SLA Metrics:
Recovery Point Objective (RPO) = data loss
How much data can you lose?
guided by criticality of application data
Recovery Time Objective (RTO) = downtime
How much downtime can you tolerate?
guided by availability requirements
Local High-Availability (Local HA)
Site Disaster Recovery (Site DR)
8. Always On Technologies
Unplanned Downtime
SAN/RAID
Backup and Restore
Log Shipping
Database Mirroring
Failover Clustering
Replication
Planned Downtime
Rolling Upgrades and Patching
Online Operations
Resource Governor
Database Snapshots
9. Always On Availability Scenarios
System Administration
Upgrades, Index rebuilds…
Logical Errors (User or Application)
Incorrect data modifications, accidental changes…
Site Disaster
Hurricanes, fires…
Hardware Failures
Memory, network, disks…
Software Failures
Bugs
10. Categorizing Availability On Solutions
High Availability Solution
Requirement
System Administration Online management
Recovery from application or Logical recovery
user errors
Site disaster protection Database or storage mirroring
Database workload scale out Replication
with redundancy
11. Online Management
Downtime Scenarios
Applying a patch or upgrade
Moving a table as part of system maintenance
Deploying a new version of an application
Recovering from a corrupted data file
Always On Solutions
Rolling Upgrades utilizing Database Mirroring, Log
Shipping, or Replication
Fast recovery
Online alter table, index create, index rebuild
Online granular restore
12. Categorizing Availability On Solutions
High Availability Solution
Requirement
System Administration Online management
Recovery from application or Logical recovery
user errors
Site disaster protection Database or storage mirroring
Database workload scale out Replication
with redundancy
13. Recovery from User or Application
Errors
Downtime Scenarios
A table is accidentally dropped
An application makes incorrect updates to data
A user possibly made unauthorized changes to data
Always On Solutions
View point in time snapshots of the system
Take database snapshots at intervals
Log ship to another site using restore delay/standby options
Compare table to older version using tablediff utility
Track history of DML statements
Use SQL Trace or customized replication
14. Log Shipping
How it works
Update orders
set….
Primary Instance Secondary Instance
Primary Secondary
DB Log Log
DB
Backup Restore
Transaction Log Backup
Transaction Log Backup Log Backup Transaction Log Backup
Transaction Log Backup
Transaction Log Backup
Transaction Log Backup Copy Transaction Log Backup
Transaction Log Backup
15. SQL Server - Database Snapshots
Create database “HADB Snapshot”
on ( filename=<files>)
as snapshot of “HADB”
Update orders Select from orders
set…. where…
Maintains the original
HADB snapshot view
HADB of the database
Snapshot
from the time of creation
Database Pages
Database Files
V2 V1
Instance
16. Tablediff command line utility
Program FilesMicrosoft SQL Server90COMtablediff.exe
Tablediff identifies the data usage: tablediff
-- Source Options --
differences between two -sourceserver
-sourcedatabase
Source Host
Source Database
tables -sourceschema
-sourcetable
Source Schema Name
Source Table or View
-sourceuser Source Login
Tables must have same -sourcepassword Source Password
schema but can be on -sourcelocked Lock the source table/view durring tablediff
different servers -- Destination Options --
-destinationserver Destination Host
Use the –f option to generate -destinationdatabase
-destinationschema
Destination Database
Destination Schema Name
a SQL Server script to fix the -destinationtable
-destinationuser
Destination Table or View
Destination Login
out of sync destination version -destinationpassword
-destinationlocked
Destination Password
Lock the destination table/view durring tablediff
The diff algorithm uses an -- Misc Options --
-t Timeout
efficient hash technique -c Column Level Diff
-f Generate Fix SQL (You may also specify a file name and path)
-q Quick Row Count
-et Specify a table to put the errors into
-dt Drop the error table if it exists
-o Output file
-b Number of bytes to read for blob data types (Default 8000)
-strict Strict compare of source and destination schema
-rc Number of retries
-ri Retry interval
17. Categorizing Availability On Solutions
High Availability Solution
Requirement
System Administration Online management
Recovery from application or Logical recovery
user errors
Site disaster protection Database or storage mirroring
Database workload scale out Replication
with redundancy
18. Site Disaster Protection
Downtime Scenarios
Earthquake, fire, or flood causes datacenter outage
Always On Solutions
Database Mirroring to a secondary site
Optimized solution - allows very fast failover times to the
secondary site
Optionally add log shipping for additional site protection
Third party geo-clustering solutions for data center
storage level redundancy
Find SQL Server Always On reviewed solutions at the
Microsoft Always On website:
www.microsoft.com/SQL/AlwaysOn
19. Database Mirroring
Synchronous mode
Mirror is always
Application Witness redoing—it remains
Commit current
Principal Mirror
1 5
2
SQL Server SQL Server
2 >2 4 3 >3
Log Data Log Data
20. Database Mirroring – trade offs
Hot-standby
+ Fastest failover (best RTO)
Synchronous
+ No data loss (RPO=0)
- Performance impact for commit
Limited to one mirror per database
Performance impact increases with number of mirrored
databases
No read access to mirror
22. Categorizing Availability On Solutions
High Availability Solution
Requirement
System Administration Online management
Recovery from application or Logical recovery
user errors
Site disaster protection Database or storage mirroring
Database workload scale out Replication
with redundancy
23. Database Scale Out with Redundancy
Scenario
Real time reporting on one or more secondary
servers that can also be used for disaster recovery
Tier of identical databases for scaling out
applications which are partitioned by site
Solutions
Transactional Replication
Peer to Peer Replication
24. Database Scale Out with Redundancy
Transactional Replication Peer to Peer Replication
Reporting + Redundancy Scale Out* + Redundancy
Boston
New York England
Shanghai
New Jersey
Tokyo
Seattle
*Application data modifications must be
partitioned by site to prevent conflicts
26. Combining Technologies
Database
Failover Clustering Replication Scale Out
Failover Clustering
Local server redundancy For Queries
Database Mirroring
Primary disaster site for databases
Database Mirroring
Hot
Log Shipping
Standby
Additional disaster sites for databases
App/user error recovery Production
Database
Replication Log Shipping
Warm
Database reporting
and read scale out Standby
with redundancy
Always On Partner Solutions Log Shipping
With Restore Delay App/User
Highest hardware reliability
Error
Recovery