This document summarizes key points from a presentation on SQL Server tips and best practices. It discusses the importance of database performance and speed, providing tips on identifying and addressing bottlenecks. It also covers backups and disaster recovery, explaining the differences and best approaches. New features in SQL Server 2017 are highlighted, including AlwaysOn availability groups and machine learning services. The conclusion emphasizes that SQL Server can be optimized to provide a solid foundation for businesses when treated properly.
Here is presented the phenomenon of the data explosion and how Oracle 12c with Information Lifecycle Management (ILM) can help to handle it efficiently.
ORACLE DBA Online Training by Keylabstraining is a well defined course and trained by our Well Qualified Oracle DBA Professionals all over the World. Our course content designed as per the current IT industry requirement.
Course Content : http://www.keylabstraining.com/oracle/oracle-dba-online-training-hyderabad-bangalore
For more information email us : info@keylabstraining.com
Here is presented the phenomenon of the data explosion and how Oracle 12c with Information Lifecycle Management (ILM) can help to handle it efficiently.
ORACLE DBA Online Training by Keylabstraining is a well defined course and trained by our Well Qualified Oracle DBA Professionals all over the World. Our course content designed as per the current IT industry requirement.
Course Content : http://www.keylabstraining.com/oracle/oracle-dba-online-training-hyderabad-bangalore
For more information email us : info@keylabstraining.com
Oracle Recovery Manager (Oracle RMAN) has evolved since being released in version 8i. With the newest version of Oracle 12c , RMAN has great new features that will allow you to reduce your down time in case of a disaster. In this session you will learn about the new features that were introduced in Oracle 12c and how can you take advantage of them from the first day you upgrade to this version.
SQL Server 2017 - Mejoras Impulsadas por la ComunidadJavier Villegas
Con SQL Sever 2017 Microsoft incorpora nuevas funcionalidades propuestas por la comunidad de profesionales de Data Platform, hablaremos acerca de las mismas así como también sobre las funcionalidades más destacadas de la próxima versión de SQL
Oracle RAC on Extended Distance Clusters - Customer ExamplesMarkus Michalewicz
This presentation show cases some Extended RAC customers and provides some background on their motivation. It is best consumed together with the more technical presentation http://www.slideshare.net/MarkusMichalewicz/oracle-rac-on-extended-distance-clusters and the the respective white paper http://www.slideshare.net/MarkusMichalewicz/extended-oracle-racclusters
Today, many businesses around the world are using an Oracle product and in many of these at the core there is an Oracle Database. Many of us who started as a Database administrator where put in this position because we were good PL/SQL programmers or good Sysadmins, but knew very little of what it took to be a DBA. In this session you will learn the core architecture of an Oracle Database in 12c as well as what it takes to administer and apply this new knowledge the day you go back to your office.
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyContinuent
Users seeking high availability, disaster recovery and zero downtime maintenance operation for business-critical MySQL applications face confusing choices. Is multi-master or master/slave clustering better? What about synchronous versus asynchronous replication? Using a plain vanilla, stock MySQL or a modified version of it? Which of these choices are right for data-driven businesses that depend on fast, reliable data access?
This no-BS webinar cuts through the FUD to explore the real trade-offs between the different clustering and replication methods, thens show you how Continuent's asynchronous master/slave clusters support these important capabilities for business-critical applications:
- High application write rates Master/slave clustering with Continuent
- Mixed workloads consisting of large and small transactions
- Data across multiple geographically distributed locations
- Failures and more importantly recovery from them
- Zero downtime maintenance and software upgrades
- Use of off-the-shelf MySQL/MariaDB to avoid application changes and allow clusters to improve as MySQL itself does.
We illustrate key points with demonstrations and case studies from deployed systems.
Oracle Recovery Manager (Oracle RMAN) has evolved since being released in version 8i. With the newest version of Oracle 12c , RMAN has great new features that will allow you to reduce your down time in case of a disaster. In this session you will learn about the new features that were introduced in Oracle 12c and how can you take advantage of them from the first day you upgrade to this version.
SQL Server 2017 - Mejoras Impulsadas por la ComunidadJavier Villegas
Con SQL Sever 2017 Microsoft incorpora nuevas funcionalidades propuestas por la comunidad de profesionales de Data Platform, hablaremos acerca de las mismas así como también sobre las funcionalidades más destacadas de la próxima versión de SQL
Oracle RAC on Extended Distance Clusters - Customer ExamplesMarkus Michalewicz
This presentation show cases some Extended RAC customers and provides some background on their motivation. It is best consumed together with the more technical presentation http://www.slideshare.net/MarkusMichalewicz/oracle-rac-on-extended-distance-clusters and the the respective white paper http://www.slideshare.net/MarkusMichalewicz/extended-oracle-racclusters
Today, many businesses around the world are using an Oracle product and in many of these at the core there is an Oracle Database. Many of us who started as a Database administrator where put in this position because we were good PL/SQL programmers or good Sysadmins, but knew very little of what it took to be a DBA. In this session you will learn the core architecture of an Oracle Database in 12c as well as what it takes to administer and apply this new knowledge the day you go back to your office.
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyContinuent
Users seeking high availability, disaster recovery and zero downtime maintenance operation for business-critical MySQL applications face confusing choices. Is multi-master or master/slave clustering better? What about synchronous versus asynchronous replication? Using a plain vanilla, stock MySQL or a modified version of it? Which of these choices are right for data-driven businesses that depend on fast, reliable data access?
This no-BS webinar cuts through the FUD to explore the real trade-offs between the different clustering and replication methods, thens show you how Continuent's asynchronous master/slave clusters support these important capabilities for business-critical applications:
- High application write rates Master/slave clustering with Continuent
- Mixed workloads consisting of large and small transactions
- Data across multiple geographically distributed locations
- Failures and more importantly recovery from them
- Zero downtime maintenance and software upgrades
- Use of off-the-shelf MySQL/MariaDB to avoid application changes and allow clusters to improve as MySQL itself does.
We illustrate key points with demonstrations and case studies from deployed systems.
Management and Automation of MongoDB Clusters - SlidesSeveralnines
Use MongoDB at Any Scale
As you scale, one of the challenges is optimizing your clusters and mitigating operational risk. Proper preparation can result in significant savings and reduced downtime.
This session covers:
* Deployment of dev/test/production environments across private data centers or public clouds
* What to monitor in production environments
* Management automation with ClusterControl from Severalnines
* How ClusterControl works with TokuMX
The session will give you the tools to more effectively manage your cluster, immediately. The presentation will include code samples and a live Q&A session.
This webinar is being delivered jointly by Severalnines & Tokutek. Severalnines provides automation and management tools to reduce the complexity of working with highly available database clusters. Tokutek provides high-performance and scalability for MongoDB, MySQL and MariaDB.
Consolidation, cloud privé, cloud public, SQL As A Service etc. sont autant de scénarios de virtualisation possibles avec SQL Server. Cette session reposera les règles de bon usage de ce type de déploiement et les scénarios clés. Nous reviendrons sur quelques-unes des « Lessons learned from Azure ».
Consolidation, cloud privé, cloud public, SQL As A Service etc. sont autant de scénarios de virtualisation possibles avec SQL Server. Cette session reposera les règles de bon usage de ce type de déploiement et les scénarios clés. Nous reviendrons sur quelques-unes des « Lessons learned from Azure ».
Compare the capabilities of the Microsoft Access, Microsoft SQL Serv.pdfarihantplastictanksh
Compare the capabilities of the Microsoft Access, Microsoft SQL Server, Oracle’s MySQL, and
Oracle relational database management systems (RDBMSs). Your paper should discuss the
processing speeds, data storage capabilities, maximum users supported, platforms supported,
user interfaces, development tools, vendor support, and cost. Discuss and cite at least two
references in addition to our textbook. Your paper should be 3-5 pages in length (excluding title
and References pages)
Solution
Microsoft Access
Overview:
Microsoft Access is a part of Microsoft Office,
it is commercially available database in the market
Inexpensive/standard on most computers
users can create complex databases
database professionalas can use construct a database
customers of MS-Access:
It is mainly used in small corporate companies or IT Sectors with 1-80 endusers.
Features of MS-Access:
1.It is having GUI Interface for creating databases
2. A databae contains tables, forms, reports, queries, macros.
3. It facilitates autocontent wizards to build tables or forms or reports.
4. It acts as an interface to other DBMS using ODBC
5. It is used for small business companies
6. Provides security like password protection
7. Provides a Data dictionary
8. We can repair the database
9. We can create different views
10. External data can be imported into Access
11. We can create web pages based using the database
12. It has as built in Macro functions
13. It uses Structurered Query Language
14. We can create forms, reports etc by using Visual Basic Application programming
15. Provides Add in controls like calendars
16. It can merged into word and analysed with Excel etc.
Issues:
Security:
User level security is very difficult
Tuning:
It does not have the ability to split over multiple Hard Drives, multiple CPUs or to place tables
into memory.
Locking:
Basic handling of concurrent users Backup and recovery at basic level.
ANSI SQL standard often doesn\'t work,MS-Access has it\'s own modified version of ANSI
SQL.
MySQL
Overview
MySQL is a database engine. It has a command line interface that allows the creation of
database. It Requires Front-end applications to access it for end users. EX:- C#, PHP, Microsoft
ASP.Net.
Typical users
Small companies or workgroups, through to very large Internet databases with large numbers of
users
Ex:wikipedia,Moodle.
Features
1. Speed:One of the fastest databases available
2. Ease of use: when compared to larger databases such as Oracle Uses standard SQL
3. Capability: A multi-threaded server allowing many clients to connect at the same time Fully
networked for the Internet with built in security
4.Portability: Runs on a many operating systems and different hardware
5. Small size: when compared to other large databases e.g. Oracle
6. Availabliity and Cost: Open Source ,Free in most situations to use
7. Open distribution and source code: You can check how it works – if you have the knowledge.
8. interface to other DBMS’s using Open Database Connectivit.
With AWS you can choose the right database technology and software for the job. Given the myriad of choices, from relational databases to non-relational stores, this session provides details and examples of some of the choices available to you. This session also provides details about real-world deployments from customers using Amazon RDS, Amazon ElastiCache, Amazon DynamoDB, and Amazon Redshift.
It's no mystery to anyone that software out cycles are bolder than ever. Now that the cloud has become universal as a strategic component of IT services, we are spoiled by continually releasing unique features and services.
Learn about IBM FlashSystem in OLAP Database Environments. IBM FlashSystem storage systems deliver high performance and efficiency in an easy to integrate offering so that businesses can more readily compete in the market.FlashSystem storage systems transform the data center environment and enhance performance and resource consolidation to gain the most from business processes and critical applications. For more information on IBM FlashSystem, visit http://ibm.co/10KodHl.
Visit http://bit.ly/KWh5Dx to 'Follow' the official Twitter handle of IBM India Smarter Computing.
Building High Performance MySQL Query Systems and Analytic ApplicationsCalpont
This presentation describes how to build fast running MySQL applications that service read-based systems. It takes a special look at column databases and Calpont's InfiniDB
Building High Performance MySql Query Systems And Analytic Applicationsguest40cda0b
This presentation gives practical advice and tips on how to build high-performance read intensive databases, and discusses innovations such as column-oriented databases
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Key Trends Shaping the Future of Infrastructure.pdf
Sql Server tips from the field
1. SQL Server Tips From The Field
Three Things IT Leaders Need to Know…
Web: www.sqlwatchmen.com
Email: Jim.Murphy@sqlwatchmen.com
Twitter: @SQLMurph
Jim Murphy
CEO
SQLWatchmen, LLC.
2. Who is SQLWatchmen?
DBA Services – performance tuning,
disaster recovery planning, maintenance
SQL Programming - views, SPs,
triggers
Integration Services - SSIS for trying
systems together
Reporting - SSRS for custom analytics to
fill business needs
Cloud Migration
2
Austin based tech company
Can serve as Remote / Fractional DBAs
SQL Server Specialists (We work alongside
general tech consulting firms)
Compliance (HIPAA, SOX, SOC2)
How can we assist you?
6. 6
1. Identifying the problem & why you should care
Problem:
The database is the foundation of the entire
application or corporate stack. If the database
is slow…
7. 2. There are many reasons for databases to get slower over time
(i.e. bottlenecks)
7
Cause is usually:
CPU
Memory
Disk IO
Network
8. 3. Slow-downs happen when queries are inefficient
8
But Why Jim:
More users
More data
volume
More complex
queries
9. 4. Which solution is faster & cheaper?
9
Solution:
A. Upgrade hardware and migrate.
B. Figure out which queries are the biggest resource hogs
and make adjustments.
That doesn’t sound
cheap!
So offending queries
use far fewer resources.
10. 5. Performance Tuning gets to the root cause of slowdowns
10
Benefit = Lower Cost
Benefit = Tuning is more effective at improving
speed & performance
11. 6. Understanding how queries are processed
11
SQL Server processes query; makes
Execution Plan
Execution Plan cached;
remembered next time
Ad hoc (one-time, on-demand)
queries can fill up the cache with lots
of these (inefficient)
Stored Procedures reuse pre-cached
Execution Plans (more efficient)
14. 14
1. Identifying the problem & why you should care
What’s the difference between a backup and a disaster recovery
plan?
15. 15
2. There are lots of different technologies you might consider
using:
VM Snapshots
SAN Replication
Volume Shadow Copy
VEEAM
SQL Dump Files – Microsoft recommended
16. 16
3. Transaction Log explained
Diary of data changes
Diary won’t ‘clear’ (Truncate) and be reused until it is backed up (if
database in FULL mode)
T-Log (.LDF file) will grow and grow until drive fills up
DANGER! Full drive = corrupt database (and also bring it offline)!
17. 17
4. Transaction Log explained (continued)
FULL backup hurts performance
Saves off all data pages with valid data on it
Locks tables and indexes to access up to date data
T-Log backup DOES NOT hurt performance
T-Log is circular in usage. Segments (VLF)
T-Log backup backs up each VLF & “truncates” T-Log
Doesn’t lock tables
18. 18
5. There are also 2 different recovery modes to consider:
SIMPLE
Only non-production
Uses Transaction Log for current
transactions only.
T-Log only grows if a long transaction
with lots of data changes runs.
No point-in-time recovery (can only
recover to most recent FULL or
Differential backup).
FULL
Use for all Production databases.
Keeps T-Log as diary for all data
changes until T-Log is backed up (and
also ‘replicated’ if an HA/DR technology
is configured).
T-Log will grow until drive is filled if not
backed up.
Can perform point-in-time recovery
(restore to an exact millisecond before a
disaster so no data is lost).
19. 19
6. An example of Point in Time Recovery
Image Source: https://sqlbak.com/blog/sql-server-backup-and-restore/
20. 20
PRO TIP
If T-Log backup is getting too big,
and you can’t backup or shrink
- Switch your Recovery Mode to Simple*
[ ]
22. High Availability / Disaster Recovery
(HA/DR)
is a set of procedures and methods
used for proactive disaster protection
22
23. 23
1. Identifying the problem & why you should care
Reasons why you might want to consider HA/DR for your
company:
What does High Availability mean?
What is Disaster Recovery in this context?
What is AlwaysOn?
What are Availability Groups?
24. 24
2. Solutions involve removing the single point of failure
Clustering - redundant hardware
RAID - redundant individual disks
“Replication” - redundant databases
Transactional Replication Issues
Log Shipping Issues
Mirroring Issues
25. 25
3. Problems that arise with “Replication” methods
Transactional
Replication
MirroringLog Shipping
No automatic failover.
Secondary DB is not
really Online*.
Single DB solution.
Secondary offline
while restoring T-
Logs.
Secondary database is
not Online.
Single Mirror/ Secondary
only.
SNAC/Failover Partner
in connection string.
What will AlwaysOn Solve?
No automatic failover.
Major headache.
Higher
administration.
Republish articles,
etc.
Complicated
troubleshooting
26. 26
4. AlwaysOn Solves World Hunger!
…and peace on earth and goodwill toward men.
Automatic Failover
Multiple Replicas (secondaries) – and readable!
“Replication” - redundant databases
Offload Backups, Reporting, etc.
Availability Groups - assists with using multiple DBs
Lower administrative costs
Plus more!
27. 27
5. There are a few requirements to consider
Enterprise Edition
AD for WSFC
Nodes must be in the same domain
28. 28
7. HA, DR, or Both?
Synchronous
Asynchronous
Sync Async
Legend
32. 32
Columnstore indexes for big data
Query Store – better diagnostics for a DBA
In-Memory Databases
30x in-memory OLTP speed
100x in-memory Columnstore speed
Stretch databases (Auto-archiving)
Always Encrypted (at rest, in motion, cloud)
Temporal DB – track historical changes
Row-level security.
…and a lot more.
In case you missed these 2016 features…
33. What’s New in 2017…
33
Always On Availibility Group – supporting the ability to cross database
transactions among all databases, as well as, clusterless support in
Availibility Groups.
Machine Learning Services – SQL Server R Services have been
renamed in this release and now supports Python in addition to R.
In-memory and memory-optimized object enhancements.
SQL Server Reporting Services 2017 – the REST API and the “all in
one” on-premise, self-service Power BI.
Scale Out for SSIS.
Resumable online index rebuild – Pause & resume index builds to fit
your tight maintenance window. Each night, it can chip away a little at a
time.
For a full list of details visit: https://docs.microsoft.com/en-us/sql/sql-
server/what-s-new-in-sql-server-2017
CONCLUSION
34. SQL Server is beautiful…
but it can be a beast[ ]
34
35. You don’t need new hardware -
Tune for Performance[ ]
35
36. Keep your backups secure.
Disaster recovery methods should
be tested!
[ ]
36
37. Treated properly, MS SQL Server
can contribute a solid foundation to
the efforts of any business ][
37
38. Next Steps
● For another slide deck that delves deeper on SQL backups -
visit http://www.sqlwatchmen.com/contact-us
● To check out if a Database Diagnostic Exam is right for you
-
visit http://www.sqlwatchmen.com/services/database-
diagnostic-analysis
38
39. Let us help you
Protect Your Data
][
39
QUESTIONS
www.sqlwatchmen.com
Jim.Murphy@sqlwatchmen.com
@SQLMurph
Editor's Notes
Customers are frustrated; hurts your reputation
Employees are frustrated; hourglass of time wasted