- Oracle Database 12c introduced several new features for DBAs including adaptive execution plans, PGA_AGGREGATE_LIMIT parameter, enhanced statistics gathering options, renaming datafiles online, FETCH FIRST clause for limiting rows, table restoration using RMAN, SQL statements in RMAN, preupgrade and parallel upgrade utilities, and real-time ADDM analysis.
- Adaptive execution plans allow queries to switch plans during execution if row counts differ significantly from estimates. PGA_AGGREGATE_LIMIT provides a hard limit on PGA memory usage to prevent sessions from consuming too much. Enhanced statistics options include system statistics for Exadata, concurrent collection, and new histogram types.
Optimizing Query is very important to improve the performance of the database. Analyse query using query execution plan, create cluster index and non-cluster index and create indexed views
How to tune slow running SQLs in PostgreSQL? See this to know (with screenshots) -
1. See the explain plan and analyze the slow running query
2. Some basic tips for tuning the query
Optimizing Query is very important to improve the performance of the database. Analyse query using query execution plan, create cluster index and non-cluster index and create indexed views
How to tune slow running SQLs in PostgreSQL? See this to know (with screenshots) -
1. See the explain plan and analyze the slow running query
2. Some basic tips for tuning the query
The aim of the query optimizer is not only to provide the SQL engine execution plans that describe how to process data but also, and more importantly, to provide efficient execution plans. Even though this central component of Oracle Database is enhanced with every new release, there are always cases where it generates suboptimal execution plans. The aim of this presentation is to describe and demonstrate how, with Adaptive Query Optimization, which is a set of features available as of Oracle Database 12c, the query optimizer is able to generate less suboptimal execution plans.
Stream Processing with Pipelines and Stored ProceduresSingleStore
This talk will discuss an upcoming feature in MemSQL 6.5 showing how advanced stream processing use cases can be tackled with a combination of stored procedures (new in 6.0) and MemSQL's pipelines feature.
Proactive performance monitoring with adaptive thresholdsJohn Beresniewicz
Presentation given at UKOUG 2008 conference on the Adaptive Thresholds technology in Oracle database 10.2+ and Enterprise Manager 11. Adaptive Thresholds allows users to do consistent and effective performance monitoring across systems and architectures by using statistical characterization of metric streams to automatically set and adapt monitoring thresholds independent of application workload.
Antes de migrar de 10g a 11g o 12c, tome en cuenta las siguientes consideraciones. No es tan sencillo como simplemente cambiar de motor de base de datos, se necesita hacer consideraciones a nivel del aplicativo.
Accumulo Summit 2015: Building Aggregation Systems on Accumulo [Leveraging Ac...Accumulo Summit
Talk Abstract
Aggregation has long been a use case of Accumulo Iterators. Iterators' ability to reduce data during compaction and scanning can greatly simplify an aggregation system built on Accumulo. This talk will first review how Accumulo's Iterators/Combiners work in the context of aggregating values. I'll then step back and look at the abstraction of aggregation functions as commutative operations and the several benefits that result by making this abstraction. We will see how it becomes no harder to introduce powerful operations such as cardinality estimation and approximate top-k than it is to sum integers. I will show how to integrate these ideas into Accumulo with an example schema and Iterator. Finally, a practical aggregation use case will be discussed to highlight the concepts from the talk.
Speakers
Gadalia O'Bryan
Senior Solutions Architect, Koverse
Gadalia O'Bryan is a Sr. Solutions Architect at Koverse, where she leads customer projects and contributes to key feature and algorithm design, such as Koverse's Aggregation Framework. Prior to Koverse, Gadalia was a mathematician for the National Security Agency. She has an M.A. in mathematics from UCLA and has been working with Accumulo for the past 6 years.
Bill Slacum
Software Engineer, Koverse
Bill is an Accumulo committer and PMC member who has been working on large scale query and analytic frameworks since 2010. He holds BS's in computer science and financial economics from UMBC. Having never used his passport to leave the United States, he is currently a national man of mystery.
Oracle Performance Tuning Training | Oracle Performance TuningOracleTrainings
Email: inbox.oracletrainings@gmail.com
Contact: +91 8121 020 111
Oracle Performance Tuning Training helps to use Oracle Database performance tools in the command-line interface to optimize database performance and tune SQL statements.
Oracle Performance Tuning Training Course Content
Overview Of Performance Tuning
• Basic Concepts in Performance Tuning
• Getting Start with Performance Tuning Features & Tools
Designing & Developing for Performance
• Oracle_Methodology
• Understanding the Investment Options
• Understanding the Scalability
• System _Architecture
• The Application Design Principles
• Workload Testing, Modeling, & Implementation
• Deploying the New Applications
The Performance Improvement Methods
• Oracle Performance Improvement Method
• Emergency Performance_Methods
Configuring an Database for Performance
• Performance Considerations for the Initial Instance Configuration
• Creating & Maintaining Tables for Good Performance
• Performance Considerations for the Shared Servers
Automatic Performance Statistics
• Data Gathering
• Overview toAutomatic Workload Repository
The Automatic Performance Diagnostics
• Introduction to the Database Diagnostic Monitoring
• Automatic Database Diagnostic_ Monitor
Memory Configuration & Use
• Understanding the Memory Allocation Issues
• Configuring & Using the Buffer Cache
• Configuring & Using the Shared Pool and Large Pool
• Configuring & Using the Redo Log Buffer
• PGA Memory Management
I/O Configuration & Design
• Understanding the I/O
• The Basic I/O Configuration
Understanding The Operating System Resources
• Understanding The Operating System Performance Issues
• Solving the Operating System Problems
• Understanding Of CPU
PostgreSQL Hangout Replication Features v9.4Ashnikbiz
See the new enhancements in v9.4 which takes away the pain of guessing right wal_keep_segment
See the new time lagging replication capability in v9.4
Short intro to logical replication introduced in v9.4
SQL Server Tuning to Improve Database PerformanceMark Ginnebaugh
SQL Server tuning is a process to eliminate performance bottlenecks and improve application service. This presentation from Confio Software discusses SQL diagramming, wait type data, column selectivity, and other solutions that will help make tuning projects a success, including:
•SQL Tuning Methodology
•Response Time Tuning Practices
•How to use SQL Diagramming techniques to tune SQL statements
•How to read executions plans
Write Less (code) With More (Oracle Database 12c New Features)Oren Nakdimon
Oracle 12c introduced many new features that allow us developers to write less code than in previous releases, and become more efficient and productive.
Some features, such as Row Limiting and Lateral Inline Views, enhance the SQL language, so SQL statements can become much shorter and more readable than before.
Other features, such as Temporal Validity and In-Database Archiving, offer built-in functionality that previously had to be implemented by the application.
Attend this session to learn about several of these new features, and see many useful examples.
The aim of the query optimizer is not only to provide the SQL engine execution plans that describe how to process data but also, and more importantly, to provide efficient execution plans. Even though this central component of Oracle Database is enhanced with every new release, there are always cases where it generates suboptimal execution plans. The aim of this presentation is to describe and demonstrate how, with Adaptive Query Optimization, which is a set of features available as of Oracle Database 12c, the query optimizer is able to generate less suboptimal execution plans.
Stream Processing with Pipelines and Stored ProceduresSingleStore
This talk will discuss an upcoming feature in MemSQL 6.5 showing how advanced stream processing use cases can be tackled with a combination of stored procedures (new in 6.0) and MemSQL's pipelines feature.
Proactive performance monitoring with adaptive thresholdsJohn Beresniewicz
Presentation given at UKOUG 2008 conference on the Adaptive Thresholds technology in Oracle database 10.2+ and Enterprise Manager 11. Adaptive Thresholds allows users to do consistent and effective performance monitoring across systems and architectures by using statistical characterization of metric streams to automatically set and adapt monitoring thresholds independent of application workload.
Antes de migrar de 10g a 11g o 12c, tome en cuenta las siguientes consideraciones. No es tan sencillo como simplemente cambiar de motor de base de datos, se necesita hacer consideraciones a nivel del aplicativo.
Accumulo Summit 2015: Building Aggregation Systems on Accumulo [Leveraging Ac...Accumulo Summit
Talk Abstract
Aggregation has long been a use case of Accumulo Iterators. Iterators' ability to reduce data during compaction and scanning can greatly simplify an aggregation system built on Accumulo. This talk will first review how Accumulo's Iterators/Combiners work in the context of aggregating values. I'll then step back and look at the abstraction of aggregation functions as commutative operations and the several benefits that result by making this abstraction. We will see how it becomes no harder to introduce powerful operations such as cardinality estimation and approximate top-k than it is to sum integers. I will show how to integrate these ideas into Accumulo with an example schema and Iterator. Finally, a practical aggregation use case will be discussed to highlight the concepts from the talk.
Speakers
Gadalia O'Bryan
Senior Solutions Architect, Koverse
Gadalia O'Bryan is a Sr. Solutions Architect at Koverse, where she leads customer projects and contributes to key feature and algorithm design, such as Koverse's Aggregation Framework. Prior to Koverse, Gadalia was a mathematician for the National Security Agency. She has an M.A. in mathematics from UCLA and has been working with Accumulo for the past 6 years.
Bill Slacum
Software Engineer, Koverse
Bill is an Accumulo committer and PMC member who has been working on large scale query and analytic frameworks since 2010. He holds BS's in computer science and financial economics from UMBC. Having never used his passport to leave the United States, he is currently a national man of mystery.
Oracle Performance Tuning Training | Oracle Performance TuningOracleTrainings
Email: inbox.oracletrainings@gmail.com
Contact: +91 8121 020 111
Oracle Performance Tuning Training helps to use Oracle Database performance tools in the command-line interface to optimize database performance and tune SQL statements.
Oracle Performance Tuning Training Course Content
Overview Of Performance Tuning
• Basic Concepts in Performance Tuning
• Getting Start with Performance Tuning Features & Tools
Designing & Developing for Performance
• Oracle_Methodology
• Understanding the Investment Options
• Understanding the Scalability
• System _Architecture
• The Application Design Principles
• Workload Testing, Modeling, & Implementation
• Deploying the New Applications
The Performance Improvement Methods
• Oracle Performance Improvement Method
• Emergency Performance_Methods
Configuring an Database for Performance
• Performance Considerations for the Initial Instance Configuration
• Creating & Maintaining Tables for Good Performance
• Performance Considerations for the Shared Servers
Automatic Performance Statistics
• Data Gathering
• Overview toAutomatic Workload Repository
The Automatic Performance Diagnostics
• Introduction to the Database Diagnostic Monitoring
• Automatic Database Diagnostic_ Monitor
Memory Configuration & Use
• Understanding the Memory Allocation Issues
• Configuring & Using the Buffer Cache
• Configuring & Using the Shared Pool and Large Pool
• Configuring & Using the Redo Log Buffer
• PGA Memory Management
I/O Configuration & Design
• Understanding the I/O
• The Basic I/O Configuration
Understanding The Operating System Resources
• Understanding The Operating System Performance Issues
• Solving the Operating System Problems
• Understanding Of CPU
PostgreSQL Hangout Replication Features v9.4Ashnikbiz
See the new enhancements in v9.4 which takes away the pain of guessing right wal_keep_segment
See the new time lagging replication capability in v9.4
Short intro to logical replication introduced in v9.4
SQL Server Tuning to Improve Database PerformanceMark Ginnebaugh
SQL Server tuning is a process to eliminate performance bottlenecks and improve application service. This presentation from Confio Software discusses SQL diagramming, wait type data, column selectivity, and other solutions that will help make tuning projects a success, including:
•SQL Tuning Methodology
•Response Time Tuning Practices
•How to use SQL Diagramming techniques to tune SQL statements
•How to read executions plans
Write Less (code) With More (Oracle Database 12c New Features)Oren Nakdimon
Oracle 12c introduced many new features that allow us developers to write less code than in previous releases, and become more efficient and productive.
Some features, such as Row Limiting and Lateral Inline Views, enhance the SQL language, so SQL statements can become much shorter and more readable than before.
Other features, such as Temporal Validity and In-Database Archiving, offer built-in functionality that previously had to be implemented by the application.
Attend this session to learn about several of these new features, and see many useful examples.
How to convert schema to pluggable database to increase isolation. - Presentation - Advantages - Demo
Benefits of pluggable database for upgrade process. - To new platform - To new hardware -
MongoDB is a popular NoSQL database. This presentation was delivered during a workshop.
First it talks about NoSQL databases, shift in their design paradigm, focuses a little more on document based NoSQL databases and tries drawing some parallel from SQL databases.
Second part, is for hands-on session of MongoDB using mongo shell. But the slides help very less.
At last it touches advance topics like data replication for disaster recovery and handling big data using map-reduce as well as Sharding.
This presentation talks about the different ways of getting SQL Monitoring reports, reading them correctly, common issues with SQL Monitoring reports - and plenty of Oracle 12c-specific improvements!
“A new multitenant architecture that easily deploy and manage database clouds. Innovations such as Oracle Multitenant for consolidating multiple databases, Automatic Data Optimization for compressing and tiering data at a higher density also maximize resource efficiency and flexibility. These unique advancements, combined with major enhancements in availability, security, and big data support, ideal platform for private and public cloud deployments.”
Python 101: Python for Absolute Beginners (PyTexas 2014)Paige Bailey
If you're absolutely new to Python, and to programming in general, this is the place to start!
Here's the breakdown: by the end of this workshop, you'll have Python downloaded onto your personal machine; have a general idea of what Python can help you do; be pointed in the direction of some excellent practice materials; and have a basic understanding of the syntax of the language.
Please don't forget to bring your laptop!
Audience: "Python 101" is geared toward individuals who are new to programming. If you've had some programming experience (shell scripting, MATLAB, Ruby, etc.), then you'll probably want to check out the more intermediate workshop, "Python 101++".
Apache Apex Fault Tolerance and Processing SemanticsApache Apex
Apache Apex (http://apex.incubator.apache.org/) is an open source stream processing and next generation analytics platform incubating at the Apache Software Foundation. Apex is Hadoop native and was built from ground up for scalability, low-latency processing, high availability and operability.
In this webinar, you will learn about Apache Apex fault tolerance, high availability and processing guarantees.
From the users perspective, fault tolerance of a stream processing platform should cover the state of the application/processor and the in-flight data. In the event of failure, the platform should recover, restore state and resume processing with no loss of data. We will cover:
* Components of an Apex application and how they are made fault tolerant
* How native YARN support is leveraged for fault tolerance
* How operator checkpointing works and how the user can tune it
* Failure scenarios, recovery from failures, incremental recovery
* Processing guarantees and which option is appropriate for your application
* Sample topology for highly available, low latency real-time processing
* How is fault-tolerance in Apex different from similar platforms such as Storm, Spark Streaming and Flink.
Presented by Thomas Weise, Architect & Co-founder; Pramod Immaneni, Architect on BrightTALK on Mar 24th, 2016
On version 12c Oracle introduced new features to allow Adaptive optimizations: Adaptive Plans and Adaptive Statistics. After a quick presentation of concepts, this session will explore the interaction of these features with other performance management techniques using examples, like SPM and SQL profiles. Attendees will get an updated picture of tools available to troubleshoot performance issues, and how to get the most of these new features.
Oracle optimizer is very complex and is getting more complex with every version. This presentation covers some new optimizer behavior and how to deal with it
New Features for Database Administrator of Oracle 12c Database. Here are some of excellent Oracle 12c new features with examples for learning purpose. SQL,Backup and recovery, Database management, Oracle RAC, Oracle ASM included.
An AMIS Overview of Oracle database 12c (12.1)Marco Gralike
Presentation used by Lucas Jellema and Marco Gralike during the AMIS Oracle Database 12c Launch event on Monday the 15th of July 2013 (much thanks to Tom Kyte, Oracle, for being allowed to use some of his material)
M.
New Features
● Developer and SQL Features
● DBA and Administration
● Replication
● Performance
By Amit Kapila at India PostgreSQL UserGroup Meetup, Bangalore at InMobi.
http://technology.inmobi.com/events/india-postgresql-usergroup-meetup-bangalore
AMIS organiseerde op maandagavond 15 juli het seminar ‘Oracle database 12c revealed’. Deze avond bood AMIS Oracle professionals de eerste mogelijkheid om de vernieuwingen in Oracle database 12c in actie te zien! De AMIS specialisten die meer dan een jaar bèta testen hebben uitgevoerd lieten zien wat er nieuw is en hoe we dat de komende jaren gaan inzetten!
Deze presentatie is deze avond gegeven als een plenaire sessie!
2. Points to note before the presentation
• This slide is self made
• I don’t know everything
3. Features
• Adaptive execution plans during runtime
• PGA_AGGREGATE_LIMIT
• Enhanced Statistics options
• Renaming a datafile online
• Fetch First X Rows only
• Table restoration using rman
• Invisible columns
• Sql statements in rman directly
• preupgrd.sql and parallel upgrade utility
• Real-time ADDM analysis
4. Adaptive execution plans during
runtime
• Execution of a statement can start with one
plan, and (during execution) switch to
another.
• Correct it in flight.
• It is enabled during the hard parse, and used
during execution.
• As the statement executes, if the embedded
counters for actual cardinality cross those
limits, it will switch plan.
8. PGA_AGGREGATE_LIMIT
• So far we have been using
PGA_AGGREGATE_TARGET which is like a soft
limit.
• PGA memory consumption can go beyond
PGA_AGGREGATE_TARGET at times.
• PGA_AGGREGATE_LIMIT is a hard limit. If this
limit is reached, Oracle will terminate sessions
consuming the most untunable PGA.
9. • Jobs that are killed end with a notification : ORA-
04036: PGA memory used by the instance exceeds
PGA_AGGREGATE_LIMIT
• Default value is calculated as below :
• 1. 2 GB
2. Two times of PGA_AGGREGATE_TARGET parameter
• 3. The value of PROCESS parameter * 3M
• In oracle apps , this is set to 0 , which means the
default value, which could be any fro above 3.
10. • How to find which process caused ORA-04036 ?
• Use below steps :
• dba_hist_active_sess_history and sort by PGA
usage in Desc order.
• The top in the list is the sql_id which has issues.
• Use query in reference URL to find the rows
returned / plan changed when it got bad.
11. Enhanced Statistics options
• DBMS_STATS.GATHER_SYSTEM_STATS has now an option to gather system
stats for an Exadata machine. ( It actually came in 11.2.0.4 onwards).
• Allows concurrent statistics collection using job scheduler, AQ and
resource manager. Can reduce time to gather stats overall however the
system should have the capacity to take the load.
• Has to be explicitly enabled.
• Cardinality feedback is now renamed to Statistic feedback. *
• Dynamic Sampling has now been renamed to Dynamics Statistics.*
• 2 new types of histograms are introduced , top frequency and hybrid. (
other being frequency and height based).
• Online stats gathering during CTAS and IAS and during partition creation. (
has some restrictions though).
• It is possible to have session-private statistics for global temporary tables.
• * will be covered later
12. Renaming a datafile online
• Release 12c made is more easy , all steps
taken care by just giving the below command :
• ALTER DATABASE MOVE DATAFILE
'/u01/app/oracle/oradata/cdb1/system01.dbf'
TO '/tmp/system01.dbf';
13. Fetch First X Rows only
• Prior to 12 c , to get the top 5 the query would be :
SELECT ename, sal FROM
( SELECT ename, sal, RANK() OVER (ORDER BY sal DESC) sal_rank FROM emp )
WHERE sal_rank <= 10;
• IN 12c , that’s taken care using FETCH FIRST N ROWS
ONLY as below :
SELECT val FROM
rownum_order_test
ORDER BY val DESC FETCH FIRST 5 ROWS ONLY;
• 12c also supports queries for pagination , fetching last
20% etc. ( refer to references for more details).
14. Table restoration using rman
• Table Point In Time Recovery (PITR)
• Table Point In Time Recovery (PITR) to Dump
File
• Table Point In Time Recovery (PITR) in a
Pluggable Database (PDB)
15. • General syntax :
• RECOVER TABLE 'TEST'.'T1' UNTIL SCN
1853267 AUXILIARY DESTINATION '/u01/aux'
REMAP TABLE 'TEST'.'T1':'T1_PREV';
• Auxiliary is where it will generate an auxiliary
database only with the file it has to extract.
17. preupgrd.sql and parallel upgrade
utility
• Earlier used was utlu121s.sql however that has
been changed to preupgrd.sql
• Apart from verification , it gives a list of changes
to be done as part of fixup scripts.
In Earlier releases there was no option to do an
upgrade in parallel. catupgrd.sql is now replaced
with catctl.pl utility.
Syntax :
cd $ORACLE_12_HOME/perl/bin $ ./perl catctl.pl –n 3 -catupgrd.sql
18. Real-time ADDM analysis
• Needs OEM 12 c
• Helpful during hung/unresponsive DB time
• Steps :
• Select the Emergency Monitoring option from
the Performance menu on the Access the Database Home page.
• This will show the top blocking sessions in the Hang Analysis table.
• Select the Real-Time ADDM option from the Performance to
perform Real-time ADDM analysis.
• After collecting the performance data, click on the Findings tab to
get the interactive summary of all the findings.
19. • What is dynamic Sampling ?
• Oracle Database 10g introduced Dynamic
Sampling to allow the optimizer to gather
additional information at parse time if
database statistics were missing, stale or
insufficient to produce a good execution plan.
• Value from 1 to 10 , default value is 2.
20. • So what is cardinality feedback ?
• When the optimizer generates an execution plan the presence of
missing statistics, stale statistics, complex predicates or complex
operators may trigger the optimizer to monitor the cardinality of
operations in the plan. Once the execution is complete, if there is a
significant difference between the estimated and actual
cardinalities, the actual cardinalities are stored in the SGA for later
use and the statement is marked as reoptimizable. On next
execution the statement is reoptimized using the stored
cardinalities, allowing a better plan to be determined. Cardinality
feedback is statement specific and is lost if the instance is restarted
or the statement is aged out of the shared pool. In Oracle Database
12c, cardinality feedback has been renamed to statistics feedback.