You’re a busy Oracle DBA. Your phone rings. It’s your most troublesome user, once again complaining that her query is running slow. You take a quick look at the execution plan, find a possible choice for a new index to improve its performance, and drop it in place: Problem solved. Or is it? Even an experienced DBA may not immediately realize the impact that new index will have on the performance of dozens of other queries and DML statements.
Finally, there’s a better way: Let the database decide.
I'll show you how Automatic Indexing (AI) - one of the newest features of Oracle Database 19c – provides an intriguing alternative to reactive performance tuning methodologies for index creation. We’ll look at how AIC reacts to a heavy hybrid application workload and then holistically builds, tests, and implements the most appropriate secondary indexes needed to improve database performance.
The Changing Role of a DBA in an Autonomous WorldMaria Colgan
The advent of the cloud and the introduction of Oracle Autonomous Database Cloud presents opportunities for every organization, but what's the future role for the DBA? This presentation explores how the role of the DBA will continue to evolve, and provides advice on key skills required to be a successful DBA in the world of the cloud.
The presentation helps to introduce the key aspects of the Oracle Optimizer and how you find out what it's up to and how you can influence its decisions.
Part2 Best Practices for Managing Optimizer StatisticsMaria Colgan
Part 2 of the SQL Tuning workshop focuses on Optimizer Statistics and the best practices for managing them, including when and how to gather statistics. It also covers what additional information you may need to give the Optimizer and provides guidance on when not to gather statistics. Finally we look at all of the techniques you can use to speed up statistics gathering including taking advantage of Incremental statistics, parallelism and concurrency.
Introduction to microsoft sql server 2008 r2Eduardo Castro
In this presentation we review the new features in SQL 2008 R2.
Regards,
Ing. Eduardo Castro Martinez, PhD
http://comunidadwindows.org
http://ecastrom.blogspot.com
The final part of the SQL Tuning workshop focuses on applying the techniques discussed in the previous sections to help diagnose and correct a number of problematic SQL statements and shows how you can use SQL Plan Management or a SQL Patch to influence an execution plan.
This is one of the 15 minute "TED" style talk presented as part of the Database Symposium at the ODTUG Kscope18 conference. In this presentation @SQLMaria shares details on 4 useful supplied PL/SQL package with the Oracle Database
The Changing Role of a DBA in an Autonomous WorldMaria Colgan
The advent of the cloud and the introduction of Oracle Autonomous Database Cloud presents opportunities for every organization, but what's the future role for the DBA? This presentation explores how the role of the DBA will continue to evolve, and provides advice on key skills required to be a successful DBA in the world of the cloud.
The presentation helps to introduce the key aspects of the Oracle Optimizer and how you find out what it's up to and how you can influence its decisions.
Part2 Best Practices for Managing Optimizer StatisticsMaria Colgan
Part 2 of the SQL Tuning workshop focuses on Optimizer Statistics and the best practices for managing them, including when and how to gather statistics. It also covers what additional information you may need to give the Optimizer and provides guidance on when not to gather statistics. Finally we look at all of the techniques you can use to speed up statistics gathering including taking advantage of Incremental statistics, parallelism and concurrency.
Introduction to microsoft sql server 2008 r2Eduardo Castro
In this presentation we review the new features in SQL 2008 R2.
Regards,
Ing. Eduardo Castro Martinez, PhD
http://comunidadwindows.org
http://ecastrom.blogspot.com
The final part of the SQL Tuning workshop focuses on applying the techniques discussed in the previous sections to help diagnose and correct a number of problematic SQL statements and shows how you can use SQL Plan Management or a SQL Patch to influence an execution plan.
This is one of the 15 minute "TED" style talk presented as part of the Database Symposium at the ODTUG Kscope18 conference. In this presentation @SQLMaria shares details on 4 useful supplied PL/SQL package with the Oracle Database
OUG Harmony 2012 - Using SQL Plan Baselines for Performance TestingMaris Elsins
My presentation (OUG Harmony 2012 in Tallin) on how to use SQL Plan baselines to assess the completeness of testing. I also have a white-paper on this topic, see the whitepapers section.
Five Tips to Get the Most Out of Your IndexingMaria Colgan
This is one of the 15 minute "TED" style talk presented as part of the Database Symposium at the ODTUG Kscope18 conference. In this presentation @SQLMaria provides 5 useful tips for getting the most out of indexes in the Oracle Database
En esta sesión revisamos las nuevas mejoras y funcionalidades que estarán implementadas en la siguiente versión de SQL Server principalmente en Seguridad, Rendimiento y Alta Disponibilidad
Getting the most out of your Oracle 12.2 Optimizer (i.e. The Brain)SolarWinds
The Oracle Optimizer is the main brain behind an Oracle database, especially since it’s required in processing every SQL statement. The optimizer determines the most efficient execution plan based on the structure of the given query, the statistics available on the underlying objects as well as using all pertinent optimizer features available. In this presentation, we will introduce all of the new optimizer / statistics-related features in Oracle 12.2 release.
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowRodrigo Radtke de Souza
ODI is an incredible and flexible development tool that goes beyond simple data integration. But most of its development power comes from outside-the-box ideas.
* Did you ever want to dynamically run any number of “OS” commands using a single ODI component?
* Did you ever want to have only one data store and loop different sources without the need of different ODI contexts?
* Did you ever want to have only one interface and loop any number of ODI objects with a lot of control?
* Did you ever need to have a “third command tab” in your procedures or KMs to improve ODI powers?
* Do you still use an old version of ODI and miss a way to know the values of the variables in a scenario execution?
* Did you know ODI has four “substitution tags”? And do you know how useful they are?
* Do you use “dynamic variables” and know how powerful they can be?
* Do you know how to have control over you ODI priority jobs automatically (stop, start, and restart scenarios)?
Ground Breakers Romania: Explain the explain_planMaria Colgan
This session was delivered as part of the EMEA Ground Breakers tour in Romania, Oct. 2019. The execution plan for a SQL statement can often seem complicated and hard to understand. Determining if the execution plan you are looking at is the best plan you could get or attempting to improve a poorly performing execution plan can be a daunting task even for the most experienced DBA or developer. This session examines the different aspects of an execution plan, from selectivity to parallel execution and explains what information you should be gleaming from the plan and how it affects the execution. It offers insight into what caused the Optimizer to make the decision it did as well as a set of corrective measures that can be used to improve each aspect of the plan.
Optimizing Alert Monitoring with Oracle Enterprise ManagerDatavail
Watch this webinar to find out how OEM Grid configuration using Datavail’s Alert Optimizer™ and custom templates helps eliminate unwanted alerts, while enriching actionable alerts, and improving the performance of the entire database system.
These five areas help organize the tuning approach and define the major concerns beyond the architecture, setup, and data model. It also addresses how performance tuning becomes less of a mystery if it can be measured, documented, affected, and improved.
Intel IT empowers business units to easily make rapid, impactful business decisions. Ingesting a variety of internal/external data sources has challenges. This slideset covers how Intel IT overcame the issues with Hadoop and Gobblin. Learn more at http://www.intel.com/itcenter
Informatica Power Center - Workflow ManagerZaranTech LLC
50-55 hours Training + Assignments + Actual Project Based Case Studies
All attendees will receive,
Assignment after each module, Video recording of every session
Notes and study material for examples covered.
Access to the Training Blog & Repository of Materials
Training Highlights
Focus on Hands on training
30-35 hours of Assignments, Live Case Studies
Video Recordings of sessions provided
Demonstration of Concepts using different tools
One Problem Statement discussed across the Whole training program
Informatica Certification Guidance
Resume prep, Interview Questions provided
Introduction to Data Warehousing, Infomatica Designer
Understand the Transformation, Mapping and Qualifier
Informatica Advanced Features
An Autonomous Singularity Approaches: Force Multipliers For Overwhelmed DBAsJim Czuprynski
Autonomous Database Services have expanded well beyond their original scope of heavy analytical workloads (ADW) and hybrid transaction processing / reporting workloads (ATP) to include dedicated Cloud-based instances to eliminate contention between “noisy neighbors” in the same region and domain.
I'll explain how Oracle DBAs at any skill level can immediately leverage Autonomous resources as force multipliers to free them from most mundane administration tasks so they can concentrate on mastering the new skills required to become an Enterprise Data Architect - the emerging post-DBA role – and shift their focus towards building better enterprise systems in concert with their organization’s application developers, business analysts, and business units.
OUG Harmony 2012 - Using SQL Plan Baselines for Performance TestingMaris Elsins
My presentation (OUG Harmony 2012 in Tallin) on how to use SQL Plan baselines to assess the completeness of testing. I also have a white-paper on this topic, see the whitepapers section.
Five Tips to Get the Most Out of Your IndexingMaria Colgan
This is one of the 15 minute "TED" style talk presented as part of the Database Symposium at the ODTUG Kscope18 conference. In this presentation @SQLMaria provides 5 useful tips for getting the most out of indexes in the Oracle Database
En esta sesión revisamos las nuevas mejoras y funcionalidades que estarán implementadas en la siguiente versión de SQL Server principalmente en Seguridad, Rendimiento y Alta Disponibilidad
Getting the most out of your Oracle 12.2 Optimizer (i.e. The Brain)SolarWinds
The Oracle Optimizer is the main brain behind an Oracle database, especially since it’s required in processing every SQL statement. The optimizer determines the most efficient execution plan based on the structure of the given query, the statistics available on the underlying objects as well as using all pertinent optimizer features available. In this presentation, we will introduce all of the new optimizer / statistics-related features in Oracle 12.2 release.
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowRodrigo Radtke de Souza
ODI is an incredible and flexible development tool that goes beyond simple data integration. But most of its development power comes from outside-the-box ideas.
* Did you ever want to dynamically run any number of “OS” commands using a single ODI component?
* Did you ever want to have only one data store and loop different sources without the need of different ODI contexts?
* Did you ever want to have only one interface and loop any number of ODI objects with a lot of control?
* Did you ever need to have a “third command tab” in your procedures or KMs to improve ODI powers?
* Do you still use an old version of ODI and miss a way to know the values of the variables in a scenario execution?
* Did you know ODI has four “substitution tags”? And do you know how useful they are?
* Do you use “dynamic variables” and know how powerful they can be?
* Do you know how to have control over you ODI priority jobs automatically (stop, start, and restart scenarios)?
Ground Breakers Romania: Explain the explain_planMaria Colgan
This session was delivered as part of the EMEA Ground Breakers tour in Romania, Oct. 2019. The execution plan for a SQL statement can often seem complicated and hard to understand. Determining if the execution plan you are looking at is the best plan you could get or attempting to improve a poorly performing execution plan can be a daunting task even for the most experienced DBA or developer. This session examines the different aspects of an execution plan, from selectivity to parallel execution and explains what information you should be gleaming from the plan and how it affects the execution. It offers insight into what caused the Optimizer to make the decision it did as well as a set of corrective measures that can be used to improve each aspect of the plan.
Optimizing Alert Monitoring with Oracle Enterprise ManagerDatavail
Watch this webinar to find out how OEM Grid configuration using Datavail’s Alert Optimizer™ and custom templates helps eliminate unwanted alerts, while enriching actionable alerts, and improving the performance of the entire database system.
These five areas help organize the tuning approach and define the major concerns beyond the architecture, setup, and data model. It also addresses how performance tuning becomes less of a mystery if it can be measured, documented, affected, and improved.
Intel IT empowers business units to easily make rapid, impactful business decisions. Ingesting a variety of internal/external data sources has challenges. This slideset covers how Intel IT overcame the issues with Hadoop and Gobblin. Learn more at http://www.intel.com/itcenter
Informatica Power Center - Workflow ManagerZaranTech LLC
50-55 hours Training + Assignments + Actual Project Based Case Studies
All attendees will receive,
Assignment after each module, Video recording of every session
Notes and study material for examples covered.
Access to the Training Blog & Repository of Materials
Training Highlights
Focus on Hands on training
30-35 hours of Assignments, Live Case Studies
Video Recordings of sessions provided
Demonstration of Concepts using different tools
One Problem Statement discussed across the Whole training program
Informatica Certification Guidance
Resume prep, Interview Questions provided
Introduction to Data Warehousing, Infomatica Designer
Understand the Transformation, Mapping and Qualifier
Informatica Advanced Features
An Autonomous Singularity Approaches: Force Multipliers For Overwhelmed DBAsJim Czuprynski
Autonomous Database Services have expanded well beyond their original scope of heavy analytical workloads (ADW) and hybrid transaction processing / reporting workloads (ATP) to include dedicated Cloud-based instances to eliminate contention between “noisy neighbors” in the same region and domain.
I'll explain how Oracle DBAs at any skill level can immediately leverage Autonomous resources as force multipliers to free them from most mundane administration tasks so they can concentrate on mastering the new skills required to become an Enterprise Data Architect - the emerging post-DBA role – and shift their focus towards building better enterprise systems in concert with their organization’s application developers, business analysts, and business units.
ABAP Test Cockpit in action with Doctor ZedGe and abap2xlsxIvan Femia
The powerful ABAP Test Cockpit in action and the a new SAP related product in the domain of Custom ABAP Code Application Lifecycle realized by Techedge.
MySQL 5.7 is GA. Here is the news about our NoSQL features in MySQL and MySQL Cluster, with a lot of emphasize on the new JSON features that make MySQL suitable as a document store.
Maintenance Plans for Beginners (but not only) | Each of experienced administrators used (to some extent) what is called Maintenance Plans - Plans of Conservation. During this session, I'd like to discuss what can be useful for us to provide functionality when we use them and what to look out for. Session at 200 times the forward-300, with the opening of the discussion.
Vote Early, Vote Often: From Napkin to Canvassing Application in a Single Wee...Jim Czuprynski
The frenetic pace of application development in modern IT organizations means it’s not unusual to demand an application be built with minimal requirement gathering – literally, from a napkin-based sketch – to a working first draft of the app within extremely short time frames – even a weekend! – with production deployment to follow just a few days later.
I'll demonstrate a real-life application development scenario – the creation of a mobile application that gives election canvassers a tool to identify, classify, and inform voters in a huge suburban Chicago voting district – using the latest Oracle application development UI, data modeling tools, and database technology. Along the way, we’ll show how Oracle APEX makes short work of building a working application while the Oracle DBA leverages her newest tools – SQL Developer and Data Modeler – to build a secure, reliable, scalable application for her development team.
DB Optimizer Datasheet - Automated SQL Profiling & Tuning for Optimized Perfo...Embarcadero Technologies
Learn more about DB Optimizer and try it free at: http://embt.co/DBOptimizer
Embarcadero® DB Optimizer™ XE6 is an automated SQL optimization tool that maximizes database and application performance by quickly discovering, diagnosing, and optimizing poor-performing SQL code. DB Optimizer empowers DBAs and database developers to eliminate performance bottlenecks by graphically profiling key metrics inside the database, relating resource utilization to specific queries, and helping to visually tune problematic SQL.
Practical SQL query monitoring and optimizationIvo Andreev
Practical SQL query monitoring and optimization
Today the project owners demand results as soon as possible and most often - for yesterday. Time to market is crucial and it is practical to deliver bit-by-bit, get feedback and grow with the number of your customers. But as the project grows, the team does too and not all have the same expertise. As well rarely in the beginning the requirements clear enough to allow performance-wise SQL interaction. In most cases there does not exist an ORM that can solve this task for you and you will need to have hard T-SQL writer in the team. If you already know this story or are going this way then in this practical session we will share how to monitor, measure and optimize your SQL code and DB layer interaction.
Modern business is fast and needs to take decisions immediatly. It cannot wait that a traditional BI task that works on data snapshots at some time. Social data, Internet of Things, Just in Time don't undestand "snapshot" and needs working on streaming, live data. Microsoft offers a PaaS solution to satisfy this need with Azure Stream Analytics. Let's see how it works.
Modern Oracle DBAs have spent years acquiring extremely valuable skills, even while facing increased responsibility for growing numbers of diverse multi-version databases, demands to transition to public cloud computing Infrastructure, and a never-ending drumbeat for upskilling and relevance in our industry. It’s the perfect time to consider a transition in your career by leveraging your expertise with the Oracle database in a new role as a Data Engineer (DE).
Going Native: Leveraging the New JSON Native Datatype in Oracle 21cJim Czuprynski
Need to incorporate JSON documents into existing Oracle database applications? The new native JSON datatype introduced in Oracle 21c makes it simple to store, access, traverse, and filter the complex data often found within JSON documents, often without any application code changes.
Access Denied: Real-World Use Cases for APEX and Real Application SecurityJim Czuprynski
Limiting users’ access to data is still a thorny issue in many Oracle shops: How do we insure only the right people view - much less change! - only the data they’re allowed to? We’ll show you how we solved those issues for a large government agency with hundreds of external users via Real Application Security (RAS), whether they’re using APEX applications or direct-access tools like SQLcl.
Charge Me Up! Using Oracle ML, Analytics, and APEX For Finding Optimal Charge...Jim Czuprynski
Think finding a close parking space is a challenge? Finding the closest charging station for your EV when you’re running short on battery power will be the next nightmare for drivers in Smart Cities. I’ll show how to use existing Oracle Machine Learning, Analytics, and APEX to find the closest charge point while driving, as well as determine where it makes the most sense to placed charge points to benefit utility customers.
Graphing Grifters: Identify & Display Patterns of Corruption With Oracle GraphJim Czuprynski
Uncovering patterns of suspicious behavior is no longer something only an experienced gumshoe or fraud investigator can ferret out. Using Oracle’s powerful Machine Learning algorithms and Property Graph plug-ins, we’ll show how to quickly identify and display potentially suspicious financial transactions.
So an Airline Pilot, a Urologist, and an IT Technologist Walk Into a Bar: Thi...Jim Czuprynski
It’s no joke: The IT industry is undergoing a maelstrom of change – ever-increasing data volumes, horrendous security incursions, the promise / threat of Cloud-based computing, and a gradual loss of its most talented people through age-based attrition. What’s needed more than ever is a revival of professionalism within our ranks, and it’s time for us to rise up as a community to strive towards that goal. Seriously - if you are just doing your IT job and are perfectly satisfied with your status in our industry, please don’t even bother downloading this presentation. (Just kidding!)
Autonomous Transaction Processing (ATP): In Heavy Traffic, Why Drive Stick?Jim Czuprynski
Autonomous Transaction Processing (ATP) - the second in the family of Oracle’s Autonomous Databases – offers Oracle DBAs the ability to apply a force multiplier for their OLTP database application workloads. However, it’s important to understand both the benefits and limitations of ATP before migrating any workloads to that environment. I'll offer a quick but deep dive into how best to take advantage of ATP - including how to load data quickly into the underlying database – and some ideas on how ATP will impact the role of Oracle DBA in the immediate future. (Hint: Think automatic transmission instead of stick-shift.)
Conquer Big Data with Oracle 18c, In-Memory External Tables and Analytic Func...Jim Czuprynski
There’s an onslaught of Big Data coming to our IT shops - zettabytes of it! – but instead of your application developers struggling to learn new languages and techniques to analyze it, why not leverage Oracle Database 18c?
I'll demonstrate how to tackle handling the coming Big Data tidal wave with the best tool ever designed to filter, sort, aggregate, and report information: Structured Query Language. We’ll also take a closer look at using some new Analytic Functions in 19c to make short work of complex analyses and how best to leverage 18c’s latest Database In-Memory features for External Tables. And we’ll even explore how easy it is to leverage External Tables in Autonomous Data Warehouse using the latest features of DBMS_CLOUD.
What's Your Super-Power? Mine is Machine Learning with Oracle Autonomous DB.Jim Czuprynski
Artificial Intelligence (AI) and Machine Learning (ML) are a lot like preserving the Earth's environment: Almost everyone is talking about what should be done to save it, but very few people have committed to actually doing something about it. I'll demonstrate a few real-life opportunities to discover unseen patterns and relationships within sample financial and election data by leveraging the AI and ML capabilities already built into Oracle Autonomous Database.
Politics Ain’t Beanbag: Using APEX, ML, and GeoCoding In a Modern Election Ca...Jim Czuprynski
Oracle announced in December 2019 its Spatial and Graph features are now included without additional licensing costs for Oracle databases. This means application developers now have low-cost access to powerful geolocation, routing, and mapping capabilities – a welcome addition for any Application Express (APEX) application that previously shied away from implementing those features. I'll demonstrate a real-life use case – handling the changing demands of a modern election campaign, including managing widely-dispersed volunteers and voters, using geolocation for merchandise distribution, and identifying “flippable” voters with ML and analytics – through a mobile-capable APEX application.
Keep Your Code Low, Low, Low, Low, Low: Getting to Digitally Driven With Orac...Jim Czuprynski
In the brave new digitally-driven world, IT organizations can no longer focus on internal-only RDBMS databases as the central pillar of their infrastructure; data must be accessed externally as well, regardless of format or location, with utmost security. Fortunately, Oracle’s Converged Database strategy makes it simple to satisfy these demands. This presentation explores the myriad facets of a Converged Database strategy and what it means for your career’s future path, regardless of whether you’re an application developer or DBA.
Cluster, Classify, Associate, Regress: Satisfy Your Inner Data Scientist with...Jim Czuprynski
The modern data scientist has a daunting task: Probing petabytes of data, figuring out which Machine Learning (ML) algorithms to apply to filter the grain from the chaff, and producing meaningful intelligence on which to base digitally-driven strategies for their organization. This presentation demonstrates how even a fledgling citizen data scientist facing new real-life opportunities to discover unseen patterns and relationships within sample data can quickly leverage the powerful ML capabilities already built into the Oracle Database and available for use at no additional cost.
Where the %$#^ Is Everybody? Geospatial Solutions For Oracle APEXJim Czuprynski
Geospatial use cases are common – closest coffeeshop, efficient delivery routing, other stores near me – and I’ll show you how to use Oracle’s Spatial and Graph feature set to tackle them within a simple-to-build APEX application.
JSON, A Splash of SODA, and a SQL Chaser: Real-World Use Cases for Autonomous...Jim Czuprynski
JSON is the new XML! It’s everywhere, from NoSQL databases to REST APIs. Let me share with you how Oracle’s Autonomous JSON Database (AJD) makes short work of handling JSON-resident information, especially when paired with robust functions and features of Oracle 19c and 21c.
Fast and Furious: Handling Edge Computing Data With Oracle 19c Fast Ingest an...Jim Czuprynski
The Internet of Things (IoT) has deep use cases - energy grids, communications, policing, security, and manufacturing. I’ll show how to use Oracle 19c’s Fast Ingest and Fast Lookup features to load IoT data from “edge” sources to take immediate advantage of that information in nearly real time.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
One Less Thing For DBAs to Worry About: Automatic Indexing
1. One Less Thing For DBAs
to Worry About:
Automatic Indexing
Jim Czuprynski
@JimTheWhyGuy
2. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Who Am I, and How Did I Get Here?
E-mail me at jczuprynski@zerodefectcomputing.com
Follow me on Twitter (@JimTheWhyGuy)
Connect with me on LinkedIn (Jim Czuprynski)
Traveler & public speaker Summers:
Wisconsin
Winters:
Illinois
Cyclist
XC skier
Avid
amateur
bird
watcher
Oldest dude in
Krav Maga class
3. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Our Agenda
•Automatic Indexing: Evolutionary, Not Revolutionary!
•TPC-E, the Perfect Hybrid Workload for Automatic Indexing
•Activating, Controlling, and Monitoring Automatic Indexing
•Reviewing the Fruits of Automatic Indexing’s Labour
•A Demonstration: Automatic Indexing in Action
4. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Why Bother?
• Exadata leverages Smart Scan technology and techniques to quickly filter only needed data from
large datasets, often leveraging parallel processing, partitioning, and storage indexes
• Online Transaction Processing (OLTP) operations cannot always leverage Smart Scan due to
transaction scope (which tends to be quite small)
• Hybrid workloads – i.e. OLTP transactions accompanied by real-time reporting activity – may be
able to benefit from Smart Scan STORAGE ACCESS FULL operations …
• … but often the reporting activity may focus on much smaller result sets that partitioning,
parallelism, or storage indexes may be of little help in retrieving
• Therefore, secondary indexes may be immensely helpful for these queries …
• … but for RAC databases, too many indexes may contribute to incessant GCS messaging and waits
Exadata technology - the same hardware that underlies all Autonomous Database
services – has proven itself as an extremely scalable and highly available platform for
not only reporting and analytics, but OLTP / hybrid workloads as well
Therefore, be it Resolved:
Not all secondary indexes are evil!
(As long as they’re the right
secondary indexes.)
5. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Evolutionary, Not Revolutionary!
SQL Tuning Advisor
SQL Access Advisor
SQL Profiles
SQL Plan Baselines
Automatic SQL Tuning
SQL Performance Analyzer
Autonomous Health Framework
Integrated SPA and Database
Replay
Automatic In-Memory Population
SPA Result Set Validation
Improved Exadata SQL Tuning
High-Frequency Statistics
Real-Time Statistics
SQL Quarantine
Automatic Indexing
6. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Methodology
8. April 2-6, 2017 in Las Vegas, NV USA #C17LV
TPC-E’s Complex Schema
The 33-table
TPC-E data model is
definitely
non-trivial…
In short, TPC-E implements an
OLTP-oriented schema that’s
focused on huge numbers of
Trades performed for
Customers, either at the
request of a Broker or the
Customer herself
9. April 2-6, 2017 in Las Vegas, NV USA #C17LV
TPC-E’s Application Workload Simulation
… and neither is its
functional implementation
via PL/SQL in Swingbench
Five OLTP transactions encompass Trade
Request activity, including determination
of how each sale or purchase will be
settled and how it affects the Holdings
retained in each Customer’s Account …
…while five other transactions reflect
hybrid report activities, from simple
(show a current Customer’s Account
Balance) to complex (list the most active
n Securities across all portfolios)
11. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Leveraging DBMS_AUTO_INDEX
Procedure Purpose
CONFIGURE
Controls AI configuration settings, including:
• Mode (IMPLEMENT, REPORT ONLY, OFF)
• Report and logging retention
• Index retention period for auto and manual secondary indexes
• Default tablespace for indexes and how much space to
allocate
• Denying schemas from leveraging AI implementation
DROP_SECONDARY_INDEXES
Remove AI and secondary indexes for entire database, specific
schema(s), or specific table(s) within a schema
REPORT_ACTIVITY
Generate reporting at various summary and detail levels about AI
activity, including impacts of each AI index that’s been made
VISIBLE
REPORT_LAST_ACTIVITY
Generate reporting at various summary and detail levels about AI
activity during the immediately last evaluation period
12. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What If I Don’t Have Access To an Exadata Platform?
How to simulate an Exadata environment for AI evaluation:
1
SQL> ALTER SYSTEM
SET "_exadata_feature_on” = true
SCOPE=SPFILE;
SQL> SHUTDOWN IMMEDIATE;
SQL> STARTUP;
SQL> EXEC DBMS_AUTO_INDEX.CONFIGURE(
parameter_name => 'AUTO_INDEX_MODE’
,parameter_value => ‘IMPLEMENT’);
Here’s a neat trick to fake out your Oracle
19c test environment into thinking it’s
actually an Exadata platform!
(Provenance: @JulianDontcheff)
Choose either:
• IMPLEMENT (activates AI fully)
• REPORT ONLY (activates AI analyses only – no
indexes created)
• OFF (deactivates AI completely)
After a successful instance bounce, activate Automatic
Indexing via DBMS_AUTO_INDEX.CONFIGURE:
2
Note: This is intended only for evaluation purposes only – not ever for production implementation!
13. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Activating and Controlling Automatic Indexing
SQL> EXEC DBMS_AUTO_INDEX.CONFIGURE(
parameter_name => ‘AUTO_INDEX_RETENTION_FOR_AUTO’
,parameter_value => 373);
SQL> EXEC DBMS_AUTO_INDEX.CONFIGURE(
parameter_name => ‘AUTO_INDEX_RETENTION_FOR_MANUAL’
,parameter_value => 181);
. . .
AI Parameter Setting
-------------------------------- ---------
AUTO_INDEX_COMPRESSION OFF
AUTO_INDEX_DEFAULT_TABLESPACE
AUTO_INDEX_MODE IMPLEMENT
AUTO_INDEX_REPORT_RETENTION 31
AUTO_INDEX_RETENTION_FOR_AUTO 373
AUTO_INDEX_RETENTION_FOR_MANUAL
AUTO_INDEX_SCHEMA
AUTO_INDEX_SPACE_BUDGET 50
Parameter Description
AUTO_INDEX_COMPRESSION Controls whether secondary indexes are compressed
(default: OFF)
AUTO_INDEX_DEFAULT_TABLESPACE Defines default tablespace in which Automatic Indexing
will instantiate secondary indexes (by default, the default
PERMANENT tablespace)
AUTO_INDEX_MODE Controls level of Automatic Indexing applied
AUTO_INDEX_REPORT_RETENTION Limits retention of Automatic Indexing reports to specified
number of days (default: 31)
AUTO_INDEX_RETENTION_FOR_AUTO Limits how long (in days) an unused secondary index
created by Automatic Indexing will be kept (default: 373)
AUTO_INDEX_RETENTION_FOR_MANUAL Limits how long (in days) an unused secondary index not
created by Automatic Indexing will be kept (default: NULL)
AUTO_INDEX_SCHEMA Defines which schemas are included or excluded from
Automatic Indexing (default: all non-SYS schemas included)
AUTO_INDEX_SPACE_BUDGET Controls how much space is allocated to secondary indexes
created by Automatic Indexing (default: 50%)
14. April 2-6, 2017 in Las Vegas, NV USA #C17LV
How Is Automatic Indexing Configured Right Now?
SQL> SELECT parameter_name, parameter_value
FROM dba_auto_index_config;
AI Parameter Setting
-------------------------------- ---------
AUTO_INDEX_COMPRESSION OFF
AUTO_INDEX_DEFAULT_TABLESPACE
AUTO_INDEX_MODE IMPLEMENT
AUTO_INDEX_REPORT_RETENTION 31
AUTO_INDEX_RETENTION_FOR_AUTO 373
AUTO_INDEX_RETENTION_FOR_MANUAL
AUTO_INDEX_SCHEMA
AUTO_INDEX_SPACE_BUDGET 50
It is already activated and it’s running in fully
automatic mode. It can also be set to only gather
intelligence for later index implementation
(REPORT ONLY) or even deactivated (OFF)
Logging will be retained for 31 days; any
automatically-created indexes will be
retained for at least 373 days …
… and up to 50% of the default
tablespace can be allocated for
automatically–created indexes
16. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Accessing Its Metadata
View Description
DBA_AUTO_INDEX_CONFIG Shows all current standard configuration parameters and settings
DBA_AUTO_INDEX_STATISTICS Describes detailed statistics of operations performed during a
Automatic Index task execution
DBA_AUTO_INDEX_VERIFICATIONS Captures “before and after” performance statistics for SQL
statements evaluated for Automatic Indexing improvement
DBA_AUTO_INDEX_IND_ACTIONS Lists the commands issued to create and instantiate secondary
indexes automatically
DBA_AUTO_INDEX_SQL_ACTIONS Identifies any specific SQL plan baselines that were created to
improve SQL statement performance
DBA_ADVISOR_EXECUTIONS
DBA_ADVISOR_FINDINGS
DBA_ADVISOR _OBJECTS
Contain details about AI task executions, related AI advisor
findings (including errors during task executions), and database
objects used during / impacted by task executions
DBA_INDEXES
DBA_INDEX_COLUMNS
Lists the indexes created through AI tasks and their related
columns, including current index status (INVISIBLE vs. VISIBLE)
17. April 2-6, 2017 in Las Vegas, NV USA #C17LV
So … Has Automatic Indexing Been Doing Anything?
SQL> SELECT
execution_id
,TO_CHAR(execution_start,
'yyyy-mm-dd.hh24:mi:ss') exec_dtm
,status
,advisor_name
FROM dba_advisor_executions
WHERE task_name='SYS_AUTO_INDEX_TASK'
AND execution_start >= (SYSDATE - 6/24)
ORDER BY execution_id DESC;
In this case, Automatic Indexing has been
tirelessly executing every 15 minutes
since it was activated
SQL> SELECT type, attr17, adv_sql_id
FROM dba_advisor_objects
WHERE task_name = 'SYS_AUTO_INDEX_TASK'
AND type = 'SQL’
ORDER BY attr17 DESC, object_id;
It’s even possible to see which individual SQL
statements have been (re-)evaluated during
each Automatic Indexing advisor execution
18. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Are There Any Automatic Indexes Already?
SQL> SELECT owner, table_name, index_name, visibility
FROM dba_indexes
WHERE auto = 'YES'
ORDER BY 1,2,3;
OWNER TABLE_NAME INDEX_NAME VISIBILITY
----- -------------------------------- -------------------------------- ------------
TPCE ADDRESS SYS_AI_c3s7r26pujqyw INVISIBLE
TPCE COMPANY SYS_AI_5bz560x7mkmm5 INVISIBLE
TPCE COMPANY SYS_AI_8m4x6f5kzagpk INVISIBLE
TPCE COMPANY_COMPETITOR SYS_AI_g16pbfxkcvndg INVISIBLE
TPCE CUSTOMER_ACCOUNT SYS_AI_2nq8gbwuzdb6j INVISIBLE
TPCE CUSTOMER_ACCOUNT SYS_AI_d3kmzk12banrf VISIBLE
TPCE DAILY_MARKET SYS_AI_804nrthjdbw65 INVISIBLE
TPCE FINANCIAL SYS_AI_f48n5gfuab5xd INVISIBLE
TPCE HOLDING_HISTORY SYS_AI_c2vqkp1cnaynt INVISIBLE
TPCE HOLDING_SUMMARY SYS_AI_5unr1rda8j36j INVISIBLE
TPCE NEWS_XREF SYS_AI_8v3ttavnf0607 INVISIBLE
TPCE SECURITY SYS_AI_2gm9u3nyxkwcu INVISIBLE
TPCE SECURITY SYS_AI_4qyqwxyvbn1ut INVISIBLE
TPCE TRADE SYS_AI_1hjwdmk5q4mkz VISIBLE
TPCE TRADE SYS_AI_385rjxyamg6nd VISIBLE
TPCE TRADE SYS_AI_a8805thkfs7ua VISIBLE
TPCE TRADE SYS_AI_f03t41rg8f49c INVISIBLE
TPCE TRADE_HISTORY SYS_AI_cbcn2hcywmvcb INVISIBLE
TPCE WATCH_ITEM SYS_AI_cz35y7a104y79 INVISIBLE
TPCE WATCH_LIST SYS_AI_3h68gvvm1cmvr INVISIBLE
The SYS_AI prefix is proof that Automatic
Indexing has been hard at work …
… but even
though Automatic
Indexing created
these indexes
automatically,
some are still
INVISIBLE because
they’re not yet
valuable enough
to improve
workload
performance
19. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing: Peeking Under the Covers?
SQL> SELECT *
FROM sys.smb$config
WHERE parameter_name LIKE '%_AUTO_INDEX%’
ORDER BY 1;
PARAMETER_NAME PARAMETER_VALUE
---------------------------------- ---------------
_AUTO_INDEX_ABSDIFF_THRESHOLD 100
_AUTO_INDEX_CONCURRENCY 1
_AUTO_INDEX_CONTROL 0
_AUTO_INDEX_DERIVE_STATISTICS 0
_AUTO_INDEX_IMPROVEMENT_THRESHOLD 20
_AUTO_INDEX_REBUILD_COUNT_LIMIT 5
_AUTO_INDEX_REBUILD_TIME_LIMIT 30
_AUTO_INDEX_REGRESSION_THRESHOLD 10
_AUTO_INDEX_REVERIFY_TIME 30
_AUTO_INDEX_SPA_CONCURRENCY 1
_AUTO_INDEX_STS_CAPTURE_TASK 0
_AUTO_INDEX_TASK_INTERVAL 900
_AUTO_INDEX_TASK_MAX_RUNTIME 3600
_AUTO_INDEX_TRACE 0
Parameter [Probably] Controls …
_AUTO_INDEX_IMPROVEMENT_THRESHOLD Minimum performance improvement to consider before
activating a secondary index (???)
_AUTO_INDEX_REBUILD_COUNT_LIMIT Maximum number of times permitted to retry instantiating
a secondary index via REBUILD ONLINE
_AUTO_INDEX_REBUILD_TIME_LIMIT Maximum time allotted to instantiate a secondary index
can be instantiated as VISIBLE (which requires REBUILD
ONLINE)
_AUTO_INDEX_TASK_MAX_RUNTIME Longest permitted advisor task run time (in seconds)
_AUTO_INDEX_TRACE Activates tracing (0 = off, 1 = high-level, 2 = detailed)
20. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing in Action: Leveraging REPORT ONLY Mode
In this small-scale test in REPORT ONLY mode, 20
index candidates are identified and overall
performance improvement is forecasted at 91X:
1
This statement improved
respectably, by almost 9X …
2
… because of the addition of a single
new secondary index, reducing
estimated cost significantly
3
Here’s a bit more impressive
performance improvement, projected
to be 22,460X!
4
Here’s the original plan …
5
… and the new plan
6
In this latest release of Automatic
Indexing, note that it can also identify a
SQL Plan Baseline that might be
beneficial for performance
improvement
7
21. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Automatic Indexing in Action: Switching to IMPLEMENT Mode
Here’s a look at what Automatic Indexing
projected for the indexes it had already
created in REPORT ONLY mode …
1
… and here’s some details under the
covers on what Automatic Indexing
actually did during each executions
2
Here’s a look at the
SwingBench sessions and
their corresponding SQL
statements hammering
the database
3
Here, we’ll drill into just
one of the queries
positively affected by a
newly-instantiated
secondary index
4 Finally, here’s a reflection of how
activating Automatic Indexing in
IMPLEMENT mode improved
performance for several queries
5
22. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Check Out Our White Paper on ATP-D and Automatic Indexing!
• Shows implementation of intense Swingbench
simulated TPC-E workload against an ATP-D instance
• Explains how Automatic Indexing improved
workload performance by over two orders of
magnitude … without any DBA intervention
Download the free white paper now!
https://viscosityna.com/resources/whitepapers/atp-19c/
23. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Useful Resources and Documentation
• Automatic Indexing Documentation:
https://docs.oracle.com/en/database/oracle/oracle-database/19/admin/managing-indexes.html#GUID-D1285CD5-
95C0-4E74-8F26-A02018EA7999
• DBMS_AUTO_INDEX Package Documentation:
https://docs.oracle.com/en/database/oracle/oracle-database/19/arpls/DBMS_AUTO_INDEX.html#GUID-78C59A20-
2F92-448F-96F7-6C4FBB355E42
• Julian Dontcheff’s Blog Posts on Automatic Indexing:
https://juliandontcheff.wordpress.com/2019/02/18/automatic-indexing-in-19c/
https://juliandontcheff.wordpress.com/2019/03/07/ai-in-ai-artificial-intelligence-in-automatic-indexing/
• Franck Pachot’s Blog Post on Automatic Indexing:
https://medium.com/@FranckPachot/19c-auto-index-the-dictionary-views-ea2927a9786
Editor's Notes
Package DBMS_AUTO_INDEX and its procedures provides command and control capabilities for implementing AI, including generation of detailed reports of prior AI evaluations and explanations of why a particular AI secondary index has been made VISIBLE.
The DBA_AUTO_INDEX_CONFIG data dictionary view contains full information on which aspects and features of AI are currently activated.
The DBA_AUTO_INDEX_CONFIG data dictionary view contains full information on which aspects and features of AI are currently activated.
The DBA_AUTO_INDEX_CONFIG data dictionary view contains full information on which aspects and features of AI are currently activated.
Package DBMS_AUTO_INDEX and its procedures provides command and control capabilities for implementing AI, including generation of detailed reports of prior AI evaluations and explanations of why a particular AI secondary index has been made VISIBLE.
Any secondary index created by AI is prefixed with SYS_AI, so they’re easy to identify.
However, in this example, note that only four of the nearly 20 AI indexes created are actually VISIBLE because they have been determined via AI and ML to be of definite benefit to application workloads. The other indexes will be retained up to the threshold defined by AUTO_INDEX_RETENTION_FOR_AUTO and if they have not been used after that threshold expires, they will be automatically purged.
Any secondary index created by AI is prefixed with SYS_AI, so they’re easy to identify.
However, in this example, note that only four of the nearly 20 AI indexes created are actually VISIBLE because they have been determined via AI and ML to be of definite benefit to application workloads. The other indexes will be retained up to the threshold defined by AUTO_INDEX_RETENTION_FOR_AUTO and if they have not been used after that threshold expires, they will be automatically purged.
The DBA_AUTO_INDEX_CONFIG data dictionary view contains full information on which aspects and features of AI are currently activated.