This document provides an overview of SQL tuning in Oracle 10g using the SQL Tuning Advisor and SQL Access Advisor. It describes the challenges of manual SQL tuning and how the advisors automate the tuning process. The SQL Tuning Advisor analyzes SQL statements, statistics, and access paths to recommend optimizations like indexes, SQL profile changes, and statistics gathering. The SQL Access Advisor recommends comprehensive index and materialized view strategies for a workload. The document outlines how to use the advisors through the Oracle Enterprise Manager interface or PL/SQL APIs and provides best practices for live and remote SQL tuning.
SQL Server Query Optimization, Execution and Debugging Query PerformanceVinod Kumar
This document summarizes a presentation on SQL Server query optimization, execution, and debugging query performance. The key takeaways are: 1) estimated row counts affect plan selection because the optimizer uses cardinality estimates to determine query plan costs; 2) tools like SSMS, DMVs, and tracing can be used to find estimated and actual row counts and compare query plans; 3) parameterized queries can cause issues if the plan is reused for parameter values that expected different plans. Techniques for influencing plan choice and testing considerations for parameterized queries are also discussed.
This resume summary provides details about Dipankar Banik's career objective, skills, and experience. Banik has over 6 years of experience as an Oracle DBA and developer with expertise in Oracle, MySQL, data replication, ETL processes, database performance tuning, and more. He is seeking a position that allows him to utilize his skills and experience to further an organization's objectives while gaining new professional growth opportunities.
This document discusses SQL Performance Analyzer and how it can be used to forecast the impact of potential database changes on the performance of SQL queries. It extracts a SQL Tuning Set (STS) from production, transports it to a test system, re-executes the SQL after applying changes, detects any performance improvements, regressions or plan changes, and allows tuning of regressed SQL queries.
Msbi Online Training is Offering at Glory IT Technologies. We have Certified Working Professionals on this Modules. They trained so many Global Students. We also Provides Corporate Training, Job/Project Support Services to msbi . We are Only Institute Delivering Best Online Training Services to this Module.
This document discusses using Oracle tools to manage database performance through SQL tuning. It covers using the SQL Tuning Advisor to identify and tune SQL statements that use the most resources. It also discusses using the SQL Access Advisor to tune a workload and the SQL Performance Analyzer to compare SQL performance before and after changes. The objectives are to learn to use these tools to optimize SQL performance and tune applications and workloads.
Antes de migrar de 10g a 11g o 12c, tome en cuenta las siguientes consideraciones. No es tan sencillo como simplemente cambiar de motor de base de datos, se necesita hacer consideraciones a nivel del aplicativo.
This document provides an overview of Module 5: Optimize query performance in Azure SQL. The module contains 3 lessons that cover analyzing query plans, evaluating potential improvements, and reviewing table and index design. Lesson 1 explores generating and comparing execution plans, understanding how plans are generated, and the benefits of the Query Store. Lesson 2 examines database normalization, data types, index types, and denormalization. Lesson 3 describes wait statistics, tuning indexes, and using query hints. The lessons aim to help administrators optimize query performance in Azure SQL.
SQL Server Query Optimization, Execution and Debugging Query PerformanceVinod Kumar
This document summarizes a presentation on SQL Server query optimization, execution, and debugging query performance. The key takeaways are: 1) estimated row counts affect plan selection because the optimizer uses cardinality estimates to determine query plan costs; 2) tools like SSMS, DMVs, and tracing can be used to find estimated and actual row counts and compare query plans; 3) parameterized queries can cause issues if the plan is reused for parameter values that expected different plans. Techniques for influencing plan choice and testing considerations for parameterized queries are also discussed.
This resume summary provides details about Dipankar Banik's career objective, skills, and experience. Banik has over 6 years of experience as an Oracle DBA and developer with expertise in Oracle, MySQL, data replication, ETL processes, database performance tuning, and more. He is seeking a position that allows him to utilize his skills and experience to further an organization's objectives while gaining new professional growth opportunities.
This document discusses SQL Performance Analyzer and how it can be used to forecast the impact of potential database changes on the performance of SQL queries. It extracts a SQL Tuning Set (STS) from production, transports it to a test system, re-executes the SQL after applying changes, detects any performance improvements, regressions or plan changes, and allows tuning of regressed SQL queries.
Msbi Online Training is Offering at Glory IT Technologies. We have Certified Working Professionals on this Modules. They trained so many Global Students. We also Provides Corporate Training, Job/Project Support Services to msbi . We are Only Institute Delivering Best Online Training Services to this Module.
This document discusses using Oracle tools to manage database performance through SQL tuning. It covers using the SQL Tuning Advisor to identify and tune SQL statements that use the most resources. It also discusses using the SQL Access Advisor to tune a workload and the SQL Performance Analyzer to compare SQL performance before and after changes. The objectives are to learn to use these tools to optimize SQL performance and tune applications and workloads.
Antes de migrar de 10g a 11g o 12c, tome en cuenta las siguientes consideraciones. No es tan sencillo como simplemente cambiar de motor de base de datos, se necesita hacer consideraciones a nivel del aplicativo.
This document provides an overview of Module 5: Optimize query performance in Azure SQL. The module contains 3 lessons that cover analyzing query plans, evaluating potential improvements, and reviewing table and index design. Lesson 1 explores generating and comparing execution plans, understanding how plans are generated, and the benefits of the Query Store. Lesson 2 examines database normalization, data types, index types, and denormalization. Lesson 3 describes wait statistics, tuning indexes, and using query hints. The lessons aim to help administrators optimize query performance in Azure SQL.
The document discusses tuning SQL queries in Oracle databases. It begins by noting that while tools can help, there is no single process for tuning every query as each case depends on factors like the schema design, data distribution and how the optimizer chooses a plan. The document then provides a methodology for investigating and tuning a query with poor performance, including getting the execution plan, checking it visually, and identifying possible causes like stale statistics, missing indexes or inefficient SQL.
Sql server club - performance management methodologies and enhancements in sq...Charley Hanania
The document summarizes a SQL Club meeting about enterprise performance management. It discusses tools like Performance Dashboard Reports, DMVStats, SQL Server Management Studio, the Management Data Warehouse, Operations Manager, the SQL Server Health and History Tool, and Performance Point. It covers how these tools can be used to measure performance, identify issues, perform historical analysis, and present metrics and KPIs. It also discusses new capabilities in SQL Server 2008 like Resource Governor and Extended Events.
The document summarizes the performance and scalability capabilities of Microsoft SQL Server 2008. It discusses how SQL Server 2008 provides tools to optimize performance for databases of any size through features like an improved query processing engine and partitioning. It also explains how SQL Server 2008 allows databases to scale up by supporting new hardware and scale out through technologies like distributed partitioning and replication.
Vijaya Lakshmi P has over 3 years of experience as a SQL Server Database Administrator. She has expertise in installing, configuring, managing, monitoring and troubleshooting various versions of Microsoft SQL Server. Some of her responsibilities include database backups, high availability implementations such as database mirroring and log shipping, and addressing issues like locking, blocking and deadlocks. She is currently working as a Software Engineer at Honeywell, Bangalore where she administers the SQL servers for their AEROCMS project.
Satya SK Jayanty is an experienced data architect and SQL Server expert based in Edinburgh, UK. He offers consulting services related to database development, administration, and performance tuning. He has over 18 years of experience working with SQL Server and providing software architecture and data platform solutions. Some of his past clients include DunnHumby, Cashfac Solutions, Sucden Financials, Firstplus, Flagstone Reinsurance, British Telecom, and The Royal Bank of Scotland Group.
This document contains the resume of Satya SK Jayanty, who has over 21 years of experience as a solutions architect, consultant, and subject matter expert for SQL Server. He provides data platform solutions and specializes in architecture, database administration, business intelligence, and training. He has extensive experience delivering projects for many clients in industries such as banking, insurance, retail, and oil and gas. He is a Microsoft MVP and has authored books and conference presentations on SQL Server administration and security.
Red Rock Consulting is an Australian IT services company focused on providing solutions using Microsoft SQL Server and Oracle technologies. They have developed RockSolid, an automated database management product that uses virtualization and automation to provide consistent high service levels for SQL Server instances. RockSolid monitors databases, analyzes issues, resolves problems automatically using predefined processes, and provides capacity planning to reduce management costs and improve support.
This document outlines the author's experience with business intelligence tools including data modeling, T-SQL, SQL Server Integration Services, SQL Server Analysis Services, MDX programming, SQL Server Reporting Services, Performance Point Server, and SharePoint Server. Specific examples provided include designing an OLAP data warehouse schema, developing ETL processes in SSIS, building and deploying an SSAS cube, writing MDX queries, creating parameterized reports in SSRS, developing reports in Performance Point Server published to SharePoint, and integrating various reporting solutions using SharePoint. The author has over 20 years of IT experience including requirements gathering, database and application design, development, testing, documentation, and support.
MicroStrategy integrates with Microsoft SQL Server in several ways to optimize analytical queries:
1) MicroStrategy generates SQL Server-specific syntax and pushes over 120 functions to take advantage of SQL Server's analytics capabilities.
2) MicroStrategy uses multi-pass SQL and intermediate tables to help answer complex analytical questions, with options like global temporary tables and parallel query execution.
3) MicroStrategy supports key SQL Server features like parallel queries, indexed views, compression, and partitioning to improve performance.
This document provides an overview of using Sybase WorkSpace to develop applications for Sybase IQ. It discusses WorkSpace features for enterprise modeling, database development, and migrating data and schemas from Sybase ASE to IQ. Specific capabilities covered include conceptual and physical data modeling, SQL development and debugging, schema development, and using WorkSpace to model replication environments and stage data migration to IQ. Links are provided to learn more about Sybase IQ, WorkSpace, and related products.
This document summarizes new features in SQL Server 2016 including improvements to SQL Server Integration Services, Master Data Services, Analysis Services, Data Quality Services, and Reporting Services. Key enhancements include increased data source support, performance optimizations, expanded DAX functionality, custom parameters in Reporting Services, and integration with Power BI. The presentation provides an overview of these features to help users understand the capabilities of SQL Server 2016.
This document provides a summary of Satya SK Jayanty's experience and qualifications. He has over 18 years of experience providing database and architecture solutions using technologies like SQL Server. Some of his roles include Principal Consultant, Director, Principal Software Architect, and Solutions Architect. He has worked with several large companies in industries like banking, insurance, and telecommunications.
This professional summary outlines Shashank Jain's 5+ years of experience in Microsoft Business Intelligence and Data Warehousing tools like SQL Server Integration Services, Reporting Services, and Analysis Services. He has experience designing, developing, and supporting BI solutions, including ETL development, cube modeling, report scheduling, and more. Shashank is seeking a role where he can utilize his skills and experience in MSBI tools, databases, and programming languages like Java and SQL.
This document summarizes a presentation about modernizing SQL Server databases. It discusses:
1. Why organizations may want to modernize their databases, such as to reduce costs, maintain compliance, or keep vendor support.
2. The concept of database compatibility level, which sets database behaviors to be compatible with a specified SQL Server version. Certifying databases based on compatibility level rather than specific SQL Server versions simplifies certification.
3. Tools that can help with the modernization process, including the Database Migration Assistant for assessment and migration, the Database Experimentation Assistant for testing, and the Query Tuning Assistant for addressing query regressions.
4. The recommended process of using these tools is to discover the current
This document provides an overview of auditing data access in SQL Server. It discusses various methods for auditing such as using common criteria, SQL Trace, DML triggers, temporal tables, and implementing SQL Server Audit. SQL Server Audit is described as the primary auditing tool in SQL Server that can track both server and database level events. Considerations for implementing and managing SQL Server Audit are also covered.
SQL Server Workshop for Developers - Visual Studio Live! NY 2012Andrew Brust
Here are the key enhancements to the OVER clause in SQL Server 2012:
- Ability to specify both PARTITION BY and ORDER BY clauses, allowing window functions to operate over ordered partitions of data. This enables more advanced windowing scenarios.
- New window frame specifications - RANGE and ROWS, which allow window functions to consider rows before and/or after the current row within the partition. This enables window functions like moving averages.
- Ability to use window functions with aggregate functions like SUM(), COUNT(), etc. This allows calculations like cumulative sums within partitions.
- Performance improvements for window functions through optimizations like push-down of predicates and better parallelization.
So in summary, SQL Server 2012 significantly expands the
The document discusses SQL Server migrations from Oracle databases. It highlights top reasons for customers migrating to SQL Server, including lower total cost of ownership, improved performance, and increased developer productivity. It also outlines concerns about migrations and introduces the SQL Server Migration Assistant (SSMA) tool, which automates components of database migrations to SQL Server.
The document discusses monitoring databases to assess server performance over time. Effective monitoring involves periodically measuring performance metrics to identify issues and tracking trends. This helps minimize response times and maximize throughput. The document provides an overview of monitoring SQL Server components and tools, establishing a performance baseline, isolating problems, and identifying bottlenecks. It also discusses monitoring server performance and activity using SQL Server and Windows tools.
MySQL 5.7 includes several improvements such as 3x faster performance for point selects, native JSON support with indexing capabilities, InnoDB optimizations like online buffer pool resizing and general tablespaces, and replication enhancements including multi-source replication and transaction-based parallel replication. The document provides details on these and other new features in areas like security, high availability, geospatial functions, and monitoring capabilities exposed through the performance schema and SYS schema.
This document summarizes the key aspects and process of migrating an Oracle database to SQL Server 2008/2012. It discusses the major components being migrated - schema, data, applications. The major steps are analysis, migration, testing and deployment. It then focuses on using Microsoft's SQL Server Migration Assistant (SSMA) for Oracle tool to migrate the schema, data, and business logic between the two databases.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
The document discusses tuning SQL queries in Oracle databases. It begins by noting that while tools can help, there is no single process for tuning every query as each case depends on factors like the schema design, data distribution and how the optimizer chooses a plan. The document then provides a methodology for investigating and tuning a query with poor performance, including getting the execution plan, checking it visually, and identifying possible causes like stale statistics, missing indexes or inefficient SQL.
Sql server club - performance management methodologies and enhancements in sq...Charley Hanania
The document summarizes a SQL Club meeting about enterprise performance management. It discusses tools like Performance Dashboard Reports, DMVStats, SQL Server Management Studio, the Management Data Warehouse, Operations Manager, the SQL Server Health and History Tool, and Performance Point. It covers how these tools can be used to measure performance, identify issues, perform historical analysis, and present metrics and KPIs. It also discusses new capabilities in SQL Server 2008 like Resource Governor and Extended Events.
The document summarizes the performance and scalability capabilities of Microsoft SQL Server 2008. It discusses how SQL Server 2008 provides tools to optimize performance for databases of any size through features like an improved query processing engine and partitioning. It also explains how SQL Server 2008 allows databases to scale up by supporting new hardware and scale out through technologies like distributed partitioning and replication.
Vijaya Lakshmi P has over 3 years of experience as a SQL Server Database Administrator. She has expertise in installing, configuring, managing, monitoring and troubleshooting various versions of Microsoft SQL Server. Some of her responsibilities include database backups, high availability implementations such as database mirroring and log shipping, and addressing issues like locking, blocking and deadlocks. She is currently working as a Software Engineer at Honeywell, Bangalore where she administers the SQL servers for their AEROCMS project.
Satya SK Jayanty is an experienced data architect and SQL Server expert based in Edinburgh, UK. He offers consulting services related to database development, administration, and performance tuning. He has over 18 years of experience working with SQL Server and providing software architecture and data platform solutions. Some of his past clients include DunnHumby, Cashfac Solutions, Sucden Financials, Firstplus, Flagstone Reinsurance, British Telecom, and The Royal Bank of Scotland Group.
This document contains the resume of Satya SK Jayanty, who has over 21 years of experience as a solutions architect, consultant, and subject matter expert for SQL Server. He provides data platform solutions and specializes in architecture, database administration, business intelligence, and training. He has extensive experience delivering projects for many clients in industries such as banking, insurance, retail, and oil and gas. He is a Microsoft MVP and has authored books and conference presentations on SQL Server administration and security.
Red Rock Consulting is an Australian IT services company focused on providing solutions using Microsoft SQL Server and Oracle technologies. They have developed RockSolid, an automated database management product that uses virtualization and automation to provide consistent high service levels for SQL Server instances. RockSolid monitors databases, analyzes issues, resolves problems automatically using predefined processes, and provides capacity planning to reduce management costs and improve support.
This document outlines the author's experience with business intelligence tools including data modeling, T-SQL, SQL Server Integration Services, SQL Server Analysis Services, MDX programming, SQL Server Reporting Services, Performance Point Server, and SharePoint Server. Specific examples provided include designing an OLAP data warehouse schema, developing ETL processes in SSIS, building and deploying an SSAS cube, writing MDX queries, creating parameterized reports in SSRS, developing reports in Performance Point Server published to SharePoint, and integrating various reporting solutions using SharePoint. The author has over 20 years of IT experience including requirements gathering, database and application design, development, testing, documentation, and support.
MicroStrategy integrates with Microsoft SQL Server in several ways to optimize analytical queries:
1) MicroStrategy generates SQL Server-specific syntax and pushes over 120 functions to take advantage of SQL Server's analytics capabilities.
2) MicroStrategy uses multi-pass SQL and intermediate tables to help answer complex analytical questions, with options like global temporary tables and parallel query execution.
3) MicroStrategy supports key SQL Server features like parallel queries, indexed views, compression, and partitioning to improve performance.
This document provides an overview of using Sybase WorkSpace to develop applications for Sybase IQ. It discusses WorkSpace features for enterprise modeling, database development, and migrating data and schemas from Sybase ASE to IQ. Specific capabilities covered include conceptual and physical data modeling, SQL development and debugging, schema development, and using WorkSpace to model replication environments and stage data migration to IQ. Links are provided to learn more about Sybase IQ, WorkSpace, and related products.
This document summarizes new features in SQL Server 2016 including improvements to SQL Server Integration Services, Master Data Services, Analysis Services, Data Quality Services, and Reporting Services. Key enhancements include increased data source support, performance optimizations, expanded DAX functionality, custom parameters in Reporting Services, and integration with Power BI. The presentation provides an overview of these features to help users understand the capabilities of SQL Server 2016.
This document provides a summary of Satya SK Jayanty's experience and qualifications. He has over 18 years of experience providing database and architecture solutions using technologies like SQL Server. Some of his roles include Principal Consultant, Director, Principal Software Architect, and Solutions Architect. He has worked with several large companies in industries like banking, insurance, and telecommunications.
This professional summary outlines Shashank Jain's 5+ years of experience in Microsoft Business Intelligence and Data Warehousing tools like SQL Server Integration Services, Reporting Services, and Analysis Services. He has experience designing, developing, and supporting BI solutions, including ETL development, cube modeling, report scheduling, and more. Shashank is seeking a role where he can utilize his skills and experience in MSBI tools, databases, and programming languages like Java and SQL.
This document summarizes a presentation about modernizing SQL Server databases. It discusses:
1. Why organizations may want to modernize their databases, such as to reduce costs, maintain compliance, or keep vendor support.
2. The concept of database compatibility level, which sets database behaviors to be compatible with a specified SQL Server version. Certifying databases based on compatibility level rather than specific SQL Server versions simplifies certification.
3. Tools that can help with the modernization process, including the Database Migration Assistant for assessment and migration, the Database Experimentation Assistant for testing, and the Query Tuning Assistant for addressing query regressions.
4. The recommended process of using these tools is to discover the current
This document provides an overview of auditing data access in SQL Server. It discusses various methods for auditing such as using common criteria, SQL Trace, DML triggers, temporal tables, and implementing SQL Server Audit. SQL Server Audit is described as the primary auditing tool in SQL Server that can track both server and database level events. Considerations for implementing and managing SQL Server Audit are also covered.
SQL Server Workshop for Developers - Visual Studio Live! NY 2012Andrew Brust
Here are the key enhancements to the OVER clause in SQL Server 2012:
- Ability to specify both PARTITION BY and ORDER BY clauses, allowing window functions to operate over ordered partitions of data. This enables more advanced windowing scenarios.
- New window frame specifications - RANGE and ROWS, which allow window functions to consider rows before and/or after the current row within the partition. This enables window functions like moving averages.
- Ability to use window functions with aggregate functions like SUM(), COUNT(), etc. This allows calculations like cumulative sums within partitions.
- Performance improvements for window functions through optimizations like push-down of predicates and better parallelization.
So in summary, SQL Server 2012 significantly expands the
The document discusses SQL Server migrations from Oracle databases. It highlights top reasons for customers migrating to SQL Server, including lower total cost of ownership, improved performance, and increased developer productivity. It also outlines concerns about migrations and introduces the SQL Server Migration Assistant (SSMA) tool, which automates components of database migrations to SQL Server.
The document discusses monitoring databases to assess server performance over time. Effective monitoring involves periodically measuring performance metrics to identify issues and tracking trends. This helps minimize response times and maximize throughput. The document provides an overview of monitoring SQL Server components and tools, establishing a performance baseline, isolating problems, and identifying bottlenecks. It also discusses monitoring server performance and activity using SQL Server and Windows tools.
MySQL 5.7 includes several improvements such as 3x faster performance for point selects, native JSON support with indexing capabilities, InnoDB optimizations like online buffer pool resizing and general tablespaces, and replication enhancements including multi-source replication and transaction-based parallel replication. The document provides details on these and other new features in areas like security, high availability, geospatial functions, and monitoring capabilities exposed through the performance schema and SYS schema.
This document summarizes the key aspects and process of migrating an Oracle database to SQL Server 2008/2012. It discusses the major components being migrated - schema, data, applications. The major steps are analysis, migration, testing and deployment. It then focuses on using Microsoft's SQL Server Migration Assistant (SSMA) for Oracle tool to migrate the schema, data, and business logic between the two databases.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Monitoring and Managing Anomaly Detection on OpenShift.pdfTosin Akinosho
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Programming Foundation Models with DSPy - Meetup SlidesZilliz
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on integration of Salesforce with Bonterra Impact Management.
Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceIndexBug
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Generating privacy-protected synthetic data using Secludy and MilvusZilliz
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Webinar: Designing a schema for a Data WarehouseFederico Razzoli
Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you.
A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services.
But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts.
We will discuss these topics:
- How to gather information about a business;
- Understanding dictionaries and how to identify business entities;
- Dimensions and facts;
- Setting a table granularity;
- Types of facts;
- Types of dimensions;
- Snowflakes and how to avoid them;
- Expanding existing dimensions and facts.
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 6
SQL_Tuning_Oracle_10g.pdf
1.
2. SQL Tuning in Oracle 10g:
The Do’s and Don’ts
Mughees A. Minhas
Group Product Manager
Database Manageability
Oracle Corp.
3. Outline
y Introduction
y Manual Tuning Challenges
y SQL Tuning & Access Advisor Overview
y SQL Tuning Advisor
– Automatic SQL Tuning
– Usage scenarios
– User interface
y SQL Access Advisor
– Usage scenarios
– User interface
y Tips, Do’s, Don’ts
y Conclusion
4. Introduction
y Automatic SQL Tuning solution consists of
– SQL Tuning Advisor
– SQL Access Advisor
y Provides comprehensive, automatic, and cost-
effective solution for application tuning
y Reduces SQL tuning time by up to 80%
y Reduces management cost
5. Manual Tuning Challenges
y Requires expertise in several domains
– SQL optimization: adjust the execution plan
– Access design: provide fast data access
– SQL design: use appropriate SQL constructs
y Time consuming
– Each SQL statement is unique
– Potentially large number of statements to tune
y Never ending task
– SQL workload always evolving
– Plan regressions
6. Manual Tuning Example
Packaged App Tuning Scenario
Manual Tuning
1. Get explain plan
2. Examine query objects and their sizes
3. Review and compare explain plan statistics with execution
statistics (stored in V$SQL view)
4. Identify the problem, e.g., “first rows” issue because only recent
data is ever displayed despite large history being queried
5. Contact application vendor
6. Produce test case for vendor
7. Get a patch with appropriate code modifications from the
vendor
8. Install the patch in next maintenance cycle
7. SQL Tuning & Access Advisor
Overview
How do I tune
my SQL
workload?
SQL Tuning &
Access Advisors
Solution
Component
of CBO
Provides
implementation
script
No expert
required
DBA
SQL
Workload
11. Automatic Tuning Optimizer (ATO)
y It is the query optimizer running in tuning mode
– Uses same plan generation process but performs
additional steps that require significantly more time
y It performs verification steps
– To validate statistics and its own estimates
y Uses dynamic sampling and partial executions to validate
y It performs exploratory steps
– To investigate the use of new indexes that could
provide significant speed-up
– To analyze SQL constructs that led to expensive
plan operators
13. Statistics Analysis
y Motivation
– Statistics are key input to the query optimizer
y Their availability and accuracy is very important
y In Oracle10g, the Automatic Statistics
Collection maintains statistics up to date…
– But it may not be enabled or properly configured!
y The ATO verifies statistics that it needs/uses
– Generates auxiliary information to compensate for
missing or stale statistics
– Generates recommendations to gather statistics
where appropriate
15. SQL Profiling
y Motivation
– Empower query optimizer to find better plan by
gathering additional information on query behavior
y The query optimizer has time constraints
– Makes compromises while finding right plan
y The ATO is allowed a lot more time
– Uses the time to gather customized information
about the SQL statement, known as SQL Profile
– Builds a SQL Profile and recommends it
– Once implemented, SQL Profile is used by the
query optimizer to generate a well-tuned plan
16. SQL Profile
y Contains auxiliary information collected by the
ATO for a SQL statement
– Customized optimizer settings
y Based on past execution history (e.g., first_rows vs. all_rows)
– Compensation for missing or stale statistics
– Compensation for errors in optimizer estimates
y Estimation errors occur due to data skews and correlations,
complex filters and joins
y Doesn’t require any change to the SQL text
– Ideal for Packaged Apps
y Persistence: Works across shutdowns & upgrades
y Transportable across databases (10.2)
17. SQL Profiling Flow
Optimizer
(Tuning Mode)
create
submit
SQL Profiling
Optimizer
(Normal Mode)
output
submit
SQL
Profile
SQL Tuning
Advisor
Database
Users
Well-Tuned
Plan
After …
use
19. Access Path Analysis
y Motivation
– Adding an index may significantly improve the
performance of a SQL statement
y Problem: A critical access path is missing
– Index not created or mistakenly dropped
y ATO explores the use of new indexes
– Recommends index if major performance boost
provided
– Also recommends running SQL Access Advisor to get
comprehensive index analysis for entire workload
y SQL Access Advisor also uses this analysis mode
21. SQL Structure Analysis
y Motivation
– Help application developers identify poorly written
SQL statements
– Suggest restructuring of SQL for efficiency
y Problem categories
– Semantic changes of SQL operators (e.g., use
UNION ALL instead of UNION)
y Subject to user acceptance of new result
– Syntactic changes to predicates on indexed columns
(e.g., remove type mismatch in column = :bind)
– SQL design issues (e.g., add missing join predicate
to eliminate a large Cartesian join)
22. SQL Tuning Usage Scenarios
SQL Tuning
Advisor
ADDM High-load SQL
Cursor Cache
AWR
SQL Tuning Set
(STS)
User-defined
Filter / Rank
SQL Sources Manual Selection
Automatic Selection
AWR
23. SQL Tuning Set (STS)
y Motivation
– Enable user to tune custom set of SQL statements
y New object in Oracle10g for capturing and
managing SQL workload
y Stores SQL statements along with:
– Execution context: parsing user, bind values, etc.
– Execution statistics: buffer gets, CPU time, elapse
time, number of executions, etc.
y Transportable across databases (10.2)
y Created from any SQL source
– AWR, cursor cache, user-defined workload, STS
24. SQL Tuning Set Benefits
y Allows selective, on-demand, custom SQL
workload tuning
y Simplifies tuning of large number of SQL
statements
y Is persistent
y Facilitates workload capture/management
y Provides a common infrastructure for dealing
with SQL workloads
– Can be used as a source for different tuning tasks
25. SQL Tuning Advisor User
Interface
y GUI: Enterprise Manager
y Launch SQL Tuning Advisor from a SQL
Source page
– ADDM Finding page, or
– Top SQL page, or
– SQL Tuning Set (STS) page
y View/Implement SQL Tuning
Recommendations
y Command line: DBMS_SQLTUNE package
29. Enterprise Manager Interface
y Launch SQL Tuning Advisor from a SQL
Source page
– ADDM Finding page, or
– Top SQL page, or
– SQL Tuning Set (STS) page
y View/Implement SQL Tuning
Recommendations
31. DBMS_SQLTUNE PL/SQL Package
y Contains API for SQL Tuning
– Create Tuning Task
– Execute Tuning Task
– Display Advisor
Recommendations
– Drop Tuning Task
– Create STS
– Populate STS
– Query STS Contents
– Drop STS
– Accept SQL Profile
– Drop SQL Profile
– Alter SQL Profile
Attribute
Tuning Task Management STS Management
SQL Profile Management
32. Automatic vs. Manual SQL Tuning
Manual Tuning
1. Get explain plan
2. Examine query objects and their sizes
3. Review and compare explain plan statistics with
execution statistics (stored in V$SQL view)
4. Identify the problem, e.g., “first rows” issue because
only recent data is ever displayed despite large history
being queried
5. Contact application vendor
6. Produce test case for vendor
7. Get a patch with appropriate code modifications from
the vendor
8. Install the patch in next maintenance cycle
Automatic Tuning
1. Run SQL Tuning
Advisor
2. Implement
recommendations.
35. SQL Access Advisor Features
y De-mystifies access structure design for optimal
application performance
y Recommends indexes, materialized views, and
materialized view logs to create and/or drop for
faster performance
y Analyzes entire workload and not just independent
SQL statements
y Takes into account impact of new access
structures on DML operations
y Considers storage, creation and maintenance
costs
36. SQL Access Advisor Features
y Simultaneously considers
– index solutions
– materialized view solutions
– combinations of both
y Optimizes materialized views for
– maximum query rewrite usage
– fast refresh
y Recommends materialized view logs for fast refresh
y Combines similar indexes into single index
y Impact of new access structures on DML considered
y Considers storage, creation & maintenance costs
38. Filter Options
y Don’t have to use the entire workload
y Filter by
– Application or module name
– Number of SQL statements
– Queries during a specified time window
– Username
– Tables
y must be in this list
y not in this list
39. SQL Access Advisor User
Interface
y GUI: Enterprise Manager
– Launch SQL Access Advisor from Advisor Central
– Select workload source
– Set options
y Workload
y Recommendation
y Advanced
– Schedule job
– Review job and submit
– Monitor job
– View Recommendations
– Implement Recommendations
y Command line: DBMS_ADVISOR package
52. Capturing SQL Workload
y Use cursor cache capture capability of STS
– Run workload
– Capture workload in STS simultaneously
DBMS_SQLTUNE.CAPTURE_CURSOR_CACHE_SQLSET(
sqlset_name => ‘MY_STS’,
time_limit => 3600,
repeat_interval => 60,
sqlset_owner => own);
53. SQL Profile Cursor Sharing
y Cursor sharing can be enforced at database
or SQL level
– Database level: CURSOR_SHARING=FORCE
– SQL level: Set SQL Profile attribute
FORCE_MATCH=TRUE
DBMS_SQLTUNE.ACCEPT_SQL_PROFILE (
task_name => 'my_sql_tuning_task',
name => 'my_sql_profile',)
force_match => TRUE);
54. Tuning Considerations
y Resource consumption
– Running SQL advisors consumes CPU, I/O, memory and can
affect system performance
y Potential negative impact of recommendation
– Implementing recommendations may impact system
negatively, e.g., optimizer stats refresh
• Before initiating tuning, answer the following
questions
• How much resources will be consumed by tuning activity?
• Can the system spare resources needed for tuning?
• How can the production system be shielded from possible
negative impact of tuning actions?
55. Resource Consumption of SQL
Advisors
y SQL Tuning Advisor
– Limited mode: Resource consumption minimal
y Stats, index and SQL restructure analysis is cheap
y Average is less than 1 second per SQL statement
– Comprehensive mode: Resource consumption may be
significant
y SQL Profiling can potentially consume non-trivial resources
y Roughly comparable to amount of resources/time consumed
when executing SQL statement(s)
• SQL Access Advisor
• Resource consumption depends on size of SQL workload
• For small number of SQL, resource consumption not very high
56. Tuning Options
y Options
– Direct tuning of live system
– Remote tuning
y Live system tuning
– Run SQL Tuning Advisor in Comprehensive mode
– Run SQL Tuning Advisor in Limited mode only if …
y System does not have spare resources to tune SQL
– Run SQL Access Advisor for few SQL at a time
y Perform remote tuning, if …
– Cumulative resources/time consumed by all SQL
statements being tuned significant
– System cannot spare resources
57. Live System Tuning Tips
1. Ensure tables referenced in SQL have representative
optimizer stats
2. Run SQL Access Advisor
– For individual SQL, set “Recommendation Type” to indexes
– MV not suitable for tuning individual statements
3. Run SQL Tuning Advisor
– Test profile before making it PUBLIC
DBMS_SQLTUNE.ACCEPT_SQL_PROFILE (
task_name => ‘<tuning task name>’,
category => ‘MY_CATEGORY’);
ALTER SESSION SET SQLTUNE_CATEGORY=‘MY_CATEGORY’ ;
– Once satisfied with results set category to DEFAULT
DBMS_SQLTUNE.ALTER_SQL_PROFILE()
58. Remote Tuning Tips
1. Move SQL to Test
Production System Test System
2. Tune SQL
3. Apply recomm. on production
• Performed to shield production system from
performance impact of running SQL advisors
59. Remote Tuning Tips
y Move SQL to test
– Use Transportable STS
y DBMS_SQLTUNE.XXX_STGTAB_SQLSET
y Apply recommendation on production
– Use Transportable SQL Profiles
y DBMS_SQLTUNE.XXX_STGTAB_SQLPROF
61. Conclusion
y SQL Advisors help address critical SQL tuning
challenges
y Provides targeted and automated tuning
y Makes possible comprehensive tuning of
packaged applications
y Eliminates need for highly skilled performance
experts