This document describes a new solution implemented by Trivadis to address a customer's need to clone databases faster. The previous solution took 2 hours to clone a 300GB database. The new solution leverages Oracle Data Guard, NVM-e, ACFS snapshots, bash scripts, Linux, and Windows with Perl to enable cloning a database within minutes. Key aspects of the new architecture include using ACFS snapshots to quickly copy data, placing components like GRID infrastructure and databases on high-performance NVM-e storage, and automating the cloning process with scripts. This provides faster database clones while avoiding costly additional technologies.
Get the most out of Oracle Data Guard - OOW versionLudovico Caldara
If you use Oracle Data Guard feature just for data protection, you are using less than half of its potential. You already pay for it, so why not getting the most out of it? In this session I will show how you can use Oracle Data Guard capabilities for common tasks such as database cloning, database migration and reporting, with the help of other features included in Oracle Database Enterprise Edition
Are your Oracle databases highly available? You have deployed Real Application Clusters (RAC), Data Guard, or Failover Clusters and are well protected against server failures? Great – the prerequisites for a highly available environment are given. However, to assure that backend infrastructure failures also remain transparent to the client, an appropriate configuration is a prerequisite.
This lecture will discuss the Oracle technologies that can be used to achieve automatic client failover functionality. What are the advantages, but also the limitations of these technologies?
DMU is the new tool introduced by Oracle for database conversion to the Unicode character set. Beside introducing briefly the tool, this session will focus on a real database conversion scenario faced by a customer, the problems encountered and the solutions.
Oracle Active Data Guard 12cR2. Is it the best option?Ludovico Caldara
If you are using Oracle Data Guard for data protection (hint: you should!), you might also want to know more about Oracle Active Data Guard and what makes it essential for even more increased availability and performance. In this session, I will give an overview of many new and old Active Data Guard features such as:
- Rolling Upgrades
- Real-time Query
- Fast Incremental Backup
- Subset Standby
- Multiple Instance Redo Apply
- Advanced topologies (Real-time Cascading Standby, Far Sync Standby, Alternate destinations)
- Automatic Block Repair
- Global Data Services
I will also explain why the ROI of Oracle Database Enterprise Edition can be higher when coupled with Oracle Active Data Guard.
Get the most out of Oracle Data Guard - POUG versionLudovico Caldara
If you use Oracle Data Guard feature just for data protection, you are using less than half of its potential. You already pay for it, so why not getting the most out of it? In this session I will show how you can use Oracle Data Guard capabilities for common tasks such as database cloning, database migration and reporting, with the help of other features included in Oracle Database Enterprise Edition
Migrating to Oracle Database 12c: 300 DBs in 300 days.Ludovico Caldara
For a customer in Switzerland, we are in process of migrating 400 databases to 12c. We have migrated 300 so far, and we have had good and bad surprises. This session will show a few scenarios that we faced during the upgrade project.
Effective Oracle Home Management in the new Release Model eraLudovico Caldara
How many companies can afford patching regularly their environments?
Patching and maintaining a big amount of Oracle Databases is perceived as complex by most companies. Is there a way to make patching simpler and more controlled? What are the best (and worst) practices for Oracle Home maintenance?
What are the challenges of the new release model that will bring us one new major release per year?
In this session, we will explain some ideas to improve Oracle Home management and database patching, as well as practical examples of automated environments, live demos included!
Get the most out of Oracle Data Guard - OOW versionLudovico Caldara
If you use Oracle Data Guard feature just for data protection, you are using less than half of its potential. You already pay for it, so why not getting the most out of it? In this session I will show how you can use Oracle Data Guard capabilities for common tasks such as database cloning, database migration and reporting, with the help of other features included in Oracle Database Enterprise Edition
Are your Oracle databases highly available? You have deployed Real Application Clusters (RAC), Data Guard, or Failover Clusters and are well protected against server failures? Great – the prerequisites for a highly available environment are given. However, to assure that backend infrastructure failures also remain transparent to the client, an appropriate configuration is a prerequisite.
This lecture will discuss the Oracle technologies that can be used to achieve automatic client failover functionality. What are the advantages, but also the limitations of these technologies?
DMU is the new tool introduced by Oracle for database conversion to the Unicode character set. Beside introducing briefly the tool, this session will focus on a real database conversion scenario faced by a customer, the problems encountered and the solutions.
Oracle Active Data Guard 12cR2. Is it the best option?Ludovico Caldara
If you are using Oracle Data Guard for data protection (hint: you should!), you might also want to know more about Oracle Active Data Guard and what makes it essential for even more increased availability and performance. In this session, I will give an overview of many new and old Active Data Guard features such as:
- Rolling Upgrades
- Real-time Query
- Fast Incremental Backup
- Subset Standby
- Multiple Instance Redo Apply
- Advanced topologies (Real-time Cascading Standby, Far Sync Standby, Alternate destinations)
- Automatic Block Repair
- Global Data Services
I will also explain why the ROI of Oracle Database Enterprise Edition can be higher when coupled with Oracle Active Data Guard.
Get the most out of Oracle Data Guard - POUG versionLudovico Caldara
If you use Oracle Data Guard feature just for data protection, you are using less than half of its potential. You already pay for it, so why not getting the most out of it? In this session I will show how you can use Oracle Data Guard capabilities for common tasks such as database cloning, database migration and reporting, with the help of other features included in Oracle Database Enterprise Edition
Migrating to Oracle Database 12c: 300 DBs in 300 days.Ludovico Caldara
For a customer in Switzerland, we are in process of migrating 400 databases to 12c. We have migrated 300 so far, and we have had good and bad surprises. This session will show a few scenarios that we faced during the upgrade project.
Effective Oracle Home Management in the new Release Model eraLudovico Caldara
How many companies can afford patching regularly their environments?
Patching and maintaining a big amount of Oracle Databases is perceived as complex by most companies. Is there a way to make patching simpler and more controlled? What are the best (and worst) practices for Oracle Home maintenance?
What are the challenges of the new release model that will bring us one new major release per year?
In this session, we will explain some ideas to improve Oracle Home management and database patching, as well as practical examples of automated environments, live demos included!
Adaptive Features or: How I Learned to Stop Worrying and Troubleshoot the Bomb.Ludovico Caldara
Adaptive Dynamic Sampling, Adaptive Execution Plans, SQL Plan Directives: these new features are the new performance troublemakers when migrating databases from 11g to 12c. The optimizer uses them to seek for the perfect execution plan, but does it always succeed? This session will focus on the first steps required to quickly troubleshoot performance issues due to the adaptive features.
How many companies can afford patching regularly their environments?
Patching and maintaining a big amount of Oracle Databases is perceived as complex by most companies. Is there a way to make patching simpler and more controlled? What are the best (and worst) practices for Oracle Home maintenance?
What are the challenges of the new release model that will bring us one new major release per year?
In this session, we will explain some ideas to improve Oracle Home management and database patching, as well as practical examples of automated environments.
Oracle ACFS 12c now supports Oracle Database files. Which new opportunities can come out from this combination?
In this session you will discover the new features of ACFS 12c that are useful when deploying Oracle Databases. You will then learn how to use them through examples and live demos.
Oracle Drivers configuration for High AvailabilityLudovico Caldara
... is it a developer's job?
UCP, GridLink, TAF, AC, TAC, FAN… The configuration of Oracle Drivers for application high availability is not an easy job. The developers often care about the minimal working configuration, while the DBAs are busy with the operations. In this session I will try to demystify application server’s connectivity to the database and give a direction toward the highest availability, using Real Application Clusters and new Oracle features like TAC and CMAN TDM.
Oracle Active Data Guard 12c: Far Sync Instance, Real-Time Cascade and Other ...Ludovico Caldara
Slides used for my Oracle Open World 2014 #OOW14 session.
The new release of Oracle Database has come with many new exciting enhancements for high availability. The aim of this presentation is to introduce some new Oracle Active Data Guard features through practical examples and live demos. Among the various enhancements, the new Far Sync Instance and Real-Time Cascade Standby features receive special attention in the session.
Oracle Drivers configuration for High Availability, is it a developer's job?Ludovico Caldara
UCP, GridLink, TAF, AC, TAC, FAN… The configuration of Oracle Drivers for application high availability is not an easy job. The developers often care about the minimal working configuration, while the DBAs are busy with the operations. In this session I will try to demystify application server’s connectivity to the database and give a direction toward the highest availability, using Real Application Clusters and new Oracle features like TAC and CMAN TDM.
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIESLudovico Caldara
The new release of Oracle Database has come with many new exciting enhancements for the High Availability.
This whitepaper introduces some new Data Guard features. Among various enhancements, special attention will be given to
the new Far Sync Instance and the Real-Time Cascade Standby.
Boost your Oracle RAC manageability with Policy-Managed DatabasesLudovico Caldara
Oracle RAC Policy-Managed Database (PMD) is a powerful but so far rarely used feature introduced in Oracle Database 11g
Release 2 to automate the instance administration in a dynamic, multi-node cluster.
The aim of this presentation is to review how PMD works, how to implement and administer it successfully, and how to
benefit from this technology compared to the traditional administrator-managed deployment.
These slides are from the session I've done at Collaborate14, but re-branded with my company's template.
“A new multitenant architecture that easily deploy and manage database clouds. Innovations such as Oracle Multitenant for consolidating multiple databases, Automatic Data Optimization for compressing and tiering data at a higher density also maximize resource efficiency and flexibility. These unique advancements, combined with major enhancements in availability, security, and big data support, ideal platform for private and public cloud deployments.”
Oracle ACFS is a general purpose portable cluster file system build on the enhanced ASM available since Oracle 11.2 and benefiting from the existing ASM mirroring and striping leading to performance and fault tolerance. In the presentation you will look at the concept and the architecture of ACFS. You will see how to use familiar tools such as sqlplus, asmca, asmcmd and OEM DC to configure, implement and manage ACFS. The presentation will provide an idea for deployment of ACFS for Snapshots and replications. Being fully integrated with ASM, ASM views can be used to monitor performance and usage.
Home For Gypsies – Storage for NoSQL DatabasesAtish Kathpal
Video presentation: https://www.youtube.com/watch?v=QRmCr9qTL5o
Technical paper: https://www.usenix.org/conference/hotstorage17/program/presentation/kathpal
Abstract: Introduction to NoSQL DBs and CAP theorem
1. Advantages of shared storage as compared to DAS for NoSQL DBs: a) independent scaling of compute and storage b) consolidation, support of mixed workloads and predictable performance through use of flash arrays c) easier storage administration as compared to managing 100s of independent direct-attached disks in a scale-out NoSQL deployment
2. Challenges and need for integrated backup and restore in NoSQL DBs: a) cluster-consistent backups at scale in an eventually consistent system, b) storage efficiency in backups and c) ability to restore to different topologies
3. Relevance of light-weight snapshots, cloning and high-level solution directions to address challenges listed in #3
Speaker: Atish Kathpal
Acknowledgement: Priya Sehgal, Gaurav Makkar, Parag Deshmukh
Adaptive Features or: How I Learned to Stop Worrying and Troubleshoot the Bomb.Ludovico Caldara
Adaptive Dynamic Sampling, Adaptive Execution Plans, SQL Plan Directives: these new features are the new performance troublemakers when migrating databases from 11g to 12c. The optimizer uses them to seek for the perfect execution plan, but does it always succeed? This session will focus on the first steps required to quickly troubleshoot performance issues due to the adaptive features.
How many companies can afford patching regularly their environments?
Patching and maintaining a big amount of Oracle Databases is perceived as complex by most companies. Is there a way to make patching simpler and more controlled? What are the best (and worst) practices for Oracle Home maintenance?
What are the challenges of the new release model that will bring us one new major release per year?
In this session, we will explain some ideas to improve Oracle Home management and database patching, as well as practical examples of automated environments.
Oracle ACFS 12c now supports Oracle Database files. Which new opportunities can come out from this combination?
In this session you will discover the new features of ACFS 12c that are useful when deploying Oracle Databases. You will then learn how to use them through examples and live demos.
Oracle Drivers configuration for High AvailabilityLudovico Caldara
... is it a developer's job?
UCP, GridLink, TAF, AC, TAC, FAN… The configuration of Oracle Drivers for application high availability is not an easy job. The developers often care about the minimal working configuration, while the DBAs are busy with the operations. In this session I will try to demystify application server’s connectivity to the database and give a direction toward the highest availability, using Real Application Clusters and new Oracle features like TAC and CMAN TDM.
Oracle Active Data Guard 12c: Far Sync Instance, Real-Time Cascade and Other ...Ludovico Caldara
Slides used for my Oracle Open World 2014 #OOW14 session.
The new release of Oracle Database has come with many new exciting enhancements for high availability. The aim of this presentation is to introduce some new Oracle Active Data Guard features through practical examples and live demos. Among the various enhancements, the new Far Sync Instance and Real-Time Cascade Standby features receive special attention in the session.
Oracle Drivers configuration for High Availability, is it a developer's job?Ludovico Caldara
UCP, GridLink, TAF, AC, TAC, FAN… The configuration of Oracle Drivers for application high availability is not an easy job. The developers often care about the minimal working configuration, while the DBAs are busy with the operations. In this session I will try to demystify application server’s connectivity to the database and give a direction toward the highest availability, using Real Application Clusters and new Oracle features like TAC and CMAN TDM.
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIESLudovico Caldara
The new release of Oracle Database has come with many new exciting enhancements for the High Availability.
This whitepaper introduces some new Data Guard features. Among various enhancements, special attention will be given to
the new Far Sync Instance and the Real-Time Cascade Standby.
Boost your Oracle RAC manageability with Policy-Managed DatabasesLudovico Caldara
Oracle RAC Policy-Managed Database (PMD) is a powerful but so far rarely used feature introduced in Oracle Database 11g
Release 2 to automate the instance administration in a dynamic, multi-node cluster.
The aim of this presentation is to review how PMD works, how to implement and administer it successfully, and how to
benefit from this technology compared to the traditional administrator-managed deployment.
These slides are from the session I've done at Collaborate14, but re-branded with my company's template.
“A new multitenant architecture that easily deploy and manage database clouds. Innovations such as Oracle Multitenant for consolidating multiple databases, Automatic Data Optimization for compressing and tiering data at a higher density also maximize resource efficiency and flexibility. These unique advancements, combined with major enhancements in availability, security, and big data support, ideal platform for private and public cloud deployments.”
Oracle ACFS is a general purpose portable cluster file system build on the enhanced ASM available since Oracle 11.2 and benefiting from the existing ASM mirroring and striping leading to performance and fault tolerance. In the presentation you will look at the concept and the architecture of ACFS. You will see how to use familiar tools such as sqlplus, asmca, asmcmd and OEM DC to configure, implement and manage ACFS. The presentation will provide an idea for deployment of ACFS for Snapshots and replications. Being fully integrated with ASM, ASM views can be used to monitor performance and usage.
Home For Gypsies – Storage for NoSQL DatabasesAtish Kathpal
Video presentation: https://www.youtube.com/watch?v=QRmCr9qTL5o
Technical paper: https://www.usenix.org/conference/hotstorage17/program/presentation/kathpal
Abstract: Introduction to NoSQL DBs and CAP theorem
1. Advantages of shared storage as compared to DAS for NoSQL DBs: a) independent scaling of compute and storage b) consolidation, support of mixed workloads and predictable performance through use of flash arrays c) easier storage administration as compared to managing 100s of independent direct-attached disks in a scale-out NoSQL deployment
2. Challenges and need for integrated backup and restore in NoSQL DBs: a) cluster-consistent backups at scale in an eventually consistent system, b) storage efficiency in backups and c) ability to restore to different topologies
3. Relevance of light-weight snapshots, cloning and high-level solution directions to address challenges listed in #3
Speaker: Atish Kathpal
Acknowledgement: Priya Sehgal, Gaurav Makkar, Parag Deshmukh
Cloud Database Migration Made Easy: Migrating MySQL to NuoDBNuoDB
For organizations moving to cloud infrastructure, database migration can be the stuff of nightmares. When selecting a cloud-centric database, balancing ease of migration with the on-demand scaling and continuous availability your modern application needs can seem like a series of compromises... But it doesn’t have to be.
In these slides, we showcase how simple it is to move from a traditional relational database to NuoDB’s elastic SQL database and talk about how this compares to the complexity of moving to a NoSQL database.
Senior Product Manager Joe Leslie demonstrates how to use NuoDB’s built-in migrator facility to simplify migration from databases such as MySQL, Microsoft SQL Server, or Oracle over to NuoDB, minimizing the transition time, and making it easy to get started sooner.
Elastic SQL Database: Oxymoron or Emerging Reality? (Database Month, June 2017)NuoDB
Advancements in application architectures, development processes, and storage have enabled organizations to take advantage of cloud benefits such as agility, elasticity, and scale-out across most layers of the infrastructure stack. But one key element - the database tier - has remained stubbornly difficult to modernize. Often, as organizations move toward container and cloud-based environments, they end up leaving their database, their SQL skillsets, expectations of transactional consistency, and sometimes even their precious data behind.
To address this problem, a new class of database - the elastic SQL database - has emerged. These solutions combine the ACID guarantees and SQL interface on which applications rely, while also allowing dynamic capacity management, continuous availability, multi-datacenter operation, and radical operational simplicity.
Learn how to take advantage of this technology to optimize your application for fast transactional responsiveness, continuous availability, and full-active database utilization, even across multiple clouds, data centers, or hybrid environments.
This presentation covers:
• Why the need for an elastic SQL database
• What can you do with one and best use cases for an elastic SQL database
• Examples of how an elastic SQL database works
• Benefits of optimizing/configuring for:
• fast application data access
• continuous availability
• deployment across data centers
What is elastic data warehousing, and how does Snowflake uniquely enable it? Learn about the requirements needed to support flexible, elastic data warehousing using cloud infrastructure.
Snowflake's Kent Graziano talks about what makes a data warehouse as a service and some of the key features of Snowflake's data warehouse as a service.
Le but est de partager avec le public les connaissances et expériences éprouvées dans la conception, la mise en œuvre et l'exécution de plateformes DBaaS. La présentation comprend des exemples et des explications sur les environnements de base de données consolidées délivrant des performances sans compromis, l'évolutivité et la flexibilité en liaison avec le "time-to-market" et la rentabilité.
SQL Server 2017 - Mejoras Impulsadas por la ComunidadJavier Villegas
Con SQL Sever 2017 Microsoft incorpora nuevas funcionalidades propuestas por la comunidad de profesionales de Data Platform, hablaremos acerca de las mismas así como también sobre las funcionalidades más destacadas de la próxima versión de SQL
Similar to How to bake a Customer Story with With Windows, NVM-e, Data Guard, ACFS Snapshots & Perl (20)
... or why Oracle still cares about CMAN and why you should do it too
The Oracle Connection Manager (CMAN) is the Swiss-army knife for database connections. It can be used for security, routing, high availability, single-point of contact... Starting with Oracle 18c, it has been extended with the new Traffic Director Mode (CMAN TDM), that allows transparent failover for applications that do not implement it natively.
In this session I will introduce briefly what CMAN is capable of, how to configure it in a high availability environment, and how the new release achieves a higher protection level.
In a DEV world where everything is built automatically (with Jenkins, Gitlab, Maven...), the developers still struggle to integrate some operational tasks in their build pipelines.
Despite tools like Ansible, Puppet and Rundeck are being used by more and more companies, some DBAs need (or want) to keep control over their legacy scripts. How can the developers convince the DBAs to implement some useful REST endpoints without much development effort?
In this session I will introduce some ideas for integration between applications, ORDS and operational scripts that will help cooperation between developers and DBAs.
ADAPTIVE FEATURES OR: HOW I LEARNED TO STOP WORRYING AND TROUBLESHOOT THE BOMBLudovico Caldara
Oracle Database 12c became available to the public back in 2013, but it took more than one year for the
Oracle customers to start upgrading of their existing databases to this new release. Many customers, in
2016, are still not in the process of migrating to 12c despite the premier support deadline for Oracle
Database 11g has passed in January 2015.
I had the chance to spend the last two years by a customer who decided to embrace the new release
and start the migration to 12c as soon as possible, in order to take the most out of the (many) new
features that this release offers. When the very first production databases have been migrated to 12c,
the users began noticing quite soon that some queries started to take much more time to complete,
some of them were actually several orders of magnitude slower than before. After small investigation, I
understood that most off those queries have been slowed down by the new “Adaptive Features” that
have been introduced in 12c for the opposite reason: increasing performance. This is what this article
is about.
Oracle RAC 12c and Policy-Managed Databases, a Technical OverviewLudovico Caldara
Oracle RAC Policy-Managed Database (PMD) is a powerful but so far rarely used feature introduced in Oracle Database 11g
Release 2 to automate the instance administration in a dynamic, multi-node cluster.
The aim of this presentation is to review how PMD works, how to implement and administer it successfully, and how to
benefit from this technology compared to the traditional administrator-managed deployment. During the session, the new
features of the 12c Grid Infrastructure related to PMD are highlighted.
RACAttack 12c Advanced Lab: Server Pools and Policy-managed databasesLudovico Caldara
RACAttack 12c pre-conference workshop at IOUG Collaborate 14 will have a few advanced labs for people already confident with a simple RAC installation. This advanced lab handbook introduces server pools and policy managed databases to your Oracle RAC 12c implementation!
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
How to bake a Customer Story with With Windows, NVM-e, Data Guard, ACFS Snapshots & Perl
1. How to Bake a Customer Story
With Windows, NVM-e, Data Guard,
ACFS Snapshots & Perl
Ludovico Caldara
@ludodba ukoug_tech17
2. About Ludovico Caldara
DB Cloning : Customer Story2 12/2/2017
■ 18 Years DBA (Not Only Oracle)
▪ I do it everywhere (even Windows)
■ RAC ATTACK Ninja & co-writer
■ President, SOUG & ITOUG Board
■ OCP (11g, 12c, MySQL) & OCE
■ Italian living in Switzerland
■ http://www.ludovicocaldara.net
■ @ludodba ludodba
■ ludovicocaldara
3. Our company.
DB Cloning : Customer Story3 12/2/2017
Trivadis is a market leader in IT consulting, system integration, solution engineering
and the provision of IT services focusing on and
technologies in Switzerland, Germany, Austria and Denmark.
We offer our services in the following strategic business fields:
Trivadis Services takes over the interacting operation of your IT systems.
O P E R A T I O N
5. DB Cloning : Customer Story5 12/2/2017
Customer requirements
6. Customer "Original Requirements"
DB Cloning : Customer Story6 12/2/2017
Protect production database(s) in case of disaster
Refresh test databases on demand
Database size at that time: 50GB
7. Previous solution
DB Cloning : Customer Story7 12/2/2017
DB_NAME
PRIMARY
SERVER B @ SITE B
DB_NAME
STANDBY
DATA
GUARD
DB_NAME
CLONE
SERVER A @ SITE A
RMAN DUPLICATE
Storage Area Network Storage Area Network
8. Previous solution
DB Cloning : Customer Story8 12/2/2017
DB_NAME
PRIMARY
SERVER B @ SITE B
DB_NAME
STANDBY
DATA
GUARD
DB_NAME
CLONE
SERVER A @ SITE A
RMAN DUPLICATE
Storage Area Network Storage Area Network
25 minutes
cloning
process
9. Requirements 4 years later...
DB Cloning : Customer Story9 12/2/2017
Protect production database(s) in case of disaster
Refresh test databases on demand
Database size now: 300GB
10. Requirements 4 years later...
DB Cloning : Customer Story10 12/2/2017
Protect production database(s) in case of disaster
Refresh test databases on demand
Database size now: 300GB
2 hours
cloning
process!
11. Customer needs a new solution!
DB Cloning : Customer Story11 12/2/2017
New hardware, not related to cloning performance
– Eventually not tied to Storage Area Network
– (Eventually NVM-e)
A magic for faster clones
– Not willing to spend for additional technologies (Delphix, Actifio...)
12. DB Cloning : Customer Story12 12/2/2017
The new solution
16. Ingredients
DB Cloning : Customer Story16 12/2/2017
Oracle Data Guard
NVM-e
ACFS Snapshots
Bash Scripts
17. Ingredients
DB Cloning : Customer Story17 12/2/2017
Oracle Data Guard
NVM-e
ACFS Snapshots
Bash Scripts
Linux
18. Ingredients
DB Cloning : Customer Story18 12/2/2017
Oracle Data Guard
NVM-e
ACFS Snapshots
Bash Scripts
Linux
19. Ingredients
DB Cloning : Customer Story19 12/2/2017
Oracle Data Guard
NVM-e
ACFS Snapshots
Bash Scripts
Linux
Windows
20. Ingredients
DB Cloning : Customer Story20 12/2/2017
Oracle Data Guard
NVM-e
ACFS Snapshots
Bash Scripts
Linux
Windows + Perl
21. Target Architecture Overview
DB Cloning : Customer Story21 12/2/2017
NEW SERVER A @ SITE A
NVM-e
NEW SERVER B @ SITE B
NVM-e
22. Target Architecture Overview
DB Cloning : Customer Story22 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
23. Target Architecture Overview
DB Cloning : Customer Story23 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
24. Target Architecture Overview
DB Cloning : Customer Story24 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
SNAPSHOT
DB_NAME
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
25. Target Architecture Overview
DB Cloning : Customer Story25 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
26. Target Architecture Overview
DB Cloning : Customer Story26 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
SNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPY
27. Target Architecture Overview
DB Cloning : Customer Story27 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
SNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPY
28. Target Architecture Overview
DB Cloning : Customer Story28 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
DATABASE
CLONE
SNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPY
29. Target Architecture Overview
DB Cloning : Customer Story29 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
DATABASE
CLONE
DB_NAME
CLONE
SNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPY
30. Target Architecture Overview
DB Cloning : Customer Story30 12/2/2017
NEW SERVER A @ SITE A
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
DB_NAME
PRIMARY
NEW SERVER B @ SITE B
NVM-e
GRID INFRASTRUCTURE 12cR1
E:oracleproduct12.1.0.2grid
DG +DATA
ACFS
E:acfsDATA
ACFS
E:acfsFRA
ACFS
E:acfsREDO
DB_NAME
STANDBY
SNAPSHOT
DB_NAME
DATA
GUARD
DATABASE
CLONE
DB_NAME
CLONE
SNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPYSNAPSHOT
COPY
SNAPSHOTS
ON DATA
NO
SNAPSHOTS
ON FRA/REDO
31. DB Cloning : Customer Story31 12/2/2017
Thoughts about ACFS
32. Snapshot on Snapshot: Why?
DB Cloning : Customer Story46 12/2/2017
Multiple databases!
33. Snapshot on Snapshot: Why?
DB Cloning : Customer Story47 12/2/2017
Multiple databases!
I want to clone RED database
34. Snapshot on Snapshot: Why?
DB Cloning : Customer Story48 12/2/2017
Multiple databases!
I want to clone RED database
But I get copy on write for ALL of them!
35. Snapshot on Snapshot: Why?
DB Cloning : Customer Story49 12/2/2017
Multiple databases!
I want to clone RED database
But I get copy on write for ALL of them!
36. Snapshot on Snapshot: Why?
DB Cloning : Customer Story50 12/2/2017
Multiple databases!
I want to clone RED database
But I get copy on write for ALL of them!
Snapshot space usage will grow much faster
39. DB Cloning : Customer Story53 12/2/2017
Not Supported
40. ACFS and Oracle Restart
DB Cloning : Customer Story54 12/2/2017
From the documentation:
Oracle Restart does not support root-based Oracle ACFS resources for this release:
Loading Oracle ACFS drivers
Mounting Oracle ACFS file systems listed in the Oracle ACFS mount registry
Mounting resource-based Oracle ACFS database home file systems
And:
Oracle ACFS does not support data files or redo logs in an Oracle Restart configuration.
41. Assume the risk…
DB Cloning : Customer Story55 12/2/2017
Primary: Oracle Restart with DB on ASM Only
Standby and Test: Oracle Restart with DB on ACFS
42. DB Cloning : Customer Story56 12/2/2017
GI + ACFS Implementation
43. GI Installation and Patching… out of scope?
DB Cloning : Customer Story57 12/2/2017
Meet system requirements (e.g. Windows object access auditing disabled)
Partition Disks and stamp the partitions with asmtool.exe
Install Oracle Grid Infrastructure
Apply the latest bundle patch
At that time: BP 12.1.0.2.171017. Now: BP 12.1.0.2.171130
44. Patching "sometimes" leaves the old drivers
DB Cloning : Customer Story58 12/2/2017
Solution?
– crsctl stop has; acfsload stop
– acfsinstall /i /a ; acfsinstall /i /o ; acfsinstall /i /l
Directory of C:WindowsSystem32drivers
12/20/2016 05:15 AM 3,461,008 oracleacfs.sys
12/20/2016 05:02 AM 841,104 oracleadvm.sys
12/20/2016 04:53 AM 478,608 oracleoks.sys
Directory of C:WindowsSystem32drivers
06/21/2017 11:42 AM 3,461,008 oracleacfs.sys
06/21/2017 11:29 AM 841,104 oracleadvm.sys
06/21/2017 11:19 AM 478,608 oracleoks.sys
– acfsload start -s ; crsctl start has
45. ACFS filesystems with Oracle Restart...
DB Cloning : Customer Story59 12/2/2017
ACFS Drivers need to be loaded at boot
set ORACLE_BASE=E:oracle
set ORACLE_HOME=E:oracleproduct12.1.0.2grid
set PATH=...
%ORACLE_HOME%binacfsload start -s
46. ACFS filesystems with Oracle Restart...
DB Cloning : Customer Story60 12/2/2017
The ACFS filesystem resource does not exist on Oracle Restart configurations
Must use action script / custom type / resource!
47. ACFS filesystems with Oracle Restart...
DB Cloning : Customer Story61 12/2/2017
The ACFS filesystem resource does not exist on Oracle Restart configurations
Must use action script / custom type / resource!
crsctl add type acfs_fs.type -basetype local_resource -attr
"ATTRIBUTE=ACTION_SCRIPT,TYPE=string,DEFAULT_VALUE=E:oracleTrivadisscri
ptsstop_startacfs_actionscript.bat,ATTRIBUTE=AUTO_START,TYPE=string,DEFA
ULT_VALUE=always,ATTRIBUTE=START_TIMEOUT,TYPE=int,DEFAULT_VALUE=100,ATTRIB
UTE=STOP_TIMEOUT,TYPE=int,DEFAULT_VALUE=100,ATTRIBUTE=CHECK_INTERVAL,TYPE=
int,DEFAULT_VALUE=10,ATTRIBUTE=START_DEPENDENCIES,TYPE=string,DEFAULT_VALU
E=hard(ora.DATA.dg)pullup(ora.DATA.DG),ATTRIBUTE=STOP_DEPENDENCIES,TYPE=st
ring,DEFAULT_VALUE=hard(ora.DATA.dg),ATTRIBUTE=ACL,TYPE=string,DEFAULT_VAL
UE='owner:nt
authoritysystem:rwx,pgrp:ORA_ASMDBA:rwx',ATTRIBUTE=TYPE_ACL,TYPE=string,D
EFAULT_VALUE='owner:nt authoritysystem:rwx,pgrp:ORA_ASMDBA:rwx,other::r--
'"
48. ACFS filesystems with Oracle Restart...
DB Cloning : Customer Story62 12/2/2017
The ACFS filesystem resource does not exist on Oracle Restart configurations
Must use action script / custom type / resource!
crsctl add resource FRA.acfs -type acfs_fs.type -attr "ACL='owner:nt
authoritysystem:rwx,pgrp:ORA_ASMDBA:rwx,other::r--'"
crsctl add resource DATA.acfs -type acfs_fs.type -attr "ACL='owner:nt
authoritysystem:rwx,pgrp:ORA_ASMDBA:rwx,other::r--'"
crsctl add resource REDO.acfs -type acfs_fs.type -attr "ACL='owner:nt
authoritysystem:rwx,pgrp:ORA_ASMDBA:rwx,other::r--'"
49. DB Cloning : Customer Story63 12/2/2017
Database Implementation
50. Naming Convention is crucial!
DB Cloning : Customer Story64 12/2/2017
EXAMPLES SITE1 SITE2
ORACLE_SID/DB_NAME LUDO LUDO
DB_UNIQUE_NAME LUDO_SITE1 LUDO_SITE2
CRS_RESOURCE ora.ludo_site1.db ora.ludo_site2.db
DG Configuration LUDO LUDO
DG Member ludo_site1 ludo_site2
DGConnectIdentifier ludo_site1 ludo_site2
Static Listener Entry
(GLOBAL_DBNAME)
LUDO_SITE1_DGMGRL
LUDO_SITE2_DGMGRL
Base Snapshot Name LUDO LUDO
Snapshot Copies (when applies) -
LUDO.18H.<weekday>
E.g. LUDO.18H.Thu
51. Configuration of new standby databases
DB Cloning : Customer Story65 12/2/2017
Create the directories for controlfiles and redo log
Create the main snapshot
– acfsutil snap create LUDO E:acfsdata
Add the Database (in this case, as standby)
– srvctl add database -d LUDO_SITE2 -o
E:oracleproduct12.1.0.2db_BP171017 -p
%ORACLE_HOME%databasespfileLUDO.ora -r PHYSICAL_STANDBY -s
mount -n LUDO -i LUDO -a "DATA"
Add the dependencies with the filesystem
– crsctl modify resource ora.ludo_site2.db -attr
"START_DEPENDENCIES='hard(FRA.acfs,DATA.acfs,REDO.acfs)pullup(F
RA.acfs,DATA.acfs,REDO.acfs)',STOP_DEPENDENCIES='hard(FRA.acfs,
DATA.acfs,REDO.acfs)'" -unsupported
52. Data Guard implementation...
DB Cloning : Customer Story66 12/2/2017
Duplicate for standby
Create broker configuration
Add standby database
... usual steps!
Oracle Managed Files because the primary is on ASM
53. Configuration of new clone databases
DB Cloning : Customer Story67 12/2/2017
Create the service with ORADIM.exe
Add the resource with srvctl add database
– -db is the unique name, for the copies it MUST be the same as the db_name!
Add the dependency with the filesystem (same as a new master database)
54. DB Cloning : Customer Story68 12/2/2017
Snapshots
55. ACFS Filesystem Layout: Source and its snapshot
DB Cloning : Customer Story69 12/2/2017
E:acfsdata.ACFSsnaps<DB_NAME><DB_UNIQUE_NAME>DATAFILE...
DB_CREATE_FILE_DEST
Example of datafile:
E:acfsdata.ACFSsnapsLUDOLUDO_SITE2DATAFILE01_MF_SYSTEM_DNNMQRVC_.DBF
(Oracle Managed Files)
SOURCE DATABASE LAYOUT
E:acfsdata.ACFSsnaps<SNAP_NAME><DB_UNIQUE_NAME>DATAFILE...
DB_CREATE_FILE_DEST
Example:
E:acfsdata.ACFSsnapsLUDO.18H.THULUDO_SITE2DATAFILE...
SAME AS SOURCE
SNAPSHOT COPY LAYOUT
56. ACFS Filesystem Layout: Clones
DB Cloning : Customer Story70 12/2/2017
Source Snapshot
E:acfsdata.ACFSsnaps<SNAP_NAME><SRC_DB_UNIQUE_NAME>
DATABASE CLONE LAYOUT
E:acfsdata.ACFSsnaps<CLONE_DB_NAME><SRC_DB_UNIQUE_NAME>
ONLY THE SNAPSHOT NAME CHANGES
Example of datafile:
E:acfsdata.ACFSsnapsTESTVICOLUDO_SITE2DATAFILE01_MF_SYSTEM_DNNMQRVC_.DBF
Clone
DB_NAME
Source
DB_UNIQUE_NAME
57. Detail of the cloning process
DB Cloning : Customer Story71 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
Let's give it a name:
– Primary: LUDO_SITE1
– Standby: LUDO_SITE2
MRP0
58. Detail of the cloning process
DB Cloning : Customer Story72 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
Stop Apply
59. Detail of the cloning process
DB Cloning : Customer Story73 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
60. Detail of the cloning process
DB Cloning : Customer Story74 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
61. Detail of the cloning process
DB Cloning : Customer Story75 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
62. Detail of the cloning process
DB Cloning : Customer Story76 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
snap_database.pl
63. Running the script
DB Cloning : Customer Story77 12/2/2017
snap_all_database.bat
– Will overwrite the snapshot named <DB_NAME>.18H.<Weekday> for all the dbs
tvd_perl snap_database.pl -b SOURCE [-n SNAPNAME] [-s SUFFIX]
– Where SOURCE is the source DB (e.g. LUDO)
– SNAPNAME is the name of the new snapshot (defaults to <SOURCE>.18H)
– SUFFIX can be set to «weekday» to automatically add the week of the day to the
name of the snapshot
– E.g. tvd_perl snap_database.pl -b LUDO -n PREUPG will create a snapshot
PREUPG from the standby database LUDO
64. Detail of the cloning process
DB Cloning : Customer Story78 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
65. Detail of the cloning process
DB Cloning : Customer Story79 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
LUDO.MON
66. Detail of the cloning process
DB Cloning : Customer Story80 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
LUDO.MON
LUDO.TUE
67. Detail of the cloning process
DB Cloning : Customer Story81 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.SUN
Stop Apply
Create a Snapshot
Copy pfile and Controlfile to trace
Start Apply
MRP0
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
68. Detail of the cloning process
DB Cloning : Customer Story82 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
69. Detail of the cloning process
DB Cloning : Customer Story83 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
Delete previous clone
70. Detail of the cloning process
DB Cloning : Customer Story84 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
DATABASE
CLONE
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
Delete previous clone
Create a Snapshot
71. Detail of the cloning process
DB Cloning : Customer Story85 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
Delete previous clone
Create a Snapshot
Replace snapshot name in pfile and ctlfile
DATABASE
CLONE
72. Detail of the cloning process
DB Cloning : Customer Story86 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
Delete previous clone
Create a Snapshot
Replace snapshot name in pfile and ctlfile
Open resetlogs
DATABASE
CLONE
CLONE
73. Detail of the cloning process
DB Cloning : Customer Story87 12/2/2017
LUDO_SITE2
SNAPSHOT
LUDO
LUDO.MON
LUDO.TUE
LUDO.WED
LUDO.THU
LUDO.FRI
LUDO.SAT
MRP0
LUDO.SUN
Delete previous clone
Create a Snapshot
Replace snapshot name in pfile and ctlfile
Open resetlogs
DATABASE
CLONE
CLONE
clone_from_snap.pl
74. Cloning the databases: running the procedure
DB Cloning : Customer Story88 12/2/2017
tvd_perl clone_from_snap.pl –b SOURCEDB –s SNAPNAME –d DESTDB
– Where SOURCEDB is the original DB_NAME of the source DB (e.g. LUDO)
– SNAPNAME is the name of the snapshot used for the clone (e.g. LUDO.18h.Thu)
– DESTDB is the name of the destination database. A new snapshot will be created with this
name (or overwritten if it already exists)
– E.g.:
tvd_perl clone_from_snap.pl –b LUDO –s LUDO.18H.Thu –d testclone
Will clone LUDO to testclone using LUDO.18H.Thu snapshot
75. DB Cloning : Customer Story89 12/2/2017
Checking the ACFS
76. Checking the ACFS
DB Cloning : Customer Story90 12/2/2017
Two custom aliases inside TVD-basenv
$ acfsinfo
– Gives information (including size and free space) about the ACFS filesystems
$ snaps
– Gives information about the snapshots in E:acfsdata
– It includes parent name and creation time
– The snapshot size does not apply
(Oracle copy-on-first-write works differently from other techhnologies)
Another script is integrated with customer's PRTG environment
78. Checking the ACFS
DB Cloning : Customer Story92 12/2/2017
ludo@winsrv:E:oraclelocaldbaetc [OraDb11g_home1] acfsinfo
FS_NAME STATE CORRUPT TOTAL_SIZE TOTAL_FREE SNAP_USAGE PCT_USAGE
-------------- ------------- ------- ---------- ---------- ---------- ----------
E:acfsREDO AVAILABLE FALSE 51200 32200.07 0 37.11
E:acfsDATA AVAILABLE FALSE 1331200 517929.54 825515.75 61.09
E:acfsFRA AVAILABLE FALSE 122880 36200.09 0 70.54
SELECT fs_name, state, corrupt
, ROUND(total_size,2) as total_size
, ROUND(total_free,2) as total_free
, ROUND(total_snap_space_usage,2) as snap_usage
, ROUND((100-(total_free/total_size)*100),2) as PCT_USAGE FROM v$asm_filesystem;
79. DB Cloning : Customer Story93 12/2/2017
ACFS and Windows.
What can go wrong?
80. The Check inside the action script
DB Cloning : Customer Story94 12/2/2017
Check was executing `acfsutil info fs`
During shapshot operations there are ACFS metadata locks
The action script was failing
Oracle Restart decided to restart the FS (indluding all the databases!)
Now a lockfile mechanism and higher script timeouts prevent the problem
if ( -f $lockFile ) {
&DoMsg ("ACFS operation in progress. Will not check.");
}
81. Standby reinstate: erase all?
DB Cloning : Customer Story95 12/2/2017
ALL the snapshots depend on the first one containing the standby
Reinstate of the standby will increase massively the disk space
If not enough, all the clones will be destroyed and taken again
82. Need to switchover
DB Cloning : Customer Story96 12/2/2017
The standby is on a snapshot that has snapshots
In case of switchover the performance will decrease significantly
The customer is ready to accept degraded performance in such case
84. Three months long service request
DB Cloning : Customer Story98 12/2/2017
**************************************************************************
* *
* Bugcheck Analysis *
* *
**************************************************************************
Use !analyze -v to get detailed debugging information.
BugCheck 3B, {c0000005, fffff8012845e144, ffffd0006da60b10, 0}
*** WARNING: Unable to verify timestamp for oracleacfs.sys
*** ERROR: Module load completed but symbols could not be loaded for
oracleacfs.sys
Probably caused by : oracleacfs.sys ( oracleacfs+3d144 )
Followup: MachineOwne
85. Three months long service request
DB Cloning : Customer Story99 12/2/2017
Hi Ludovico,
We got a development teame. They are going to include patch on
12.1.0.2.171130.
Targeting fix for Bundle Patch via this CI bug:
BUG 26994229 - CI BACKPORT OF BUG 19439577 FOR INCLUSION IN WINDOWS
DB BP 12.1.0.2.171130
I would request you to monitor the next PSU release and apply on your
environment.
86. DB Cloning : Customer Story100 12/2/2017
Customer satisfied?
87. Customer satisfied?
DB Cloning : Customer Story101 12/2/2017
GOOD
Clone process reduced to 3 minutes
Space consumption: -80%
Performance increase due to NVMe
BAD
Stability problems (almost fixed)
Big operational change
Clones cannot live forever (wow, that
sounds just like Blade Runner)
because of space usage
88. 12/2/2017 DB Cloning : Customer Story102
Technology on its own won't help you.
You need to know how to use it properly.