The document describes how to build a personal DBA lab using Oracle VirtualBox to simulate different Oracle database environments. It outlines setting up a base Oracle Linux machine and cloning it to create virtual machines for a DNS server, an 11g single-instance database with ASM, a 2-node 11g RAC cluster, and a 12c Cloud Control environment. Details are provided on configuring shared disks, networking, installing Oracle Grid Infrastructure, and tips to avoid common issues. The goal is to have a self-contained, reproducible lab for testing various Oracle database functionality and configurations.
Kea DHCP – the new open source DHCP server from ISCMen and Mice
This webinar will highlight the differences between the old ISC DHCP and new Kea DHCP (database support, dynamic reconfiguration, performance wins, scripting hooks) and will showcase the Men & Mice Suite as a graphical front-end to both ISC DHCP and Kea to ease the migration.
Nagios Conference 2012 - Mike Weber - FailoverNagios
Mike Weber's presentation on using Nagios and High Availability.
The presentation was given during the Nagios World Conference North America held Sept 25-28th, 2012 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Kea DHCP – the new open source DHCP server from ISCMen and Mice
This webinar will highlight the differences between the old ISC DHCP and new Kea DHCP (database support, dynamic reconfiguration, performance wins, scripting hooks) and will showcase the Men & Mice Suite as a graphical front-end to both ISC DHCP and Kea to ease the migration.
Nagios Conference 2012 - Mike Weber - FailoverNagios
Mike Weber's presentation on using Nagios and High Availability.
The presentation was given during the Nagios World Conference North America held Sept 25-28th, 2012 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Cassandra Troubleshooting (for 2.0 and earlier)J.B. Langston
I’ll give a general lay of the land for troubleshooting Cassandra. Then I’ll take you on a deep dive through nodetool and system.log and give you a guided tour of the useful information they provide for troubleshooting. I’ll devote special attention to monitoring the various processes that Cassandra uses to do its work and how to effectively search for information about specific error messages online.
This is the old version of this presentation for Cassandra 2.0 and earlier. Check out the updated slide deck for Cassandra 2.1.
In this presentation, we are going to take a look at the mechanism about how ceph storage is provided as persistence storage to docker container.
First of all, we are going to show the process how to deploy ceph storage using openstack kola and how we developed the docker volume plugin.
OSDC 2016 - Tuning Linux for your Database by Colin CharlesNETWAYS
Many operations folk know that performance varies depending on using one of the many Linux filesystems like EXT4 or XFS. They also know of the schedulers available, they see the OOM killer coming and more. However, appropriate configuration is necessary when you're running your databases at scale.
Learn best practices for Linux performance tuning for MariaDB/MySQL (where MyISAM uses the operating system cache, and InnoDB maintains its own aggressive buffer pool), as well as PostgreSQL and MongoDB (more dependent on the operating system). Topics that will be covered include: filesystems, swap and memory management, I/O scheduler settings, using and understanding the tools available (like iostat/vmstat/etc), practical kernel configuration, profiling your database, and using RAID and LVM.
There is a focus on bare metal as well as configuring your cloud instances in.
Learn from practical examples from the trenches.
Yeti-DNS is an international research project with the purpose of testing new technologies and procedures in running the Internet root zone. The project runs tests on DNSSEC key rollovers in the root, as well as experimenting with new ways to manage the DNSSEC keys (multiple zone signing keys).
An interview with Shane Kerr, a coordinator for the Yeti-DNS project, forms part of this webinar. The interview sheds light on the technical and political aspects of the project and introduces the latest results from experiments.
The webinar also includes a tutorial on how to use the Yeti-DNS root name servers to configure a BIND 9 DNS resolver in order to take part in the project.
A webinar that looks into the new features that the Windows Server 2016 will offer in the DNS, DHCP and IPv6 space.
Showcase of some of the new stuff using the latest tech preview and the aim is to give administrators a quick overview of the Windows Server 2016 and enough information to decide if early adoption is worthwhile.
Slides that accompanied a three-hour crash training course on sysadmin survival skills useful for sysadmins of Evergreen open source library software. Session led by Don McMorris, Equinox Software.
In recent years Zalando has adopted a decentralized setup for applications and databases. This has impacted our database engineers by transferring responsibility to small teams, each of which manages its own infrastructure. Decentralization is great for team autonomy, but can present challenges in terms of how to easily manage lots of PostgreSQL clusters. That’s why our team created Spilo: an open source HA-cluster (highly available PostgreSQL cluster). This talk will show how Spilo simplifies Postgres cluster management while preserving team autonomy. By building upon streaming replication, Spilo provides a set of clusters that require no human interaction for many administration tasks and most failure scenarios; takes care of managing the number of servers (adding and removing them); and creates backups. It implements our own version of Patroni (https://github.com/zalando/patroni): a process, derived from Compose’s Governor, that governs the Postgres cluster (promoting and demoting) and updates information in etcd (the distributed consensus key/value store created by CoreOS). I’ll explore the architecture of Patroni implemented with Spilo; a live demo will show some failovers as they occur. Finally, I’ll show how Spilo combines Patroni with cloud infrastructure architecture components (for example, AWS), adding autoscaling to run a HA-cluster and allowing AWS power users to create a new HA-cluster with very little effort. Spilo relies upon STUPS, Zalando’s open-source platform as a service (PaaS) for enabling multiple, autonomous teams to use AWS while remaining audit-compliant. By using Spilo and STUPS together, our engineers can create a new HA-cluster with just a few commands. After attending this talk the audience will understand how they can also use Spilo, Patroni and STUPS to manage their Postgres clusters more efficiently while working autonomously.
MOW2010: 1TB MySQL Database Migration and HA Infrastructure by Alex Gorbachev...Alex Gorbachev
Slides from MOW2010 presentation.
On the example of this real-life project, we will demonstrate how mature MySQL database software is and what an experienced Oracle DBA can expect in MySQL land. The project included setting up highly available clustered infrastructure and disaster recovery site for MySQL.
You have amazing content and you want to get it to your users as fast as possible. In today’s industry, milliseconds matter and slow websites will never keep up. You can use a CDN but they are expensive, make you dependent on a third party to deliver your content, and can be notoriously inflexible. Enter Varnish, a powerful, open-source caching reverse proxy that lives in your network and lets you take control of how your content is managed and delivered. We’ll discuss how to install and configure Varnish in front of a typical web application, how to handle sessions and security, and how you can customize Varnish to your unique needs. This session will teach you how Varnish can help you give your users a better experience while saving your company and clients money at the same time.
Cassandra Troubleshooting (for 2.0 and earlier)J.B. Langston
I’ll give a general lay of the land for troubleshooting Cassandra. Then I’ll take you on a deep dive through nodetool and system.log and give you a guided tour of the useful information they provide for troubleshooting. I’ll devote special attention to monitoring the various processes that Cassandra uses to do its work and how to effectively search for information about specific error messages online.
This is the old version of this presentation for Cassandra 2.0 and earlier. Check out the updated slide deck for Cassandra 2.1.
In this presentation, we are going to take a look at the mechanism about how ceph storage is provided as persistence storage to docker container.
First of all, we are going to show the process how to deploy ceph storage using openstack kola and how we developed the docker volume plugin.
OSDC 2016 - Tuning Linux for your Database by Colin CharlesNETWAYS
Many operations folk know that performance varies depending on using one of the many Linux filesystems like EXT4 or XFS. They also know of the schedulers available, they see the OOM killer coming and more. However, appropriate configuration is necessary when you're running your databases at scale.
Learn best practices for Linux performance tuning for MariaDB/MySQL (where MyISAM uses the operating system cache, and InnoDB maintains its own aggressive buffer pool), as well as PostgreSQL and MongoDB (more dependent on the operating system). Topics that will be covered include: filesystems, swap and memory management, I/O scheduler settings, using and understanding the tools available (like iostat/vmstat/etc), practical kernel configuration, profiling your database, and using RAID and LVM.
There is a focus on bare metal as well as configuring your cloud instances in.
Learn from practical examples from the trenches.
Yeti-DNS is an international research project with the purpose of testing new technologies and procedures in running the Internet root zone. The project runs tests on DNSSEC key rollovers in the root, as well as experimenting with new ways to manage the DNSSEC keys (multiple zone signing keys).
An interview with Shane Kerr, a coordinator for the Yeti-DNS project, forms part of this webinar. The interview sheds light on the technical and political aspects of the project and introduces the latest results from experiments.
The webinar also includes a tutorial on how to use the Yeti-DNS root name servers to configure a BIND 9 DNS resolver in order to take part in the project.
A webinar that looks into the new features that the Windows Server 2016 will offer in the DNS, DHCP and IPv6 space.
Showcase of some of the new stuff using the latest tech preview and the aim is to give administrators a quick overview of the Windows Server 2016 and enough information to decide if early adoption is worthwhile.
Slides that accompanied a three-hour crash training course on sysadmin survival skills useful for sysadmins of Evergreen open source library software. Session led by Don McMorris, Equinox Software.
In recent years Zalando has adopted a decentralized setup for applications and databases. This has impacted our database engineers by transferring responsibility to small teams, each of which manages its own infrastructure. Decentralization is great for team autonomy, but can present challenges in terms of how to easily manage lots of PostgreSQL clusters. That’s why our team created Spilo: an open source HA-cluster (highly available PostgreSQL cluster). This talk will show how Spilo simplifies Postgres cluster management while preserving team autonomy. By building upon streaming replication, Spilo provides a set of clusters that require no human interaction for many administration tasks and most failure scenarios; takes care of managing the number of servers (adding and removing them); and creates backups. It implements our own version of Patroni (https://github.com/zalando/patroni): a process, derived from Compose’s Governor, that governs the Postgres cluster (promoting and demoting) and updates information in etcd (the distributed consensus key/value store created by CoreOS). I’ll explore the architecture of Patroni implemented with Spilo; a live demo will show some failovers as they occur. Finally, I’ll show how Spilo combines Patroni with cloud infrastructure architecture components (for example, AWS), adding autoscaling to run a HA-cluster and allowing AWS power users to create a new HA-cluster with very little effort. Spilo relies upon STUPS, Zalando’s open-source platform as a service (PaaS) for enabling multiple, autonomous teams to use AWS while remaining audit-compliant. By using Spilo and STUPS together, our engineers can create a new HA-cluster with just a few commands. After attending this talk the audience will understand how they can also use Spilo, Patroni and STUPS to manage their Postgres clusters more efficiently while working autonomously.
MOW2010: 1TB MySQL Database Migration and HA Infrastructure by Alex Gorbachev...Alex Gorbachev
Slides from MOW2010 presentation.
On the example of this real-life project, we will demonstrate how mature MySQL database software is and what an experienced Oracle DBA can expect in MySQL land. The project included setting up highly available clustered infrastructure and disaster recovery site for MySQL.
You have amazing content and you want to get it to your users as fast as possible. In today’s industry, milliseconds matter and slow websites will never keep up. You can use a CDN but they are expensive, make you dependent on a third party to deliver your content, and can be notoriously inflexible. Enter Varnish, a powerful, open-source caching reverse proxy that lives in your network and lets you take control of how your content is managed and delivered. We’ll discuss how to install and configure Varnish in front of a typical web application, how to handle sessions and security, and how you can customize Varnish to your unique needs. This session will teach you how Varnish can help you give your users a better experience while saving your company and clients money at the same time.
VMworld 2013: Virtualizing Mission Critical Oracle RAC with vSphere and vCOPSVMworld
VMworld 2013
Steven Jones, VMware
Charles Kim, Viscosity North America
Kannan Mani, VMware
George Trujillo, Hortonworks
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Azure VM 101 - HomeGen by CloudGen Verona - Marco ObinuMarco Obinu
Slides presented during HomeGen by CloudGen Verona, about how to properly size an Azure IaaS VM, with an additional focus on high availability and cost-saving topics.
Session recording: https://youtu.be/C8v6c6EkJ9A
Demo: https://github.com/OmegaMadLab/SqlIaasVmPlayground
AtlasCamp 2015: The age of orchestration: From Docker basics to cluster manag...Atlassian
Nicola Paolucci, Atlassian
Containers hit the collective developer mind with great force the past two years and created a space of fervent innovation. Now work is moving towards orchestration. In this session we'll cover an overview of the container orchestration landscape, give an introduction to Docker's own tools - machine, swarm and compose - and show a (semi)live demo of how they work in practice.
VMworld 2013: How SRP Delivers More Than Power to Their Customers VMworld
VMworld 2013
Sheldon Brown, SRP
Girish Manmadkar, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Dockerizing the Hard Services: Neutron and Novaclayton_oneill
Talk about the benefits and pitfalls involved in successfully running complex services like Neutron and Nova inside of Docker containers.
Topics include:
* What magic incantations are needed to run these services at all?
* How to prevent HA router failover on service restarts.
* How to prevent network namespaces from breaking everything.
* Bonus: How network namespace fixes also helped fix Cinder NFS backend
A talk I gave at the recent Advanced AWS Meeup - this is a detailed guide to how I installed and set up Spinnaker to work with our infrastructure at Stitch Fix. I go over the various problems I ran into and how I solved them. I hope this can be useful for others setting up, or interested in setting up Spinnaker for their purposes.
**Big thanks to Armory for recording the talks! Video for this talk can be found here: https://youtu.be/ywzPblFpIE0 (I'm the second speaker)**
This presentation will discuss the stories of 3 companies that span different industries; what challenges they faced and how cloud analytics solved for them; what technologies were implemented to solve the challenges; and how they were able to benefit from their new cloud analytics environments.
The objectives of this session include:
• Detail and explain the key benefits and advantages of moving BI and analytics workloads to the cloud, and why companies shouldn’t wait any longer to make their move.
• Compare the different analytics cloud options companies have, and the pros and cons of each.
• Describe some of the challenges companies may face when moving their analytics to the cloud, and what they need to prepare for.
• Provide the case studies of three companies, what issues they were solving for, what technologies they implemented and why, and how they benefited from their new solutions.
• Learn what to look for one considering a partner and trusted advisor to assist with an analytics cloud migration.
Accelerate SQL Server Migration to the AWS Cloud Datavail
In today’s marketplace, moving to the public Cloud is a familiar and consistent trend within the SQL Server community.
But which cloud provider do you choose? After all there are different AWS instances each with their own distinctive features. Migrations to the cloud are only going to gain greater momentum as organizations grapple with their on-premises alternatives.
Recent cloud breaches may have some organizations hesitant to take the leap and move to the cloud, however market-leading cloud providers are making every attempt in adhering to compliance guidelines while boosting their security framework and reliability offerings. They are also becoming more competitive by managing their cost more effectively.
For both homogeneous and heterogeneous migrations, planning plays a critical role in moving to the cloud. Preparing a checklist and asking the right questions to stakeholders lays the groundwork in this planning. There are different methods to migrate databases from on-premises to the AWS cloud.
This webinar is in partnership with PASS, download the recording to learn more about:
Reasons to go to the cloud
SQL Server on AWS EC2 vs. AWS RDS
SQL Server high availability (HA) & disaster recovery (DR)
SQL Server migration methodology
DBAs role in the cloud
MOUS 2020 - Hyperion 11.2 vs. Cloud: Should I Stay or Should I Go?Datavail
Oracle has announced the 11.2 release of the Oracle Hyperion EPM on-premises suite, tentatively scheduled for Q1 2019. The impending release represents a decision point for many on-premises customers: Should I invest in upgrading to 11.2, or is this the right time to move to the cloud?
The presentation will cover:
• On-premise infrastructure impacts
• Hyperion/Oracle EPM 11.2.x.x. vs. Cloud
• Understanding Oracle’s Cloud strategy
• Alternative cloud migration approaches
We will share the most important considerations when making this decision and share some of our related real-world experience.
Oracle Enterprise Manager Seven Robust Features to Put in Action finalDatavail
Oracle Enterprise Manager (OEM) brings your Oracle deployments together in a single management, monitoring, and automation dashboard. Oracle developed this solution, so it offers deep integration with many of its technologies. The ease of integration, coupled with the support of both on-premise and cloud-based Oracle databases, allows it to fit into many enterprise infrastructures. Oracle Enterprise Manager can also monitor and manage non-Oracle databases, making it a cost-effective and central tool to manage IT environments with a mix of database platforms.
The single point of control is appealing for complex enterprise infrastructures, especially when they’re heavily invested in Oracle technologies. Out-of-the-box monitoring and reporting templates cover many common use cases, and simplifies the configuration of management automation for databases, applications, and more.
Watch the webinar to see a brief history of OEM and a deep dive into seven robust features organizations should consider implementing:
Lessons from Migrating Oracle Databases to Amazon RDS or Amazon Aurora Datavail
Learn and leverage database migration best practices from moving off commercial Oracle databases to Amazon RDS or Aurora. We’ll cover common pitfalls, issues, the biggest differences between the engines, migration best practices, and how some of our customers have completed these migrations.
EPM 11.2: Lessons Learned and 2021 PreparednessDatavail
As we all know, EPM 11.2 is here!
But…it was released too late in 2019 for most organizations to budget an on-premises EPM upgrade for Fiscal 2020. However, the end of support for 11.1.2.4 is also looming in 2021. If you’re staying on-premises, an upgrade to 11.2 should go live no later than December 2021 (earlier if subject to SOX controls).
Rather than waiting for the next budget cycle to roll around, this webinar will show attendees how to prepare for an upgrade this year without spending significant time and capital. We’ll also share what we’ve learned while upgrading to 11.2, and what you can expect post-install.
Optimizing Oracle Databases & Applications Gives Fast Food Giant Major GainsDatavail
A leader in the fast-food industry began experiencing issues with database performance and financial close processes that were having major effects on the business. By implementing optimization techniques, re-architecting systems, migrating to the cloud, and properly distributing server load, this fast-food giant was able to:
Cut server lag from 24 hours to five minutes during even the most active periods
Decrease time to implement global changes to menus from one week to overnight
Speed their financial close time frame
Significantly reduce the frequency of crashes and downtime
And more!
Watch this webinar to learn HOW this was achieved with our 5S performance tuning methodology, so you can do the same in your own environment.
As an Oracle DBA manager, you have a lot to keep up with—new technologies, certifications, cloud migrations, upgrades, etc. Learn how to help your team stay ahead of technology shifts by following a few easy steps.
Delivered by DBA Managers with 15+ years of hands-on technical experience, this presentation provides proven methods these experts used to help their direct reports advance their skill sets and careers. Walk away with actionable steps you can use to elevate your DBA team’s expertise.
Upcoming Extended Support Deadlines & What They Mean for YouDatavail
Extended Support deadlines are drawing near for the technology undergirding on-premises Oracle® EPM/Hyperion systems.
Watch this on-demand webinar to learn about vendor Extended Support deadlines for Java, Oracle JRockit, Microsoft Windows Server, Microsoft SQL Server, Linux, and Oracle EPM 11.1.2.4 and prior and how they will affect your EPM/Hyperion applications. While some of these dates are a few years away, others are not and may surprise you.
Also, learn about implications of either an upgrade vs. moving to the Cloud if your system is subject to Sarbanes-Oxley or similar change audit controls. If your Oracle EPM system is subject to these controls, take note of ways to avoid being red-flagged in a future year’s SOX audit.
Are you are interested in running SQL on Linux, but don’t know how to get started? In this presentation, we’ll share the software and hardware you need to get started. We’ll also cover these steps:
- Installing and configuring VirtualBox, Ubuntu Server, PUTTY, SQL Server 2019 on Ubuntu.
- Review the basic administration steps such as start and stop the SQL Server services on Linux
- Backup and restore a database on Linux and checking CPU usage, disk i/o, and disk space.
By the end of the presentation, you will have the required knowledge to setup your own lab and continue your journey on further learning of SQL on Linux.
Reduce Cost by Tuning Queries on Azure DBaaSDatavail
Poorly written queries on on-premise servers slow down the server performance.But in the case of Azure SQL database, those queries not only degrade the application performance but also cost money. When you tune queries in Azure SQL Database, you may benefit from reducing resource demands as your application might run at a lower compute size and then eventually you can reduce cost.
In any given SQL Server instance, there are likely 8 to 10 queries or stored procedures that are responsible for 80 to 90 percent of the server load. If you can identify these problem queries and tune them, you can make a significant impact on the overall performance of your database. This presentation will explain some simple techniques of tuning the queries and will demonstrate before and after performance differences.
MOUS 2019 - Keeping Pace with Change: Prepare for Tomorrow & Advance Your Car...Datavail
There’s a lot to keep up with in the IT industry and especially as a DBA manager.
Oracle expert, Steve Thompson takes on the topic of advance your career while keeping pace with change.
Download the presentation to learn more about:
How to embrace changes
Determining your direction
How to focus on value and avoid distractions
Expanding skills
Mastering the cloud
Essbase On-Prem to Oracle Analytics Cloud - How, When, and WhyDatavail
In this presentation, you will get insight into the benefits of upgrading vs. moving to the cloud, scenarios and case studies from our recent years of experience, and how moving to the cloud might affect your budgeting, software updates & patches, existing investments, licensing costs, and more.
Is "Free" Good Enough for Your MySQL Environment?Datavail
MySQL can be the perfect answer for fast-growing, highly-performant and geographically-distributed database environments, but in order to function as a business-critical system with immediate response times, the ubiquitous database server needs a little help.
That’s where Continuent and Datavail come in. Combined, these two companies, which specialize in making MySQL and other databases perform continuously, have helped hundreds of enterprise, mid-market and start-up companies alike, including many in the data-dependent SaaS, e-commerce, financial services and gaming industries.
In addition, we’ll dive into why ‘managed’ database-as-a-service solutions, may not be quite as self-managing as people would like to believe. You’ll hear several case studies on how clients are effectively utilizing Continuent Tungsten software and Datavail services to optimize their MySQL environments.
Critical Preflight Checks for Your EPM ApplicationsDatavail
The environment which houses your business critical EPM applications is complex.
Maybe as complex as the cockpit of an aircraft. Just as a pilot might not be able to build or fix everything on their plane, you might be using applications but not know how to build or fix everything that’s being used. This shouldn’t stop you from doing a pre-flight check to ensure that all your Hyperion systems are running properly and set for you and your end users.
Let’s talk about some different strategies to achieve this and give you the confidence in your systems so that you can know when things are running well—or more importantly, when they need attention before takeoff.
In this presentation, we will do assess the on-premises environment and determining what workloads and databases are ready to make the move and what can you do to improve their Azure readiness while reducing downtime during the migration. Planning and assessment plays a critical role in moving to the cloud. We would see wide range of resources and tools to get an assessment completed with ease while identifying workload dependencies with practical tips and tricks focusing on sizing and costs. And finally, we’ll assess the SQL instances and identify their readiness for Azure as well.
Essbase On-Prem to Oracle Analytics Cloud - How, When, and WhyDatavail
In this presentation, you will get insight into the benefits of upgrading vs. moving to the cloud, scenarios and case studies from our recent years of experience, and how moving to the cloud might affect your budgeting, software updates & patches, existing investments, licensing costs, and more.
In this presentation, we’ll explore the Accidental DBA. Oracle DBA Team Lead and expert, Steve Thompson’s presentation from Kscope19 takes on the different ways to lead an Accidental DBA.
The presentation explores:
What is an Accidental DBA, and what scenarios create an Accidental DBA?
Why it’s important to evaluate skill gaps, risks and benefits and plan for them.
Why companies should invest in the training.
Managing an EPM platform is not for the faint of heart – and going at it without a plan can leave you frustrated, nervous, and accountable if trouble strikes. But how do you prepare?
This presentation helps you get all of your EPM planning in one place with an EPM Punch List. We’ll talk through all the areas you should be concerned about to keep your Hyperion and Oracle EPM applications running smoothly, and give you solid, actionable strategies so that you are prepared for the worst.
Why NBC Universal Migrated to MongoDB AtlasDatavail
NBCUniversal, a worldwide mass media corporation, was looking for a more affordable and easier way to manage their database solution that hosts their extensive online digital assets. With Datavail’s assistance, NBCUniversal made the move from MongoDB 3.6 to MongoDB Atlas on AWS.
In this presentation, learn how making this move enabled the entertainment titan to reduce overhead and labor costs associated with managing its database environment.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentations
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Oracle Sandbox
1. Patrick Gates and Peter Schroeder
How to Build a Personal DBA Lab to Keep
Up with Ever Changing Demands
2. 3/19/2014 2www.datavail.com
Our Virtual Box End State Configuration
Oracle Base machine
• DV_BASE_OEL_6.3
DNS server
• DV_DNS
11g single instance with ASM
• DV_130_11G
2 node RAC
• DV_RAC1
• DV_RAC2
12c OEM Cloud Control
• DV_EM12C
4. 3/19/2014 4www.datavail.com
What is Virtual Box?
• VirtualBox is a general-purpose full virtualizer for x86 hardware,
targeted at server, desktop and embedded use.
• Presently, VirtualBox runs on Windows, Linux, Macintosh, and
Solaris hosts and supports a large number of guest operating
systems including but not limited to Windows (NT 4.0, 2000, XP,
Server 2003, Vista, Windows 7), DOS/Windows 3.x, Linux (2.4 and
2.6), Solaris and OpenSolaris, OS/2, and OpenBSD.
• Download Virtual Box at www.virtualbox.org
5. 3/19/2014 5www.datavail.com
Why we used VirtualBox
• It’s Free!!
• Supports Multiple Operating Systems
• Ability to setup host only networking
• Testing becomes easier with features like immutable disks and
snapshots
• Can share disks between severs
• i.e. RAC installations
• Allows us to setup and perform functionality testing quickly
• Standbys
• Guaranteed Restore points
• Basic RMAN recoveries
• RMAN duplicates or clones
• 10g to 11gR2 upgrades
6. 3/19/2014 6www.datavail.com
How we did it
We did not reinvent the wheel building this lab
We used lots of good blogs and sites to build what is effective for us
• Installing OEL
• http://www.oracle-base.com/articles/linux/oracle-linux-6-installation.php
• Setting up a DNS Server
• http://www.oracle-base.com/articles/linux/dns-configuration-for-scan.php
• Installing 11gR2 RAC
• http://www.oracle-base.com/articles/11g/oracle-db-11gr2-rac-installation-
on-oracle-linux-6-using-virtualbox.php
• How to reconfigure oralce OHAS when the hostname is changed
• http://www.dbaglobe.com/2011/05/summarize-of-how-to-change-
hostname-in.html
7. 3/19/2014 7www.datavail.com
How we did it - Continued
• Enables you to get deeper understanding of how things actually work
• Can try different configurations within the OS and database
• OS
• Install the OS, Change OS parameters, set kernel values
• Create all the users and groups necessary for an Oracle install
• Oracleasm configure
• Oracleasm createdisk
• Setup SCAN IP addresses
• Database
• Flashback Database
• Fast Start Failover
• Active Dataguard
8. 3/19/2014 8www.datavail.com
Setup a BASE machine
• Build everything into base machine so you don’t have redo it
every time
• Use NAT not bridged for networking
• You can share you machine with a coworker with out
having IP conflicts
• Setup VirtualBox Host Only networking
• What is in the BASE machine
• OEL OS 6.3
• Root user
• Oracle user
• ASMLIB
67. 3/19/2014 67www.datavail.com
Cloning the BASE machine
Why clone the BASE machine?
• OS is already loaded
• Oracle OS user is created
• You will not fail 11g prerequisite checks
• Consistency
• Takes about 2 to 3 minutes to clone
Potential Gotchas
• You need to make sure you always check “Reinitalize the
MAC addresses for all network cards” on the screen when
you are cloning the base machine.
68. 3/19/2014 68www.datavail.com
Clone Base machine for a DNS server
Why create a DNS Server?
• Mimics a production environment
• No need to update the /etc/hosts file on all virtual servers
• You can setup a round robin SCAN IP for 11gR2 RAC
installs
102. 3/19/2014 102www.datavail.com
Clone from base machine for 11g Single Instance
with ASM
Main highlights
• Setup ASM disks in virtual box and server
• Create in vbox
• Fdisk steps
• Oracleasm configure, createdisk
• Changing network
• Changing hostname
• http://www.dbaglobe.com/2011/05/summarize-of-
how-to-change-hostname-in.html
130. 3/19/2014 130www.datavail.com
Clone from base machine for the first node of a two
Node 11gR2 RAC install
Main highlights
• Setup DNS entries for hostnames, SCANs, public IPs,
private IPs and VIPs
• Show how pinging the SCANs will round round through
IPs from DNS server
• Setup shared disks for RAC
• Reconfirm how network is setup on VirtualBox
Potential Gotchas
• Disable NTP
• Setup of network interface types from grid infrastructure install
• install the cvuqdisk rpm from GI install media
150. 3/19/2014 150www.datavail.com
Clone from base machine for the second node of a
two Node 11gR2 RAC install
Main highlights
• Finish configuration for shared disks with VirtualBox
Potential Gotchas
• Disable NTP
• Setup of network interface types from grid infrastructure install
• install the cvuqdisk rpm from GI install media
170. 3/19/2014 170www.datavail.com
Clone from DV-130 (11g DB machine) to install 12c
OEM Cloud Control
Main highlights
• Cloned from an existing machine that had an 11g
database because that is required for the OEM 12c install
• How we used used Google as mail relay
• Demonstrate 12c Grid monitoring targets
Potential Gotchas
• Hostname has to be changed
• IP has to be changed
• OHAS service has to be reconfigured
• Specific database parameters required
• Used this link as a guide for the steps above
• http://www.dbaglobe.com/2011/05/summarize-of-how-
to-change-hostname-in.html
Thanks for taking the time to attend our presentation on building a personal DBA lab.Peter and I are going to outline how we built a DBA LAB on Oracle’s VirtualBox to help us keep up with the latest trends in database administration.
This is the end state of our lab that we built out. We ended up with 6 servers.1 Base machine that we clone everything from1 DNS Server1 11gR2 database with ASM2 node 11gR2 RAC1 12c OEM Cloud Control
This is the final look in Oracle Virtual Box for all the machines we created
Just read the slide
Walk through slide first and then make points below.We first started using Virtual box to run Windows VMs so we could connect to multiple client VPNs at the same time. Many VPN clients conflict with each other and can also prevent you from using a browser.Over time we need an environment to perform testing upgrades and new features to keep up with Oracle releases. That drove to us to creating a lab like you will see today.
Installing an OS, getting the right ASMLIB kernel version, installing DNS, changing OS parameters, etc are not the easiest things to do. We used the knowledge in these sites to help guide us.
Just walkthrough the slide
Walk through slideThe most important part of the base machine is to only do things once. When it is in the base machine and you clone from that you don’t have to perform the steps every timeTransition to Pete to show how to setup the host only networksNetwork Address Translation (NAT) NAT enables the guest machine to see out onto the Internet, but via a private IP address that cannot be seen from the host, or indeed, the rest of your physical network. I use this, because if you are on a laptop, and sometimes you are hardwired, and other times you are wireless, you do not have to change you network setting depending with connectivity you are using.
Before we create the base machine we need to create the host only networking within Virtual box. The is an important step especially when it comes to performing RAC installs that require public and private networks. The host only networking is also going to allow our DBA to function even if we don’t have internet connectivity.Pete is now going to walk you through the host only network setup.After you install the VirtualBox Software, you need to add the 2 host only networksYou get there by choosing FILE->PREFERENCESOn this screen we see the 2 host only networks I configured1) VirtualBox Host Only Ethernet Adapter (Public 192.168.60)2) VirtualBox Host Only Ethernet Adapter #2 (Private 192.168.61)
DHCP Server:Server Address: 192.168.61.2Server Mask: 255.255.255.0Lower Address Bound: 192.168.61.3Upper Address Bound: 192.168.61.98After the Networks are defined, we can begin to create our first Virtual Machine.Save your Preferences and Click on the New Icon on the Top Left of the VirutalBox Manager
Name: DV_BASE will be the name associated with the Guest Server we are creatingType: LinuxVersion: Oracle (64bit)
Here we set the memory we are going to allocate to our Virtual Machine.I like to set the Memory to 4G. I do this, so I can take the defaults when installing Oracle Enterprise Linux. Then after the OS is installed, I can always reduce the size of the memory later.Virtual Box loves 3 things. Memory/Fast Disk (solid state)/CPUPatrick makes point below:My mac has 16G and I usually change the memory to 2G per machineMy previous laptop only had 8G and I was able to run windows & and 2 VMS with 2G of memory each
Now we add our hard drive. On a virtual machine, your hard drive is a big file.So this disk we are creating here is your hard disk for the server
I use the default VDI (Virutalbox Disk Image)
We can set our disk to allocate all it’s space at once – FIXED SIZEOrWe can let it Dynamically allocated space as it grows – DYNAMICALLY ALLOCATEFor the OS, I choose Dynamic
Here I am setting the upper limit to 40G.
Now the shell of our Virtual Machine is all Set.Imagine what you have here is a new server with 4G of memory and 40G of storage. The only problem, is that our server only came with no network cards.So now we are going to right click in the DV_BASE machine, and go into settings to add the network cards. It is a lot easier to install the OS, if it can find the network cards on the install.
We want to have three network cards in all of our servers.1) For Internet access 2) Public Network for accessing Servers 3) Private Network for interconnectAdapter 1Attach to: NATName: (if we choose bridge here, we would need to tie it to a network card on our PC. So I would see the Wired and Wireless Cards in the drop down. This is where I was saying if you switch from Wireless to Wired when you use your laptop, you would need to change this before starting the machine)
Adapter 2Attach to: Host-only AdapterName: VirtualBox Host-Only Ethernet AdapterSo this is going to be our Public Network that all of our Guest Servers communicate to each other on. Remember VB HostOnly Adapter is our public network.
Adapter 3Attach to: Host-only AdapterName: VirtualBox Host-Only Ethernet Adapter #2So this is going to be our Private. This will be used for our RAC interconnects. Remember VB HostOnly Adapter #2 is our private network.
VirtualBox allows you to setup a share folder on you host machine that can be visible from the guest machine.I always setup a shared folder on all my virtual machines. I like to use this like a shared NFS mount point. On this folder, I keep all my install media and common scripts that I like to have on all servers. This will be the location where we will run the installs from for oracle.
The setup for our base machine is all setup, and ready to the OEL OS installedAny questions at this point?So lets start our OS installation: With the BASE machine highlighted, click the start arrow
VirtualBox will know that the OS has never been loaded on this machine. So it is now prompting you for the install media for the OS.Here select OEL 6.3 iso install file I downloaded. Consider this the install CD
We are now installing the OS. We took almost all the defaults. We are not SAs, just trying to get an OS down with all the necessary packages so we can play with Oracle.I have only included screenshots, of pages I changed on the installStart with Selecting Install or Upgrade
On this screen, I do 2 thingsGive the server a hostname dv-basePress Configure Network: so I can edit the network configuration to automatically for each network card. By default, it does not.
Make sure you check ‘Connect automatically’ and Apply
On this screen, we are going to tell the install we want a basic server.We also are going to want to customize it now, because we will want to add a few packages. All of the packages I have selected are from the Oracle Base website page we showed you in the beginning. I have taken screen shots here, so you can see all the packages I selected
Under ‘Base System’ , Select the following:Base, Client management tools, Compatibility Libraries, Console internet tools, Debug tools, Directory Client, Hardware Monitoring utilities, Java Platform, Large system performance, Network file system client and Performance tools
Base System setup continuedPerl Support
Under ‘Servers’ select the following:Server Platform and System Administration tools
Under ‘Desktop’, select the following:Desktop, Desktop platform, Fonts, General Purpose Desktop, Graphical Administration Tools, Input Methods and X Windows systems
Under ‘Application’, select the following:Internet Browser
Under ‘Development’, select the following:Additional Development and Development Tools
Reboot
Default: Forward
Set up software updates, we select No.Since we probably do not have paid OEL support, we will skip this and later I will show you how to register for the free public repository for updates
We set up a datavail user, with a password of ‘password’This can be any user you want. Don’t do oracle, because later we will be adding the oracle user.
Now our OS is loaded, and we can sign in an do further setup of our base machine
First we want to disable the firewall.Select system->administration->firewall
Select the Red Disable button
Select the Apply Button
Take Yes on the override question
I am used to having some sudo privileges on a server to run some commands as root.So here I am want to add permission to the /etc/sudoers fileSo I will su - root and edit the file
Here we add datavail and oracle.I am giving the full permission to run anything as root.
Edit the /etc/selinux/config to disable the SELINUXOracle requires this.
SELINUX=disable
Reboot
OEL by default will use the Private OEL repository. We need to set it up to use the public repository, so we can get updates.Go to the /etc/yum.repos.d directoryRename the old repository file: mv public-yum-ol6.resp to public-yum-old-resp.origRun sudowgethttp://public-yum.oracle.com/public-yum-ol6.repo - to get the public repository configuration
Now that we have install the configuration for the public repository, we can not get access to packages and updates on line. The first one I want is for the prerequisites installed:yum install oracle-rdbms-server-11gR2-preinstallThis will setup the server with everything needed for an 11gR2 install and create the oracle user and groups
Run yum update to get all the latest updates for the OSAfter everything is updated, and this can take a while. You need to reboot, because it updates the Kernel.
After rebooting it is time to install the VirtualBox guest additions:Devices->InstallGuestAdditionsThis allows for seamless mouse use and make VirtualBox act a normal windows program.I like to run this after we have updated all the OS new packages, because most likely, it laid down a new Kernel, and every time the Kernel gets updated, you need to re-install the guest additions
It will look like you just inserted a CD into the server. You want to select OK, and not have it do anything
Cd to /media/VBOX…., and run sudo ../VBoxLinuxAdditions.run
When it finishes, you want to Reboot, so the changes take effect.
On this screen I like to show 2 thingsEdit the /etc/group file and add datavail and oracle to the vboxsf group. This group was created with the guest additions install, and it allows the users of this group to have access to the shared mount point we created when we were setting up this machineChange the oracle password to password
Install the ASM support RPM, you can do it with yum:Sudo yum install oracleasm-supportOEL kernel already has asmlib built-in
Run oracleasm configureSudo /usr/sbin/oraclasm configure –ISet:owner to oracle group to oinstallStart oracle ASM Libraries on boot to ‘Y’
Start asm libraries:Sudo /usr/sbin/oracleasminit
Edit the oracleasm configuration file in /etc/sysconfig
Edit the /etc/sysconfig/oracleasm file:Add ‘dm*’ to oracleasm_scanexclude list
Make Directories for oracle installs$ORACLE_BASE$ORACLE_HOME
Edit the sudoers file to allow 12c OEM to push agents without making you run root.sh scripts manuallyPatrick:Make the point about doing this on base machine. We are mentioning this because he had to go back and change every VM after the fact. We want to help you learn from our mistakes be cause we made plenty of them while doing this.
Comment out:#Defaults requirettyPatrick takes over to cover next slide
Walk through points on slide. As we go through the build of each machine we will identify the potential gotchas that we ran into.
Read slide
Right click on the DV_BASE_OEL_6.3 machine and select clone.Change the name of the new machine, and check to reinitialize the network mac address. You need to do this, so there are not conflicts assigning IP addresses.
Choose full clone
Click clone, and VirtualBox will start building out a new machine.
Then new machine is created, and we can fire it up.Transition to Pete for next slide:In the next few slides Pete will show you how to configure the IP addresses change the hostnameSet it up as a DNS server
Sign in as datavail whatever account you created.
Just so you can see, since we cloned this machine and reinitialized the network card mac addresses, in the ifconfig, you can see we have eth3, 4 and 5. I kind of like have my cards start from eth0. So I am going to walk you through how fix that.Just to confirm, eth0, will be our network card to get out on the internet.Eth1, will be our public network all the guest servers we create talk onEth2, will be our private network, we will use for interconnects.
We edit the /etc/udev/rules.d/70-persistent-net-rules file. This file retains all the details about our network cards
We need to remove the lines for eth0 thru eth2
Then we change the eth3 thru eth5 to eth0 thru eth2
This is what the final file should look like
Reboot
Now after the reboot, we have eth0 thru eth2.
We can change the hostname for the server by editing the /etc/sysconfig/network file
As you can see the server has the hostname of our base machine we cloned
AfterWe change the HOSTNAME to dns.localdomain and save it
We now want to install the software for DNS.We execute yum install bind-libs bind bind-utils
Sample of yum’s output
After the bind software is installed, we have to update the configuration files for itWe need to edit the /etc/named.conf file
In this file we make a few changes:< # listen-on port 53 { 127.0.0.1; };< listen-on port 53 { 127.0.0.1; 192.168.60.99; };---< # allow-query { localhost; };< allow-query { any; };Changed localhost to any to allow other servers to perform the DNS lookups
Added:< < // My Additions< // Forwarder: Anything this DNS can't resolve gets forwarded to my ISPs DNS.< forwarders { 208.67.222.222; 208.67.220.220; };< //forwarders { 8.8.8.8; 192.168.0.1; };< // End My Additions< forwarders are your current DNS lookup server IPs
Zones are where we define hostnames and their IP addresses < # Added zones< #< zone "localdomain." IN {< type master;< file "localdomain.zone";< allow-update { none; };< };< < zone "60.168.192.in-addr.arpa." IN {< type master;< file "60.168.192.in-addr.arpa";< allow-update { none; };< };< < zone "61.168.192.in-addr.arpa." IN {< type master;< file "61.168.192.in-addr.arpa";< allow-update { none; };< };
After we save the named.conf, we need to create the zone files where told it about in the /var/named directoryFirst we create the localdomain.zoneThis will contain all the hostnames and servers for our localdomain
Here is a sample of the file I created.You can put in all your servers that you know you will create, or you can come back to this server and add to this file as needed.
Create /var/named/60.168.192.in-addr.arpaThis file is used for reverse named lookups. It will be used if you do an nslookup with an ip address.We will also create 61.168.192.in-addr.arpa for the private network
Sample fileIn this file, you put the last digits of the ipadress and associated it with a host nameSame as the other file, you can add as you go. You just need to restart the service after you make additions
So the one thing we need to do for this server, is give it a permanent IP addressSo lets go to System->Preferences->Network Connections
So lets configure our network adapters.Lets choose eth0 and select edit
We are going to change Method from Automatic(DHCP) automatic address only
Now we will update the DNS servers to be actually this server 192.168.60.99And we make the search domain localdomain
Then edit eth1, this will be our public vbox host only network in the 192.60 range.Method: Manualaddress: 192.168.60.99Mask: 255.255.255.0Gateway: 192.168.60.0We can leave the DNS server empty
Then edit eth2, this will be our private vbox host only network in the 192.61 range.Method: Manualaddress: 192.168.61.99Mask: 255.255.255.0Gateway: 192.168.61.0
Restart the network: sudo service network restartAnd you can see the resolv.conf now contains our dns server and domain
Now it is time to start the DNS service:# sudo service named startThen configure it to start on boot:# sudo chkconfig named onTransition back to Patrick
Here are the steps we went through to clone the base machine to install 11gR2 with ASM.You will have change to change IPs to accommodate OHAS in 11gR2
Now we clone the base, just like we did the DNSWe are creating dv-130 as a standalone 11g database serverThese steps are just like the DV-DNS
Full
Building
Once the machine is created, we want to go into it’s setting and configure some disks for ASMSo go into the Storage setting and on the Controller: SATA click on the add disk icon, it is on the far right of the Controller line.Select create new disk
I take the default hard drive type as VDI
For ASM, we want to make it a Fixed size.
Give the disk a name, I like to include the ASM disk group name
Now I create one for the DATA disk group
VDI again
Fixed
DATA disk group name and 5GWe are going to create 2 disks for DATA
Here is disk 2 for DATA
Here is what you screen should look likeTransition to Pete
Now that we fired up the New Server,We want to edit the network file to clean up the eth0 thru eth2
When you go to edit your network configurations, you will see system eth0 thru eth02Remove the system eth0 thru eth2 in the network configuration
Now we can update the auto eth0 thru eth2
Set up eth0 like you did for the DNSJust an idea, now that the BASE machine is setup, you can go back to it an configure eth0 for the DNS sever, so you do not have to repeat it like we are doing here
Assign 192.168.60.130 to eth1 like we did for the DNS
Setup eth2 to use 192.168.61.130, like the DNS.Since you will not be using the private network for a standalone, this is not really need, you could just the same remove the adapter 2 from the virtual machine and be fine.
Change the hostname
Set it to dv-130.localdomain
Here is a view of all you SATA devices in /devNotice sdb, sdc and sdd have no partitions. We can tell this, because partitions are represented like device plus partition number. You can see in this ls, that sda has two partitions, sda1 and sda2.sdb is the CRS disksdc is the DATA01 disksdd is the DATA02 disk.Same order as you created them in the virtual machine.
Run sudo fdisk/dev/sdbN – add a new partitionP – primary partition1 – partition numberDefault – first cylinderDefault - last cylinderW – writeThis is adding a single primary partition to use the entire disk.
We do the same for /dev/sdc
We do the same for /dev/sdd
Now you can see the sd devices have partitions.
Next we run oracleasmcreatediskNow the disks are ready to install ASMand create and 11gR2 instance.In the interest of time we will not show how we installed oracle 11gR2 on this machine. You have all seen that before.Transition to Patrick
We will walkthrough the creation of out first RAC node
Clone the BASE to create DV_RAC1
Full
Building
Create the SATA disks like we did for the 11gR2 with ASM server
VDI
FIXED
Name it and set the size
Create DATA01
VDI
Fixed
Name and size
Create DATA02
VDI
Fixed
Name and size
We need to set the disk shareable. This is done from File->Virtual Media ManagerRight Click on the DV_RAC1_CRS01.vdi and choose Modify
Select Sharable.This will allow it to be used by the second RAC server we will build
Repeat for DATA01
Repeat for DATA02At this point you will setup the network just like we did with the 11gR2 with ASM serverYou will also need to fdisk the devices for ASMAnd then run oracleasmcreatedisks commands.
Here are the steps for the configuration of the second RAC node.
Now we do the same as we have done on RAC1 to clone the BASE
FULL
Now instead of creating disk for ASM, we will Choose existing disk
Select DV_RAC1_CRS01
Create the next disk
Choose DV_RAC1_DATA01
Create next disk
Choose DV_RAC1_DATA02
Here is what you disk settings should look like.It should look very similar to the RAC1 settings
You will notice that once you are signed in and have finished changing the network and the hostname, like in RAC1, you will see that the ORACLE ASM disks are visible in /dev/oracleasm/disksAlso you can install the cvuqdiskrpm (you want to run this on both nodes). That is a step for the grid install.
Here is an example of us doing a ping on the scan name, so you can see how it round robins the ip addresses
Read slideTransition to Pete
These are the steps needed to disable the NTP services. It is not in use, but oracle complains about it in the install, because if is see the configuration file, it assumes you are using it.Service ntpd stop – Stop the service, it will probably fail, because it is not runningChkconfigntpd off – Prevent it from starting on bootupMove the /etc/ntp.conf to ntp.conf.origNow oracle will not complain about ntp
The first screen where we have to change something for the grid install it Cluster configurationScan name: dv-rac-scanAdd dv-rac2Before setting up ssh connectivity, you need to make sure to identify network interfaces are correct. So select the button ‘Identify network interfaces’
Usually you will see the eth0 set to private, so you need to set it to do not use, and make eth2 privateScreen should look likeEth0: do not useEth1: publicEth2: private
When we did our install, we had to warnings that we ignored:Device Checks for ASMTask Resolv.confintergritySince creating these machines for the DEMO, I have found work arounds for the checks, so if you apply them these checks will not fail
As root create the file /etc/udev/permissions.d/50-udev.permissionsThis is actually a way of setting permission on raw devicesWe add the three lines, one for each ASM disk.And that will prevent the failure of the check. As I said on the other slide, you can ignore this check and the install will not fail
The resolv.conf is failing, because nslookup is exiting with a ONE on a failed server lookup.Linux releases before version six exited with a ZERO.To Fix I have this script, when run as root will Rename the original nslookup to nslookup.origCreate a new nslookupthat call nslookup.origExits with a zero whether the server is found or not
You will see in the root.sh script is saying we ignored some prerequisitesFrom here you can install the RAC RDBMS software and create your database. We will not go over that here, since it installs with out issue on this server setupTransition to Patrick
Walk through slide.We thought we were making our life easier because OEM 12c install requires an existing database so we started with our 11gR2 with ASM machine.
Clone the DV_130_11G to make the dv-em12c server.We are reusing the database setup already done. Hindsight is 20/20, we should have just cloned the base machine and reinstalled oracle. It ended up being the same amount of time either way but now we now the step it will definitely save you time.
Here we go cloning again
When you change the HostName, you need to deconfig and recreate the OHAS.Notes can be found in: http://www.dbaglobe.com/2011/05/summarize-of-how-to-change-hostname-in.html
Install some development libraries before installing EM. Here is another example of us figure out additional things to add to the base machine. We went back and adding this after the fact for future clones.
Screen shots of our install
Needed to remove DB_Control setup
We clicked yes and let the installer take care of it.
We adjusted the parameters and restarted the database.