A summary of available MongoDB backup options. We manage backup for hundreds of MongoDB servers at scalegrid.io and we have learnt a few things along the way.
Oracle database high availability solutionsKirill Loifman
This document discusses Oracle database high availability strategies, architectures, and solutions. It covers elements of high availability like eliminating single points of failure through redundancy. It also discusses disaster recovery, Oracle Maximum Availability Architecture (MAA), downtime, service level agreements (SLAs), availability targets and costs, levels of high availability, Oracle's solutions to downtime like RAC and Data Guard, best practices, and examples of high availability configurations including using Oracle RAC and Data Guard together.
Understanding MySQL Performance through BenchmarkingLaine Campbell
The document discusses using benchmarks to measure database performance. It explains that benchmarks help identify bottlenecks, understand system behavior, and plan for growth. The mysqlslap tool is introduced for performing database benchmarks. Mysqlslap can run tests to measure throughput, latency, and stability under different conditions like load, concurrency, and spikes. Examples are provided for how to use mysqlslap to benchmark different engines, schemas, and workloads.
This document outlines an agenda for an Nginx essentials presentation. The presentation introduces concepts like HTTP protocols and web servers. It covers installing and configuring Nginx, including its HTTP module and features like load balancing and SSL. It also discusses debugging, customizing Nginx using modules like Tengine and OpenResty, and provides example use cases and references for further reading.
Introduces Ansible as DevOps favorite choice for Configuration Management and Server Provisioning. Enables audience to get started with using Ansible. Developed in Python which only needs YAML syntax knowledge to automate using this tool.
This document discusses Ansible, an open-source automation tool. It provides an overview of Ansible's capabilities including configuration management, orchestration, deployment and more. It also summarizes Ansible Tower which adds centralized control, RBAC, and other features to Ansible. Examples are given of using Ansible playbooks to automate tasks like installing and configuring Apache on Linux hosts and using Ansible modules to configure network devices.
The Yocto Project is an open source project that provides tools and methods for creating custom Linux-based systems for embedded products regardless of CPU architecture. It uses a "layer" approach where components like the build system, core packages, and machine-specific files can be mixed and matched. The speaker demonstrates how to download a Yocto Project release, configure a build, and run the build process to generate root filesystem images and packages for target deployment. Potential applications mentioned include virtualization platforms and specialized subsystems in vehicles.
Video: https://www.youtube.com/watch?v=FJW8nGV4jxY and https://www.youtube.com/watch?v=zrr2nUln9Kk . Tutorial slides for O'Reilly Velocity SC 2015, by Brendan Gregg.
There are many performance tools nowadays for Linux, but how do they all fit together, and when do we use them? This tutorial explains methodologies for using these tools, and provides a tour of four tool types: observability, benchmarking, tuning, and static tuning. Many tools will be discussed, including top, iostat, tcpdump, sar, perf_events, ftrace, SystemTap, sysdig, and others, as well observability frameworks in the Linux kernel: PMCs, tracepoints, kprobes, and uprobes.
This tutorial is updated and extended on an earlier talk that summarizes the Linux performance tool landscape. The value of this tutorial is not just learning that these tools exist and what they do, but hearing when and how they are used by a performance engineer to solve real world problems — important context that is typically not included in the standard documentation.
Kata Containers provides container virtualization using lightweight virtual machines to gain the security of virtual machines while maintaining the speed of containers. It uses hypervisor-based isolation to make each container as secure as a virtual machine while integrating seamlessly with container ecosystems. Kata Containers has an open source architecture that supports multiple hypervisors and platforms.
Oracle database high availability solutionsKirill Loifman
This document discusses Oracle database high availability strategies, architectures, and solutions. It covers elements of high availability like eliminating single points of failure through redundancy. It also discusses disaster recovery, Oracle Maximum Availability Architecture (MAA), downtime, service level agreements (SLAs), availability targets and costs, levels of high availability, Oracle's solutions to downtime like RAC and Data Guard, best practices, and examples of high availability configurations including using Oracle RAC and Data Guard together.
Understanding MySQL Performance through BenchmarkingLaine Campbell
The document discusses using benchmarks to measure database performance. It explains that benchmarks help identify bottlenecks, understand system behavior, and plan for growth. The mysqlslap tool is introduced for performing database benchmarks. Mysqlslap can run tests to measure throughput, latency, and stability under different conditions like load, concurrency, and spikes. Examples are provided for how to use mysqlslap to benchmark different engines, schemas, and workloads.
This document outlines an agenda for an Nginx essentials presentation. The presentation introduces concepts like HTTP protocols and web servers. It covers installing and configuring Nginx, including its HTTP module and features like load balancing and SSL. It also discusses debugging, customizing Nginx using modules like Tengine and OpenResty, and provides example use cases and references for further reading.
Introduces Ansible as DevOps favorite choice for Configuration Management and Server Provisioning. Enables audience to get started with using Ansible. Developed in Python which only needs YAML syntax knowledge to automate using this tool.
This document discusses Ansible, an open-source automation tool. It provides an overview of Ansible's capabilities including configuration management, orchestration, deployment and more. It also summarizes Ansible Tower which adds centralized control, RBAC, and other features to Ansible. Examples are given of using Ansible playbooks to automate tasks like installing and configuring Apache on Linux hosts and using Ansible modules to configure network devices.
The Yocto Project is an open source project that provides tools and methods for creating custom Linux-based systems for embedded products regardless of CPU architecture. It uses a "layer" approach where components like the build system, core packages, and machine-specific files can be mixed and matched. The speaker demonstrates how to download a Yocto Project release, configure a build, and run the build process to generate root filesystem images and packages for target deployment. Potential applications mentioned include virtualization platforms and specialized subsystems in vehicles.
Video: https://www.youtube.com/watch?v=FJW8nGV4jxY and https://www.youtube.com/watch?v=zrr2nUln9Kk . Tutorial slides for O'Reilly Velocity SC 2015, by Brendan Gregg.
There are many performance tools nowadays for Linux, but how do they all fit together, and when do we use them? This tutorial explains methodologies for using these tools, and provides a tour of four tool types: observability, benchmarking, tuning, and static tuning. Many tools will be discussed, including top, iostat, tcpdump, sar, perf_events, ftrace, SystemTap, sysdig, and others, as well observability frameworks in the Linux kernel: PMCs, tracepoints, kprobes, and uprobes.
This tutorial is updated and extended on an earlier talk that summarizes the Linux performance tool landscape. The value of this tutorial is not just learning that these tools exist and what they do, but hearing when and how they are used by a performance engineer to solve real world problems — important context that is typically not included in the standard documentation.
Kata Containers provides container virtualization using lightweight virtual machines to gain the security of virtual machines while maintaining the speed of containers. It uses hypervisor-based isolation to make each container as secure as a virtual machine while integrating seamlessly with container ecosystems. Kata Containers has an open source architecture that supports multiple hypervisors and platforms.
PostgreSQL Replication High Availability MethodsMydbops
This slides illustrates the need for replication in PostgreSQL, why do you need a replication DB topology, terminologies, replication nodes and many more.
MySQL uses different storage engines to store, retrieve and index data. The major storage engines are MyISAM, InnoDB, MEMORY, and ARCHIVE. MyISAM uses table-level locking and supports full-text searching but not transactions. InnoDB supports transactions, row-level locking and foreign keys but with more overhead than MyISAM. MEMORY stores data in memory for very fast access but data is lost on server restart. ARCHIVE is for read-only tables to improve performance and reduce storage requirements.
This document discusses SQL Server replication and provides steps to configure snapshot replication. Snapshot replication allows entire databases or parts of databases to be copied from a publisher to subscribers. It works by having a snapshot agent capture the database objects and data and store them as snapshot files for distribution agents to apply at subscribers. The steps shown configure a publisher, distributor, publication, and push subscription to replicate tables from one database to another using snapshot replication.
PGDay.Amsterdam 2018 - Stefan Fercot - Save your data with pgBackRestPGDay.Amsterdam
Ever heard of Point-in-time recovery? pgBackRest is an awsome tool to handle backups, restores and even helps you build streaming replication ! This talk will introduce the tool, its basic features and how to use it.
This slide was presented at Mydbops Database Meetup 4 by Bajranj ( Zenefits ). ZFS as a filesystem has good features that can enhance MySQL by compression, Quick Snapshots and others.
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...Odinot Stanislas
Après la petite intro sur le stockage distribué et la description de Ceph, Jian Zhang réalise dans cette présentation quelques benchmarks intéressants : tests séquentiels, tests random et surtout comparaison des résultats avant et après optimisations. Les paramètres de configuration touchés et optimisations (Large page numbers, Omap data sur un disque séparé, ...) apportent au minimum 2x de perf en plus.
The document discusses various DB2 recovery options including backup and restore, the recovery process model, important recovery-related system files, advanced copy services, and transportable schemas. It provides examples of the backup and restore process models and describes key DB2 recovery-related files. It also outlines the scripted interface for advanced copy services backup and differences between DB2 versions 9.7 and 10.1 related to advanced copy services.
Docker Swarm allows managing Docker clusters remotely. The key components are swarm managers, swarm nodes, and a scheduler. Swarm managers oversee nodes in the cluster using Docker APIs. The scheduler uses strategies and filters to determine where to place containers on nodes. Discovery services help register and discover nodes in the cluster.
MariaDB Server Performance Tuning & OptimizationMariaDB plc
This document discusses various techniques for optimizing MariaDB server performance, including:
- Tuning configuration settings like the buffer pool size, query cache size, and thread pool settings.
- Monitoring server metrics like CPU usage, memory usage, disk I/O, and MariaDB-specific metrics.
- Analyzing slow queries with the slow query log and EXPLAIN statements to identify optimization opportunities like adding indexes.
VMWare allows restoration of forensic images into virtual machines. This allows examination of a suspect's system and networking of multiple restored systems in an isolated virtual environment. The document outlines the process to install VMWare, restore an image as a virtual drive using a tool like ILook, and configure the virtual network. Restoring additional systems like clients and examining the restored network can provide investigative insights while isolating the virtual systems from external networks.
Hypervisors are a kind of software which runs different virtual systems called virtual machines on a single computer giving the view to guest running on each virtual machine that it is running on its own single computer. This presentation talks about hypervisors and different techniques of their implementation in brief.
A talk describing our experiences building monorepo at Pinterest.
This talk was presented at Mobile Summit'18 held at CapitalOne in SF on May 22, 2018.
DCEU 18: Developing with Docker ContainersDocker, Inc.
Laura Frank Tacho - Director of Engineering, CloudBees
Wouldn't it be great for a new developer on your team to have their dev environment totally set up on their first day? What about having the confidence that your dev environment mirrors testing and prod? Containers enable this to become reality, along with other great benefits like keeping dependencies nice and tidy and making packaged code easier to share. Come learn about the ways containers can help you build and ship software easily, and walk away with two actionable steps you can take to start using Docker containers for development.
The document provides information about RPM (Red Hat Package Manager), including that it is the default package management system for Red Hat-based Linux distributions. It describes how RPM allows users to install, update, uninstall, query, verify and manage software packages. It also provides examples of common RPM commands and their usage, such as installing, upgrading, verifying, and querying packages.
An introduction to configuring Domino for DockerGabriella Davis
9.0.1 FP10 brings support for Domino on a docker platform. You may know that docker is a container solution but what does that mean and how could it affect your Domino infrstructure? In this session we'll review how to install and run Domino in a docker container, whether it can support external clustering and the decisions to consider when designing container architecture.
Ansible is an automation platform that allows users to configure, deploy, and manage applications on servers. It combines multi-node software deployment, configuration management, and task execution. Ansible works by provisioning machines using SSH and executing commands via modules. Playbooks allow users to automate complex deployment workflows through YAML scripts. Roles in Ansible allow for reusable and modular components.
This document contains interview questions for a Linux administrator role. It includes questions about shell scripting, system administration tasks, networking, and more. Some example questions are how to take input in a shell script, write a script to convert file path slashes, and explain the differences between UDP and TCP. The document provides technical questions to assess a candidate's Linux knowledge and experience.
This document provides an overview and agenda for a presentation on Yocto, an open source project for embedded Linux development. It discusses Yocto components, layers, recipes, classes, and the build system. It also outlines how Yocto can be used by both system developers and application developers.
In this webinar, we'll discuss the different ways to back up and restore your MongoDB databases in case of a disaster scenario. We'll review manual approaches as well as premium solutions - using MongoDB Management Service (MMS) for managed backup to our cloud, or using Ops Manager at your own cloud/data centers.
The document discusses MongoDB backup options including mongodump/mongorestore, storage-level backups, and the MongoDB Management Service (MMS) backup. MMS provides cloud-based, encrypted backups of MongoDB deployments with point-in-time recovery. It takes periodic snapshots of data and oplog to enable restores. Setup involves installing agents, registering with MMS, and an initial sync replicates data to MMS for backups.
PostgreSQL Replication High Availability MethodsMydbops
This slides illustrates the need for replication in PostgreSQL, why do you need a replication DB topology, terminologies, replication nodes and many more.
MySQL uses different storage engines to store, retrieve and index data. The major storage engines are MyISAM, InnoDB, MEMORY, and ARCHIVE. MyISAM uses table-level locking and supports full-text searching but not transactions. InnoDB supports transactions, row-level locking and foreign keys but with more overhead than MyISAM. MEMORY stores data in memory for very fast access but data is lost on server restart. ARCHIVE is for read-only tables to improve performance and reduce storage requirements.
This document discusses SQL Server replication and provides steps to configure snapshot replication. Snapshot replication allows entire databases or parts of databases to be copied from a publisher to subscribers. It works by having a snapshot agent capture the database objects and data and store them as snapshot files for distribution agents to apply at subscribers. The steps shown configure a publisher, distributor, publication, and push subscription to replicate tables from one database to another using snapshot replication.
PGDay.Amsterdam 2018 - Stefan Fercot - Save your data with pgBackRestPGDay.Amsterdam
Ever heard of Point-in-time recovery? pgBackRest is an awsome tool to handle backups, restores and even helps you build streaming replication ! This talk will introduce the tool, its basic features and how to use it.
This slide was presented at Mydbops Database Meetup 4 by Bajranj ( Zenefits ). ZFS as a filesystem has good features that can enhance MySQL by compression, Quick Snapshots and others.
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...Odinot Stanislas
Après la petite intro sur le stockage distribué et la description de Ceph, Jian Zhang réalise dans cette présentation quelques benchmarks intéressants : tests séquentiels, tests random et surtout comparaison des résultats avant et après optimisations. Les paramètres de configuration touchés et optimisations (Large page numbers, Omap data sur un disque séparé, ...) apportent au minimum 2x de perf en plus.
The document discusses various DB2 recovery options including backup and restore, the recovery process model, important recovery-related system files, advanced copy services, and transportable schemas. It provides examples of the backup and restore process models and describes key DB2 recovery-related files. It also outlines the scripted interface for advanced copy services backup and differences between DB2 versions 9.7 and 10.1 related to advanced copy services.
Docker Swarm allows managing Docker clusters remotely. The key components are swarm managers, swarm nodes, and a scheduler. Swarm managers oversee nodes in the cluster using Docker APIs. The scheduler uses strategies and filters to determine where to place containers on nodes. Discovery services help register and discover nodes in the cluster.
MariaDB Server Performance Tuning & OptimizationMariaDB plc
This document discusses various techniques for optimizing MariaDB server performance, including:
- Tuning configuration settings like the buffer pool size, query cache size, and thread pool settings.
- Monitoring server metrics like CPU usage, memory usage, disk I/O, and MariaDB-specific metrics.
- Analyzing slow queries with the slow query log and EXPLAIN statements to identify optimization opportunities like adding indexes.
VMWare allows restoration of forensic images into virtual machines. This allows examination of a suspect's system and networking of multiple restored systems in an isolated virtual environment. The document outlines the process to install VMWare, restore an image as a virtual drive using a tool like ILook, and configure the virtual network. Restoring additional systems like clients and examining the restored network can provide investigative insights while isolating the virtual systems from external networks.
Hypervisors are a kind of software which runs different virtual systems called virtual machines on a single computer giving the view to guest running on each virtual machine that it is running on its own single computer. This presentation talks about hypervisors and different techniques of their implementation in brief.
A talk describing our experiences building monorepo at Pinterest.
This talk was presented at Mobile Summit'18 held at CapitalOne in SF on May 22, 2018.
DCEU 18: Developing with Docker ContainersDocker, Inc.
Laura Frank Tacho - Director of Engineering, CloudBees
Wouldn't it be great for a new developer on your team to have their dev environment totally set up on their first day? What about having the confidence that your dev environment mirrors testing and prod? Containers enable this to become reality, along with other great benefits like keeping dependencies nice and tidy and making packaged code easier to share. Come learn about the ways containers can help you build and ship software easily, and walk away with two actionable steps you can take to start using Docker containers for development.
The document provides information about RPM (Red Hat Package Manager), including that it is the default package management system for Red Hat-based Linux distributions. It describes how RPM allows users to install, update, uninstall, query, verify and manage software packages. It also provides examples of common RPM commands and their usage, such as installing, upgrading, verifying, and querying packages.
An introduction to configuring Domino for DockerGabriella Davis
9.0.1 FP10 brings support for Domino on a docker platform. You may know that docker is a container solution but what does that mean and how could it affect your Domino infrstructure? In this session we'll review how to install and run Domino in a docker container, whether it can support external clustering and the decisions to consider when designing container architecture.
Ansible is an automation platform that allows users to configure, deploy, and manage applications on servers. It combines multi-node software deployment, configuration management, and task execution. Ansible works by provisioning machines using SSH and executing commands via modules. Playbooks allow users to automate complex deployment workflows through YAML scripts. Roles in Ansible allow for reusable and modular components.
This document contains interview questions for a Linux administrator role. It includes questions about shell scripting, system administration tasks, networking, and more. Some example questions are how to take input in a shell script, write a script to convert file path slashes, and explain the differences between UDP and TCP. The document provides technical questions to assess a candidate's Linux knowledge and experience.
This document provides an overview and agenda for a presentation on Yocto, an open source project for embedded Linux development. It discusses Yocto components, layers, recipes, classes, and the build system. It also outlines how Yocto can be used by both system developers and application developers.
In this webinar, we'll discuss the different ways to back up and restore your MongoDB databases in case of a disaster scenario. We'll review manual approaches as well as premium solutions - using MongoDB Management Service (MMS) for managed backup to our cloud, or using Ops Manager at your own cloud/data centers.
The document discusses MongoDB backup options including mongodump/mongorestore, storage-level backups, and the MongoDB Management Service (MMS) backup. MMS provides cloud-based, encrypted backups of MongoDB deployments with point-in-time recovery. It takes periodic snapshots of data and oplog to enable restores. Setup involves installing agents, registering with MMS, and an initial sync replicates data to MMS for backups.
Webinar: MongoDB Management Service (MMS): Session 02 - Backing up DataMongoDB
This document introduces MongoDB Backup Service (MMS Backup), which provides automated, managed backups of MongoDB deployments. MMS Backup takes snapshots of data every 6 hours and stores the oplog for 24 hours, enabling point-in-time restores within the last day. Restores can be done via a download link or pushing restored data directly to servers. MMS Backup is easy to set up and use, handles backups of sharded clusters consistently, and allows unlimited test restores without impacting production.
- Mongo DB is an open-source document database that provides high performance, a rich query language, high availability through clustering, and horizontal scalability through sharding. It stores data in BSON format and supports indexes, backups, and replication.
- Mongo DB is best for operational applications using unstructured or semi-structured data that require large scalability and multi-datacenter support. It is not recommended for applications with complex calculations, finance data, or those that scan large data subsets.
- The next session will provide a security and replication overview and include demonstrations of installation, document creation, queries, indexes, backups, and replication and sharding if possible.
In this webinar, we will be covering general best practices for running MongoDB on AWS.
Topics will range from instance selection to storage selection and service distribution to ensure service availability. We will also look at any specific best practices related to using WiredTiger. We will then shift gears and explore recommended strategies for managing your MongoDB instance on AWS.
This session also includes a live Q&A portion during which you are encouraged to ask questions of our team.
MongoDB 3.0 comes with a set of innovations regarding storage engine, operational facilities and improvements has well of security enhancements. This presentations describes these improvements and new features ready to be tested.
https://www.mongodb.com/lp/white-paper/mongodb-3.0
MongoDB capacity planning involves determining hardware requirements and sizing to meet performance and availability expectations. Key aspects include measuring the working set, monitoring resource usage, and iteratively planning as requirements and data change over time. Resources like CPU, storage, memory and network need to be considered based on the application's throughput, responsiveness and availability needs.
MongoDB Management Service (MMS): Session 01: Getting Started with MMSMongoDB
MMS is the application for managing MongoDB, created by the engineers who develop MongoDB. Using a simple yet sophisticated user interface, MMS makes it easy and reliable to run MongoDB at scale, providing the key capabilities you need to ensure a great experience for your customers. MMS is delivered as a fully-managed, cloud service, or an on-premise software for MongoDB Subscribers.
See more at: http://www.mongodb.com/mongodb-management-service#sthash.1D1Q1ts0.dpuf
This session introduces MMS, helps you to understand at a high level what it does, add users and permissions, and shows how to get started with downloading and installing the agents.
Presented by, Sam Weaver:
Sam Weaver is a Senior Solution Architect at MongoDB based in London. Prior to MongoDB, he worked at Red Hat doing technical pre-sales on the product portfolio including Linux, Virtualisation and Middleware. Originally from Cheltenham, England he received his Bachelors from Cardiff University and currently lives in Camberley, Surrey.
MongoDB and Amazon Web Services: Storage Options for MongoDB DeploymentsMongoDB
When using MongoDB and AWS, you want to design your infrastructure to avoid storage bottlenecks and make the best use of your available storage resources. AWS offers a myriad of storage options, including ephemeral disks, EBS, Provisioned IOPS, and ephemeral SSD's, each offering different performance and persistence characteristics. In this session, we’ll evaluate each of these options in the context of your MongoDB deployment, assessing the benefits and drawbacks of each.
Deploying any software can be a challenge if you don't understand how resources are used or how to plan for the capacity of your systems. Whether you need to deploy or grow a single MongoDB instance, replica set, or tens of sharded clusters then you probably share the same challenges in trying to size that deployment.
The document discusses backing up MongoDB data with MongoDB Management Service (MMS). MMS allows for backing up to the cloud or on-premises. It offers simple, automated backups with point-in-time restore capabilities. The backups are configurable in terms of frequency, retention period, and restore options. MMS supports backing up replica sets and sharded clusters to ensure consistent snapshots of the data.
Silicon Valley Code Camp 2014 - Advanced MongoDBDaniel Coupal
MongoDB presentation from Silicon Valley Code Camp 2014.
Walkthrough developing, deploying and operating a MongoDB application, avoiding the most common pitfalls.
- MongoDB 3.0 introduces pluggable storage engines, with WiredTiger as the first integrated engine, providing document-level locking, compression, and improved concurrency over MMAPv1.
- WiredTiger uses a B+tree structure on disk and stores each collection and index in its own file, with no padding or in-place updates. It includes a write ahead transaction log for durability.
- To use WiredTiger, launch mongod with the --storageEngine=wiredTiger option, and upgrade existing deployments through mongodump/mongorestore or initial sync of a replica member. Some MMAPv1 options do not apply to WiredTiger.
The document discusses exploiting data in memory (DIME) projects. It begins by defining DIME and outlining the benefits, which include reduced response times, increased throughput, and faster batch jobs. It then compares storage hierarchies from the past ("then") to the present ("now"), noting how much memory is now available on systems. The document provides examples of DIME for DB2, CICS, Java, and Coupling Facility. It argues that now is a good time to implement DIME projects due to cheaper memory and software capabilities. It concludes by emphasizing measuring memory usage and taking a fresh view of what "full" memory utilization means.
This document discusses Meteor and MongoDB as used in a case study of the Gander email triage application. Key points include:
- Meteor is a JavaScript framework that includes client and server functionality and uses MongoDB as its default database.
- The Gander app was developed using Meteor to take advantage of its reactivity, easy data syncing, and hot code pushes.
- While Meteor made prototyping easy and provided a nice pub/sub model, the presenter notes it is still a work in progress and has some performance and feature limitations compared to MongoDB.
- In conclusion, the presenter believes Meteor shows great potential despite current limitations, and recommends trying it for prototype applications.
The storage engine is responsible for managing how data is stored, both in memory and on disk. MongoDB supports multiple storage engines, as different engines perform better for specific workloads.
View this presentation to understand:
What a storage engine is
How to pick a storage engine
How to configure a storage engine and a replica set
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceIndexBug
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
HCL Notes and Domino License Cost Reduction in the World of DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
GraphRAG for Life Science to increase LLM accuracyTomaz Bratanic
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Programming Foundation Models with DSPy - Meetup SlidesZilliz
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
2. Multiple options
• All backups are full database backups
• MongoDB currently does not officially support
diff backups
• Three options
– MongoDump & MongoRestore
– LVM snapshots
– Cloud snapshots
3. Mongodump & MongoRestore
• Pros
– Fairly simple to use and script
• Cons
– For a larger database it can take hours to backup.
– Need a additional disk of the same to store dump
– Database is online during backup – so not a point
in time snapshot (big problem)
4. LVM snapshots
• Four easy steps
– Deploy MongoDB data on a LVM volume
– Fsync and Lock mongodb to prevent writes (during snap)
– Snapshot volume using LVM commands
– Copy data from snapshot to final destination (NFS share, S2,
Swift) etc
• Pros
– Point in time snapshot of the database
• Cons
– Needs preplanning. Mongodb needs to be deployed on LVM
– More complexity. Need to understand LVM
– Copy of the data takes significant cpu cycles and time
5. Cloud snapshots
• Most cloud volumes today have volume
snapshotting functionality. E.g. EC2 EBS snapshot,
CloudStack volume snapshot etc
• Technique is identical to LVM snapshots but no
copy of data is involved
• Pro
– Simple to use and automate
– Point in time copy of data
• Cons
– Opaque format. Don’t have access to data offline
unless you create a new volume
6. MongoDirector.com backups
• Our preferred option is Cloud Snapshots
• If Cloud snapshots are not available we use
LVM snapshots
• We don’t use mongodump and monorestore
• More details in these blog posts
– Mongodb backup and restore
– Mongodb auto backup