Fast and cost effective geospatial analysis pipeline with AWS lambdaMila Frerichs
The need for fast and cost effective geospatial analysis pipelines is always present. With the new serverless services out there it is getting more easy and accessible to create an analysis pipeline that is cost effective and fast.
This talk will show how to use the power of serverless infrastructure and AWS to get fast results at a low cost.
It will show how to use geospatial analysis both in python and node environments. How to install the important libraries that you need for your daily analysis. And how to test out your Lambda functions locally to save even more money.
Tutorial dos conceitos básicos de Puppet, uma ferramenta de gestão automática de configuração de servidores.
Essa apresentação está incompleta, pois foi parte de um curso básico sobre Puppet.
Fast and cost effective geospatial analysis pipeline with AWS lambdaMila Frerichs
The need for fast and cost effective geospatial analysis pipelines is always present. With the new serverless services out there it is getting more easy and accessible to create an analysis pipeline that is cost effective and fast.
This talk will show how to use the power of serverless infrastructure and AWS to get fast results at a low cost.
It will show how to use geospatial analysis both in python and node environments. How to install the important libraries that you need for your daily analysis. And how to test out your Lambda functions locally to save even more money.
Tutorial dos conceitos básicos de Puppet, uma ferramenta de gestão automática de configuração de servidores.
Essa apresentação está incompleta, pois foi parte de um curso básico sobre Puppet.
Training Slides: Basics 105: Backup, Recovery and Provisioning Within Tungste...Continuent
Join us for this training session where we discuss tools for backing up MySQL databases within Tungsten Clustering, and how Tungsten Clustering makes it easy to reprovision databases and recover a cluster. This training is for all engineers using Tungsten Clustering and will explain the tools needed to create a sound backup and recovery strategy, and is also valuable for those who wish to review their current MySQL backup and MySQL recovery procedures.
AGENDA
- Methods and tools for taking a MySQL backup from within a Tungsten cluster
- mysqldump
- xtrackbackup
- Snapshots (lvm or other)
- File copy
- tungsten_provision_slave
- Restoring a MySQL backup from within a Tungsten cluster
- Verifying the backup contains the last binary log position, and the importance of having this
- Restoring backups into a cluster
- Provisioning slaves from an existing datasource
Training Slides: Basics 105: Backup, Recovery and Provisioning Within Tungste...Continuent
Join us for this training session where we discuss tools for backing up MySQL databases within Tungsten Clustering, and how Tungsten Clustering makes it easy to reprovision databases and recover a cluster. This training is for all engineers using Tungsten Clustering and will explain the tools needed to create a sound backup and recovery strategy, and is also valuable for those who wish to review their current MySQL backup and MySQL recovery procedures.
AGENDA
- Methods and tools for taking a MySQL backup from within a Tungsten cluster
- mysqldump
- xtrackbackup
- Snapshots (lvm or other)
- File copy
- tungsten_provision_slave
- Restoring a MySQL backup from within a Tungsten cluster
- Verifying the backup contains the last binary log position, and the importance of having this
- Restoring backups into a cluster
- Provisioning slaves from an existing datasource
Glamping y aguas termales: vacaciones en contacto con la naturaleza para reca...GaliWonders
Vivir la experiencia de sumergirte en aguas termales al aire libre, disfrutar de unas vistas increibles de la ciudad de Ourense y, además poder alojarte en una novedosa cabaña en mitad del bosque.
Assemblea constitutiva Palamós i Sant Joan per l'AutodeterminacióPere Minobas Suquet
La plataforma ciutadana Palamós i Sant Joan per l’Autodeterminació, es va reunir ahir dia 6 de novembre de 2009 a la biblioteca Lluís Barceló i Bou per dur a terme l’assemblea constitutiva d’aquesta.
A l’acte hi van assistir un centenar de persones mostrant així el seu interès, oferint la col·laboració i suport necessaris per poder dur a terme el referèndum.
Presented at LinuxFest Northwest 2009, this slideshow covers how to install and use puppet, types of implementations and more. Visit http://www.bitpusher.com/ for more about BitPusher.
Puppi is a Puppet modules that drives Puppet's knowledge of the Systems to a command line tool that you can use to check services availability, gather info on the system and deploy application with a single command.
Puppet can be used effectively and at scale without running as root. In many organizations, particularly large ones, different teams are responsible for different pieces of the infrastructure. In my case, I am on a team responsible for installation, configuration, upkeep, and monitoring of an application, but we are denied root access. Despite this, we have a rich puppet infrastructure thats saves us time and reduces configuration drift. I will present our model for success in this kind of limited environment, including recipes for using puppet as non root and some encouraging words and ideas for those who want to implement puppet, but the rest of their organization isn't ready yet.
Spencer Krum
Systems Admin, UTI Worldwide
Spencer is a Linux and application administrator with UTI Worldwide, a shipping and logistics firm. He lives and works in Portland. He has been using Linux and Puppet for years. Spencer is co-authoring (with William Van Hevelingen and Ben Kero) the second edition of Pro Puppet by James Turnbull and Jeff McCune, which should be available from Apress in alpha/beta E-Book in time for Puppet Conf '13. He enjoys hacking, tennis, StarCraft, and Hawaiian food.
One-Man Ops with Puppet & Friends.
If you're getting started in Amazon AWS here's 7 tools that will help you be successful, a few tips to make your life easier and some common pitfalls to avoid.
Walter Heck, founder of OlinData, presented a step-by-step guide on how to set up a proper puppet repository, complete with the brand new PuppetDB, exported resources and usage of open source modules.
Walter Heck, founder of OlinData, presented a step-by-step guide on how to set up a proper puppet repository, complete with the brand new PuppetDB, exported resources and usage of open source modules.
Beyond Golden Containers: Complementing Docker with Puppetlutter
Often, Docker or more generally containers and immutable infrastructure are viewed as a replacement for configuration management. This talk explains why that is not the case, and that they are in fact complementary.
Containers move the challenges that configuration management solves to different places in the application lifecycle. The talk explains where Puppet fits into this changed lifecycle, and what tools Puppet provides there.
Slides for a talk I gave at the Linux Foundation Colaboration Summit 2015
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Puppet barcampexercises.jzt
1. First Moves with Puppet New Delhi Puppet HackDay/ BarCamp March 13, 2010 Presented by Slideshare Operations Engineering/Julie Tsai
2. Today Quick Primer Useful Commands PuppetingSudoers I — Permissions PuppetingSudoers II — OS Conditions PuppetingSudoers III — Inheriting Class Facter References 2
3. Quick Primer: How It Flows Ref. http://www.linuxforu.com/wp-content/uploads/2009/06/puppet_diagram.png 3
4. Quick Primer: Learning the Lingo Resource – instance of native type, plugin, or definition, i.e. user, exec, file Capitalized resource: invoked by other resources of previously defined resource, i.e. file foo.txt laver invoked as File[“foo.txt”] Class - resource(s) description with title, file, attributes Definition – abstract description of class, can be invoked multiple times Node – host instance (physical or virtual) Collection – groups of resources Recipe – sample puppet code (manifests/*.pp) 4
5. Quick Primer: Data Parameters Variables – substitution values Arrays – grouped list of values Attributes – statement(s) describing resources Literals – string values that needn’t be interpolated 5
6. Quick Primer: Variable Scoping Overridable variable defaults defined only in outer scope of resource instances Declarative language: Within the same-level scope, variables can only be defined once Qualified variables are a method of passing parameters from a class class mothership { $server = “juno” } class satellite { $ms = $mothership::server } 6
7. Quick Primer: Where Things Are Note: below assumes default install in /etc /etc/puppet/fileserver.conf(used by puppermasterd) path /var/lib/puppet/files allow 10.100.0.0/24 /etc/puppet/puppet.conf(used by clients’ puppetd) vardir = /var/lib/puppet logdir = /var/log/puppet classfile = $vardir/classes.txt /etc/puppet/manifests/[../..]/*.pp (architecture varies) 7
8. Quick Primer: A Client Directory Tree puppetclient01:/var/lib/puppet |-> classes.txt– node’s class membership |-> cientbucket– hashed config artifacts |-> lib |-> localconfig.yaml |-> ssl– authentication certs |-> state – checksums, entropy-tracking 8
10. Useful Commands to Get Started puppet <puppetscript.pp> - run standalone script -l /path/to/file.log– logpath -d– debug --noop– dry-run puppetd– daemon on client that schedules retrieval of configs from puppetmaster and applies locally -d– debug --test – verbose logging --noop– dry-run -l /path/to/log – log path facter– find out local node’s values for reserved classes 10
11. PuppetingSudoers I — Permissions Configure /etc/puppet/manifests/sudoers.pp : file { "/etc/sudoers": owner => root, group => wheel, mode => 400, } 11 And run: [puppet@puppet manifests]# puppet –noop –d /etc/puppet/manifests/sudoers.pp
13. PuppetingSudoers III — Inheriting Class /etc/puppet/manifests/sudoers3.pp class unix { file { "/etc/sudoers": owner => root, group => root, } service { "sshd": ensure => running, } } class centos_mycompany inherits unix { File["/etc/sudoers"] { mode => 440 } } 13
14. PuppetingSudoers III — Inheriting Class (cont.) /etc/puppet/manifests/sudoers3.pp node default { include unix } node bastionhost { include centos_mycompany } 14 And run: [puppet@puppet manifests]# puppet –d –noop sudoers3.pp [puppet@puppet manifests]# cat /var/lib/puppet/classes.txt
15. PuppetingSudoers III — Inheriting Class (cont. 2) Use Facter to defindnodename: [puppet@puppet manifests]# facter | egrep -i 'fqdn|hostname’ 15 /etc/puppet/manifests/sudoers3.pp node'puppet.us-west-1.compute.internal' { include centos_mycompany }
16. Facts about Facter Facter is a Puppet utility that discovers relevant “facts” that puppet can use to dynamically populate puppet manifest variables Executing command-line Facter can show you the reserved variables like FQDN, hostname, kernel, architecture, sshdsakey, etc. 16
17. References Reductive Labs Puppet Guideshttp://docs.reductivelabs.com/guides/ Glossary of Terms http://reductivelabs.com/trac/puppet/wiki/GlossaryOfTerms Resource Attributeshttp://reductivelabs.com/trac/puppet/wiki/TypeReference#metaparameters Nice vimrc for Puppethttp://www.davidpashley.com/blog/systems-administration/puppet/vim-highlighting.html Classic LISA ‘98 paper on best-practice infrastructures http://www.infrastructures.org/papers/bootstrap/bootstrap.html 17
Editor's Notes
Instructs to participants to test--> puppet -dsite.pp--> optional -l $LOG + other window with tail of log--> puppet --noop -dsite.pp --> pgrep -lf puppetd (default incremen is 30 min)--> pgrep -lf puppetmasterd
1) puppet --noopsudoers.pp2) puppet -dsudoers.pp* This faulty centos mode corrected by next exercise – this config actually changes file to faulty settings on purpose
1) demonstrate conditionals per OS <"puppet -d --noop sudoers2.pp"> 2) service, operations on resource <"puppet -d sudoers2.pp">
<run site.pp to have something to change again> (c) 1) class w/ file & service resources 2) inheritance <run once in non-func. mode> - to demo that nothing gets executed without resource instantiation, etc.
3)idefault & bastionhost node instance 4) bastionhost node instance <run once in non-func. mode> - to demo what it meands for node to belong to a certain class 5) cat /var/lib/puppet/classes.txt (loaded by puppetd)
6)facter | egrep -i 'fqdn|hostname' 7) specific node 'hostname' <run once in non-func. mode> <run once in func. mode>Done