Building A Scalable Open Source Storage SolutionPhil Cryer
The Biodiversity Heritage Library (BHL), like many other projects within biodiversity informatics, maintains terabytes of data that must be safeguarded against loss. Further, a scalable and resilient infrastructure is required to enable continuous data interoperability, as BHL provides unique services to its community of users. This volume of data and associated availability requirements present significant challenges to a distributed organization like BHL, not only in funding capital equipment purchases, but also in ongoing system administration and maintenance. A new standardized system is required to bring new opportunities to collaborate on distributed services and processing across what will be geographically dispersed nodes. Such services and processing include taxon name finding, indexes or GUID/LSID services, distributed text mining, names reconciliation and other computationally intensive tasks, or tasks with high availability requirements.
Moving towards unified logging covers thoughts on moving from proprietary log consolidation tools to open source options such as Elasticsearch, Logstash, Kibana (the ELK stack) along with other ideas like using FluentD in place of Logstash.
Webinar Monitoring in era of cloud computingCREATE-NET
The webinar "Monitoring in era of cloud computing" covers the topics:
1. What is Monitoring
2. Ceilometer
- Architecture
- Agents (Compute/Central)
- Storage & API
- Quick Demo
3. Monasca
- Architecture
- Events/Messages
- Storage & API
- Quick Demo
Building A Scalable Open Source Storage SolutionPhil Cryer
The Biodiversity Heritage Library (BHL), like many other projects within biodiversity informatics, maintains terabytes of data that must be safeguarded against loss. Further, a scalable and resilient infrastructure is required to enable continuous data interoperability, as BHL provides unique services to its community of users. This volume of data and associated availability requirements present significant challenges to a distributed organization like BHL, not only in funding capital equipment purchases, but also in ongoing system administration and maintenance. A new standardized system is required to bring new opportunities to collaborate on distributed services and processing across what will be geographically dispersed nodes. Such services and processing include taxon name finding, indexes or GUID/LSID services, distributed text mining, names reconciliation and other computationally intensive tasks, or tasks with high availability requirements.
Moving towards unified logging covers thoughts on moving from proprietary log consolidation tools to open source options such as Elasticsearch, Logstash, Kibana (the ELK stack) along with other ideas like using FluentD in place of Logstash.
Webinar Monitoring in era of cloud computingCREATE-NET
The webinar "Monitoring in era of cloud computing" covers the topics:
1. What is Monitoring
2. Ceilometer
- Architecture
- Agents (Compute/Central)
- Storage & API
- Quick Demo
3. Monasca
- Architecture
- Events/Messages
- Storage & API
- Quick Demo
Slides of OpenStack talk hold on the CeBIT 2012.
The talk introduces Cloud Computing and Infrastructure as a Service in general, gives a short overview about the OpenStack project and describes all core components of the Essex release in detail.
You can find a record of the session at http://www.techcast.com/events/cebit12/mi09/.
You can find more details about our involvment in OpenStack at http://www.b1-systems.de/openstack.
You can contacts us at openstack@b1-systems.de if you want to give us feedback or want to receive more information.
OSDC 2019 | Running backups with Ceph-to-Ceph by Michael RaabeNETWAYS
This presentation highlights several different methods for backups inside of Ceph (clusters). We often receive requests for both local and remote backups. So we would like to introduce backup methods using external tools as well as some using Ceph’s own ‘rbd export’ or ‘rbd-mirror’ approaches. Learn about the pros and cons of each approach, be warned of possible pitfalls both of native use or OpenStack-based approaches.
Slides of OpenStack talk hold on the CeBIT 2012.
The talk introduces Cloud Computing and Infrastructure as a Service in general, gives a short overview about the OpenStack project and describes all core components of the Essex release in detail.
You can find a record of the session at http://www.techcast.com/events/cebit12/mi09/.
You can find more details about our involvment in OpenStack at http://www.b1-systems.de/openstack.
You can contacts us at openstack@b1-systems.de if you want to give us feedback or want to receive more information.
OSDC 2019 | Running backups with Ceph-to-Ceph by Michael RaabeNETWAYS
This presentation highlights several different methods for backups inside of Ceph (clusters). We often receive requests for both local and remote backups. So we would like to introduce backup methods using external tools as well as some using Ceph’s own ‘rbd export’ or ‘rbd-mirror’ approaches. Learn about the pros and cons of each approach, be warned of possible pitfalls both of native use or OpenStack-based approaches.
This session is for Operations Manager (SCOM) administrators, who like to learn new tricks and tips for our daily work. Christian Heitkamp is SCOM a veteran developing and architecting SCOM solutions. This slides give details on SCOM security to review what you should be aware when using RunAs Accounts both on Linux and Windows.
Devops Day Amsterdam 2015
Arista vEOS lab in Ravello with Opscode Chef server.
Run the lab switches with chef-client and control them with cookbooks and API's
Domino 10 is due in October and if you want to take advantage of all the new feature goodness, you need to know Linux. Domino for Docker is a Linux only release, for example, and now IBM supports RHEL 7 natively with all three V10 server products. Staying current here is critical: RHEL 7 is not the usual Linux upgrade. Join BillMal Your Linux Pal to cover as much RHEL 7 info as he can in an hour: Domino 10 status, systemd, journald, administration, and upgrade tips. This is a very technical session. Let's get ready for October!
Cloud-Native Builds & Deployments in Bitbucket PipelinesAtlassian
Pipelines is Bitbucket Cloud's new integrated build and release tool, and we're on a mission to give every development team a painless build and release process. Matt Ryall, Pipelines Product Manager, will talk about new features in Pipelines to enable Docker builds and database testing in your builds, and how teams are replacing their legacy build system with Pipelines to save valuable developer time. A must-see talk for teams deploying to the cloud.
SaltConf14 - Ben Cane - Using SaltStack in High Availability EnvironmentsSaltStack
An overview on the benefits and best practices of using SaltStack for consistency and automation in highly available enterprise environments such as financial services.
Jenkins to Gitlab - Intelligent Build-PipelinesChristian Münch
At netz98 we moved from Jenkins to Gitlab. The slides show some insides about Testing of PHP libraries, Magento 1 and Magento 2 modules. How to setup a scalable and fast Gitlab-Pipeline with Docker images.
Modern CI/CD in the microservices world with KubernetesMikalai Alimenkou
In this talk, we will go through the design process of modern CI/CD for the microservices-based system with Kubernetes support. We will discuss how to verify consistency between microservices, apply different levels of quality gates and promote artifacts between environments. Thanks to Kubernetes we will review different approaches of environment resources optimization for development needs during CI/CD cycles.
OSDC 2016 - Hello Redfish, goodbye IPMI by Werner FischerNETWAYS
It's the year 2016. The PC market keeps on shrinking. More and more people use mobile devices and store most of their data in the cloud. This is good news for server manufacturers and data center admins, as market researcher expect a growth of 3% for investments in data center systems.
To keep up with managing of all these cloud systems, IT professionals around the globe formed the devops movement and made the software part of server automation easier than ever before by using tools like Puppet, Ansible, Chef or Salt.
The software part... What about the hardware part? Hmm..., IPMI (the so-called Intelligent Platform Management Interface) has been the standard to manage systems out-of-band in the datacenter since 1998. It uses UDP port 623, has a specification document with over 600 pages, requires in-depth special knowledge and has some serious security issues.
To overcome these limitations, and to bring hardware system management to the present age, the Redfish management standard has been developed and released by the DMTF (Distributed Management Task Force).
Redfish uses a RESTful interface, is used over HTTPS, and provides all data in the JSON format using ODATA schemas. Good news for devops and automation tools :-)
In this talk, Werner outlines the goals of Redfish and shows how it works using real-world examples. Don't miss this talk and start automating your server hardware the modern way.
Webinar slides - ClusterControl 1.2.11: with support for MariaDB’s MaxScale a...Severalnines
This is our best release yet for Postgres users and we’re also introducing key new features for our MySQL / MariaDB users, such as support for MaxScale, an open-source, database-centric proxy that works with MariaDB Enterprise, MariaDB Enterprise Cluster, MariaDB 5.5, MariaDB 10 and Oracle MySQL. The release further includes a range of performance improvements and bug fixes.
Some of the highlights of ClusterControl 1.2.11 include:
For PostgreSQL
Deployment and Management of Postgres Replicated Setups
Customisable dashboards
Database performance charts for nodes
Enablement of ClusterControl DevStudio
Support for MaxScale
Deployment and management of MaxScale load balancer
For MySQL
Add Existing HAProxy and Keepalived
Deployment of MySQL Replication setups
Improvements in charting of metrics
Revamped Configuration Management
New Database Logs Page
Revamped MySQL User Management
Bp307 Practical Solutions for Connections Administrators, tips and scrips for...Sharon James
Bp307 Practical Solutions for Connections Administrators, tips and scrips for your daily business - how to use wsadmin and jython scripts to make your daily life as an IBM Connections Administrator easier :)
Chicago Docker Meetup Presentation - MediaflyMediafly
Bryan Murphy's presentation from the 2nd Chicago Docker meetup on March 12, 2014 at Mediafly HQ. In his presentation, Bryan explains how we use Docker right now at Mediafly in production.
UKOUG Tech17 - Stay Secure With Oracle SolarisJomaSoft
IT Security is more important than ever. Solaris 11 is installed "Secure by Default". Weak and modified configuration can be detected using the Security Compliance tool.
On SPARC Systems Buffer Overflows can be detected. The Virtualization Features increase the overall Security by Separation of Applications. This Session provides samples to allow you to learn how to use this Security Technologies.
Italy Agriculture Equipment Market Outlook to 2027harveenkaur52
Agriculture and Animal Care
Ken Research has an expertise in Agriculture and Animal Care sector and offer vast collection of information related to all major aspects such as Agriculture equipment, Crop Protection, Seed, Agriculture Chemical, Fertilizers, Protected Cultivators, Palm Oil, Hybrid Seed, Animal Feed additives and many more.
Our continuous study and findings in agriculture sector provide better insights to companies dealing with related product and services, government and agriculture associations, researchers and students to well understand the present and expected scenario.
Our Animal care category provides solutions on Animal Healthcare and related products and services, including, animal feed additives, vaccination
Gen Z and the marketplaces - let's translate their needsLaura Szabó
The product workshop focused on exploring the requirements of Generation Z in relation to marketplace dynamics. We delved into their specific needs, examined the specifics in their shopping preferences, and analyzed their preferred methods for accessing information and making purchases within a marketplace. Through the study of real-life cases , we tried to gain valuable insights into enhancing the marketplace experience for Generation Z.
The workshop was held on the DMA Conference in Vienna June 2024.
Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdfFlorence Consulting
Quattordicesimo Meetup di Milano, tenutosi a Milano il 23 Maggio 2024 dalle ore 17:00 alle ore 18:30 in presenza e da remoto.
Abbiamo parlato di come Axpo Italia S.p.A. ha ridotto il technical debt migrando le proprie APIs da Mule 3.9 a Mule 4.4 passando anche da on-premises a CloudHub 1.0.
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC
Ellisha Heppner, Grant Management Lead, presented an update on APNIC Foundation to the PNG DNS Forum held from 6 to 10 May, 2024 in Port Moresby, Papua New Guinea.
Understanding User Behavior with Google Analytics.pdfSEO Article Boost
Unlocking the full potential of Google Analytics is crucial for understanding and optimizing your website’s performance. This guide dives deep into the essential aspects of Google Analytics, from analyzing traffic sources to understanding user demographics and tracking user engagement.
Traffic Sources Analysis:
Discover where your website traffic originates. By examining the Acquisition section, you can identify whether visitors come from organic search, paid campaigns, direct visits, social media, or referral links. This knowledge helps in refining marketing strategies and optimizing resource allocation.
User Demographics Insights:
Gain a comprehensive view of your audience by exploring demographic data in the Audience section. Understand age, gender, and interests to tailor your marketing strategies effectively. Leverage this information to create personalized content and improve user engagement and conversion rates.
Tracking User Engagement:
Learn how to measure user interaction with your site through key metrics like bounce rate, average session duration, and pages per session. Enhance user experience by analyzing engagement metrics and implementing strategies to keep visitors engaged.
Conversion Rate Optimization:
Understand the importance of conversion rates and how to track them using Google Analytics. Set up Goals, analyze conversion funnels, segment your audience, and employ A/B testing to optimize your website for higher conversions. Utilize ecommerce tracking and multi-channel funnels for a detailed view of your sales performance and marketing channel contributions.
Custom Reports and Dashboards:
Create custom reports and dashboards to visualize and interpret data relevant to your business goals. Use advanced filters, segments, and visualization options to gain deeper insights. Incorporate custom dimensions and metrics for tailored data analysis. Integrate external data sources to enrich your analytics and make well-informed decisions.
This guide is designed to help you harness the power of Google Analytics for making data-driven decisions that enhance website performance and achieve your digital marketing objectives. Whether you are looking to improve SEO, refine your social media strategy, or boost conversion rates, understanding and utilizing Google Analytics is essential for your success.
Salt - A Scalable Systems Management Solution for Datacenters
1. Salt – A Scalable Systems
Management Solution for Datacenters
Open Source Data Center Conference April 26-28, 2016
Sebastian Meyer
Linux Consultant & Trainer
B1 Systems GmbH
meyer@b1-systems.de
B1 Systems GmbH - Linux/Open Source Consulting,Training, Support & Development
2. Introducing B1 Systems
founded in 2004
operating both nationally and internationally
nearly 100 employees
provider for IBM, SUSE, Oracle & HP
vendor-independent (hardware and software)
focus:
consulting
support
development
training
operations
solutions
B1 Systems GmbH Salt – Scalable Systems Management 2 / 47
5. Yet Another Systems Management Solution?
takes inspiration from Puppet, Chef or Ansible
focuses on the entire system life cycle
easily scalable to a few thousand systems
convenient and easy to learn
configuration management and remote execution
B1 Systems GmbH Salt – Scalable Systems Management 5 / 47
6. Salt – Concept
B1 Systems GmbH Salt – Scalable Systems Management 6 / 47
10. Salt Modes
minions pull from master
master pushes to Minions
minions apply states locally
master applies states on minions via SSH
B1 Systems GmbH Salt – Scalable Systems Management 10 / 47
18. Pillar Data
Pillar Example
ntp:
{% if grains[’id’].startswith(’myntpserver’) %}
ntpservers: ["0.us.pool.ntp.org","1.us.pool.ntp.org"]
comment: ’’
{% else %}
ntpservers: ["10.1.1.20","10.1.1.21"]
comment: ’myinternalservers’
{% endif %}
Source: https://github.com/saltstack-formulas/ntp-formula/blob/master/pillar.example
B1 Systems GmbH Salt – Scalable Systems Management 18 / 47
19. Pillars and States
States top.sls
base:
’*’:
- monitoring
- ssh
- syslog
- ntp
’*dmz*’:
- firewall
Pillar top.sls
base:
’*’:
- monitoring
- ssh
- syslog
’*lan*’:
- ntp.lan
’*dmz*’:
- ntp.dmz
- firewall
B1 Systems GmbH Salt – Scalable Systems Management 19 / 47
20. Deploying the State
Master pushes to minions
salt ’*’ state.highstate
salt ’*’ state.sls mystate
Minions pull from master
salt-call state.highstate
salt-call state.sls mystate
B1 Systems GmbH Salt – Scalable Systems Management 20 / 47
21. Reusing States: Formulas
reusing existing code
roughly the same as Puppet modules/Ansible roles
collection of States and files
github.com/saltstack-formulas/ for "official" formulas
B1 Systems GmbH Salt – Scalable Systems Management 21 / 47
22. Using Formulas
directly from VCS or local
extendable via include
configurable via Pillar data
variables mapped via Jinja map
requirements across Formulas possible
B1 Systems GmbH Salt – Scalable Systems Management 22 / 47
25. Salts Event Driven Infrastructure
B1 Systems GmbH Salt – Scalable Systems Management 25 / 47
26. Overview
actions trigger events
events are communicated via the event bus
reactors execute trigger actions responding to events
B1 Systems GmbH Salt – Scalable Systems Management 26 / 47
31. Events in a State
b1/mystate/status/update:
event.send:
- data:
status: "Installation done!"
B1 Systems GmbH Salt – Scalable Systems Management 31 / 47
32. Beacons
hook into system on minion
create events
inotify, diskusage, load, journald ...
B1 Systems GmbH Salt – Scalable Systems Management 32 / 47
33. Beacons - Example
inotify Beacon
beacons:
inotify:
/etc/motd:
mask:
- modify
B1 Systems GmbH Salt – Scalable Systems Management 33 / 47
46. Saltify Existing Machines 2/2
Mapfile
salt-machine:
- first-machine:
ssh_host: 1.2.3.4
- second-machine:
ssh_host: 1.2.3.5
- third-machine:
ssh_host: 1.2.3.6
B1 Systems GmbH Salt – Scalable Systems Management 46 / 47
47. Thank You!
For more information, refer to info@b1-systems.de
or +49 (0)8457 - 931096
B1 Systems GmbH - Linux/Open Source Consulting,Training, Support & Development