"Scaling Storage with Ceph", Ross Turk, VP of Community, Inktank
Ceph is an open source distributed object store, network block device, and file system designed for reliability, performance, and scalability. It runs on commodity hardware, has no single point of failure, and is supported by the Linux kernel. This talk will describe the Ceph architecture, share its design principles, and discuss how it can be part of a cost-effective, reliable cloud stack.
Introduction to Open Source Cloud Computing", Mark Hinkle, Senior Director Cloud Computing Community, Citrix
Very few trends in IT have generated as much buzz as cloud computing. This session will cut through the hype and clarify what cloud computing is, what the use cases are, and what open source software exists to build and manage clouds. The discussion will appeal to systems administrators, IT generalists, and developers...anybody who wants to create a cloud computing environment on their own hardware in their own data centers and deploy applications to this cloud.
"Xen Cloud Platform”, Mike McClurg, Senior Engineer, Xen.org Engineering
The Xen Cloud Platform is an open-source, enterprise-ready server virtualization platform. It is based on the Xen hypervisor, and represents the common code base for Citrix's XenServer product line. This presentation gives an introduction to XCP, and how it relates to both the Xen hypervisor and to Citrix's XenServer. It covers XCP's XenAPI and how it can be used by two of the most popular cloud orchestration frameworks, CloudStack and OpenStack. Finally, it discusses the XCP "roadmap," and the plans for the future of XCP.
Introduction to Open Source Cloud Computing", Mark Hinkle, Senior Director Cloud Computing Community, Citrix
Very few trends in IT have generated as much buzz as cloud computing. This session will cut through the hype and clarify what cloud computing is, what the use cases are, and what open source software exists to build and manage clouds. The discussion will appeal to systems administrators, IT generalists, and developers...anybody who wants to create a cloud computing environment on their own hardware in their own data centers and deploy applications to this cloud.
"Xen Cloud Platform”, Mike McClurg, Senior Engineer, Xen.org Engineering
The Xen Cloud Platform is an open-source, enterprise-ready server virtualization platform. It is based on the Xen hypervisor, and represents the common code base for Citrix's XenServer product line. This presentation gives an introduction to XCP, and how it relates to both the Xen hypervisor and to Citrix's XenServer. It covers XCP's XenAPI and how it can be used by two of the most popular cloud orchestration frameworks, CloudStack and OpenStack. Finally, it discusses the XCP "roadmap," and the plans for the future of XCP.
"Deploying Private PaaS with ActiveState Stackato”, Diane Mueller, Director Cloud Evangelism, ActiveState
This presentation covers building and deploying a Private Platform-as-a-Service (PaaS) on CloudStack. Diane Mueller, ActiveState's Cloud Evangelist shows how to deploy ActiveState's Stackato, an enterprise-ready multi-lingual Private PaaS that runs on any cloud and supports deploying and managing web & mobile applications in any language including Java, .Net, Python, Perl, PHP Ruby, Node.js, Clojure, Scala and Erlang - to name a few. Using the CloudStack UI, Diane demonstrates how to configure and deploy the PaaS and then shows how easy it is to push a live application in under an hour.
“Apache Hadoop, Now and Beyond”, Jim Walker, Director of Product Marketing, Hortonworks
Hadoop is an open source project that allows you to gain insight from massive amounts of structured and unstructured data quickly and without significant investment. It is shifting the way many traditional organizations think of analytics and business models. While it is deigned to take advantage of cheap commodity hardware, it is also perfect for the cloud as it is built to scale up or down without system interruption. In this presentation, Jim Walker will provide an overview of Apache Hadoop and its current state of adoption in and out of the cloud.
Build clouds the way some of the world’s biggest public and private clouds are built—using CloudStack. This 60-minute webinar with the Cloudstack team will help you gain a better understanding of the CloudStack architecture and feature set.
Advanced automation and provisioning in Red Hat Satellite 6 - Red Hat Archite...asquelt
Red Hat Satellite is an easy-to-use system management product that helps keep Red Hat Enterprise Linux® environments and other Red Hat infrastructure running efficiently, properly secured, and compliant with various standards. We’ll introduce the most significant components and integrations in Satellite version 6 including new software life-cycle workflow, easy and flexible configuration management, one click provisioning for bare metal (with discovery) and cloud (vCenter, RHEV, KVM, EC2), inventory and reporting, hardening and security compliance
Xen Orchestra: XAPI and XenServer from the web-XPUS13 LambertThe Linux Foundation
Xen Orchestra is a web based management tool for the XAPI toolstack that is developed by the Xen Project. XAPI is a fully featured management API for Xen, that is also used by the recently open sourced enServer. We'll see how Xen Orchestra leverages XAPI by allowing a complete control of your virtualized infrastructure. First, we'll explain quickly the XO architecture (such as cache system, asynchronous events, user management with tokens…) Then, a review of current and future possibilities will be exposed, to show what you can expect from this solution: powerful visualizations with d3js, neat interface, orchestration features and integration with all XAPI's capable hosts (XenServer or any distro with XAPI packages, such as Debian, Ubuntu or CentOS). Finally, we'll talk about how to contribute.
This presentation is the introduction to the monthly CloudStack.org demonstration. The presentation details the latest features in the CloudStack open source project as well as project news. To attend a future presentation, with live demo and Q&A visit:
http://www.slideshare.net/cloudstack/introduction-to-cloudstack-12590733
Palestra apresentada internamente em 31/03/2015 para compartilhar entre os demais colaboradores da empresa informações sobre computação em nuvem e serviços AWS. O conteúdo aborda introdução sobre computação em nuvem, tipos, pilares, camadas, características e principais serviços da AWS.
Approaches to enable the OSPF protocol in Apache CloudStackMarco Sinhoreli
OSPF is a routing protocol for Internet Protocol networks. It uses a link state routing algorithm and falls into the group of interior routing protocols, operating within a single autonomous system. Compared with RIP, OSPF can provide scalable network support and faster convergence times. OSPF is widely used in large networks such as ISP backbones and enterprise networks.
Considering that in large organizations where the end-to-end access is a requirement, the current VPC model brings more complexity to management and hands-on configuration beside the overhead involved in the NAT address translations processing.
This presentation will bring some possibles approaches to enable dynamic routing using the OSPF protocol for IPv4 and IPv6 and simplify the network administrator life safely and quickly.
"Deploying Private PaaS with ActiveState Stackato”, Diane Mueller, Director Cloud Evangelism, ActiveState
This presentation covers building and deploying a Private Platform-as-a-Service (PaaS) on CloudStack. Diane Mueller, ActiveState's Cloud Evangelist shows how to deploy ActiveState's Stackato, an enterprise-ready multi-lingual Private PaaS that runs on any cloud and supports deploying and managing web & mobile applications in any language including Java, .Net, Python, Perl, PHP Ruby, Node.js, Clojure, Scala and Erlang - to name a few. Using the CloudStack UI, Diane demonstrates how to configure and deploy the PaaS and then shows how easy it is to push a live application in under an hour.
“Apache Hadoop, Now and Beyond”, Jim Walker, Director of Product Marketing, Hortonworks
Hadoop is an open source project that allows you to gain insight from massive amounts of structured and unstructured data quickly and without significant investment. It is shifting the way many traditional organizations think of analytics and business models. While it is deigned to take advantage of cheap commodity hardware, it is also perfect for the cloud as it is built to scale up or down without system interruption. In this presentation, Jim Walker will provide an overview of Apache Hadoop and its current state of adoption in and out of the cloud.
Build clouds the way some of the world’s biggest public and private clouds are built—using CloudStack. This 60-minute webinar with the Cloudstack team will help you gain a better understanding of the CloudStack architecture and feature set.
Advanced automation and provisioning in Red Hat Satellite 6 - Red Hat Archite...asquelt
Red Hat Satellite is an easy-to-use system management product that helps keep Red Hat Enterprise Linux® environments and other Red Hat infrastructure running efficiently, properly secured, and compliant with various standards. We’ll introduce the most significant components and integrations in Satellite version 6 including new software life-cycle workflow, easy and flexible configuration management, one click provisioning for bare metal (with discovery) and cloud (vCenter, RHEV, KVM, EC2), inventory and reporting, hardening and security compliance
Xen Orchestra: XAPI and XenServer from the web-XPUS13 LambertThe Linux Foundation
Xen Orchestra is a web based management tool for the XAPI toolstack that is developed by the Xen Project. XAPI is a fully featured management API for Xen, that is also used by the recently open sourced enServer. We'll see how Xen Orchestra leverages XAPI by allowing a complete control of your virtualized infrastructure. First, we'll explain quickly the XO architecture (such as cache system, asynchronous events, user management with tokens…) Then, a review of current and future possibilities will be exposed, to show what you can expect from this solution: powerful visualizations with d3js, neat interface, orchestration features and integration with all XAPI's capable hosts (XenServer or any distro with XAPI packages, such as Debian, Ubuntu or CentOS). Finally, we'll talk about how to contribute.
This presentation is the introduction to the monthly CloudStack.org demonstration. The presentation details the latest features in the CloudStack open source project as well as project news. To attend a future presentation, with live demo and Q&A visit:
http://www.slideshare.net/cloudstack/introduction-to-cloudstack-12590733
Palestra apresentada internamente em 31/03/2015 para compartilhar entre os demais colaboradores da empresa informações sobre computação em nuvem e serviços AWS. O conteúdo aborda introdução sobre computação em nuvem, tipos, pilares, camadas, características e principais serviços da AWS.
Approaches to enable the OSPF protocol in Apache CloudStackMarco Sinhoreli
OSPF is a routing protocol for Internet Protocol networks. It uses a link state routing algorithm and falls into the group of interior routing protocols, operating within a single autonomous system. Compared with RIP, OSPF can provide scalable network support and faster convergence times. OSPF is widely used in large networks such as ISP backbones and enterprise networks.
Considering that in large organizations where the end-to-end access is a requirement, the current VPC model brings more complexity to management and hands-on configuration beside the overhead involved in the NAT address translations processing.
This presentation will bring some possibles approaches to enable dynamic routing using the OSPF protocol for IPv4 and IPv6 and simplify the network administrator life safely and quickly.
The shift to cloud-based services has dramatically altered the IT landscape as we know it. Enterprise infrastructure borders have expanded beyond the firewall and now include hosted applications and infrastructure hosted in public and private clouds. Puppet helps DevOps teams meet their common objectives, creating a seamless IT infrastructure across departments, reducing cost and increasing productivity.
This training section will cover deploying cloud infrastructure automatically using Puppet, an open source configuration management and automation tool.The session will cover the following topics:
Configuring Puppet and Puppetmaster
Resource Types and the Resource Abstration Layer
Virtual Resources, Exported Resources and Stored Configs
Speaker Bio
Luke founded Puppet and Puppet Labs in 2005 out of fear and desperation, with the goal of producing better operations tools and changing how we manage systems. He has been publishing and speaking on his work in system administration since 1997, focusing on development since 2001. He has developed and published multiple simple sysadmin tools and contributed to established products like Cfengine, and has presented on Puppet and other tools around the world, including at OSCON, LISA, Linux.Conf.au, and FOSS.in. His work with Puppet has been an important part of DevOps and delivering on the promise of cloud computing.
GlusterFS is an open source scale-out NAS solution. The software is a powerful and flexible solution that simplifies the task of managing unstructured file data whether you have a few terabytes of storage or multiple petabytes. It’s no secret that unstructured data is growing like crazy, Gluster provides a solutions that scales capacity and performance as you need it and is an ideal fit for an IT environment that is increasingly virtualized and moving to the cloud.
There are two key ways that GlusterFS is beneficial for cloud builders:
1. Storage layer for VMs. If you're deploying Xen or KVM VMs on a private cloud, storing them on GlusterFS gives you the ability to migrate to different hypervisors, suspend and resume quickly - even on another hypervisor, scale out far beyond what other filesystems will allow, and utilize N-way replication for DR and HA
2. Unified storage layer for applications. With GlusterFS 3.3, you will be able to access your application data stores from an object (S3, Swift-style) interface, as well as a traditional POSIX-compatible NAS interface. This unified approach gives developers and admins the ability to access the same data store using a variety of different methods.
In this session, attendees will learn steps for deployment and some common use cases.
Speaker Bio
John Mark is an experienced veteran of all things open source and a self-described agitprop, agitator and advocate for those who volunteer countless, unpaid hours for a particular project or community. He first fell down the slippery slope of open source as a web developer at VA Linux Systems and eventually switched to the community team, beginning a career that has now lasted over ten years. Along the way, John Mark made stops at young, up-and-coming startups, such as Groundwork, Hyperic and then Gluster (later acquired by Red Hat). In between, there was a brief interlude at IDG World Expo, where he was the conference director for LinuxWorld, GridWorld and OSBC. His advice for companies who want to "do community" is to trust your community and give them the space to "just try s***." John Mark loves to perform community karaoke, and is available for weddings, funerals and Bar/Bat Mitzvahs
Very few trends in IT have generated as much buzz as cloud computing. This talk will cut through the hype and quickly clarify the ontology for cloud computing. The bulk of the conversation will focus on the open source software that can be used to build compute clouds (infrastructure-as-a-service) and the complimentary open source management tools that can be combined to automate the management of cloud computing environments. The discussion will appeal to anyone who has a good grasp of traditional data center infrastructure but is struggling with the benefits and migration path to a cloud computing environment. Systems administrators and IT generalists will leave the discussion with a general overview of the options at their disposal to effectively build and manage their own cloud computing environments using free and open source software.
[Presented as part of the Open Source Build a Cloud program on 2/28/2012 - http://cloudstack.org/about-cloudstack/cloudstack-events.html?categoryid=6]
The shift to cloud computing means that organizations are undergoing a major shift as they develop scale-out infrastructure that can respond to apace of business change faster than ever before. Opscode Chef® is an open-source systems integration framework build specifically for
automating the cloud by making it easy to deploy and scale servers and applications throughout your infrastructure. Join us for this session
containing an introduction to Chef including:
An Overview of Chef
The Chef Architecture
Cookbook Components
System Integration
Live demo launching a Java Stack on Amazon EC2, Rackspace, Ubuntu, and
CentOS
[Presented as part of the Open Source Build a Cloud program on 2/29/2012 - http://cloudstack.org/about-cloudstack/cloudstack-events.html?categoryid=6]
Cloudstack is an open source Infrastructure-as-a-Service (IaaS) software platform available under the GPLv3 license, which enables users to build, manage and deploy compute cloud environments. The community edition is based on the latest, leading edge features and bits that the Cloud.com team of engineers are working on and is supported by our open source community.
Using CloudStack a free and open source cloud computing software to build a private cloud. During the training attendees will be instructed on how to install Cloudstack to manage virtual infrastructure in a private cloud computing configuration. At the conclusion of the Build a Private Cloud section users will have the knowledge needed to create a simple private cloud computing environment.
More from CloudStack - Open Source Cloud Computing Project (11)
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Neuro-symbolic is not enough, we need neuro-*semantic*
vBACD July 2012 - Scaling Storage with Ceph
1. S C A L I N G
S T O R A G E
W I T H
C E P H
Ross
Turk,
Inktank
2.
3.
4. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
5. I N
T H E
B E G I N N I N G
Magic Madzik, Flickr / CC BY 2.0
6. E A R L Y
I N F O R M A T I O N
S T O R A G E
Chico.Ferreira, Flickr / CC BY 2.0
7. W R I T I N G
>
C A V E
P A I N T I N G S
kevingessner, Flickr / CC BY-SA 2.0
24. aa
ab 111010 ac
101 ba bb bc 111 010
da 110 db 01 010 000 dc
10
000 110 001
25. W E
O U T G R O W
T H E
H A R D
D R I V E
Mr. T in DC, Flickr / CC BY 2.0
26. DISK
DISK
DISK
HUMAN COMPUTER DISK
DISK
DISK
DISK
27. P E O P L E
N E E D
S I M U L T A N E O U S
A C C E S S
wFourier, Flickr / CC BY 2.0
28. DISK
DISK
HUMAN
DISK
HUMAN COMPUTER DISK
DISK
HUMAN
DISK
DISK
29. HUMAN HUMAN
HUMAN
HUMAN DISK
HUMAN
HUMAN DISK
HUMAN
HUMAN DISK
DISK
HUMAN
DISK
HUMAN
HUMAN DISK
(COMPUTER)
HUMAN
DISK
HUMAN
HUMAN
DISK
HUMAN
HUMAN DISK
HUMAN DISK
HUMAN DISK
HUMAN
HUMAN DISK
HUMAN
HUMAN
(actually more like this…)
30. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
31. X
aa
ab 111010 ac
101 ba bb bc 111 010
da 110 db 011 010 000 dc
000 110 001
33. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
APP
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
34. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER
COMPUTER DISK
DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
35. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
VM COMPUTER DISK
COMPUTER DISK
VM COMPUTER DISK
COMPUTER DISK
VM
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
36. Ceph
Cloud computing
Distributed storage
Shared storage
Computers
Writing
Painting
S T O R A G E
T H R O U G H O U T
H I S T O R Y
Time-scale: Roughly logarithmic. Content: Whatever the opposite of “scientific” is.
37. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
HUMAN
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
38. COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
COMPUTER DISK
39. C D
C D
C D
C D
C D
C D
C D
C D
C D
C D
C D
C D
40. C D
C D
C D
HUMAN
C D
C D
C D
HUMAN C D
C D
C D
HUMAN C D
C D
C D
41. S T O R A G E
A P P L I A N C E S
Michael Moll, Wikipedia / CC BY-SA 2.0
42. 6 . 4
M I L L I O N
S Q F T
O F
F A C T O R I E S
Dude94111, Flickr / CC BY 2.0
43. S T O R A G E
V E N D O R S
H A V E
B I G
B I L L S
CarbonNYC, Flickr / CC BY 2.0
44. S T O R A G E
A P P L I A N C E S
A R E
E X P E N S I V E
401K 2012, Flickr / CC BY-SA 2.0
45. T E C H N O L O G Y
I S
A
C O M M O D I T Y
RaeAllen, Flickr / CC-BY 2.0
46. C O M M O D I T Y
P R I C E S
F L U C T U A T E
May-07 May-08 May-09 May-10 May-11 May-12
47. G R O W I N G
W I T H
H A R D W A R E
A P P L I A N C E S
C D § First PB C D § Second PB
C D § Proprietary C D § Proprietary
C D storage C D storage
C D hardware C D hardware
C D § Well-known C D § Same storage
C D storage C D vendor
C D vendor C D
C D C D
C D C D
§ Another $14
C D
§ $14 b’zillion C D b’zillion
C D C D
C D C D
48. A P P L I A N C E S
A R E
O L D
T E C H N O L O G Y
Paul Keller, Flickr / CC BY 2.0
78. N E W
M O N T H L Y
C O D E
C O M M I T S
700
600
500
400
300
200
100
0
2004-06 2005-07 2006-07 2007-07 2008-07 2009-07 2010-07 2011-07
79. C E P H
S T A R T S
P O P P I N G
U P !
(sorry about all the logo tampering)
80. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
81. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
82. OSD OSD OSD OSD OSD
btrfs
FS FS FS FS FS
xfs
ext4
DISK DISK DISK DISK DISK
M M M
84. M
Monitors:
§ Maintain cluster map
§ Provide consensus for
distributed decision-
making
§ Must have an odd number
§ These do not serve stored
objects to clients
OSDs:
§ One per disk
(recommended)
§ At least three in a cluster
§ Serve stored objects to
clients
§ Intelligently peer to perform
replication tasks
§ Supports object classes
85. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
87. L
LIBRADOS
§ Provides direct access to
RADOS for applications
§ C, C++, Python, PHP,
Java
§ No HTTP overhead
88. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
89. APP APP
REST
RADOSGW RADOSGW
LIBRADOS LIBRADOS
native
M
M M
90. RADOS Gateway:
§ REST-based interface to
RADOS
§ Supports buckets,
accounting
§ Compatible with S3 and
Swift applications
91. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
95. RADOS Block Device:
§ Storage of virtual disks in
RADOS
§ Allows decoupling of VMs
and containers
§ Live migration!
§ Images are striped across
the cluster
§ Boot support in QEMU,
KVM, and OpenStack Nova
§ Mount support in the Linux
kernel
96. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP
RADOS
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
98. Metadata Server
§ Manages metadata for a
POSIX-compliant shared
filesystem
§ Directory hierarchy
§ File metadata (owner,
timestamps, mode, etc.)
§ Stores metadata in RADOS
§ Does not serve file data to
clients
§ Only required for shared
filesystem
132. APP APP HOST/VM CLIENT
RADOSGW RBD CEPH FS
LIBRADOS
A bucket-based REST A reliable and fully- A POSIX-compliant
A library allowing gateway, compatible distributed block distributed file
apps to directly with S3 and Swift device, with a Linux system, with a Linux
access RADOS, kernel client and a kernel client and
with support for QEMU/KVM driver support for FUSE
C, C++, Java,
Python, Ruby,
and PHP AWESOME AWESOME
NEARLY
AWESOME AWESOME
RADOS AWESOME
A reliable, autonomous, distributed object store comprised of self-healing, self-managing,
intelligent storage nodes
134. C E P H
A N D
C L O U D S T A C K
tableatny, Flickr / CC BY 2.0
135. R B D
S U P P O R T
I N
C L O U D S T A C K
§ Just announced two weeks ago!
§ Allows storage of virtual disks inside RADOS
§ Works with KVM only right now
§ No volume snapshots yet
§ Requires the latest version of, um, everything
§ More information can be found on the mailing list:
§ ceph-devel / incubator-cloudstack-dev:
http://article.gmane.org/gmane.comp.file-systems.ceph.devel/7505