This document summarizes a webinar presentation about managing resources and services in a cloud federation using FIWARE Lab solutions. The presentation discusses:
- The FIWARE Lab open innovation platform and its distributed cloud infrastructure across Europe.
- Key components that enable deployment of applications across the federation, including the Pegasus platform-as-a-service and Deployment and Configuration Adapter.
- A federation monitoring system that collects data from the distributed infrastructure and provides aggregated metrics through a standardized API.
- A case study example of deploying a multi-tier weather application across two cloud infrastructures using these solutions.
After a short introduction on the API landscape within Cloud Computing services & its operational impacts for the NextGEOSS users, we’ll go through the EGI Federated Cloud journey in improving and harmonizing its federation and interoperability services. The EGI Cloud resources are supporting the NextGEOSS Pilot applications needs for compute and storage. These Pilot applications are empowered for Cloud Computing thanks to some NextGEOSS Platform services operated by the NextGEOSS partner Terradue. These Cloud Integration and Cloud Bursting services are based on Cloud APIs, and both deliver vendor-agnostic capabilities for the management and deployment at scale of a range of NextGEOSS EO data processing applications.
Recorded Webinar:
https://youtu.be/peqOhar0OcA
IoT Physical Servers and Cloud Offerings.pdfGVNSK Sravya
Introduction to Cloud Storage models
• Communication APIs
• Webserver-Web server for IoT
• Cloud for IoT
• Python web application framework
• Designing a RESTful web API.
ATMOSPHERE at HPC2018 – Fogbow: Middleware for the Federation of IaaS Cloud P...ATMOSPHERE .
ATMOSPHERE was invited to be a speaker at HPC2018 workshop. Francisco Brasileiro, Brazilian Coordinator of ATMOSPHERE and Professor at Federal University of Campina Grande, will present a talk on “Fogbow: A Middleware for the Federation of IaaS Cloud Providers”.
Francisco Brasileiro presented the design and implementation of a middleware that allows the fast and non-intrusive deployment of very large federations of IaaS cloud providers. The use of the middleware in production systems will be also discussed, providing concrete evidences of its suitability
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
VMworld 2013
Amjad Afanah, VMware
Rajesh Khazanchi, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
CNCF general introduction to beginners at openstack meetup Pune & Bangalore February 2018. Covers broadly the activities and structure of the Cloud Native Computing Foundation.
After a short introduction on the API landscape within Cloud Computing services & its operational impacts for the NextGEOSS users, we’ll go through the EGI Federated Cloud journey in improving and harmonizing its federation and interoperability services. The EGI Cloud resources are supporting the NextGEOSS Pilot applications needs for compute and storage. These Pilot applications are empowered for Cloud Computing thanks to some NextGEOSS Platform services operated by the NextGEOSS partner Terradue. These Cloud Integration and Cloud Bursting services are based on Cloud APIs, and both deliver vendor-agnostic capabilities for the management and deployment at scale of a range of NextGEOSS EO data processing applications.
Recorded Webinar:
https://youtu.be/peqOhar0OcA
IoT Physical Servers and Cloud Offerings.pdfGVNSK Sravya
Introduction to Cloud Storage models
• Communication APIs
• Webserver-Web server for IoT
• Cloud for IoT
• Python web application framework
• Designing a RESTful web API.
ATMOSPHERE at HPC2018 – Fogbow: Middleware for the Federation of IaaS Cloud P...ATMOSPHERE .
ATMOSPHERE was invited to be a speaker at HPC2018 workshop. Francisco Brasileiro, Brazilian Coordinator of ATMOSPHERE and Professor at Federal University of Campina Grande, will present a talk on “Fogbow: A Middleware for the Federation of IaaS Cloud Providers”.
Francisco Brasileiro presented the design and implementation of a middleware that allows the fast and non-intrusive deployment of very large federations of IaaS cloud providers. The use of the middleware in production systems will be also discussed, providing concrete evidences of its suitability
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
VMworld 2013
Amjad Afanah, VMware
Rajesh Khazanchi, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
CNCF general introduction to beginners at openstack meetup Pune & Bangalore February 2018. Covers broadly the activities and structure of the Cloud Native Computing Foundation.
EOSC-hub brings together multiple service providers to create the Hub: a single contact point for European researchers and innovators to discover, access, use and reuse a broad spectrum of resources for advanced data-driven research.
This presentation introduces the services on offer to scientists of all disciplines
App modernization projects are hard. Enterprises are looking to cloud-native platforms like Pivotal Cloud Foundry to run their applications, but they’re worried about the risks inherent to any replatforming effort.
Fortunately, several repeatable patterns of successful incremental migration have emerged.
In this webcast, Google Cloud’s Prithpal Bhogill and Pivotal’s Shaun Anderson will discuss best practices for app modernization and securely and seamlessly routing traffic between legacy stacks and Pivotal Cloud Foundry.
Webinar presented live on April 4, 2017
The Cloud Standards Customer Council has published an API Management reference architecture. APIs allow companies to open up data and services to external third party developers, business partners, and internal departments within the company to create innovative channel applications and new business opportunities. An effective API management platform provides a layer of controlled and secure self-service access to core business assets for reuse.
In this webinar, the authors of the reference architecture will cover the architectural components and capabilities that make up a superior API Management Platform and will also cover important runtime characteristics and deployment considerations.
Read the CSCC's paper here: http://www.cloud-council.org/deliverables/cloud-customer-architecture-for-api-management.htm
Microservice Best Practices The 8020 Way.pdfSimform
Microservices have fundamentally changed the way server-side engines are architected.
Rather than a single giant #monolithic codebase hosting all the business logic of your application, microservices reflect the distributed systems model, where a group of application components works together to deliver the business needs.
By following ten basic microservices best practices, you can achieve an efficient microservices ecosystem devoid of unnecessary architectural complexities.
Presentation gives more insight about what is Converged Infrastructure , types of Converged Infrastructure and its benefits. Also it provides details about various Converged Infrastructure vendors in market and their shares.
A proper Microservice is designed for fast failure.
Like other architectural style, microservices bring costs and benefits. Some development teams have found microservices architectural style to be a superior approach to a monolithic architecture. Other teams have found them to be a productivity-sapping burden.
This material start with the basic what and why microservice, follow with the Felix example and the the successful strategies to develop microservice application.
VMworld 2013: Architecting the Software-Defined Data Center VMworld
VMworld 2013
Aidan Dalgleish, VMware
David Hill, VMware
Kamau Wanguhu, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
{code} and Containers - Open Source Infrastructure within Dell TechnologiesThe {code} Team
Learn how The {code} Team is building new infrastructure possibilities for persistent storage in all the major container ecosystems such as Kubernetes, Docker, and Mesos with native integrations and contributing the Container Storage Interface
Infrastructure as Code in Large Scale OrganizationsXebiaLabs
The adoption of tools for the provisioning and automatic configuration of "Infrastructure as Code" (eg Terraform, Cloudformation or Ansible) reduces cost, time, errors, violations and risks when provisioning and configuring the necessary infrastructure so that our software can run .
However, those who have begun to make intensive use of this technology at the business level agree to identify the emergence of a very critical problem regarding the orchestration and governance needs of supply requests such as security, compliance, scalability, integrity and more.
Learn how The Digital.ai DevOps Platform (formerly XebiaLabs DevOps Platform) responds to all these problems and many more, allowing you to continue working with your favorite tools.
An architect’s guide to leveraging your incumbencyMichael Elder
O'Reilly Software Architecture Conference 2018 (London)
Continuous delivery for 12-factor Microservices works because it’s by design. When you can architect a solution for continuous delivery, you control all the angles but what do you do when you don’t have that luxury? This session will highlight how modernizing existing IT infrastructure with containers enables you to manage change through continuous delivery and reduce ongoing operational costs.
Abstract
While the industry has promoted a dramatic trend to build new, improved styles of architecture; there remains a gap in how to address the ongoing and continuous improvement and operation of existing enterprise IT systems alongside these new 12-factor apps.
In this session, we will review why 12-factor apps are a natural fit for Kubernetes by design. We will demonstrate how Kubernetes addresses virtually all of the 12 factors for scalable web apps. Then we will take a step back and consider the important question: how well will stateful and transactional workloads that were not designed for 12-factor be able to run within Kubernetes?
Even with purist gaps from 12-factor for traditional enterprise workloads, there are real benefits to velocity and cost management to move stateful and transactional workloads to containers. With a container based orchestrator like Kubernetes, all workload types can take advantage of automated DevOps release pipelines, provide rich feedback loops with canary testing, leverage better automated failure recovery in production, and provide easier visibility into the operational health of services running within Kubernetes. Leveraging a standard platform for a blend of architectural types enables an enterprise to standardize operational practices for across the board. The end result might be the right path for your enterprise to drive your digital transformation.
3 Reasons to Select Time Series Platforms for Cloud Native Applications Monit...DevOps.com
Cloud native architectures deliver the much needed performance and scale but require an entirely different monitoring strategy. Legacy monitoring technologies fail to meet the granularity, ingest and query requirements of modern cloud-native architectures.
Enter Time Series platforms such as InfluxDB which can capture the metrics and events generated by applications, containers and Kubernetes pods & nodes.
Join us to find out more about why Time Series platforms are growing faster than any other monitoring technology and why they should be part of your new application architecture.
BigFix’s well-established endpoint management capabilities support multicloud environments to provide a single solution for organizations to identify, manage and secure workloads across multiple clouds and on-premise endpoints in a consistent and effective manner. With Bigfix organizations can continuously discover all cloud instances, apply patches, and track security configurations and software inventory to ensure all workloads are always patched and compliant both on cloud workloads and on-premises endpoints using a single infrastructure and management model.
To learn more about BigFix, contact your HCL Software representative: https://www.hcltechsw.com/bigfix/contact-us
EOSC-hub brings together multiple service providers to create the Hub: a single contact point for European researchers and innovators to discover, access, use and reuse a broad spectrum of resources for advanced data-driven research.
This presentation introduces the services on offer to scientists of all disciplines
App modernization projects are hard. Enterprises are looking to cloud-native platforms like Pivotal Cloud Foundry to run their applications, but they’re worried about the risks inherent to any replatforming effort.
Fortunately, several repeatable patterns of successful incremental migration have emerged.
In this webcast, Google Cloud’s Prithpal Bhogill and Pivotal’s Shaun Anderson will discuss best practices for app modernization and securely and seamlessly routing traffic between legacy stacks and Pivotal Cloud Foundry.
Webinar presented live on April 4, 2017
The Cloud Standards Customer Council has published an API Management reference architecture. APIs allow companies to open up data and services to external third party developers, business partners, and internal departments within the company to create innovative channel applications and new business opportunities. An effective API management platform provides a layer of controlled and secure self-service access to core business assets for reuse.
In this webinar, the authors of the reference architecture will cover the architectural components and capabilities that make up a superior API Management Platform and will also cover important runtime characteristics and deployment considerations.
Read the CSCC's paper here: http://www.cloud-council.org/deliverables/cloud-customer-architecture-for-api-management.htm
Microservice Best Practices The 8020 Way.pdfSimform
Microservices have fundamentally changed the way server-side engines are architected.
Rather than a single giant #monolithic codebase hosting all the business logic of your application, microservices reflect the distributed systems model, where a group of application components works together to deliver the business needs.
By following ten basic microservices best practices, you can achieve an efficient microservices ecosystem devoid of unnecessary architectural complexities.
Presentation gives more insight about what is Converged Infrastructure , types of Converged Infrastructure and its benefits. Also it provides details about various Converged Infrastructure vendors in market and their shares.
A proper Microservice is designed for fast failure.
Like other architectural style, microservices bring costs and benefits. Some development teams have found microservices architectural style to be a superior approach to a monolithic architecture. Other teams have found them to be a productivity-sapping burden.
This material start with the basic what and why microservice, follow with the Felix example and the the successful strategies to develop microservice application.
VMworld 2013: Architecting the Software-Defined Data Center VMworld
VMworld 2013
Aidan Dalgleish, VMware
David Hill, VMware
Kamau Wanguhu, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
{code} and Containers - Open Source Infrastructure within Dell TechnologiesThe {code} Team
Learn how The {code} Team is building new infrastructure possibilities for persistent storage in all the major container ecosystems such as Kubernetes, Docker, and Mesos with native integrations and contributing the Container Storage Interface
Infrastructure as Code in Large Scale OrganizationsXebiaLabs
The adoption of tools for the provisioning and automatic configuration of "Infrastructure as Code" (eg Terraform, Cloudformation or Ansible) reduces cost, time, errors, violations and risks when provisioning and configuring the necessary infrastructure so that our software can run .
However, those who have begun to make intensive use of this technology at the business level agree to identify the emergence of a very critical problem regarding the orchestration and governance needs of supply requests such as security, compliance, scalability, integrity and more.
Learn how The Digital.ai DevOps Platform (formerly XebiaLabs DevOps Platform) responds to all these problems and many more, allowing you to continue working with your favorite tools.
An architect’s guide to leveraging your incumbencyMichael Elder
O'Reilly Software Architecture Conference 2018 (London)
Continuous delivery for 12-factor Microservices works because it’s by design. When you can architect a solution for continuous delivery, you control all the angles but what do you do when you don’t have that luxury? This session will highlight how modernizing existing IT infrastructure with containers enables you to manage change through continuous delivery and reduce ongoing operational costs.
Abstract
While the industry has promoted a dramatic trend to build new, improved styles of architecture; there remains a gap in how to address the ongoing and continuous improvement and operation of existing enterprise IT systems alongside these new 12-factor apps.
In this session, we will review why 12-factor apps are a natural fit for Kubernetes by design. We will demonstrate how Kubernetes addresses virtually all of the 12 factors for scalable web apps. Then we will take a step back and consider the important question: how well will stateful and transactional workloads that were not designed for 12-factor be able to run within Kubernetes?
Even with purist gaps from 12-factor for traditional enterprise workloads, there are real benefits to velocity and cost management to move stateful and transactional workloads to containers. With a container based orchestrator like Kubernetes, all workload types can take advantage of automated DevOps release pipelines, provide rich feedback loops with canary testing, leverage better automated failure recovery in production, and provide easier visibility into the operational health of services running within Kubernetes. Leveraging a standard platform for a blend of architectural types enables an enterprise to standardize operational practices for across the board. The end result might be the right path for your enterprise to drive your digital transformation.
3 Reasons to Select Time Series Platforms for Cloud Native Applications Monit...DevOps.com
Cloud native architectures deliver the much needed performance and scale but require an entirely different monitoring strategy. Legacy monitoring technologies fail to meet the granularity, ingest and query requirements of modern cloud-native architectures.
Enter Time Series platforms such as InfluxDB which can capture the metrics and events generated by applications, containers and Kubernetes pods & nodes.
Join us to find out more about why Time Series platforms are growing faster than any other monitoring technology and why they should be part of your new application architecture.
BigFix’s well-established endpoint management capabilities support multicloud environments to provide a single solution for organizations to identify, manage and secure workloads across multiple clouds and on-premise endpoints in a consistent and effective manner. With Bigfix organizations can continuously discover all cloud instances, apply patches, and track security configurations and software inventory to ensure all workloads are always patched and compliant both on cloud workloads and on-premises endpoints using a single infrastructure and management model.
To learn more about BigFix, contact your HCL Software representative: https://www.hcltechsw.com/bigfix/contact-us
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Designing for Privacy in Amazon Web ServicesKrzysztofKkol1
Data privacy is one of the most critical issues that businesses face. This presentation shares insights on the principles and best practices for ensuring the resilience and security of your workload.
Drawing on a real-life project from the HR industry, the various challenges will be demonstrated: data protection, self-healing, business continuity, security, and transparency of data processing. This systematized approach allowed to create a secure AWS cloud infrastructure that not only met strict compliance rules but also exceeded the client's expectations.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
Worried about document security while sharing them in Salesforce? Fret no more! Here are the top-notch security standards XfilesPro upholds to ensure strong security for your Salesforce documents while sharing with internal or external people.
To learn more, read the blog: https://www.xfilespro.com/how-does-xfilespro-make-document-sharing-secure-and-seamless-in-salesforce/
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Why React Native as a Strategic Advantage for Startup Innovation.pdfayushiqss
Do you know that React Native is being increasingly adopted by startups as well as big companies in the mobile app development industry? Big names like Facebook, Instagram, and Pinterest have already integrated this robust open-source framework.
In fact, according to a report by Statista, the number of React Native developers has been steadily increasing over the years, reaching an estimated 1.9 million by the end of 2024. This means that the demand for this framework in the job market has been growing making it a valuable skill.
But what makes React Native so popular for mobile application development? It offers excellent cross-platform capabilities among other benefits. This way, with React Native, developers can write code once and run it on both iOS and Android devices thus saving time and resources leading to shorter development cycles hence faster time-to-market for your app.
Let’s take the example of a startup, which wanted to release their app on both iOS and Android at once. Through the use of React Native they managed to create an app and bring it into the market within a very short period. This helped them gain an advantage over their competitors because they had access to a large user base who were able to generate revenue quickly for them.
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
Developing Distributed High-performance Computing Capabilities of an Open Sci...
fiware-lab-dev-6.pdf
1. Yahya Al-Hazmi | Technische Universität Berlin
yahya.al-hazmi@tu-berlin.de
XIFI Webinar | GoToWebinar | February 23, 2015, 11-12 AM CET
FIWARE Lab Solution for Managing
Resources & Services in a Cloud
Federation
http://lab.fiware.org
3. Introduction (1)
We need an open ecosystem or platform for open innovation
Cloud capacity and services are of great value to support open innovation
and facilitate start-up incubation through infrastructure resource
How to create a large distributed cloud to boost innovation across
European regions?
• This requires
› either large investments by a single player or
› an agreement among many players (federation)
• Of course, when different players team up together within a federation, they do not
want to lose all the control on their own infrastructure.
There are several challenges and motivations behind cloud federation in
the literature, as well as different federation models and approaches
2
4. Introduction (2)
There is no „best“ cloud federation approach
• Different approaches exist and each has its pros/cons
• Depend on different requirements
We focus on Cloud Federation conducted within XIFI project to build the
federation of cloud infrastructures for the Future Internet Lab (FIWARE Lab)
FIWARE Lab:
• Is an open innovation platform to develop Future Internet (FI) applications
• Offers a rich catalogue of services available either in SaaS or PaaS modality, the
so called Generic Enabler implementations (GEis)
› FIWARE GEs: set of general-purpose platform functions available through APIs
• Provides also a wide offer of FI facilities (e.g. sensor networks, 4G networks,
etc.) that provide advanced experimental capacities to developers allowing them
to link their applications with actual infrastructures and test them in real world
settings
3
5. FIWARE Lab
FIWARE Lab is the Community Cloud for European FI-PPP developers
enabled by advanced FI infrastructures in Europe
XIFI, as part of the overall vision of FI-PPP and following the principle “eat
your own dog food”, is based on FI-PPP technologies delivered by FIWARE
4
6. FIWARE Lab: the “meeting point”
where innovation takes place
5
Entrepreneurs, Developers
• Develop once for a large market
• Easily meet potential customers
• Marketing, promotion
• Ability to test with real data and
end users
• Simple yet powerful APIs that
accelerate product development
App Customers and Data providers
• Connect to entrepreneurs
• Put their data at work
• Bring new innovative services to end
users
• Be more efficient
• Social Reputation
FIWARE Technology Providers
• “Competitive” approach
• Connect to entrepreneurs: jointly
exploit the opportunities
4,2 M€ promotion campaign
• Campus Party events
• Startup Weekend events
• Chambers of Commerce
• 870 K€ in prizes
100 M€ of funding devoted
to entrepreneurs in phase 3
of the FIWARE program
7. Distributed Cloud for FIWARE Lab
6
• 17 nodes in Europe
providing up to
3000+ cores,
16TB+ Ram,
750TB+ HD
• A node is a data-
center (or more
linked)
• Connectivity node-
to-node offered
through GEANT /
NRENs
• Service topology
depending on GEs
release and UC
requirements
• 17 nodes in Europe
providing up to
3000+ cores,
16TB+ Ram,
750TB+ HD
• A node is a data-
center (or more
linked)
• Connectivity node-
to-node offered
through GEANT /
NRENs
• Service topology
depending on GEs
release and UC
requirements
8. The Federation “topology”
Identity Federation
Identity Federation
Spain
(M)
Spain
(M)
Italy
(M)
Italy
(M)
France
(S)
France
(S)
Ireland
(S)
Ireland
(S)
German
y (S)
Load Balancer
Synchronize
Spain
(M)
Italy
(M)
France
(S)
Ireland
(S)
Germany
(S)
Note:
• Not all the links are
shown
• For simplicity only five
nodes are depicted
M (master):
management and
operation layers
S (slave):
operation layer
7
9. General Architecture
8
Centralized Federation
Management
• Find available resources
• Compare resources
• Deploy GEs
• Federated Monitoring
Distributed Resources
• Access GEs
• Access VMs
• Monitoring data
• IdM & AC
• Network configuration
10. FIWARE Lab cloud federation management
from App developers’ viewpoint
Focusing on innovative components that, working in an orchestrated
manner, perform core operations dealing with the management of
resources and services from an application developer viewpoint, in
particular:
i. the ability to deploy multi-tier applications across the federation
a. Due to regulatory or security reasons each tier may need to be deployed in different
infrastructure
b. Select among a set of configuration tools helping developers to minimize chronophage
operations
ii. the provisioning of real-time information about the services (GEis) available
in the federation through standardized RESTfull API
iii. a centralized mechanism to handle large-scale monitoring data gathered
through the federated underlying resources, by establishing a well-defined
and standardized API for storing, aggregating and publishing such data
9
11. Simplified architecture: cloud federation
management from App developers’ viewpoint
10
IdM: Identity Management
IMM: Infrastructure Monitoring
Middleware
DCRM: Data Center Resource
Management ( OpenStack-
Based)
12. Platform-as-a-Services (Pegasus)
Enables a user to deploy easily any kind of application (single VM, single GEi or
multiple GEis)
Offers the opportunity to deploy multi-tier applications, where each tier can be
accommodated by a different infrastructure of the federation
11
No restriction of the
platform technology
• The developer is free to
select his own platform
• Products that will be
supported: J2EE, Apache,
DB: MySQL, PostgreSQL,
PHP, …
Automate how you build,
deploy, and manage your
infrastructure using Chef
or Puppet (Sagitta)
13. Platform-as-a-Services (Pegasus)
Deployment design: concrete number of machines, VM structure: products,
application components, load balancers, final network structure
Deployment execution: orchestration of different steps: configuration of the
cloud services, configuration of IaaS/NaaS, creation of the VMs with the
software inside, configuration of the monitoring system, etc.
Infrastructure control layer: creation and configuration of VMs+software,
interaction with IaaS/NaaS providers, deployment and execution of VMs
Monitoring: configuration of the monitoring probes in order to recover the
data from the VMs, network and or process
Adaptation and scalability of the applications (multi-tenancy)
12
14. Deployment and Configuration Adapter (DCA)
DCA caters for the persistency of all
pertinent information related to the
whole lifecycle of services (GEis)
DCA exposes a RESTful API that
can be used by interested users to
collect all needed information
regarding GE instances available in
the cloud federation either as SaaS
or PaaS offerings
DCA is a flexible component that
accommodates different accessing
policies, following infrastructure
owners’ requirements
13
15. Deployment and Configuration Adapter (DCA)
Challenges:
i. Respecting potential stringent access policies applied by the infrastructure
owners (Slave Nodes) not willing to provide administrative privileges to external
parties
ii. Unambiguous identification of the deployment of a specific GEi in several
infrastructures
Solutions:
i. Software component (Python script), which is able to collect respective
information through the OpenStack Nova and Glance components, is used by
the infrastructure administrator to edit and customize the parameters of the
Python script before installing it on the controller of the infrastructure (DCRM)
ii. The information is made available to the DCA through a particular configuration
done by the Pegasus during GEi deployment through the use of the
metadata service offered by the OpenStack
› inserting a specific value (called NID) in the Glance metadata that uniquely and
unambiguously allows for GEi identification across the cloud federation
14
16. Federation Monitoring
Attached to the local monitoring
system(s), a cross-domain
adaptation mechanism, denoted
as Infrastructure Monitoring
Middleware (IMM), unifies the
format of and the accessibility
to the collected data
The Federation Monitoring
fulfilling the next operational
layer is in charge of storing and
publishing the unified data-set
by defining a Fed. Monitoring
API
• This layer is able to elaborate
the data by leveraging on Big
Data analysis techniques and
providing aggregation features
15
17. Federation Monitoring
Fed. Monitoring components:
• Context Broker: the IMM notify
the monitoring data as NGSI
context format into the CB that
handles the datasets and updates
the metrics into Hadoop
• Apache Hadoop: provides
scalable, reliable and distributed
data processing and storage
› perform aggregating operations to
the data coming from the
subscription with the CB
› all Hadoops are federated in order
to maintain the service in high
availability
› only the Hadoop deployed in the
Master Node is allowed to perform
operations with the relational
database
16
18. Federation Monitoring
• Relational database: required to
store the elaborated data
• Fed. Monitoring API Server: API
for users to access the processed
monitoring data stored in the
relational database, and real-time
data from the federation
Only master node hosts specific
federation-aware functionalities
17
19. Managing resources in multi-tier application:
a real case scenario
An application developer willing to offer a weather service
• by allowing subscribed users to check, via a website, weather conditions or be
automatically informed of sudden weather changes
• Weather information are collected through a network including several sensors
S/he selects:
• the Orion Context Broker GEi: to publish the data collected by the sensor
• the Complex Event Processing GEi: to process the information from sensors and to
create events through customized threshold
• the WireCloud GEi: to properly display this information in a webpage,
Due to regulatory reason, Pegasus deploys them in two clouds (two-
infrastructure application)
DCA allows a user to query its API providing all VMs created by him
Monitoring API is used to get monitoring infos using a unique ID of the VM
18
20. Conclusion
Addressed FIWARE Lab solutions
• for seamless deployment of services across the federation and ability of services to
span across different members of the federation
• For monitoring of the resources and data which can be aggregated with a common
structure
• be offered as an open ecosystem for innovation at the developers’ disposal
These solutions are implemented and deployed in FIWARE Lab that includes
a running federation of 17 infrastructures distributed across Europe
Developers can get an account by registering through the Cloud Portal and
enjoy the offerings
How to use/interact/start working is presented in the upcoming Webinar “XIFI
for developers” on Wednesday, February 25, 2015.
19
21. Acknowledgment
The research work has received funding
from the EU FP7 grant agreement no.
604590 XIFI Project. The authors would
like to thank the project partners for their
contribution, especially Panos Trakadas,
Pablo Rodríguez, Silvio Cretti and Attilio
Broglio.
20