This document discusses building platforms for cloud native applications on Kubernetes. It begins by introducing the speaker, Mauricio Salatino, and his background working with CNCF projects. It then outlines the topics that will be covered, including continuous delivery, platform engineering, building and deploying cloud native applications, multi-cloud infrastructure, and measuring platform performance. It also provides an initial table of contents for a book on platform engineering for Kubernetes. Examples of platform components like provisioning databases and multi-cloud resources are discussed. Finally, the document concludes with two demo examples of platforms that simplify consuming cloud resources for developers.
Serverless Toronto User Group - Let's go Serverless!Daniel Zivkovic
Presentation slides from the first Toronto Kickoff Meetup. Topics covered:
1. Debunking Serverless Myths
2. How did we get here? Serverless past, present and the future
3. Serverless vs. FaaS vs. BaaS
4. Products Landscape
5. Popular Use Cases & Design Patterns
6. How to leverage The Serverless Framework to start building cloud-native applications!
7. Serverless forecast: How big will serverless be?
8. Learning Serverless & Serverless Tips
9. Adopting Serverless in your organization
10. Planning Serverless Toronto next steps...
[Srijan Wednesday Webinars] How to Build a Cloud Native Platform for Enterpri...Srijan Technologies
Drupal has been a consistent leader in the Gartner Magic Quadrant for Web Content Management. However, enterprises leveraging Drupal have traditionally relied on PaaS providers for their hosting, scaling and lifecycle management. And that usually leads to enterprise applications being locked-in with a particular cloud or vendor.
As container and container orchestration technologies disrupt the cloud and platform landscape, there’s a clear way to avoid this state of affairs. In this webinar, we discuss why it's important to build a cloud-native Drupal platform, and exactly how to do that.
Join the webinar to understand how you can avoid vendor lock-in, and create a secure platform to manage, operate and scale your Drupal applications in a multi-cloud portable manner.
Key Takeaways:
- Why you need a cloud-native Drupal platform and how to build one
- How to craft an idiomatic development workflow
- Understanding infrastructure and cloud engineering - under the hood
- Demystifying the art and science of Docker and Kubernetes: deep dive into scaling the LAMP stack
- Exploring cost optimization and cloud governance
- Understand portability of applications
- A hands-on demo of how the platform works
SkyBase - a Devops Platform for Hybrid CloudVlad Kuusk
Skybase system is a DevOps platform designed to be used for deployment and maintenance of Services inside all locations of an organization including Dev, QA, Prod and different clouds and geographic regions and data centers.
Dutch Oracle Architects Platform - Reviewing Oracle OpenWorld 2017 and New Tr...Lucas Jellema
Not since the rise of Service Oriented Architecture (and the supporting Fusion Middleware technology) over a decade ago have we seen so much rapid change in terms of application and infrastructure architecture. Cloud, Microservices and DevOps are perhaps the most explicit examples – but many other developments in technology, architecture and even the industry at large have an impact on how enterprises consider and employ IT – such as machine learning, IoT, blockchain.
In this session for (infrastructure, solution, application, enterprise, security, data) architects – we will present the main stories, roadmaps and technologies from Oracle OpenWorld 2017 (and JavaOne) that influence, shape and enable architecture. We will brainstorm together on the consequences of the new directions outlined by Oracle – and coming our way from other quarters. We are seeing a a lot of change. New opportunities arise – that may become challenges or threats if we fail to recognize and embrace the change in time. This session will help us all to get a better handle on the winds in enterprise IT in general and in Oracle land in particular.
Among the topics we will present and discuss are:
- The Only Way is Up – the inevitable and imminent move from on premises to the cloud, and upwards in the stack – from IaaS to SaaS
- Security and Ops in a hybrid landscape (multiple clouds & on premises, multiple technologies & interaction channels)
- Autonomous Database – what, when, how
- Oracle’s cloud strategy, High PaaS and Low PaaS, Open [source] technology (star of the show: Apache Kafka) and the commodization of the traditional Oracle platform
- Container and Cloud Native at Oracle Cloud (Docker, Kubernetes Container Platform, Wercker, Istio Service Mesh, CNCF)
- Serverless
- Java Reborn – for microservices and cloud, modularized (highlights from the JavaOne conference)
- Disruptive: Blockchain, IoT, Machine Learning
Serverless Toronto User Group - Let's go Serverless!Daniel Zivkovic
Presentation slides from the first Toronto Kickoff Meetup. Topics covered:
1. Debunking Serverless Myths
2. How did we get here? Serverless past, present and the future
3. Serverless vs. FaaS vs. BaaS
4. Products Landscape
5. Popular Use Cases & Design Patterns
6. How to leverage The Serverless Framework to start building cloud-native applications!
7. Serverless forecast: How big will serverless be?
8. Learning Serverless & Serverless Tips
9. Adopting Serverless in your organization
10. Planning Serverless Toronto next steps...
[Srijan Wednesday Webinars] How to Build a Cloud Native Platform for Enterpri...Srijan Technologies
Drupal has been a consistent leader in the Gartner Magic Quadrant for Web Content Management. However, enterprises leveraging Drupal have traditionally relied on PaaS providers for their hosting, scaling and lifecycle management. And that usually leads to enterprise applications being locked-in with a particular cloud or vendor.
As container and container orchestration technologies disrupt the cloud and platform landscape, there’s a clear way to avoid this state of affairs. In this webinar, we discuss why it's important to build a cloud-native Drupal platform, and exactly how to do that.
Join the webinar to understand how you can avoid vendor lock-in, and create a secure platform to manage, operate and scale your Drupal applications in a multi-cloud portable manner.
Key Takeaways:
- Why you need a cloud-native Drupal platform and how to build one
- How to craft an idiomatic development workflow
- Understanding infrastructure and cloud engineering - under the hood
- Demystifying the art and science of Docker and Kubernetes: deep dive into scaling the LAMP stack
- Exploring cost optimization and cloud governance
- Understand portability of applications
- A hands-on demo of how the platform works
SkyBase - a Devops Platform for Hybrid CloudVlad Kuusk
Skybase system is a DevOps platform designed to be used for deployment and maintenance of Services inside all locations of an organization including Dev, QA, Prod and different clouds and geographic regions and data centers.
Dutch Oracle Architects Platform - Reviewing Oracle OpenWorld 2017 and New Tr...Lucas Jellema
Not since the rise of Service Oriented Architecture (and the supporting Fusion Middleware technology) over a decade ago have we seen so much rapid change in terms of application and infrastructure architecture. Cloud, Microservices and DevOps are perhaps the most explicit examples – but many other developments in technology, architecture and even the industry at large have an impact on how enterprises consider and employ IT – such as machine learning, IoT, blockchain.
In this session for (infrastructure, solution, application, enterprise, security, data) architects – we will present the main stories, roadmaps and technologies from Oracle OpenWorld 2017 (and JavaOne) that influence, shape and enable architecture. We will brainstorm together on the consequences of the new directions outlined by Oracle – and coming our way from other quarters. We are seeing a a lot of change. New opportunities arise – that may become challenges or threats if we fail to recognize and embrace the change in time. This session will help us all to get a better handle on the winds in enterprise IT in general and in Oracle land in particular.
Among the topics we will present and discuss are:
- The Only Way is Up – the inevitable and imminent move from on premises to the cloud, and upwards in the stack – from IaaS to SaaS
- Security and Ops in a hybrid landscape (multiple clouds & on premises, multiple technologies & interaction channels)
- Autonomous Database – what, when, how
- Oracle’s cloud strategy, High PaaS and Low PaaS, Open [source] technology (star of the show: Apache Kafka) and the commodization of the traditional Oracle platform
- Container and Cloud Native at Oracle Cloud (Docker, Kubernetes Container Platform, Wercker, Istio Service Mesh, CNCF)
- Serverless
- Java Reborn – for microservices and cloud, modularized (highlights from the JavaOne conference)
- Disruptive: Blockchain, IoT, Machine Learning
Triangle Devops Meetup covering Netflix open source, cloud architecture, and what Andrew did in his first year working as a senior software engineer in the cloud platform group.
CloudNativeLondon 2018: "In Search of the Perfect Cloud Native Developer Expe...Daniel Bryant
In a productive cloud native development workflow, individual teams can build and ship software independently from each other. But with a rapidly evolving cloud native landscape, creating an effective developer workflow using a platform based on something like Kubernetes can be challenging. You are all creating software to support the delivery of value to your customers and to the business, and therefore, the developer experience from idea generation to running (and observing) in production must be fast, reliable, and provide good feedback. During this talk Daniel will share with you several lessons learned from real world consulting experience working with teams deploying to Kubernetes.
Key takeaways include:
Why an efficient development workflow is so important
A series of questions to ask in order to understand if you should attempt to build a PaaS on top of Kubernetes (everyone needs a platform, but how much should be built versus integrated versus bought?)
A brief overview of developer experience tooling for Kubernetes, and how this domain could evolve in the future
The role of Kubernetes, Envoy, Prometheus, and other popular cloud-native tools in your workflow
Key considerations in implementing a cloud-native workflow
Slides from my talk at Big Data Conference 2018 in Vilnius
Doing data science today is far more difficult than it will be in the next 5-10 years. Sharing, collaborating on data science workflows in painful, pushing models into production is challenging.
Let’s explore what Azure provides to ease Data Scientists’ pains. What tools and services can we choose based on a problem definition, skillset or infrastructure requirements?
In this talk, you will learn about Azure Machine Learning Studio, Azure Databricks, Data Science Virtual Machines and Cognitive Services, with all the perks and limitations.
Webcast Presentation: Be lean. Be agile. Work together with DevOps Services (...GRUC
Teams need to deliver quality software faster and need integrated agile planning, task tracking, source control, auto deploy with continuous builds and a configurable process to adapt to the way you work. Rational Team Concert and DevOps Services for BlueMix have everything you need to build great software, integrated seamlessly together right out of the box or available immediately in the cloud. And with the Rational Team Concert Client, you can connect your on-premise projects with Public or Private projects in the cloud hosted in DevOps Services for BlueMix so your teams can work the way that best suits their needs. Hear more about how you can leverage the capabilities that address your needs to collaboratively develop great software faster and more efficiently.
Watch this webcast replay to learn:
The pros and cons of cloud vs on-premise software development
How on-premise development can effectively leverage cloud technology
Rational Team Concert and DevOps Services for BlueMix have the flexibility to work the way you want
About the Presenters:
Kate Hauser, Product Manager of PerfectStorm Communities and JazzHub in-market experiments
Kate Hauser curently manages the PerfectStorm Communities and JazzHub in-market experiments. She holds a Bachelor of Arts degree from Dartmouth College. To learn more, visit https://hub.jazz.net/.
Rolf Nelson, Product Manager, Rational Team Concert
Rolf Nelson has more than 20 years of experience in software development tools, operating systems, agile methods and ecosystem development. He has an understanding in key value drivers of enterprise information technology and systems companies. Rolf is currently responsible for the growth and direction of IBM Rational Team Concert, an end-to-end, agile-based collaborative development solution for high performance teams. To learn more, visit www.jazz.net.
Depending on their size and complexity, content management systems such as Sitecore can require various workflows and tools for DevOps management. The choice in processes largely depends upon the scale and depth of your DevOps projects.
Deploying DevOps strategies on Microsoft Azure makes it easy to convert your network, virtual machines, databases, and more from infrastructure into code, enabling you to increase speed and reduce risk.
We discussed the benefits of Sitecore DevOps on Microsoft Azure, including using Microsoft Azure and Microsoft Azure (VSTS) to:
-Automate the build-out of Sitecore environments
-Automate code and content deployment
-Use Azure Resource Manager templates, PowerShell, and -VSTS to provision Sitecore environments
-Automate Sitecore installations
-Move your Sitecore databases into Azure SQL
AWS re:Invent 2016: Deploying Amazon WorkSpaces at Enterprise Scale to Delive...Amazon Web Services
Your enterprise has decided it is exiting the traditional desktop business and migrating to Amazon WorkSpaces. Your challenge: how do you provide end users a high quality experience using DaaS while integrating key enterprise services? Focusing on user adoption and simplified operational management DaaS offers significant benefits over traditional physical desktops and VDI solutions. These benefits include hourly consumption pricing, sizing flexibility, linear scalability, and simplified management.
We will dive into the methodology and design decisions that Informa, a global leader in business intelligence and part of the Information Economy, made to migrate to Amazon WorkSpaces. The goal of this strategy for Informa was to provide their end users with a Windows 10 desktop that could scale across three AWS regions.
Following this session you will be equipped with a methodology for migrating to Amazon WorkSpaces and key design decision points that will assist your organization in rolling out this service for your end users. Best practices will be presented and there will be discussion on the capabilities required to build an enterprise-scale solution around WorkSpaces. All of this will include the fundamental value proposition AWS has brought to market with their industry-leading DaaS offering. Session sponsored by AHEAD.
Platform Engineering is the practice of building and operating a common platform as a product for technology teams.
In this session, we will talk about why and when we need a platform. How to build Platform Engineering and demo.
Jirayut Nimsaeng
Founder & CEO
Opsta (Thailand) Co., Ltd.
Youtube Record: https://youtu.be/brBZYbNbnAo
Dev Mountain Tech Festival 2022 @ Khaoyai
March 19, 2022
Idi2018 - Serverless does not mean OpslessLinuxaria.com
Presentaion done at Devops Day Bologna 2018.
We talk about DevOps as Dev + Ops, and the evolution of this movement, mainly on the ops point of view.
We’ll arrive to today new paradigm “NoOps”, to try to answer a question: “Is this the end of the operations team ?”
Triangle Devops Meetup covering Netflix open source, cloud architecture, and what Andrew did in his first year working as a senior software engineer in the cloud platform group.
CloudNativeLondon 2018: "In Search of the Perfect Cloud Native Developer Expe...Daniel Bryant
In a productive cloud native development workflow, individual teams can build and ship software independently from each other. But with a rapidly evolving cloud native landscape, creating an effective developer workflow using a platform based on something like Kubernetes can be challenging. You are all creating software to support the delivery of value to your customers and to the business, and therefore, the developer experience from idea generation to running (and observing) in production must be fast, reliable, and provide good feedback. During this talk Daniel will share with you several lessons learned from real world consulting experience working with teams deploying to Kubernetes.
Key takeaways include:
Why an efficient development workflow is so important
A series of questions to ask in order to understand if you should attempt to build a PaaS on top of Kubernetes (everyone needs a platform, but how much should be built versus integrated versus bought?)
A brief overview of developer experience tooling for Kubernetes, and how this domain could evolve in the future
The role of Kubernetes, Envoy, Prometheus, and other popular cloud-native tools in your workflow
Key considerations in implementing a cloud-native workflow
Slides from my talk at Big Data Conference 2018 in Vilnius
Doing data science today is far more difficult than it will be in the next 5-10 years. Sharing, collaborating on data science workflows in painful, pushing models into production is challenging.
Let’s explore what Azure provides to ease Data Scientists’ pains. What tools and services can we choose based on a problem definition, skillset or infrastructure requirements?
In this talk, you will learn about Azure Machine Learning Studio, Azure Databricks, Data Science Virtual Machines and Cognitive Services, with all the perks and limitations.
Webcast Presentation: Be lean. Be agile. Work together with DevOps Services (...GRUC
Teams need to deliver quality software faster and need integrated agile planning, task tracking, source control, auto deploy with continuous builds and a configurable process to adapt to the way you work. Rational Team Concert and DevOps Services for BlueMix have everything you need to build great software, integrated seamlessly together right out of the box or available immediately in the cloud. And with the Rational Team Concert Client, you can connect your on-premise projects with Public or Private projects in the cloud hosted in DevOps Services for BlueMix so your teams can work the way that best suits their needs. Hear more about how you can leverage the capabilities that address your needs to collaboratively develop great software faster and more efficiently.
Watch this webcast replay to learn:
The pros and cons of cloud vs on-premise software development
How on-premise development can effectively leverage cloud technology
Rational Team Concert and DevOps Services for BlueMix have the flexibility to work the way you want
About the Presenters:
Kate Hauser, Product Manager of PerfectStorm Communities and JazzHub in-market experiments
Kate Hauser curently manages the PerfectStorm Communities and JazzHub in-market experiments. She holds a Bachelor of Arts degree from Dartmouth College. To learn more, visit https://hub.jazz.net/.
Rolf Nelson, Product Manager, Rational Team Concert
Rolf Nelson has more than 20 years of experience in software development tools, operating systems, agile methods and ecosystem development. He has an understanding in key value drivers of enterprise information technology and systems companies. Rolf is currently responsible for the growth and direction of IBM Rational Team Concert, an end-to-end, agile-based collaborative development solution for high performance teams. To learn more, visit www.jazz.net.
Depending on their size and complexity, content management systems such as Sitecore can require various workflows and tools for DevOps management. The choice in processes largely depends upon the scale and depth of your DevOps projects.
Deploying DevOps strategies on Microsoft Azure makes it easy to convert your network, virtual machines, databases, and more from infrastructure into code, enabling you to increase speed and reduce risk.
We discussed the benefits of Sitecore DevOps on Microsoft Azure, including using Microsoft Azure and Microsoft Azure (VSTS) to:
-Automate the build-out of Sitecore environments
-Automate code and content deployment
-Use Azure Resource Manager templates, PowerShell, and -VSTS to provision Sitecore environments
-Automate Sitecore installations
-Move your Sitecore databases into Azure SQL
AWS re:Invent 2016: Deploying Amazon WorkSpaces at Enterprise Scale to Delive...Amazon Web Services
Your enterprise has decided it is exiting the traditional desktop business and migrating to Amazon WorkSpaces. Your challenge: how do you provide end users a high quality experience using DaaS while integrating key enterprise services? Focusing on user adoption and simplified operational management DaaS offers significant benefits over traditional physical desktops and VDI solutions. These benefits include hourly consumption pricing, sizing flexibility, linear scalability, and simplified management.
We will dive into the methodology and design decisions that Informa, a global leader in business intelligence and part of the Information Economy, made to migrate to Amazon WorkSpaces. The goal of this strategy for Informa was to provide their end users with a Windows 10 desktop that could scale across three AWS regions.
Following this session you will be equipped with a methodology for migrating to Amazon WorkSpaces and key design decision points that will assist your organization in rolling out this service for your end users. Best practices will be presented and there will be discussion on the capabilities required to build an enterprise-scale solution around WorkSpaces. All of this will include the fundamental value proposition AWS has brought to market with their industry-leading DaaS offering. Session sponsored by AHEAD.
Platform Engineering is the practice of building and operating a common platform as a product for technology teams.
In this session, we will talk about why and when we need a platform. How to build Platform Engineering and demo.
Jirayut Nimsaeng
Founder & CEO
Opsta (Thailand) Co., Ltd.
Youtube Record: https://youtu.be/brBZYbNbnAo
Dev Mountain Tech Festival 2022 @ Khaoyai
March 19, 2022
Idi2018 - Serverless does not mean OpslessLinuxaria.com
Presentaion done at Devops Day Bologna 2018.
We talk about DevOps as Dev + Ops, and the evolution of this movement, mainly on the ops point of view.
We’ll arrive to today new paradigm “NoOps”, to try to answer a question: “Is this the end of the operations team ?”
Similar to Building Developer Experiences for the Cloud .pdf (20)
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Accelerate Enterprise Software Engineering with Platformless
Building Developer Experiences for the Cloud .pdf
1. Mauricio Salatino - @Salaboy
OSS Software Engineer @ Diagrid.io
Building DevExp for the Cloud
2. Agenda
- You should never write a book!
- Try to not talk for too long about Platform Engineering, Continuous
Delivery and CNCF Projects
- Demos
3. • Mauricio Salatino -> Also known as @Salaboy
• I work for @Diagrid and @LearnK8s instructor
○ CNCF project Dapr(https://dapr.io)
○ Steering committee member for the Knative
Project (https://knative.dev)
○ Co-Lead Knative Functions Working Group
• I used to work for Red Hat and VMware building
tools for developers
Who I am?
4. • Continuous Delivery for Kubernetes
• 35% Discount Code:
○ mtppuclkuldn23
I am writing a book
5. • Continuous Delivery for Kubernetes
• Platform Engineering for Kubernetes
• 35% Discount Code:
○ mtppuclkuldn23
I am writring a book
6. • Platform Engineering for Kubernetes
○ When and why do we need platforms?
○ Challenges of Cloud Native Applications (Helm, Kustomize, monitoring, open
telemetry, tracing, dashboards, etc)
○ Building/Deploying Cloud-Native Applications (Tekton, Dagger, GitHub actions,
ArgoCD, CNCF Buildpacks, etc.)
○ Multi-Cloud Application Infrastructure (Crossplane, Terraform, Pulumi, CDK8s, etc.)
○ Building a platform on top of Kubernetes (Crossplane, Kratix)
○ Developer Experience
■ Release Strategies (Knative Serving, Argo Rollouts, Service Meshes)
■ Connecting to services (Dapr, Knative Functions and Libraries)
■ Event-driven system to system integrations (Cloud Events, Knative Eventing,
Dapr Pub/Sub, EventsBridge, EventArc, etc)
○ Measuring our Platforms performance using DORA (CDEvents, Four Keys)
Book ToC (Table of Content)
7. • Platform Engineering for Kubernetes
○ When and why do we need platforms?
○ Challenges of Cloud Native Applications
○ Building/Deploying Cloud-Native Applications
○ Multi-Cloud Application Infrastructure
○ Building a platform on top of Kubernetes
○ Developer Experience
■ Release Strategies
■ Connecting to services
■ Event-driven system to system integrations
○ Measuring our Platforms performance using DORA
Book ToC (Table of Content)
8. • Cloud Provider Platforms (AWS, GCP, Azure) provide us with:
○ Tons of services to choose from
○ Each service have
■ Dashboards
■ API-First
■ CLIs (Command Line Interface tools)
Platforms are not new
9. • Amazon Web Services 🤔
• Microsoft Azure (bright blue in colour like a cloudless sky.)
• Google Cloud Platform 👍
Weird note on Cloud Providers name
10. • Your teams will need to learn Cloud Provider specific tooling
• You need to hire experts on the Cloud Provider that you choose
• Cloud Provider lock-in
• You are still responsible of defining which services to use, how to
combine them and how to expose them to your teams
Some Challenges
14. You need to start thinking about Platforms and
Platform Engineering internally
15. Platform Engineering and Continuous Delivery
- What we build is an Internal Platform
- That encodes all the organization’s choices and practices
- Why we build it to enable teams to deliver software in a
continuous fashion
- The platform provide golden paths to production
- How we build it with a Platform Engineering team
- That treat development teams as customers to keep improving the
platform