Audience Level
Intermediate
Synopsis
M3 is the latest generation system of the MASSIVE project, an HPC facility specializing in characterization science (imaging and visualization). Using OpenStack as the compute provisioning layer, M3 is a hybrid HPC/cloud system, custom-integrated by Monash’s R@CMon Research Cloud team. Built to support Monash University’s next-gen high-throughput instrument processing requirements, M3 is half-half GPU-accelerated and CPU-only.
We’ll discuss the design and tech used to build this innovative platform as well as detailing approaches and challenges to building GPU-enabled and HPC clouds. We’ll also discuss some of the software and processing pipelines that this system supports and highlight the importance of tuning for these workloads.
Speaker Bio
Blair Bethwaite: Blair has worked in distributed computing at Monash University for 10 years, with OpenStack for half of that. Having served as team lead, architect, administrator, user, researcher, and occasional hacker, Blair’s unique perspective as a science power-user, developer, and system architect has helped guide the evolution of the research computing engine central to Monash’s 21st Century Microscope.
Lance Wilson: Lance is a mechanical engineer, who has been making tools to break things for the last 20 years. His career has moved through a number of engineering subdisciplines from manufacturing to bioengineering. Now he supports the national characterisation research community in Melbourne, Australia using OpenStack to create HPC systems solving problems too large for your laptop.
Audience Level
Intermediate
Synopsis
In this presentation, Shunde will show you how to simplify the migration process with a workload migration engine, making the move to OpenStack easy. This talk will address the various difficulties operators and administrators face when migrating workloads and resources between various cloud platforms, including removing time consuming, repetitive and complicated steps.
This tool can be applied to many cloud migrations, including between Virtual Machines and OpenStack, between Public and Private clouds, as well as between OpenStack and OpenStack. This tool integrates completely with other OpenStack projects minimising deployment and maintenance efforts. So whether you’re looking to upgrade from your existing traditional virtualisation platform, setup a new OpenStack instance, or upgrade to a newer version of OpenStack, we will show you how to simplify this process using GUTS.
Speaker Bio
Shunde is a senior software developer in Aptira with over 15 years experience in software development, automation and system administration. He has worked with OpenStack since the Diablo cycle and has been involved in projects from OpenStack infrastructure to distributed systems running on top of OpenStack.
Meshing OpenStack and Bare Metal Networks with EVPN - David Iles, Mellanox Te...OpenStack
Audience Level
Intermediate
Synopsis
The latest SDN revolution is centered on creating efficient virtualized data center networks using VXLAN & EVPN. We will talk about the scale, performance, and cost advantages of using a modern controller-free virtualized network solution built on 100 Gigabit Ethernet switches with hardware based VXLAN Routing. We will explore the ease of automating such a network in an OpenStack environment and take you through a real world use case of using OpenStack Network Node bridging between a bare metal cloud (EVPN) and a fully virtualized cloud environments (orchestrated by Neutron).
Speaker Bio:
David has held leadership roles at 3COM, Cisco Systems, Nortel Networks, and IBM where he promoted advanced network technologies including High Speed Ethernet, Layer 4-7 switching, Virtual Machine-aware networking, and Software Defined Networking.
David’s current focus is on the evolving landscape of data center networking, scale out storage, Open Networking, and cloud computing.
OpenStack and Red Hat: How we learned to adapt with our customers in a maturi...OpenStack
Audience Level
All levels
Synopsis
Peter has been involved in OpenStack community since its B-release, and he has been enabling and helping customers across various industries adopt OpenStack in strategic ways. In this session, you will learn from his experience what Red Hat’s perspective is on the current state of affairs in the OpenStack community and the path we see ahead that Red Hat is putting its efforts in. OpenStack is not a product that tries to solve any one business problem in particular, but a technology that aims to be usable for many – what are the required steps to make sure that your organisation is ready for the OpenStack-based cloudification and transformation.
Speaker Bio:
Peter Jung is a Senior Business Development Manager at Red Hat where he leads the practice in the areas of Cloud, SDN/NFV and IoT across Australia and New Zealand. He is passionate about open innovation and open source software development model as the foundation for next generation society and ICT systems. Prior to Red Hat, he had various roles at Cisco and Dell for 15 years. He holds a BSEE and an MBA.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
Enabling OpenStack for Enterprise - Tarso Dos Santos, VeritasOpenStack
Audience Level
All levels
Synopsis
OpenStack offers many advantages for organisations building out their cloud environments, including flexibility and community-driven innovation. However, enterprises looking to deploy OpenStack in production typically find its storage management capabilities wanting from the perspective of management complexity and business resiliency. Enterprises are also challenged when it comes to ensuring protection of their data and providing the necessary performance – especially for their tier one applications. Meeting these fundamental needs is critical for enterprises to proceed confidently with their OpenStack deployments.
Veritas HyperScale for OpenStack is a software-defined storage management solution uniquely developed for OpenStack based clouds. It leverages direct attached storage (DAS) and provides enterprise-strength capabilities that enable robust, production-scale deployment while meeting performance and data protection needs. Learn how this innovative solution, coupled with other relevant Veritas offerings, solve the remaining issues around implementing OpenStack within the enterprise.
Speaker Bio:
Tarso dos Santos works as a Technical Account Manager at Veritas, directly engaging with customers to develop strategies, architectures and solutions with focus on Cloud – Openstack, Containers, Data Protection, High Availability and Compliance.
He has over 21 years in the IT industry architecting, delivering and positioning solutions such as private clouds, distributed systems, hpc, storage, and high available platforms.
Tarso has a great interest in distributed systems performance, and scientific organizations that push the boundaries of existing technologies, but also need to link these into the Enterprise.
Tarso in his life has enjoyed working in some of the most amazing projects ranging from mission critical systems protecting Australian lives, to IT infrastructure projects that are looking at the sky and discovering new planets out in the space.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
OpenStack Networks the Web-Scale Way - Scott Laffer, Cumulus NetworksOpenStack
Audience Level
Beginner
Synopsis
Layer 2 versus Layer 3, MLAG, Spanning-Tree, switch mechanism drivers, overlays and routing-on-the-host — What scales and what does not? The underlying plumbing of an OpenStack network is something you’d rather not have to think about. This presentation examines the network architectures of web-scale and large enterprise OpenStack users and how those same efficiencies can be used in deployments of all sizes.
Speaker Bio:
Scott is a Member of Technical Staff at Cumulus Networks where he designs, supports and deploys web-scale technologies and architectures in enterprise networks globally. Prior to becoming a founding member of the Cumulus office in Australia, Scott started his career as a network administrator before joining Cisco Systems to support their data centre products.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
Andre Paul: Importing VMware infrastructures into CloudStackShapeBlue
The talk will show how the VMware ingestion feature uses existing VMware Zones, and ‘imports’ them into CloudStack. We will describe the process by which database entries of already existing components of an existing virtual machine are created and how it enables CloudStack to safely manage such instances even though they were not initially set up by CloudStack.
This talk will give an introduction on how to use Terraform to deploy CloudStack infrastructure (VMs, Networks, Storage, etc.) using the Terraform cloudstack modules.
Audience Level
Intermediate
Synopsis
In this presentation, Shunde will show you how to simplify the migration process with a workload migration engine, making the move to OpenStack easy. This talk will address the various difficulties operators and administrators face when migrating workloads and resources between various cloud platforms, including removing time consuming, repetitive and complicated steps.
This tool can be applied to many cloud migrations, including between Virtual Machines and OpenStack, between Public and Private clouds, as well as between OpenStack and OpenStack. This tool integrates completely with other OpenStack projects minimising deployment and maintenance efforts. So whether you’re looking to upgrade from your existing traditional virtualisation platform, setup a new OpenStack instance, or upgrade to a newer version of OpenStack, we will show you how to simplify this process using GUTS.
Speaker Bio
Shunde is a senior software developer in Aptira with over 15 years experience in software development, automation and system administration. He has worked with OpenStack since the Diablo cycle and has been involved in projects from OpenStack infrastructure to distributed systems running on top of OpenStack.
Meshing OpenStack and Bare Metal Networks with EVPN - David Iles, Mellanox Te...OpenStack
Audience Level
Intermediate
Synopsis
The latest SDN revolution is centered on creating efficient virtualized data center networks using VXLAN & EVPN. We will talk about the scale, performance, and cost advantages of using a modern controller-free virtualized network solution built on 100 Gigabit Ethernet switches with hardware based VXLAN Routing. We will explore the ease of automating such a network in an OpenStack environment and take you through a real world use case of using OpenStack Network Node bridging between a bare metal cloud (EVPN) and a fully virtualized cloud environments (orchestrated by Neutron).
Speaker Bio:
David has held leadership roles at 3COM, Cisco Systems, Nortel Networks, and IBM where he promoted advanced network technologies including High Speed Ethernet, Layer 4-7 switching, Virtual Machine-aware networking, and Software Defined Networking.
David’s current focus is on the evolving landscape of data center networking, scale out storage, Open Networking, and cloud computing.
OpenStack and Red Hat: How we learned to adapt with our customers in a maturi...OpenStack
Audience Level
All levels
Synopsis
Peter has been involved in OpenStack community since its B-release, and he has been enabling and helping customers across various industries adopt OpenStack in strategic ways. In this session, you will learn from his experience what Red Hat’s perspective is on the current state of affairs in the OpenStack community and the path we see ahead that Red Hat is putting its efforts in. OpenStack is not a product that tries to solve any one business problem in particular, but a technology that aims to be usable for many – what are the required steps to make sure that your organisation is ready for the OpenStack-based cloudification and transformation.
Speaker Bio:
Peter Jung is a Senior Business Development Manager at Red Hat where he leads the practice in the areas of Cloud, SDN/NFV and IoT across Australia and New Zealand. He is passionate about open innovation and open source software development model as the foundation for next generation society and ICT systems. Prior to Red Hat, he had various roles at Cisco and Dell for 15 years. He holds a BSEE and an MBA.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
Enabling OpenStack for Enterprise - Tarso Dos Santos, VeritasOpenStack
Audience Level
All levels
Synopsis
OpenStack offers many advantages for organisations building out their cloud environments, including flexibility and community-driven innovation. However, enterprises looking to deploy OpenStack in production typically find its storage management capabilities wanting from the perspective of management complexity and business resiliency. Enterprises are also challenged when it comes to ensuring protection of their data and providing the necessary performance – especially for their tier one applications. Meeting these fundamental needs is critical for enterprises to proceed confidently with their OpenStack deployments.
Veritas HyperScale for OpenStack is a software-defined storage management solution uniquely developed for OpenStack based clouds. It leverages direct attached storage (DAS) and provides enterprise-strength capabilities that enable robust, production-scale deployment while meeting performance and data protection needs. Learn how this innovative solution, coupled with other relevant Veritas offerings, solve the remaining issues around implementing OpenStack within the enterprise.
Speaker Bio:
Tarso dos Santos works as a Technical Account Manager at Veritas, directly engaging with customers to develop strategies, architectures and solutions with focus on Cloud – Openstack, Containers, Data Protection, High Availability and Compliance.
He has over 21 years in the IT industry architecting, delivering and positioning solutions such as private clouds, distributed systems, hpc, storage, and high available platforms.
Tarso has a great interest in distributed systems performance, and scientific organizations that push the boundaries of existing technologies, but also need to link these into the Enterprise.
Tarso in his life has enjoyed working in some of the most amazing projects ranging from mission critical systems protecting Australian lives, to IT infrastructure projects that are looking at the sky and discovering new planets out in the space.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
OpenStack Networks the Web-Scale Way - Scott Laffer, Cumulus NetworksOpenStack
Audience Level
Beginner
Synopsis
Layer 2 versus Layer 3, MLAG, Spanning-Tree, switch mechanism drivers, overlays and routing-on-the-host — What scales and what does not? The underlying plumbing of an OpenStack network is something you’d rather not have to think about. This presentation examines the network architectures of web-scale and large enterprise OpenStack users and how those same efficiencies can be used in deployments of all sizes.
Speaker Bio:
Scott is a Member of Technical Staff at Cumulus Networks where he designs, supports and deploys web-scale technologies and architectures in enterprise networks globally. Prior to becoming a founding member of the Cumulus office in Australia, Scott started his career as a network administrator before joining Cisco Systems to support their data centre products.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
Andre Paul: Importing VMware infrastructures into CloudStackShapeBlue
The talk will show how the VMware ingestion feature uses existing VMware Zones, and ‘imports’ them into CloudStack. We will describe the process by which database entries of already existing components of an existing virtual machine are created and how it enables CloudStack to safely manage such instances even though they were not initially set up by CloudStack.
This talk will give an introduction on how to use Terraform to deploy CloudStack infrastructure (VMs, Networks, Storage, etc.) using the Terraform cloudstack modules.
Red Hat Ceph Storage: Past, Present and FutureRed_Hat_Storage
Ceph is a massively scalable, open source, software-defined storage system that runs on commodity hardware. Get an update about the latest version of Red Hat Ceph Storage, including information about the newest features and use cases, with a particular focus on cloud storage and OpenStack. We’ll also explore the themes and directions for the roadmap for the next 12 months.
Adam Dagnall: Advanced S3 compatible storage integration in CloudStackShapeBlue
Adam's slides from his talk at the CloudStack European User group meetup, March 13, London. To provide tighter integration between the S3 compatible object store and CloudStack, Cloudian has developed a connector to allow users and their applications to utilize the object store directly from within the CloudStack platform in a single sign-on manner with self-service provisioning. Additionally, CloudStack templates and snapshots are centrally stored within the object store and managed through the CloudStack service. The object store offers protection of these templates and snapshots across data centres using replication or erasure coding.
Introducing QuickStack, a converged cloud solution powered by The Canonical Distribution of Ubuntu OpenStack. QuickStack delivers the fastest and reliable way to build an OpenStack cloud with the verified and thoroughly tested architecture, which dramatically reduces the time and risk associated with your OpenStack cloud projects. With QuickStack, building an OpenStack cloud is no longer complicated, but instead fast and easy
Building a redundant CloudStack management cluster - Vladimir MelnikShapeBlue
Building a redundant CloudStack management cluster. Building and maintaining an open-source-driven clustered environment for Apache CloudStack management server with GNU Linux, HAProxy, HeartBeat, Bind, OpenLDAP and other tools.
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatOpenStack
Audience: Intermediate
About: Learn how cloud storage differs to traditional storage systems and how that delivers revolutionary benefits.
Starting with an overview of how Ceph integrates tightly into OpenStack, you’ll see why 62% of OpenStack users choose Ceph, we’ll then take a peek into the very near future to see how rapidly Ceph is advancing and how you’ll be able to achieve all your childhood hopes and dreams in ways you never thought possible.
Speaker Bio: Andrew Hatfield – Practice Lead–Cloud Storage and Big Data, Red Hat
Andrew has over 20 years experience in the IT industry across APAC, specialising in Databases, Directory Systems, Groupware, Virtualisation and Storage for Enterprise and Government organisations. When not helping customers slash costs and increase agility by moving to the software-defined storage future, he’s enjoying the subtle tones of Islay Whisky and shredding pow pow on the world’s best snowboard resorts.
OpenStack Australia Day - Sydney 2016
https://events.aptira.com/openstack-australia-day-sydney-2016/
Introduction to Container Storage Interface (CSI)Idan Atias
Among the cool stuff we do at Silk, my colleagues and I develop the Silk CSI Plugin for customers who use our system as the storage layer for their Kubernetes workloads.
Before deep diving into the code and as part of my ramp-up on this subject I prepared some slides that cover some basic and important information on this topic.
These slides start by recapping some basic storage principals in containers and Kubernetes, continues with some more advanced use cases (including an "offline demo" of persisting Redis data on EBS volumes), and ends with a detailed information on the CSI solution itself.
IMHO, reviewing these slides can improve your understanding on this matter and can get you started implementing your own CSI plugin.
The main sources of information I used for preparing these slides are:
* Official CSI docs
* Kubernetes Storage Lingo 101 - Saad Ali, Google
* Container Storage Interface: Present and Future - Jie Yu, Mesosphere, Inc.
The Microsoft cloud ecosystem evolved considerably in recent years to interoperate with a wide range of open source technologies, including hardware (Open Compute), cloud software platforms (OpenStack), networking (Open vSwitch, OpenDaylight) and orchestration (Juju, Heat).
During this session we will show how to deploy in no time an entire OpenStack cloud based on Microsoft Hyper-V using MaaS and Juju. Networking is going to be based on Open vSwitch, which brings OVSDB and VXLAN to Hyper-V, allowing full interoperability with KVM and other hypervisors.
To conclude, we are going to orchestrate with Juju on top of our OpenStack cloud some of the most common Microsoft workloads, including Active Directory, IIS, SQL Server, SharePoint and Exchange, side by side with open source applications.
Paul Angus - CloudStack Container ServiceShapeBlue
A walkthrough of the recently released update to ShapeBlue’s CloudStack Container Service (CCS). This update brings CCS bang up-to-date by running the latest version of Kubernetes (v1.11.3) on the latest version of Container Linux. CCS also now makes use of CloudStack’s new CA framework to automatically secure the Kubernetes environments it creates.
Red Hat Ceph Storage: Past, Present and FutureRed_Hat_Storage
Ceph is a massively scalable, open source, software-defined storage system that runs on commodity hardware. Get an update about the latest version of Red Hat Ceph Storage, including information about the newest features and use cases, with a particular focus on cloud storage and OpenStack. We’ll also explore the themes and directions for the roadmap for the next 12 months.
Adam Dagnall: Advanced S3 compatible storage integration in CloudStackShapeBlue
Adam's slides from his talk at the CloudStack European User group meetup, March 13, London. To provide tighter integration between the S3 compatible object store and CloudStack, Cloudian has developed a connector to allow users and their applications to utilize the object store directly from within the CloudStack platform in a single sign-on manner with self-service provisioning. Additionally, CloudStack templates and snapshots are centrally stored within the object store and managed through the CloudStack service. The object store offers protection of these templates and snapshots across data centres using replication or erasure coding.
Introducing QuickStack, a converged cloud solution powered by The Canonical Distribution of Ubuntu OpenStack. QuickStack delivers the fastest and reliable way to build an OpenStack cloud with the verified and thoroughly tested architecture, which dramatically reduces the time and risk associated with your OpenStack cloud projects. With QuickStack, building an OpenStack cloud is no longer complicated, but instead fast and easy
Building a redundant CloudStack management cluster - Vladimir MelnikShapeBlue
Building a redundant CloudStack management cluster. Building and maintaining an open-source-driven clustered environment for Apache CloudStack management server with GNU Linux, HAProxy, HeartBeat, Bind, OpenLDAP and other tools.
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatOpenStack
Audience: Intermediate
About: Learn how cloud storage differs to traditional storage systems and how that delivers revolutionary benefits.
Starting with an overview of how Ceph integrates tightly into OpenStack, you’ll see why 62% of OpenStack users choose Ceph, we’ll then take a peek into the very near future to see how rapidly Ceph is advancing and how you’ll be able to achieve all your childhood hopes and dreams in ways you never thought possible.
Speaker Bio: Andrew Hatfield – Practice Lead–Cloud Storage and Big Data, Red Hat
Andrew has over 20 years experience in the IT industry across APAC, specialising in Databases, Directory Systems, Groupware, Virtualisation and Storage for Enterprise and Government organisations. When not helping customers slash costs and increase agility by moving to the software-defined storage future, he’s enjoying the subtle tones of Islay Whisky and shredding pow pow on the world’s best snowboard resorts.
OpenStack Australia Day - Sydney 2016
https://events.aptira.com/openstack-australia-day-sydney-2016/
Introduction to Container Storage Interface (CSI)Idan Atias
Among the cool stuff we do at Silk, my colleagues and I develop the Silk CSI Plugin for customers who use our system as the storage layer for their Kubernetes workloads.
Before deep diving into the code and as part of my ramp-up on this subject I prepared some slides that cover some basic and important information on this topic.
These slides start by recapping some basic storage principals in containers and Kubernetes, continues with some more advanced use cases (including an "offline demo" of persisting Redis data on EBS volumes), and ends with a detailed information on the CSI solution itself.
IMHO, reviewing these slides can improve your understanding on this matter and can get you started implementing your own CSI plugin.
The main sources of information I used for preparing these slides are:
* Official CSI docs
* Kubernetes Storage Lingo 101 - Saad Ali, Google
* Container Storage Interface: Present and Future - Jie Yu, Mesosphere, Inc.
The Microsoft cloud ecosystem evolved considerably in recent years to interoperate with a wide range of open source technologies, including hardware (Open Compute), cloud software platforms (OpenStack), networking (Open vSwitch, OpenDaylight) and orchestration (Juju, Heat).
During this session we will show how to deploy in no time an entire OpenStack cloud based on Microsoft Hyper-V using MaaS and Juju. Networking is going to be based on Open vSwitch, which brings OVSDB and VXLAN to Hyper-V, allowing full interoperability with KVM and other hypervisors.
To conclude, we are going to orchestrate with Juju on top of our OpenStack cloud some of the most common Microsoft workloads, including Active Directory, IIS, SQL Server, SharePoint and Exchange, side by side with open source applications.
Paul Angus - CloudStack Container ServiceShapeBlue
A walkthrough of the recently released update to ShapeBlue’s CloudStack Container Service (CCS). This update brings CCS bang up-to-date by running the latest version of Kubernetes (v1.11.3) on the latest version of Container Linux. CCS also now makes use of CloudStack’s new CA framework to automatically secure the Kubernetes environments it creates.
Red Hat multi-cluster management & what's new in OpenShiftKangaroot
More and more organisations are not only using container platforms but starting to run multiple clusters of containers. And with that comes new headaches of maintaining, securing, and updating those multiple clusters. In this session we'll look into how Red Hat has solved multi-cluster management, covering cluster lifecycle, app lifecycle, and governance/risk/compliance.
Open cloud infrastructure built for the enterpriseRedHatInc
Learn about Red Hat Enterprise Linux OpenStack Platform and how it fits in Red Hat's cloud strategy, and also see how Red Hat is partnering with NetApp to deliver OpenStack-based cloud solutions for our enterprise customers.
Introduction to HPC & Supercomputing in AITyrone Systems
Catch up with our live webinar on Natural Language Processing! Learn about how it works and how it applies to you. We have provided all the information in our video recording you would not miss out on.
Watch the Natural Language Processing webinar here!
Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy
n this talk we will address how we developed our Cassandra environments utilizing Cisco UCS Open Stack Platform with the DataStax Enterprise Edition software. In addition we are utilizing OpenSource CEPH storage in our Infrastructure to optimize the Performance and reduce the costs.
HPC and cloud distributed computing, as a journeyPeter Clapham
Introducing an internal cloud brings new paradigms, tools and infrastructure management. When placed alongside traditional HPC the new opportunities are significant But getting to the new world with micro-services, autoscaling and autodialing is a journey that cannot be achieved in a single step.
Fórum E-Commerce Brasil | Tecnologias NVIDIA aplicadas ao e-commerce. Muito a...E-Commerce Brasil
Tecnologias NVIDIA aplicadas ao e-commerce. Muito além do hardware.
Jomar Silva
Gerente de relacionamento com desenvolvedores para a América Latina - NVIDIA
https://eventos.ecommercebrasil.com.br/forum/
New Ceph capabilities and Reference ArchitecturesKamesh Pemmaraju
Have you heard about Inktank Ceph and are interested to learn some tips and tricks for getting started quickly and efficiently with Ceph? Then this is the session for you!
In this two part session you learn details of:
• the very latest enhancements and capabilities delivered in Inktank Ceph Enterprise such as a new erasure coded storage back-end, support for tiering, and the introduction of user quotas.
• best practices, lessons learned and architecture considerations founded in real customer deployments of Dell and Inktank Ceph solutions that will help accelerate your Ceph deployment.
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?Red_Hat_Storage
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About? By: Kamesh Pemmaraju,Neil Levine
Have you heard about Inktank Ceph and are interested to learn some tips and tricks for getting started quickly and efficiently with Ceph? Then this is the session for you! In this two part session you learn details of: • the very latest enhancements and capabilities delivered in Inktank Ceph Enterprise such as a new erasure coded storage back-end, support for tiering, and the introduction of user quotas. • best practices, lessons learned and architecture considerations founded in real customer deployments of Dell and Inktank Ceph solutions that will help accelerate your Ceph deployment.
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc
Webinar Session - https://youtu.be/_5MfGMf8PG4
In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance.
We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.
Hadoop Summit San Jose 2015: What it Takes to Run Hadoop at Scale Yahoo Persp...Sumeet Singh
Since 2006, Hadoop and its ecosystem components have evolved into a platform that Yahoo has begun to trust for running its businesses globally. In this talk, we will take a broad look at some of the top software, hardware, and services considerations that have gone in to make the platform indispensable for nearly 1,000 active developers, including the challenges that come from scale, security and multi-tenancy. We will cover the current technology stack that we have built or assembled, infrastructure elements such as configurations, deployment models, and network, and and what it takes to offer hosted Hadoop services to a large customer base.
Similar to Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash University (20)
Swinburne University of Technology - Shunde Zhang & Kieran Spear, AptiraOpenStack
We recently teamed up with our good friends at SUSE to build a very high-performing and scalable storage landscape at a fraction of the cost than with traditional storage systems for the Swinburne University of Technology.
The challenge that the IT team at Swinburne were facing is how to accommodate the ever-growing need for performance and capacity while sticking to a tight budget. With SUSE Enterprise Storage we have been able to deploy a compelling and affordable solution to support Swinburne’s storage needs. Their new storage platform is fast and flexible, meaning the IT team at Swinburne can support the needs of researchers more effectively.
https://aptira.com/swinburne-university-technology/
Related OSS Projects - Peter Rowe, Flexera SoftwareOpenStack
Audience Level
Intermediate
Synopsis
Today’s fast-paced development environment has changed the compliance landscape. Many software projects consist of more than 50% Open Source Software (OSS) components, but as much as 99% are undocumented, increasing the complexities of managing your company’s software compliance process.
Of particular concern is “Zombie software”, or software that is outdated and contains vulnerable versions of certain components. Zombies can live in your code forever if you’re not aware of them. The acceleration of modern development lifecycles and the breakdown of an undocumented software supply chain have opened up new pathways for zombies to enter your software – leaving you exposed to security threats.
This presentation discusses best practices for implementing an Open Source Software management strategy that covers common pitfalls and commercial licence issues as well as the optimal way to track and eliminate the risks associated with Zombies!
Speaker Bio:
Involved in and around IT development for over 20 years, starting as a web developer using NotePad in 1995 when the most exciting thing online was Sun’s animated Java coffee cup, through Numega Pre-Sales selling BoundsChecker and now into the brave, new World of Open Source and software composition analysis.
Supercomputing by API: Connecting Modern Web Apps to HPCOpenStack
Audience Level
Intermediate
Synopsis
The traditional user experience for High Performance Computing (HPC) centers around the command line, and the intricacies of the underlying hardware. At the same time, scientific software is moving towards the cloud, leveraging modern web-based frameworks, allowing rapid iteration, and a renewed focus on portability and reproducibility. This software still has need for the huge scale and specialist capabilities of HPC, but leveraging these resources is hampered by variation in implementation between facilities. Differences in software stack, scheduling systems and authentication all get in the way of developers who would rather focus on the research problem at hand. This presentation reviews efforts to overcome these barriers. We will cover container technologies, frameworks for programmatic HPC access, and RESTful APIs that can deliver this as a hosted solution.
Speaker Bio
Dr. David Perry is Compute Integration Specialist at The University of Melbourne, working to increase research productivity using cloud and HPC. David chairs Australia’s first community-owned wind farm, Hepburn Wind, and is co-founder/CTO of BoomPower, delivering simpler solar and battery purchasing decisions for consumers and NGOs.
Federation and Interoperability in the Nectar Research CloudOpenStack
Audience Level
Beginner
Synopsis
The Nectar Research Cloud provides an OpenStack cloud for Australia’s academic researchers. Since its inception in 2012 it has grown steadily to over 30,000 CPUs, with over 10,000 registered users from more than 50 research institutions. It is different to many clouds in being a federation across eight organisations, each of which runs cloud infrastructure in one or more data centres and contributes to a distributed help desk and user support. A Nectar core services team runs centralised cloud services. This presentation will give an overview of the experiences, challenges and benefits of running a federated OpenStack cloud and a short demonstration on using the Nectar cloud. We will also describe some current approaches that are looking to extend this federation to encompass other institutions including some in New Zealand, to extend the infrastructure using commercial cloud providers, and to move towards interoperability with the growing number of international science and research clouds through the new Open Research Cloud initiative.
Speaker Bio
Dr Paul Coddington is a Deputy Director of Nectar, responsible for the Nectar national Research Cloud, and also Deputy Director of eResearch SA. He has over 30 years experience in eResearch including computational science, high performance and distributed computing, cloud computing, software development, and research data management.
I am text block. Click edit button to change this text. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatOpenStack
Audience Level
Intermediate
Synopsis
Hypercoverged Compute, Network and Storage is ready for production workloads – where it makes sense.
Whether you’re a telecommunications carrier, service provider or enterprise; implementing Network Function Virtualisation (NFV), focusing on specific known workloads or simply a dev / test cloud – deploying a hypercoverged OpenStack cloud makes a lot of sense.
Come along and discover which workloads fit a hyperconverged architecture, see examples and look into the very near future and learn how OpenStack is truly ready to serve your every need.
Speaker Bio
Andrew has over 20 years experience in the IT industry across APAC, specialising in Databases, Directory Systems, Groupware, Virtualisation and Storage for Enterprise and Government organisations. When not helping customers slash costs and increase agility by moving to the software-defined future, he’s enjoying the subtle tones of Islay Whisky and shredding pow pow on the world’s best snowboard resorts.
Migrating your infrastructure to OpenStack - Avi Miller, OracleOpenStack
Audience Level
Beginner
Synopsis
Migrating is never simple, but migrating from a traditional infrastructure to a private cloud infrastructure adds a whole new layer of complexity and raises a number of questions for IT decision makers. Come learn first hand how to begin to migrate your traditional infrastructure management tools and processes to OpenStack.
This session will provide details on common questions and answers to help administrators avoid costly mistakes. Learn what to look out for, what to avoid, how to identify risks and how to mitigate them.
Speaker Bio:
Avi is an accomplished technical product manager with extensive experience across the operating system, virtualisation and application stacks.
A glimpse into an industry Cloud using Open Source Technologies - Adrian Koh,...OpenStack
Audience Level
All levels
Synopsis
Often times, prospects and existing OpenStack users wonder if there is indeed strong business and technical value proposition for cloud platforms serving a specific industry vertical.
In this session, EasyStack would like to share with the participants our experience engaging with an industry leader to build a credible solution platform catering to their current and future business and technology roadmap.
Speaker Bio:
Adrian is Director Global Business Development in EasyStack and has 20 years working experience in leading tech companies in the IT industry.
Prior to joining EasyStack, Adrian was with IBM Singapore and IBM China and served in roles such as Offering Manager, Engagement Manager, Solution Architect, Services Consultant, IT Specialist.
Adrian holds a Bachelor of Science degree with honors in Computer Sciences from University of Texas at Austin.
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSEOpenStack
Audience Level
Intermediate
Synopsis
Ceph – the most popular storage solution for OpenStack – stores all data as a collection of objects. This object store was originally implemented on top of a POSIX filesystem, an approach that turned out to have a number of problems, notably with performance and complexity.
BlueStore, a new storage backend for Ceph, was created to solve these issues; the Ceph Jewel release included an early prototype. The code and on-disk format were declared stable (but experimental) for Ceph Kraken, and now in the upcoming Ceph Luminous release, BlueStore will be the recommended default storage backend.
With a 2-3x performance boost, you’ll want to look at migrating your Ceph clusters to BlueStore. This talk goes into detail about what BlueStore does, the problems it solves, and what you need to do to use it.
Speaker Bio:
Tim works for SUSE, hacking on Ceph and related technologies. He has spoken often about distributed storage and high availability at conferences such as linux.conf.au. In his spare time he wrangles pigs, chickens, sheep and ducks, and was declared by one colleague “teammate most likely to survive the zombie apocalypse”.
Diving in the desert: A quick overview into OpenStack Sahara capabilities - A...OpenStack
Audience Level
Intermediate
Synopsis
Data Analytics is a hot topic today for most organisations as they race to convert vast amounts of data into useful information that can be leveraged to make critical decisions or recommendations in a very limited time window.
Today, there is a widely accepted talent gap when it comes to creating and managing Hadoop Clusters. Even for the experts can take hours (or days) to get a fully functional Hadoop farm up and running.
On top of that it can be difficult to find java programmers that have enough experience to be productive with Map Reduce.
OpenStack Sahara is looking to address most of this challenges by facilitating the deployment of Hadoop clusters and provide a set of API to provide data processing tasks.
This session will provide an insight into OpenStack Sahara capabilities and how the end users can leverage on it.
Speaker Bio:
Alex has been working with Open Source enterprise technologies for the better part of his 15 years IT career in companies like Hewlett-Packard Enterprise, Red Hat, IBM and Sun Microsystems.
He started his OpenStack journey with Grizzly, delivering the first HPC cloud in APAC for a Singapore University making use of SRIOV technologies combined with big data. He has extensive deployment experience on configuration management and automation of private cloud based on OpenStack.
Alex is currently an APJ Cloud Consultant in the Helion Cloud team at Hewlett-Packard Enterprise, where he evangelizes the OpenSource side of the Helion portfolio (OpenStack / Docker / Ceph).
He enjoys running automation workshops and seminars in the APJ region for cloud adopters.
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...OpenStack
Audience Level
Intermediate
Synopsis
High performance computing and cloud computing have traditionally been seen as separate solutions to separate problems, dealing with issues of performance and flexibility respectively. In a diverse research environment however, both sets of compute requirements can occur. In addition to the administrative benefits in combining both requirements into a single unified system, opportunities are provided for incremental expansion.
The deployment of the Spartan cloud-HPC hybrid system at the University of Melbourne last year is an example of such a design. Despite its small size, it has attracted international attention due to its design features. This presentation, in addition to providing a grounding on why one would wish to build an HPC-cloud hybrid system and the results of the deployment, provides a complete technical overview of the design from the ground up, as well as problems encountered and planned future developments.
Speaker Bio
Lev Lafayette is the HPC and Training Officer at the University of Melbourne. Prior to that he worked at the Victorian Partnership for Advanced Computing for several years in a similar role.
Audience Level
All levels
Synopsis
Our journey towards solving our Application and Infrastructure Problems using Immutability, Codification, Mesos, Docker and Ironic.
OpenStack Australia Day Melbourne 2017
https://events.aptira.com/openstack-australia-day-melbourne-2017/
Traditional Enterprise to OpenStack Cloud - An Unexpected JourneyOpenStack
Audience Level
Intermediate
Synopsis
Hostworks is a part of the Inabox group and an Australian based Managed Hosting and Services Provider with a strong background in management of infrastructure, servers, and applications following Traditional Enterprise management practices. 2 years ago, we began our transition to adopt and deploy cloud technologies and mindsets with an on On-Premises OpenStack platform as part of a larger hybrid cloud offering. This presentation details how we did it, what went wrong, and what went right, important lessons and recommendations for other businesses who wish to follow the same path.
Speaker Bio:
Daniel is Platform Engineer at Hostworks and specialises in their On-Premises OpenStack cloud offering.
Building a GPU-enabled OpenStack Cloud for HPC - Lance Wilson, Monash UniversityOpenStack
Audience Level
Intermediate
Synopsis
M3 is the latest generation system of the MASSIVE project, an HPC facility specializing in characterization science (imaging and visualization). Using OpenStack as the compute provisioning layer, M3 is a hybrid HPC/cloud system, custom-integrated by Monash’s R@CMon Research Cloud team. Built to support Monash University’s next-gen high-throughput instrument processing requirements, M3 is half-half GPU-accelerated and CPU-only.
We’ll discuss the design and tech used to build this innovative platform as well as detailing approaches and challenges to building GPU-enabled and HPC clouds. We’ll also discuss some of the software and processing pipelines that this system supports and highlight the importance of tuning for these workloads.
Speaker Bio
Blair Bethwaite: Blair has worked in distributed computing at Monash University for 10 years, with OpenStack for half of that. Having served as team lead, architect, administrator, user, researcher, and occasional hacker, Blair’s unique perspective as a science power-user, developer, and system architect has helped guide the evolution of the research computing engine central to Monash’s 21st Century Microscope.
Lance Wilson: Lance is a mechanical engineer, who has been making tools to break things for the last 20 years. His career has moved through a number of engineering subdisciplines from manufacturing to bioengineering. Now he supports the national characterisation research community in Melbourne, Australia using OpenStack to create HPC systems solving problems too large for your laptop.
Monitoring Uptime on the NeCTAR Research Cloud - Andy Botting, University of ...OpenStack
Audience Level
Intermediate
Synopsis
We will discuss how we do monitoring on the Nectar research cloud, utilising tools like OpenStack tempest, Nagios and translating this into a user facing dashboard.
Speaker Bio:
Andy is a DevOps engineer working at the University of Melbourne in the Core Services team for the Nectar Research Cloud.
Containers and OpenStack: Marc Van Hoof, Kumulus: Containers and OpenStackOpenStack
Containers and OpenStack
Audience: Intermediate
Topic: Infrastructure
Abstract: Containers are the new darling of the development world, and many are calling for an end of the IaaS world. But there are still key reasons that IaaS is important even as Container based development becomes the desired path for the development community. We will review containers in the context of their growth in popularity, and look at how OpenStack both continues to support and enable Container solutions, and the latest developments in OpenStack as a containerized solution directly.
Speaker Bio: Marc Van Hoof, Kumulus
Marc van Hoof has been in the technology industry for over 20 years, focused on developing, deploying, and scaling internet applications. He was part of a team that built the first internet data centre in Australia, has worked on some of the largest online real-time events, and advises companies on how to take advantage of the true benefits of migrating to the cloud.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
Moving to Cloud for Good: Alexander Tsirel, HiveTecOpenStack
Moving to Cloud for Good.
Audience: Intermediate
Topic: User Stories
Abstract: Chase to be compliant when you work with gov systems.
– Planning your move from traditional infrastructure to cloud.
– Rolling out CoreOs and Windows in the cloud as a part of infrastructure. Tough journey.
– Security in Openstack. How we passed IRAP assessment to ISM. Always hard to explain why software replace hardware.
– Swift. Good and bad parts.
– When to complain about OpenStack or Infrastructure.
Speaker Bio: Alexander Tsirel, HiveTec
Senior Developer/Devops in HiveTec. Moved from Estonia to join a huge project about building software deeply integrated with government Employment Services. Specialising in infrastructure architecting, cloud automation, continuous integration.
Working on infrastructure scaling for resource-hungry applications grid bundling docker, windows server, swift in one in our mission critical system.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
We Are OpenStack: David F. Flanders & Tom Fifield, OpenStack FoundationOpenStack
Audience: All levels
Topic: OpenStack Keynote
Abstract: Fresh from the OpenStack Summit in Barcelona, David and Tom will conduct an interactive QA session, discuss several hot industry topics, including:
Containers and OpenStack being the fastest way for Enterprise to get their hands on them for testing.
Security and OpenStack being the leading cloud for this capability as per Linux award.
Multi-cloud and forthcoming cross-cloud applications.
To support these high level themes David and Tom will look to highlight two case studies:
The UK Tax office using OpenStack for all tax payments, and The Australian Federal Gov’t investment in the NeCTAR cloud.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
Big Data and OpenStack, a Love Story: Michael Still, RackspaceOpenStack
Big Data and OpenStack, a Love Story
Audience: Intermediate
Topic: Storage
Abstract: Increasingly we’re being asked to build out clusters of machines to solve big data problems. These clusters can become quite large, reaching up to thousands of machines. Of course, our operational budgets don’t scale linearly like our machine counts do, and we’re asked to do more and more with less. This talk will explore how organisations around the world are using OpenStack to automate the management of their big data implementations, harnessing interesting characteristics of big data workloads along the way.
Speaker Bio: Michael Still, Rackspace
OpenStack core developer and former Nova PTL, as well as experienced software and reliability engineer. Part of the team that grew Google Mobile to being a billion dollar business. Director of linux.conf.au 2013. Author of The Definitive Guide to ImageMagick (www.imagemagickbook.com) and Practical MythTV (www.mythtvbook.com) from Apress, as well as a bunch of articles.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
How to deliver High Performance OpenStack Cloud: Christoph Dwertmann, Vault S...OpenStack
Securing Openstack in Line with the Government ISM and PSPF controls and how to deliver High Performance OpenStack Cloud to address Government Legacy Systems
Audience: Intermediate/Advanced
Topic: Security, Infrastructure, Performance
Abstract: As the CTO of Vault Systems, Christoph will take us through the challenges of implementing ASD’s ISM controls within Vault’s OpenStack cloud to create a Protected Certified OpenStack Platform and give a technical account of some of the optimizations he has done around Ceph on NVMe Storage to deliver High Performance Storage.
Speaker Bio: Christoph Dwertmann, Vault Systems
Christoph is a full stack engineer with four years of experience in deploying and securing Openstack. Fully automated software deployment and self-healing microservice containers are amongst his current interests. As the CTO of Vault Systems he recently deployed the world’s first pure NVMe Ceph cluster into production. From his previous work in network research for the National Science Foundation (NSF) he gathered in-depth knowledge spanning software-defined networks across continents.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
Crowbar and OpenStack: Steve Kowalik, SUSEOpenStack
Crowbar and OpenStack
Audience: Intermediate
Topic: Operations
Abstract: One of the greatest challenges in implementing OpenStack is the complexity in deploying and maintaining all of its many components on what can be a wide range of different hardware platforms. To mitigate this problem, SUSE has developed Crowbar, an open source deployment tool that has led to SUSE winning the “Rule the Stack” deployment competition every time it has been run.
This presentation will take you through the basics of Crowbar as well as a demonstration of some of its features.
Speaker Bio: Steven Kowalik, SUSE
Steven Kowalik is a Sydney-based open source developer with over two decades experience contributing to major projects, including over 15 years with Debian GNU/Linux, as well as significant involvement with upstream OpenStack.
Steven is currently a senior developer at SUSE, working on primarily on SUSE OpenStack Cloud and related projects.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
2. Monash eResearch Centre:
Enabling and Accelerating 21st Century Discovery through the
application of advanced computing, data informatics, tools and
infrastructure, delivered at scale, and built by with “co-design”
principle (researcher + technologist)
3. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
• UniMelb, as lead agent for Nectar, established first Node/site of the
Research Cloud in Jan 2012 and opened doors to the research
community
• Now seven Nodes (10+ DCs) and >40k cores around Australia
• Nectar established an OpenStack ecosystem for research computing in
Australia
• M3 built as first service in a new “monash-03” zone of the Research
Cloud focusing on HPC (computing) & HPDA (data-analytics)
4. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
5. HPC
150 active projects
1000+ user accounts
100+ institutions across Australia
Interactive Vis
600+ users
Multi-modal Australian ScienceS Imaging and Visualisation Environment
Specialised Facility for Imaging and Visualisation
MASSIVE
Instrument
Integration
Integrating with key Australian
Instrument Facilities.
– IMBL, XFM
– CryoEM
– MBI
– NCRIS: NIF, AMMRF
Large cohort of
researchers new to
HPC
~$2M per year funded by
partners and national
project funding
Partners
Monash University
Australian Synchrotron
CSIRO
Affiliate Partners
ARC Centre of Excellence in
Integrative Brain Function
ARC Centre of Excellence in
Advanced Molecular Imaging
6. M3 at Monash University
(including recent upgrade)
A Computer for
Next-Generation Data Science
2100 Intel Haswell CPU-cores
560 Intel Broadwell CPU-cores
NVIDIA GPU coprocessors for data processing and
visualisation:
• 48 NVIDIA Tesla K80
• 40 NVIDIA Pascal P100 (16GB PCIe) (upgrade)
• 8 NVIDIA Grid K1 (32 individual GPUs) for medium
and low end visualisation
A 1.15 petabyte Lustre parallel file system
100 Gb/s Ethernet Mellanox Spectrum
Supplied by Dell, Mellanox and NVIDIA
M3
Steve Oberlin, Chief Technology Officer
Accelerated Computing, NVIDIA
Alan Finkel
Australia’s Chief Scientist
7. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
www.openstack.org/science
openstack.org
The Crossroads of Cloud
and HPC: OpenStack
for Scientific Research
Exploring OpenStack cloud
computing for scientific workloads
8. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
Why OpenStack
‣Heterogeneous user requirements
‣same underlying infrastructure can be expanded to
accommodate multiple distinct and dynamic clusters (e.g.
bioinformatics focused, Hadoop)
‣Clusters need provisioning systems anyway
‣Forcing the cluster to be cloud-provisioning and managed makes it
easier to leverage other cloud resources e.g. community science
cloud, commercial cloud
‣OpenStack is a big focus of innovation and effort in the industry -
benefits of association and osmosis
‣Business function boundaries at the APIs
?
9. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
Key tuning for HPC
‣ With hardware features & software tuning this
is very much possible and performance is
almost native
‣ CPU host-model / host-passthrough
‣ Expose host CPU and NUMA cell topology
‣ Pin virtual cores to physical cores
‣ Pin virtual memory to physical memory
‣ Back guest memory with hugepages
‣ Disable kernel consolidation features
‣ Remove host network overheads for high-
performance data
http://frankdenneman.nl/2015/02/27/memory-deep-dive-numa-data-locality/
10. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
https://www.mellanox.com/related-docs/whitepapers/WP_Solving_IO_Bottlenecks.pdf
11. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
M3 HPFS Integration
• special flavors for cluster
instances which specify a PCI
passthrough SRIOV vNIC
• hypervisor has NICs with VFs
tied to data VLAN(s)
• data VLAN is RDMA capable so
e.g. Lustre can use o2ib LNET
driver
12. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
HPC-Cloud Interconnect
…
13. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
M3 Compute Performance
Snapshot
• Early system and virtualisation tuning on an m3d node
• Hardware & hypervisor:
• Dell R730, 2x E5-2680 v3 (2x 12 cores, HT off), 256GB RAM, 2x NVIDIA K80 cards,
Mellanox CX-4 50GbE DP
• Ubuntu Trusty host with Xenial kernel (4.4) and Mitaka Ubuntu Cloud archive hypervisor
(QEMU 2.5 + KVM)
• (Kernel samepage merging and transparent huge pages disabled to avoid performance
noise)
• Guest:
• M3 large GPU compute flavor (m3d) - 24 cores, 240GB RAM, 4x K80 GPUs, 1x Mellanox
CX-4 Virtual Function
• CentOS7 guest (3.10 kernel) running High Performance Linpack and Intel Optimised Linpack
14. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
15. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
16. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
So, all 👍 ?
• Early user on-boarding hit some speed bumps with inconsistent to poor performance on particular codes/
workloads, e.g., slower than legacy clusters
• Initial tuning did not include hugepages because…
• Couldn’t start 240GB RAM guests backed by static hugepages - initial memory allocation in KVM is
single threaded and takes longer than 30 secs after which libvirt gives up and shoots guest
• enabled transparent hugepages (THP) for large memory guests, configured 1G static hugepages for
everything else and repeated tests for all hosts to ensure no “bad” nodes
• benchmarks from m3a nodes:
• Dell C6320, 2x E5-2680 v3 (2x 12 cores, HT off), 128GB RAM, Mellanox CX-4 Lx 25GbE DP
• Ubuntu Trusty host with Xenial kernel (4.4) and Mitaka Ubuntu Cloud archive hypervisor (QEMU
2.5 + KVM)
• M3 standard compute flavor (m3a) - 24 cores, 120GB RAM, 1x Mellanox CX-4 Lx Virtual Function
• CentOS7 guest (3.10 kernel) running High Performance Linpack
19. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU-accelerated OpenStack Instances
How-to?
1. Confirm hardware capability
• IOMMU - Intel VT-d, AMD-Vi (common in contemporary servers)
• GPU support
• https://etherpad.openstack.org/p/GPU-passthrough-model-
success-failure
2. Prep nova-compute hosts/hypervisors
3. Configure OpenStack nova-scheduler
4. Create GPU flavor
20. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU-accelerated OpenStack Instances
1. Confirm hardware capability
2. Prep compute hosts/hypervisors
1. ensure IOMMU is enabled in BIOS
2. enable IOMMU in Linux, e.g., for Intel:
3. ensure no other drivers/modules claim GPUs, e.g., blacklist
nouveau
4. Configure nova-compute.conf pci_passthrough_whitelist:
# in /etc/default/grub:
GRUB_CMDLINE_LINUX_DEFAULT="quiet splash intel_iommu=on iommu=pt rd.modules-
load=vfio-pci”
~$ update-grub
~$ lspci -nn | grep NVIDIA
03:00.0 3D controller [0302]: NVIDIA Corporation Device [10de:15f8] (rev a1)
82:00.0 3D controller [0302]: NVIDIA Corporation Device [10de:15f8] (rev a1)
# in /etc/nova/nova.conf:
pci_passthrough_whitelist=[{"vendor_id":"10de", "product_id":"15f8"}]
21. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU-accelerated OpenStack Instances
1. Confirm hardware capability
2. Prep compute hosts/hypervisors
3. Configure OpenStack nova-scheduler
1. On nova-scheduler / cloud-controllers
# in /etc/nova/nova.conf:
pci_alias={"vendor_id":"10de", "product_id":"15f8", "name":"P100"}
scheduler_driver=nova.scheduler.filter_scheduler.FilterScheduler
scheduler_available_filters=nova.scheduler.filters.all_filters
scheduler_available_filters=nova.scheduler.filters.pci_passthrough_filter
.PciPassthroughFilter
scheduler_default_filters=RamFilter,ComputeFilter,AvailabilityZoneFilter,
ComputeCapabilitiesFilter,ImagePropertiesFilter,PciPassthroughFilter
22. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU-accelerated OpenStack Instances
1. Confirm hardware capability
2. Prep compute hosts/hypervisors
3. Configure OpenStack nova-scheduler
4. Create GPU flavor
~$ openstack flavor create --ram 122880 --disk 30
--vcpus 24 mon.m3.c24r120.2gpu-p100.mlx
~$ openstack flavor set mon.m3.c24r120.2gpu-p100.mlx
--property pci_passthrough:alias='P100:2'
23. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU-accelerated OpenStack Instances
~$ openstack flavor show 56cd053c-b6a2-4103-b870-a83dd5d27ec1
+----------------------------+--------------------------------------------+
| Field | Value |
+----------------------------+--------------------------------------------+
| OS-FLV-DISABLED:disabled | False |
| OS-FLV-EXT-DATA:ephemeral | 1000 |
| disk | 30 |
| id | 56cd053c-b6a2-4103-b870-a83dd5d27ec1 |
| name | mon.m3.c24r120.2gpu-p100.mlx |
| os-flavor-access:is_public | False |
| properties | pci_passthrough:alias='P100:2,MlxCX4-VF:1' |
| ram | 122880 |
| rxtx_factor | 1.0 |
| swap | |
| vcpus | 24 |
+----------------------------+--------------------------------------------+
~$ openstack server list --all-projects --project d99… --flavor 56c…
+--------------------------------------+------------+--------+----------------------------------+
| ID | Name | Status | Networks |
+--------------------------------------+------------+--------+----------------------------------+
| 1d77bf12-0099-4580-bf6f-36c42225f2c0 | massive003 | ACTIVE | monash-03-internal=10.16.201.20 |
+--------------------------------------+------------+--------+----------------------------------+
24. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU Instances - rough edges
• Hardware monitoring
• No OOB interface to monitor GPU hardware when it is assigned to
an instance (and doing so would require loading drivers in the host)
• P2P (peer-to-peer multi-GPU)
• PCIe topology not available in default guest configuration (not even
a PCIe bus on legacy QEMU i440fx machine type)
• PCIe ACS (Access Control Services - forces transactions through
the Root Complex which blocks/disallows P2P for security)
25. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
GPU Instances - rough edges
• PCIe security
• Compromised device could access privileged host memory via PCIe
ATS (Address Translation Services)
• Some special device registers should be blocked/proxied in multi-
tenant environment
• Common to use cloud images for base OS+driver versioning and
standardisation, but new NVIDIA driver versions do not support some
existing hardware (e.g. K1)
• Requires multiple images or automated driver deployment/config -
no big thing just inconvenient
26. bought to you by
MASSIVE Business Plan 2013 / 2014 DRAFT
OpenStack Cyborg -
accelerator management
… aims to provide a general purpose
management framework for acceleration
resources (i.e. various types of
accelerators such as Crypto cards,
GPUs, FPGAs, NVMe/NOF SSDs, ODP,
DPDK/SPDK and so on)
(https://wiki.openstack.org/wiki/Cyborg)
https://review.openstack.org/#/c/448228/
27. Title: Business Plan for the Multi-modal Australian ScienceS Imaging and
Visualisation Environment (MASSIVE) 2013 / 2014
Document no: MASSIVE-BP-2.3 DRAFT
Date: June 2013
Prepared by: Name: Wojtek J Goscinski
Title: MASSIVE Coordinator
Approved by: Name: MASSIVE Steering Committee
Date:
Open IaaS:
Technology:
30/10/2015 1:59 pmMyTardis | Automatically stores your instrument data for sharing.
Menu
MyTardis Tech Group Meeting
#3
Posted on August 20, 2015August 20, 2015 by steve.androulakissteve.androulakis
It’s been months since the last one, so a wealth of activity to report on.
MyTardis
Automatically stores your instrument data for sharing.
Application layers: