GoDaddy's OpenStack Journey

•Download as PPTX, PDF•

0 likes•516 views

GoDaddy adopted OpenStack in late 2013 and has since scaled it significantly. They now run over 16,000 VMs and 2000 hypervisors on OpenStack. GoDaddy has focused on automating packaging, deployment, and operations through tools like Kolla, Ansible, and continuous integration/deployment. While the scale provides challenges, GoDaddy remains engaged in the community through contributions and the #openstack-operators channel. Areas for future work include further automation, self-healing, and improved APIs.

Technology

OpenStack at Scale
February 9th, 2017
GoDaddy's OpenStack Journey
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.

Where we started
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
• OpenStack (late 2013 – now())
• Strategic bet on open source!
• A nice, active, larger and bountiful community
• Deploying started soon thereafter
• Missing some key functionality (but getting better)

Our clouds
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
*2x the above (for public cloud and private cloud)

Our size
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
VMs HVs
16,000+ 2000+
VMs HVs
1,900+ 260+
~2017
~2013
(vmware)

Our layout
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Highlights
• One of the first adopters of nova cells v1

Our journey (so far)
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
• Packaging
• Deployment
• Scale
• Operational best practices
• Keeping involved and engaged
• (and more)

Packaging
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Old: partially hand generated rpms
• Error prone and fragile
New: machine generated docker images
• Github integrated
• Slack integrated
• Auto-built via jenkins jobs
• Auto-pushed to artifactory
• Auto-pulled from thereafter for deployment
+ + + +
Kolla
+

Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Nifffty!

Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.

Deployment
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Old: hand-driven puppet with a sprinkling of ansible
• Peer review and pray
New: moving to continuous automation (and eventual CD)
• Takes advantage of docker images to mitigate fragility
• Interactions audited and tracked by command and control
• Eliminates the (faulty) person-behind-the-keyboard
• Heavily ansible based (also slack integrated)
• Interacts with tool agnostic cloud topology (yaml) format
+ + + +

Cloud at scale - lessons learned
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Beginners:
• Devstack
Intermediate (but still easy):
• Operating a small cloud (less than 100 nodes)
• Deploying a small cloud (even by hand/high touch)
Advanced (not easy):
• Operating multiple clouds (multiple thousands of nodes/VMs)
• Hand-crafted deployment no longer ‘just works’
• Transitioning from high touch to low touch is required
• Being involved (upstream) while doing this
Transition from high touch to low touch – the earlier the better

Operational best practices
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
• Do not create distribution packages
• Containerization even used minimally is worth it
• Attend the #openstack-operators meetings 
• Incorporate reoccurring questions into the product
• Education - ephemeral nature of the cloud
• Balance downstream and upstream carefully

Community involvement
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
Not so easy staying involved while building operations/automation/deployments.
But we manage!
0
20
40
60
80
100
120
140
160
GoDaddy Commits
0
50
100
150
200
250
300
350
400
GoDaddy Reviews

Things we want to work on
Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved.
• Less complicated upgrades & deployments
• Self-healing
• Scale & performance
• Less complicated networking/compute/… APIs
• Better resource cleanup
• Discoverable API endpoints
• (and more, partner with us!)

We are hiring!!!
We are hiring!!!
x.co/openjobs
For OpenStack:
• Neutron + SDN experts
• Nova experts
• Engineers passionate about automating operations
Mailto: recruiting@godaddy.com
Find: Stephen Hoffman (in the back)

The document appears to be from the website of the Electronic Visualization Laboratory at the University of Illinois at Chicago, which is celebrating its 40th anniversary. It discusses the lab's work in big data, virtual and augmented reality systems like ImmersaDesk and LambdaTable, as well as its role in establishing over 100 CAVE virtual reality installations worldwide. The document also lists some campus building locations.

Asgard and the aws cloud

rjtg

Chevaliez du hépatites 2015

odeckmyn

Openstack architecture for the enterprise (Openstack Ireland Meet-up)

Keith Tobin

Synchronous Replication This document discusses OpenStack architecture for the enterprise. It describes using Crowbar to easily deploy OpenStack on Dell servers and networking equipment. Key aspects covered include using RabbitMQ clusters with mirrored queues for high availability, deploying Neutron on separate networking nodes, and using a Percona MySQL cluster to provide synchronous replication, data consistency, parallel applying and atomic node provisioning. The goal is an OpenStack architecture that is highly available, reliable, and can recover automatically from faults.

Grid syste Layout (960)

Mohammad Abuzaid

[DevDay 2016] OpenStack and approaches for new users - Speaker: Chi Le – Head...

DevDay.org

CloudInit Introduction

Publicis Sapient Engineering

This document summarizes a workshop about using CloudInit to bootstrap cloud instances. CloudInit allows giving instances a user-data file on first start that can configure the instance. Examples shown include setting hostname, importing SSH keys, installing packages, executing scripts. The document provides advice to use existing recipes or write your own scripts in YAML or other languages to declare configuration.

Cinder Live Migration and Replication - OpenStack Summit Austin

Ed Balduf

This document discusses live migration and replication in OpenStack Cinder storage. It describes the process of live migration for instances with block storage, including the different phases from pre-migration to clean-up. It also covers storage compatibility for live migration and the use of config drives. The document then discusses replication in Cinder, including early non-standard implementations and the goals for the "Cheesecake" implementation in Mitaka, which focuses on basic disaster recovery of replicated volumes.

Evil Superuser's HOWTO: Launching instances to do your bidding. You click 'run' on the OpenStack dashboard, or launch a new instance via the api. Some provisioning magic happens and soon you've got a server created especially for you. Did you ever wonder what magic happens to a standard image on boot? Have you wanted to launch instances and have them into your infrastructure with no manual interaction? Cloud-init is software that runs in most linux instances. It can take your input and do your bidding. Learn what things cloud-init magically does for you and how you can make it do more. Also, take advantage of the after-talk to pester cloud-init developers on what is missing or throw rotten fruits in their direction.

OpenStack and Rackspace – an Australian perspective: Tony Breeds, Rackspace

OpenStack

Audience: Intermediate About: Rackspace has one of, if not the largest, OpenStack Development teams in the A/NZ region – a technical depth that delivers unique capabilities to customers. This session will review a unique Continuous Integration approach for one of our Australian clients that sees fortnightly rolling updates in their production environment with no downtime; work done by the various OpenStack PTL and Core contributors we have within our Australian development organisation leading up to the Mitaka release and conclude with an update on future directions for utilising Containers within OpenStack environments. Speaker Bio: Tony Breeds – Software Developer / OpenStack Stable PTL,Rackspace Tony Breeds is the Project Team Lead for OpenStack Stable Branch Maintenance within Rackspace’s Global OpenStack team. Tony’s extensive experience in using OpenSource goes back to 1991, not long after Linus Torvalds released the first Linux Kernel. Since then he has held roles as a Systems Administrator, Network Architect, Kernel Developer and Engineering Manager. OpenStack Australia Day - Sydney 2016 https://events.aptira.com/openstack-australia-day-sydney-2016/

OpenStack & OVS: From Love-Hate Relationship to Match Made in Heaven - Erez C...

Cloud Native Day Tel Aviv

"Many developers building OpenStack clouds have “love-hate” relationship with OVS. They love flexibility and elasticity offered by OVS, but hate the network performance and scalability. As emerging technologies such as NFV keep pushing for higher network performance, it becomes critical to improve OVS performance without compromising flexibility, network programmability, and cost. In this session, we will present an approach that Mellanox has devised with input from key partners and customers to accelerate Virtual Switch dataplane, using the embedded switch implemented in the server Network Interface Card (NIC)’s hardware. This approach supports both ParaVirt vNIC interfaces and SRIOV based vNICs interfaces"

Introduction to OpenStack Architecture (Grizzly Edition)

Ken Pepple

Presentation from OpenStack Summit in April 2013. Building upon his popular blog posts and diagrams (http://ken.pepple.info), Ken will walk through the architecture of OpenStack Grizzly and describe its key software components and important interactions with a special focus on recent changes. After finishing with the software architecture, he will discuss common physical design patterns available for large scale deployments.

Simplifying OpenStack Networks with Routing on the Host: Gerard Chami + Scott...

OpenStack

Audience: Beginner About: This session details the design and implementation of an L3 network underlay, routing to the host, and a hardware VXLAN gateway used with an enterprise OpenStack distribution. Speaker Bio: Gerard Chami – Technical Support Engineer, Cumulus Networks Gerard is a Technical Support Engineer for Cumulus Networks and a founding members of the Australian support team. Since joining Cumulus Gerard has enjoyed working with Open Source and DevOps tools to help bring web-scale architectures and efficiency to enterprise networking. Prior to joining Cumulus Networks, Gerard worked at Cisco Systems where focused on emerging data centre solutions including UCS, Nexus Switching and ACI. Speaker Bio: Scott Laffer – Technical Support Engineer, Cumulus Networks Scott works at Cumulus Networks as a Technical Support Engineer. Always a fan of networking, while at Cumulus, Scott has enjoyed being a part of the Linux networking evolution. He is passionate about using NetDevOps tools to build, maintain and troubleshoot new generations networking architectures, all utilising the power of Linux. Scott started his career as a network administrator, before joining Cisco Systems to work with their high end Nexus switching range. OpenStack Australia Day - Sydney 2016 https://events.aptira.com/openstack-australia-day-sydney-2016/

OpenStack and DevOps - DevOps Meetup

Opsta

OpenStack Architecture

Mirantis

Web Performance testing with CI/CD

Marcel Verkerk

The document discusses integrating performance testing into continuous integration and delivery (CICD) pipelines to prevent performance regressions. It describes capturing performance metrics like page load times and custom measurements during UI tests using the browser APIs and comparing the results to real user monitoring baselines. The performance tests run as part of the automated test suite and must pass for deployments to proceed. The demo shows capturing these metrics and visualizing them in a dashboard for monitoring performance over time. Expanding this to support teams not using Selenium by running the tests as a web service is also discussed.

GoDaddy at Velocity 2016 New York

Jim Pierson

WordCamp Montreal - Catching regressions faster with automated acceptance tests

Jonathan Bardo

The document discusses acceptance testing and how automated acceptance tests can help catch regressions faster. It defines acceptance testing as testing that ensures requirements are met. It provides an example test using the Codeception PHP framework. It discusses tools for writing and running acceptance tests locally and with Travis CI, including Codeception, Selenium, and browser drivers. It includes demos of setting up a test environment, writing sample tests, and running tests from the terminal and with Travis CI.

Catching regressions faster with automated acceptance tests

Jonathan Bardo

Deploying OBIEE in the Cloud - Oracle Openworld 2014

Mark Rittman

Delivering the Data Factory, Data Reservoir and a Scalable Oracle Big Data Ar...

Mark Rittman

Presentation from the Rittman Mead BI Forum 2015 masterclass, pt.2 of a two-part session that also covered creating the Discovery Lab. Goes through setting up Flume log + twitter feeds into CDH5 Hadoop using ODI12c Advanced Big Data Option, then looks at the use of OBIEE11g with Hive, Impala and Big Data SQL before finally using Oracle Big Data Discovery for faceted search and data mashup on-top of Hadoop

Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors

Michael Rainey

Oracle GoldenGate 12c is well known for its highly performant data replication between relational databases. With the GoldenGate Adaptors, the tool can now apply the source transactions to a Big Data target, such as HDFS. In this session, we'll explore the different options for utilizing Oracle GoldenGate 12c to perform real-time data replication from a relational source database into HDFS. The GoldenGate Adaptors will be used to load movie data from the source to HDFS for use by Hive. Next, we'll take the demo a step further and publish the source transactions to a Flume agent, allowing Flume to handle the final load into the targets. Presented at the Oracle Technology Network Virtual Technology Summit February/March 2015.

OpenStack: Everything You Need To Know to Get Started (ATO2014)

Mark Voelker

Slides for my talk at All Things Open 2014 OpenStack is widely recognized as a leading open source cloud computing platform and has attracted plenty of attention from developers, end users, IT companies, and media. As OpenStack continue to gain adoption, the audience of potential users continues to expand. Whether you’re building a public cloud service or private clouds for e-commerce, video/collaboration apps, sceintific research, NFV, or are simply looking for a more elastic model of infrastructure, OpenStack is an option to consider. This talk will serve as an extensive introduction for newcomers to OpenStack. We’ll discuss both the software itself and the makeup of the community of developers and users around it. We’ll learn how to contribute to OpenStack, who’s using it today, different deployment scenarios and use cases, and provide both online and local resources for learning more. We’ll also provide an introduction to incubated components, underpinning pieces, and pointers to installers and service providers who can help you get started.

OGH 2015 - Hadoop (Oracle BDA) and Oracle Technologies on BI Projects

Mark Rittman

OpenStack: Everything You Need to Know To Get Started

All Things Open

OpenStack Deployment in the Enterprise

Cisco Canada

Openstack 101 by Jason Kalai

MyNOG

This document provides an introduction to OpenStack, including: - OpenStack is an open-source software platform for building private and public clouds with components that provide compute, storage, and networking capabilities. - The OpenStack architecture is modular with components that can be used individually or together, including compute, networking, block storage, image service, object storage, identity service, and dashboard. - Challenges of deploying OpenStack include needing skills in Linux, cloud infrastructure, and OpenStack architecture, as well as getting operations and engineering teams familiarized with OpenStack.

Part 1 - Introduction to Hadoop and Big Data Technologies for Oracle BI & DW ...

Mark Rittman

Delivered as a one-day seminar at the SIOUG and HROUG Oracle User Group Conferences, October 2014 In this presentation we cover some key Hadoop concepts including HDFS, MapReduce, Hive and NoSQL/HBase, with the focus on Oracle Big Data Appliance and Cloudera Distribution including Hadoop. We explain how data is stored on a Hadoop system and the high-level ways it is accessed and analysed, and outline Oracle’s products in this area including the Big Data Connectors, Oracle Big Data SQL, and Oracle Business Intelligence (OBI) and Oracle Data Integrator (ODI).

Exadata Cloud Service Overview(v2)

Okcan Yasin Saygılı

The document provides an overview of Oracle Database Exadata Cloud Service. It discusses how the service allows customers to easily provision Exadata infrastructure in the cloud with automated tools. The Exadata Cloud Service offers extreme performance and scalability for consolidated database workloads through its scale-out compute and storage architecture. Customers benefit from Oracle's management of the underlying infrastructure while maintaining control over database software administration.

Viewers also liked

Introduction to OpenStack : Barcamp Bangkhen 2016

Opsta

Cloud init and cloud provisioning [openstack summit vancouver]

Joshua Harlow

OpenStack and Rackspace – an Australian perspective: Tony Breeds, Rackspace

OpenStack

OpenStack & OVS: From Love-Hate Relationship to Match Made in Heaven - Erez C...

Cloud Native Day Tel Aviv

Introduction to OpenStack Architecture (Grizzly Edition)

Ken Pepple

Simplifying OpenStack Networks with Routing on the Host: Gerard Chami + Scott...

OpenStack

OpenStack and DevOps - DevOps Meetup

Opsta

OpenStack Architecture

Mirantis

Viewers also liked (8)

Introduction to OpenStack : Barcamp Bangkhen 2016

Cloud init and cloud provisioning [openstack summit vancouver]

OpenStack and Rackspace – an Australian perspective: Tony Breeds, Rackspace

OpenStack & OVS: From Love-Hate Relationship to Match Made in Heaven - Erez C...

Introduction to OpenStack Architecture (Grizzly Edition)

Simplifying OpenStack Networks with Routing on the Host: Gerard Chami + Scott...

OpenStack and DevOps - DevOps Meetup

OpenStack Architecture

Similar to GoDaddy's OpenStack Journey

Web Performance testing with CI/CD

Marcel Verkerk

GoDaddy at Velocity 2016 New York

Jim Pierson

WordCamp Montreal - Catching regressions faster with automated acceptance tests

Jonathan Bardo

Catching regressions faster with automated acceptance tests

Jonathan Bardo

Deploying OBIEE in the Cloud - Oracle Openworld 2014

Mark Rittman

Delivering the Data Factory, Data Reservoir and a Scalable Oracle Big Data Ar...

Mark Rittman

Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors

Michael Rainey

OpenStack: Everything You Need To Know to Get Started (ATO2014)

Mark Voelker

OGH 2015 - Hadoop (Oracle BDA) and Oracle Technologies on BI Projects

Mark Rittman

OpenStack: Everything You Need to Know To Get Started

All Things Open

OpenStack Deployment in the Enterprise

Cisco Canada

Openstack 101 by Jason Kalai

MyNOG

Part 1 - Introduction to Hadoop and Big Data Technologies for Oracle BI & DW ...

Mark Rittman

Exadata Cloud Service Overview(v2)

Okcan Yasin Saygılı

WhereScape, the pioneer in data warehouse automation software

Patrick Van Renterghem

This document summarizes WhereScape as the pioneer in data warehouse automation software. It discusses WhereScape's background, customers in various industries and regions, and value proposition of providing an integrated development environment that manages the entire data warehouse lifecycle in an automated, simplified, and faster manner compared to traditional approaches. The document also outlines the challenges of managing an EDW/BI environment with multiple tools and skills, and how WhereScape addresses this with a single tool, skillset, and lower cost of change.

Low Friction Continuous Delivery: Going From 0 to 1 with Drupal and Acquia

Acquia

The value of automated testing and quality control to your code, site, and digital presence can be huge. A well designed build and test process reduces the stress and uncertainty of deployments and maintenance. New open source components and tools from Acquia can help. By reducing friction in the deployment process, teams can move to releasing more often, which in turn: - Reduces the scope and therefore risk of each release; - Provides features to customers sooner; - Gets data and feedback on new features much sooner after they are developed Releasing early and often is called Continuous Delivery. Most teams recognize the benefits of this approach, but find it hard to implement it in practice. CI tools are many and varied, can be complex to set up, and introduce a maintenance and security burden. Acquia is working hard to simplify this process, and is introducing reliable managed and supported tools to the Acquia Platform to assist. Learn how to quickly implement a continuous integration workflow for your Drupal application on Acquia Cloud. Easily build automated tests that execute each time that you make a change to your application. Deploy to production with the confidence that every release has gone through a streamlined testing process. Register for this Tech Talk to learn more!

Part 4 - Hadoop Data Output and Reporting using OBIEE11g

Mark Rittman

Delivered as a one-day seminar at the SIOUG and HROUG Oracle User Group Conferences, October 2014. Once insights and analysis have been produced within your Hadoop cluster by analysts and technical staff, it’s usually the case that you want to share the output with a wider audience in the organisation. Oracle Business Intelligence has connectivity to Hadoop through Apache Hive compatibility, and other Oracle tools such as Oracle Big Data Discovery and Big Data SQL can be used to visualise and publish Hadoop data. In this final session we’ll look at what’s involved in connecting these tools to your Hadoop environment, and also consider where data is optimally located when large amounts of Hadoop data need to be analysed alongside more traditional data warehouse datasets

Young it - digital transformation on a personal level

Dez Blanchfield

Integrating multiple CDNs at Etsy

Laurie Denness

MySQL DBaaS with OpenStack Trove

Matt Lord

This document provides an overview of MySQL Database as a Service (DBaaS) with OpenStack Trove. It begins with some background on OpenStack and its components, including Trove which provides database services. The rest of the document outlines the agenda which includes introductions to OpenStack and Trove, benefits of MySQL Enterprise Edition, integrating MySQL with Trove, and future plans. It also includes examples of large companies using OpenStack such as Walmart, Fujitsu, Photobucket, and CERN.

Similar to GoDaddy's OpenStack Journey (20)

Web Performance testing with CI/CD

GoDaddy at Velocity 2016 New York

WordCamp Montreal - Catching regressions faster with automated acceptance tests

Catching regressions faster with automated acceptance tests

Deploying OBIEE in the Cloud - Oracle Openworld 2014

Delivering the Data Factory, Data Reservoir and a Scalable Oracle Big Data Ar...

Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors

OpenStack: Everything You Need To Know to Get Started (ATO2014)

OGH 2015 - Hadoop (Oracle BDA) and Oracle Technologies on BI Projects

OpenStack: Everything You Need to Know To Get Started

OpenStack Deployment in the Enterprise

Openstack 101 by Jason Kalai

Part 1 - Introduction to Hadoop and Big Data Technologies for Oracle BI & DW ...

Exadata Cloud Service Overview(v2)

WhereScape, the pioneer in data warehouse automation software

Low Friction Continuous Delivery: Going From 0 to 1 with Drupal and Acquia

Part 4 - Hadoop Data Output and Reporting using OBIEE11g

Young it - digital transformation on a personal level

Integrating multiple CDNs at Etsy

MySQL DBaaS with OpenStack Trove

Recently uploaded

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Zilliz

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

Data structures and Algorithms in Python.pdf

TIPNGVN2

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Uni Systems S.M.S.A.

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

National Security Agency - NSA mobile device best practices

Quotidiano Piemontese

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

Neo4j

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Neo4j

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

How to Get CNIC Information System with Paksim Ga.pptx

danishmna97

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Vladimir Iglovikov, Ph.D.

Presented by Vladimir Iglovikov: - https://www.linkedin.com/in/iglovikov/ - https://x.com/viglovikov - https://www.instagram.com/ternaus/ This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation. Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners. This case study covers various aspects, including: People: The contributors and community that have supported Albumentations. Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions. Challenges: The hurdles in monetizing open-source projects and measuring user engagement. Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration. Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community. Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations. Mental Health: Maintaining balance and not feeling pressured by user demands. Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth. Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects. Explore more about Albumentations and join the community at: GitHub: https://github.com/albumentations-team/albumentations Website: https://albumentations.ai/ LinkedIn: https://www.linkedin.com/company/100504475 Twitter: https://x.com/albumentations

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Neo4j

Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

Mind map of terminologies used in context of Generative AI

Kumud Singh

A tale of scale & speed: How the US Navy is enabling software delivery from l...

sonjaschweigert1

Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved: - Reduction in onboarding time from 5 weeks to 1 day - Improved developer experience and productivity through actionable findings and reduction of false positives - Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO) Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production. We will cover: - How to remove silos in DevSecOps - How to build efficient development pipeline roles and component templates - How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence) - How to streamline operations with automated policy checks on container images

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

Speck&Tech

ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune. Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile. BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).

Recently uploaded (20)

Essentials of Automations: The Art of Triggers and Actions in FME

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Securing your Kubernetes cluster_ a step-by-step guide to success !

Removing Uninteresting Bytes in Software Fuzzing

Data structures and Algorithms in Python.pdf

Uni Systems Copilot event_05062024_C.Vlachos.pdf

20240605 QFM017 Machine Intelligence Reading List May 2024

National Security Agency - NSA mobile device best practices

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

20240607 QFM018 Elixir Reading List May 2024

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

How to Get CNIC Information System with Paksim Ga.pptx

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

PCI PIN Basics Webinar from the Controlcase Team

Mind map of terminologies used in context of Generative AI

A tale of scale & speed: How the US Navy is enabling software delivery from l...

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

GoDaddy's OpenStack Journey

2. Where we started Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. • OpenStack (late 2013 – now()) • Strategic bet on open source! • A nice, active, larger and bountiful community • Deploying started soon thereafter • Missing some key functionality (but getting better)

6. Our journey (so far) Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. • Packaging • Deployment • Scale • Operational best practices • Keeping involved and engaged • (and more)

7. Packaging Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. Old: partially hand generated rpms • Error prone and fragile New: machine generated docker images • Github integrated • Slack integrated • Auto-built via jenkins jobs • Auto-pushed to artifactory • Auto-pulled from thereafter for deployment + + + + Kolla +

11. Deployment Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. Old: hand-driven puppet with a sprinkling of ansible • Peer review and pray New: moving to continuous automation (and eventual CD) • Takes advantage of docker images to mitigate fragility • Interactions audited and tracked by command and control • Eliminates the (faulty) person-behind-the-keyboard • Heavily ansible based (also slack integrated) • Interacts with tool agnostic cloud topology (yaml) format + + + +

13. Cloud at scale - lessons learned Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. Beginners: • Devstack Intermediate (but still easy): • Operating a small cloud (less than 100 nodes) • Deploying a small cloud (even by hand/high touch) Advanced (not easy): • Operating multiple clouds (multiple thousands of nodes/VMs) • Hand-crafted deployment no longer ‘just works’ • Transitioning from high touch to low touch is required • Being involved (upstream) while doing this Transition from high touch to low touch – the earlier the better

14. Operational best practices Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. • Do not create distribution packages • Containerization even used minimally is worth it • Attend the #openstack-operators meetings  • Incorporate reoccurring questions into the product • Education - ephemeral nature of the cloud • Balance downstream and upstream carefully

15. Community involvement Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. Not so easy staying involved while building operations/automation/deployments. But we manage! 0 20 40 60 80 100 120 140 160 GoDaddy Commits 0 50 100 150 200 250 300 350 400 GoDaddy Reviews

16. Things we want to work on Copyright© 2016 GoDaddy Inc. · 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 · All Rights Reserved. • Less complicated upgrades & deployments • Self-healing • Scale & performance • Less complicated networking/compute/… APIs • Better resource cleanup • Discoverable API endpoints • (and more, partner with us!)

17. We are hiring!!! We are hiring!!! x.co/openjobs For OpenStack: • Neutron + SDN experts • Nova experts • Engineers passionate about automating operations Mailto: recruiting@godaddy.com Find: Stephen Hoffman (in the back)

19. We are hiring!!!

Editor's Notes

Ensure to denote that there is double the amount of the above. The tech we use (and operate and make sure works) is all of the above.
Network design not detailed here (should be other presentations/talks that you can find online about that).
Educate your users about ephemeral nature of OpenStack VMs - especially if transitioning from VMWare. Immutability (configs and code). Incorporate reoccurring questions into the product - prevents live support burden.

GoDaddy's OpenStack Journey

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (8)

Similar to GoDaddy's OpenStack Journey

Similar to GoDaddy's OpenStack Journey (20)

Recently uploaded

Recently uploaded (20)

GoDaddy's OpenStack Journey

Editor's Notes