Wix has scaled to serve 30 million users and over 1 million new websites per month. As the company grew, its initial architecture based on Tomcat and MySQL struggled to scale. Wix transitioned to a distributed system separating the editor and public segments for higher availability. It also developed Prospero, a media storage system using consistent hashing to shard files across servers. Caching and a CDN help further improve performance and scalability.
Over the first 7 years of Wix, Wix infrastructure has gone a number of transformations, starting as a monolithic application server with MySQL, evolving to a service based architecture with with diverse infrastructure. During this period, we have learned a few things that we like to share, as well as gone by a number of transformations. We evolved into TDD / CI / CD and DevOps, changed our product from Flash to HTML 5 and started selling products. Let us take you on the Wix (technical) journey...
Scaling wix with microservices architecture jax london-2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. As a startup grows, the team is confronted with the problem of how to evolve and scale the system.
Over the first 8 years of Wix, Wix infrastructure has gone a number of transformations, starting as a monolithic application server with MySQL, evolving to a service based architecture with with diverse infrastructure.
Over this 8 years journey, we have learned a thing or two - some DOs and some DON'Ts.
This presentation goes over the evolution of Wix architecture, with the different transformations we have done to support Wix at scale. We will share some of out insights about building a web infrastructure for over 50M users
Advanced A/B Testing - Jax London 2015Aviran Mordo
How do you know what 60 millions users are like? Wix.com is conducting hundreds of experiments per month on production to understand, which features our users like and which hurt or improve our business. In this talk we’ll explain how the engineering team is supporting product managers in making the right decisions and getting our product road map on the right path. We will also present some of the open source tools we developed that help us experimenting our products on humans.
Mircoservices, dev ops and Engineering best practices at Wix.comAviran Mordo
How Wix.com migrated from a monolith to microservices architecture, what was the effect on the company structure and how Wix built a top of the line engineering group
Wix Architecture at Scale - QCon London 2014Aviran Mordo
In this talk I will go over Wix's architecture, how we evolved our system to be highly available even at the worst case scenarios when everything can break, how we built a self-healing eventual consistency system for website data distribution and will show some of the patterns we use that helps us render 45M websites while maintaining a relatively low number of servers.
Over the first 7 years of Wix, Wix infrastructure has gone a number of transformations, starting as a monolithic application server with MySQL, evolving to a service based architecture with with diverse infrastructure. During this period, we have learned a few things that we like to share, as well as gone by a number of transformations. We evolved into TDD / CI / CD and DevOps, changed our product from Flash to HTML 5 and started selling products. Let us take you on the Wix (technical) journey...
Scaling wix with microservices architecture jax london-2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. As a startup grows, the team is confronted with the problem of how to evolve and scale the system.
Over the first 8 years of Wix, Wix infrastructure has gone a number of transformations, starting as a monolithic application server with MySQL, evolving to a service based architecture with with diverse infrastructure.
Over this 8 years journey, we have learned a thing or two - some DOs and some DON'Ts.
This presentation goes over the evolution of Wix architecture, with the different transformations we have done to support Wix at scale. We will share some of out insights about building a web infrastructure for over 50M users
Advanced A/B Testing - Jax London 2015Aviran Mordo
How do you know what 60 millions users are like? Wix.com is conducting hundreds of experiments per month on production to understand, which features our users like and which hurt or improve our business. In this talk we’ll explain how the engineering team is supporting product managers in making the right decisions and getting our product road map on the right path. We will also present some of the open source tools we developed that help us experimenting our products on humans.
Mircoservices, dev ops and Engineering best practices at Wix.comAviran Mordo
How Wix.com migrated from a monolith to microservices architecture, what was the effect on the company structure and how Wix built a top of the line engineering group
Wix Architecture at Scale - QCon London 2014Aviran Mordo
In this talk I will go over Wix's architecture, how we evolved our system to be highly available even at the worst case scenarios when everything can break, how we built a self-healing eventual consistency system for website data distribution and will show some of the patterns we use that helps us render 45M websites while maintaining a relatively low number of servers.
Scaling wix with microservices and multi cloud - 2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset like Tomcat, Hibernate, and MySQL. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. So as a startup grows, the team is confronted with the problem of how to evolve the system and make it scalable. Facing the same dilemma, Wix.com grew from 0 to 70 million users in just a few years. Facing some interesting challenges, like performance and availability. Traditional performance solutions, such as caching, would not help due to a very long tail problem which causes caching to be highly inefficient. And because every minute of downtime means customers lose money, the product needed to have near 100% availability. Solving these issues required some interesting and out-of-the-box thinking, and this talk will discuss some of these strategies: building a highly preformant, highly available and highly scalable system; and leveraging microservices architecture and multi-cloud platforms to help build a very efficient and cost-effective system.
Scaling wix with microservices architecture devoxx London 2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset like Tomcat, Hibernate, and MySQL. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. So as a startup grows, the team is confronted with the problem of how to evolve the system and make it scalable.
Facing the same dilemma, Wix.com grew from 0 to 60 million users in just a few years. Facing some interesting challenges, like performance and availability. Traditional performance solutions, such as caching, would not help due to a very long tail problem which causes caching to be highly inefficient. And because every minute of downtime means customers lose money, the product needed to have near 100% availability.
Solving these issues required some interesting and out-of-the-box thinking, and this talk will discuss some of these strategies: building a highly preformant, highly available and highly scalable system; and leveraging microservices architecture and multi-cloud platforms to help build a very efficient and cost-effective system.
Experimenting on Humans - Advanced A/B Tests - QCon SF 2014Aviran Mordo
How do you know what 55 millions users like? Wix.com is conducting hundreds of experiments every month on production to understand which features our users like and which hurt or improve our business.
In this talk we’ll explain how our engineering team is supporting our product managers in making the right decisions and getting our product road map on the right path. We will also present some of the open source tools we developed that help us experimenting our products on humans.
While A/B test is a very known and familiar methodology for conducting experiments on production when you do that on a large scale by changing your system behavior every 9 minutes, it entails many challenges in the organization level from developers, product managers, QA, marketing and management.
In this talk we will explain what is the life-cycle of an experiment, some of the challenges we faced and the effect on our development process and product evolution.
Concurrency at Scale: Evolution to Micro-ServicesRandy Shoup
Most large-scale web companies have evolved their system architecture from a monolithic application and monolithic database to a set of loosely coupled micro-services. Using examples from Google, eBay, and KIXEYE, this talk outlines the pros and cons of these different stages of evolution, and makes practical suggestions about when and how other organizations should consider migrating to micro-services. It concludes with some more advanced implications of a micro-services architecture, including SLAs, cost-allocation, and vendor-customer relationships within the organization.
Microservices Architecture for Content Management Systems using AWS Lambda an...Mitoc Group
Content Management Systems are by nature resource intensive, expensive to customize, and difficult to manage at scale. What if we can change this perception and help PHP / Drupal developers architect a content platform that is high performance and low cost, high security and low maintenance? This talk will focus on 3 key topics: 1) serverless environment, 2) microservices architecture and 3) hands-on demos. We will describe a serverless solution and propose a scalable architecture that will help Drupal community to adopt cloud-native approach without huge efforts or expensive resources allocation.
Using apache camel for microservices and integration then deploying and managing on Docker and Kubernetes. When we need to make changes to our app, we can use Fabric8 continuous delivery built on top of Kubernetes and OpenShift.
DevOps đại diện cho một sự thay đổi trong văn hóa CNTT, tập trung vào cung cấp dịch vụ CNTT nhanh chóng thông qua áp dụng Agile, Lean trong bối cảnh của phương pháp tiếp cận theo định hướng về hệ thống. DevOps nhấn mạnh yếu tố con người (và văn hóa), và tìm cách cải thiện sự phối hợp giữa các hoạt động và đội ngũ phát triển, triển khai DevOps sử dụng công nghệ - đặc biệt là các công cụ tự động hóa có thể tận dụng một cơ sở hạ tầng ngày càng hiệu quả và tăng cường theo hướng có thể lập trình được và bạn sẽ có một cơ sở hạ tầng linh động trong chu trình phát triển.
This is the slide deck for the DFW Azure User Group meetup of 18 July 2017, presented by Doug Vanderweide and discussing Azure's services that support a microservices architecture.
10 yrs ago, SOA promised a lot of the same things Microservices promise use today. So where did we go wrong? What makes microservices different? In this talk, we discussed from an architectural view how we went sideways with SOA, why we must embrace things like Domain Driven Design and scaled-out architectures, and how microservices can be built with enterprises in mind. We also cover a step-by-step, in-depth tutorial that covers these concepts.
DCSF 19 Modern Orchestrated IT for Enterprise CMSDocker, Inc.
Wiley’s Education Services (WES) leverages a mix of CMS platforms across their 50+ student information sites for major universities throughout the world. Traditionally these sites have been housed as part of a multi-site CMS install on a single VM, and eventually across 2 VMs. Failure of either one of these VMs would mean an outage for one or all of the hosted sites. As Wiley’s leadership looked forward, they recognized the risks involved with their current design and identified Docker as a way to mitigate these risks.
WES began their investigation in to Docker to address issues of fault tolerance, consistency, and portability. They used this opportunity to modernize their workflows and reduce risk by promoting Docker images through their dev, preview, and production environments using CI/CD. This increased their confidence in deployments and reduced the need for maintenance windows. Early in the process, WES brought in BoxBoat as subject matter experts to accelerate their migration, and architect their Docker EE solution. Through the use of well-defined workflows and persistent storage, applications are continually redeployed and restored between environments with zero downtime and no loss of data. Additionally developers can pull down and run any of the sites independently with configuration that matches production. Join this sessions to learn about the challenges and triumphs that Wiley faced when orchestrating CMS deployments in Docker!
Looking to the cloud to serve Bitbucket (formerly Stash) to a horde of hungry developers? Netflix has the recipe for you! Take one part fresh open source platforms, two parts juicy deployment pipelines, and add a dash of gooey-rich custom bakes. Join this session to find out how Netflix used this unique combination of technologies to move Stash from their data center to the cloud and what they burned (yes, burned) along the way.
The goal of MicroProfile is to optimise Java EE for a micro-service architecture. It is based on some of the Java EE specifications and standardise a few technologies from the micro-services space.
However, some of the MicroProfile implementations are completely different 'servers', like the KumuluzEE server. So how can you migrate easily from your favorite Java EE server to a MicroProfile implementation?
This session shows you an overview of what MicroProfile.IO is and how it relates to Java EE. It then demonstrates with a few examples how you can adjust your Java EE application to incorporate some of the MicroProfile.IO specifications and how you can transform your Java EE application to a MicroProfile.IO one using Thorntail, Payara Micro, and KumuluzEE.
As a growing company Wix has tried many monitoring solutions some worked better than others. In this talk we will go over the lessons we learned at Wix about what to monitor and how to monitor production systems; when to trigger alerts and also when not to trigger alerts.
We will go over some of the tools we use and also some of the tools we built to help us sleep better at night while doing 400 deployments to production every month.
http://www.youtube.com/watch?v=OLPA2KOWJ8I
Working in a fast-growing company that doubles in size every year, maintaining the quality of products and engineers is a very challenging task.
In this talk I will describe how Wix corporate structure evolved from functional teams to gangs, cross-functional teams responsible for end-to-end delivery; guilds, professional groups responsible for methodology, best practices, and training; and mini-companies that serve as internal startups to support rapid growth while maintaining velocity. I will also discuss how we poured our culture into a game-like “guild day”, that helps us maintain alignment, keep the high quality of our work and people, share knowledge, recruit and preserve the best developers, and support a quality-based culture of innovation.
Scaling wix with microservices and multi cloud - 2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset like Tomcat, Hibernate, and MySQL. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. So as a startup grows, the team is confronted with the problem of how to evolve the system and make it scalable. Facing the same dilemma, Wix.com grew from 0 to 70 million users in just a few years. Facing some interesting challenges, like performance and availability. Traditional performance solutions, such as caching, would not help due to a very long tail problem which causes caching to be highly inefficient. And because every minute of downtime means customers lose money, the product needed to have near 100% availability. Solving these issues required some interesting and out-of-the-box thinking, and this talk will discuss some of these strategies: building a highly preformant, highly available and highly scalable system; and leveraging microservices architecture and multi-cloud platforms to help build a very efficient and cost-effective system.
Scaling wix with microservices architecture devoxx London 2015Aviran Mordo
Many small startups build their systems on top of a traditional toolset like Tomcat, Hibernate, and MySQL. These systems are used because they facilitate easy development and fast progress, but many of them are monolithic and have limited scalability. So as a startup grows, the team is confronted with the problem of how to evolve the system and make it scalable.
Facing the same dilemma, Wix.com grew from 0 to 60 million users in just a few years. Facing some interesting challenges, like performance and availability. Traditional performance solutions, such as caching, would not help due to a very long tail problem which causes caching to be highly inefficient. And because every minute of downtime means customers lose money, the product needed to have near 100% availability.
Solving these issues required some interesting and out-of-the-box thinking, and this talk will discuss some of these strategies: building a highly preformant, highly available and highly scalable system; and leveraging microservices architecture and multi-cloud platforms to help build a very efficient and cost-effective system.
Experimenting on Humans - Advanced A/B Tests - QCon SF 2014Aviran Mordo
How do you know what 55 millions users like? Wix.com is conducting hundreds of experiments every month on production to understand which features our users like and which hurt or improve our business.
In this talk we’ll explain how our engineering team is supporting our product managers in making the right decisions and getting our product road map on the right path. We will also present some of the open source tools we developed that help us experimenting our products on humans.
While A/B test is a very known and familiar methodology for conducting experiments on production when you do that on a large scale by changing your system behavior every 9 minutes, it entails many challenges in the organization level from developers, product managers, QA, marketing and management.
In this talk we will explain what is the life-cycle of an experiment, some of the challenges we faced and the effect on our development process and product evolution.
Concurrency at Scale: Evolution to Micro-ServicesRandy Shoup
Most large-scale web companies have evolved their system architecture from a monolithic application and monolithic database to a set of loosely coupled micro-services. Using examples from Google, eBay, and KIXEYE, this talk outlines the pros and cons of these different stages of evolution, and makes practical suggestions about when and how other organizations should consider migrating to micro-services. It concludes with some more advanced implications of a micro-services architecture, including SLAs, cost-allocation, and vendor-customer relationships within the organization.
Microservices Architecture for Content Management Systems using AWS Lambda an...Mitoc Group
Content Management Systems are by nature resource intensive, expensive to customize, and difficult to manage at scale. What if we can change this perception and help PHP / Drupal developers architect a content platform that is high performance and low cost, high security and low maintenance? This talk will focus on 3 key topics: 1) serverless environment, 2) microservices architecture and 3) hands-on demos. We will describe a serverless solution and propose a scalable architecture that will help Drupal community to adopt cloud-native approach without huge efforts or expensive resources allocation.
Using apache camel for microservices and integration then deploying and managing on Docker and Kubernetes. When we need to make changes to our app, we can use Fabric8 continuous delivery built on top of Kubernetes and OpenShift.
DevOps đại diện cho một sự thay đổi trong văn hóa CNTT, tập trung vào cung cấp dịch vụ CNTT nhanh chóng thông qua áp dụng Agile, Lean trong bối cảnh của phương pháp tiếp cận theo định hướng về hệ thống. DevOps nhấn mạnh yếu tố con người (và văn hóa), và tìm cách cải thiện sự phối hợp giữa các hoạt động và đội ngũ phát triển, triển khai DevOps sử dụng công nghệ - đặc biệt là các công cụ tự động hóa có thể tận dụng một cơ sở hạ tầng ngày càng hiệu quả và tăng cường theo hướng có thể lập trình được và bạn sẽ có một cơ sở hạ tầng linh động trong chu trình phát triển.
This is the slide deck for the DFW Azure User Group meetup of 18 July 2017, presented by Doug Vanderweide and discussing Azure's services that support a microservices architecture.
10 yrs ago, SOA promised a lot of the same things Microservices promise use today. So where did we go wrong? What makes microservices different? In this talk, we discussed from an architectural view how we went sideways with SOA, why we must embrace things like Domain Driven Design and scaled-out architectures, and how microservices can be built with enterprises in mind. We also cover a step-by-step, in-depth tutorial that covers these concepts.
DCSF 19 Modern Orchestrated IT for Enterprise CMSDocker, Inc.
Wiley’s Education Services (WES) leverages a mix of CMS platforms across their 50+ student information sites for major universities throughout the world. Traditionally these sites have been housed as part of a multi-site CMS install on a single VM, and eventually across 2 VMs. Failure of either one of these VMs would mean an outage for one or all of the hosted sites. As Wiley’s leadership looked forward, they recognized the risks involved with their current design and identified Docker as a way to mitigate these risks.
WES began their investigation in to Docker to address issues of fault tolerance, consistency, and portability. They used this opportunity to modernize their workflows and reduce risk by promoting Docker images through their dev, preview, and production environments using CI/CD. This increased their confidence in deployments and reduced the need for maintenance windows. Early in the process, WES brought in BoxBoat as subject matter experts to accelerate their migration, and architect their Docker EE solution. Through the use of well-defined workflows and persistent storage, applications are continually redeployed and restored between environments with zero downtime and no loss of data. Additionally developers can pull down and run any of the sites independently with configuration that matches production. Join this sessions to learn about the challenges and triumphs that Wiley faced when orchestrating CMS deployments in Docker!
Looking to the cloud to serve Bitbucket (formerly Stash) to a horde of hungry developers? Netflix has the recipe for you! Take one part fresh open source platforms, two parts juicy deployment pipelines, and add a dash of gooey-rich custom bakes. Join this session to find out how Netflix used this unique combination of technologies to move Stash from their data center to the cloud and what they burned (yes, burned) along the way.
The goal of MicroProfile is to optimise Java EE for a micro-service architecture. It is based on some of the Java EE specifications and standardise a few technologies from the micro-services space.
However, some of the MicroProfile implementations are completely different 'servers', like the KumuluzEE server. So how can you migrate easily from your favorite Java EE server to a MicroProfile implementation?
This session shows you an overview of what MicroProfile.IO is and how it relates to Java EE. It then demonstrates with a few examples how you can adjust your Java EE application to incorporate some of the MicroProfile.IO specifications and how you can transform your Java EE application to a MicroProfile.IO one using Thorntail, Payara Micro, and KumuluzEE.
As a growing company Wix has tried many monitoring solutions some worked better than others. In this talk we will go over the lessons we learned at Wix about what to monitor and how to monitor production systems; when to trigger alerts and also when not to trigger alerts.
We will go over some of the tools we use and also some of the tools we built to help us sleep better at night while doing 400 deployments to production every month.
http://www.youtube.com/watch?v=OLPA2KOWJ8I
Working in a fast-growing company that doubles in size every year, maintaining the quality of products and engineers is a very challenging task.
In this talk I will describe how Wix corporate structure evolved from functional teams to gangs, cross-functional teams responsible for end-to-end delivery; guilds, professional groups responsible for methodology, best practices, and training; and mini-companies that serve as internal startups to support rapid growth while maintaining velocity. I will also discuss how we poured our culture into a game-like “guild day”, that helps us maintain alignment, keep the high quality of our work and people, share knowledge, recruit and preserve the best developers, and support a quality-based culture of innovation.
How do you know what 60 millions users like? Wix.com is conducting hundreds of experiments per month on production to understand which features our users like and which hurt or improve our business. In this talk we’ll explain how the engineering team is supporting product managers in making the right decisions and getting our product road map on the right path. We will also present some of the open source tools we developed that help us experimenting our products on humans.
Guide to continuous delivery and the journey wix.com had made transitioning to DevOps and continuous delivery culture making ~100 production changes daily
Wix.com back-end engineering guild activities and culture manifesto describes our guild activities and culture that support a highly innovative and renowned engineering group
Weebly builder has an easy to use blog embedded inside the website helping you to generate your valuable content within your website. This helps to drive draffic back to your website and give you better SEO. More at www.PluginMuse.com
Scaling Wix with microservices architecture and multi-cloud platforms - Reve...Aviran Mordo
In 6 years, Wix grew from a small startup with traditional system architecture (based on a monolithic server running on Tomcat, Hibernate, and MySQL) to a company that serves 60 million users. To keep up with this tremendous growth, Wix’s architecture had to evolve from a monolithic system to microservices, using some interesting patterns like CQRS to achieve our goal of building a blazing fast highly scalable and highly available system.
In this presentation we go over the motivations for wix.com R&D to move to a CI/CD/TDD model, how the model was implemented and the impact on Wix R&D. We will cover the tools used (developed in-house and 3rd party), change in methodologies, what we have learned during the transformation and the unexpected change in working with product and the rest of the company.
Developing large scale web applications is challenging enough on its own. It gets even trickier when development should be done by several independent teams responsible for their own product areas and UI design implies that their work is tightly integrated and should be perceived as one product. Workflow driven development is about how we at Nordnet decided to address these issues, what frontend architecture solutions we’ve decided to adopt to allow our teams to work independently and still deliver common product we call next.nordnet.
Join AWS at this session to understand how to architect an infrastructure to handle going from zero to millions of users. From leveraging highly scalable AWS services to making smart decisions on building out your application, you'll learn a number of best practices for scaling your infrastructure in the cloud.
Speakers:
Andreas Chatzakis, AWS Solutions Architect
Pete Mounce, Senior Developer, JustEat
AAI-2075 Evolving an IBM WebSphere Topology to Manage a Changing WorkloaWASdev Community
Customers have a huge investment in WebSphere ND infrastructure including installation, development, deployment, management, support, and 3rd party products. At the same time there are significant new workloads. Mobile is driving very high transaction rates using new device types. New applications often require extremely fast response times. The Cloud economy based on Restful services is rapidly expanding the very nature of applications. Meanwhile, teams need to improve efficiency and drive higher density on their platforms.
In this session we will show you how to evolve your WebSphere ND environment to manage new workloads while preserving your existing investment. See how to add Liberty servers into ND. Explore how Intelligent Management and the ODR extend ND to support Restful services. Examine the benefits of a caching tier to improve response time and availability. See how to add Worklight into your ND environment to provide mobile device and application support. Explore continuous delivery and devOps options for WebSphere ND.
For people who start to create a cloud service, it’s really important to know how to create a scalable cloud service to fit the growth of the future workloads. In this session, we will introduce how to design a scalable cloud service including AWS services introduction and best practices.
A common question from companies considering Alfresco for content management is what to do with their legacy ECM systems. In many cases, they want to run Alfresco alongside their existing system for some period of time, and then gradually migrate their content. Join Alfresco Partner of the Year – Zia Consulting – to learn how OpenWorkdesk will allow users to interact with both Alfresco and any CMIS compatible repository in a multi-repository environment.
The presentation will include a specific demonstration of OpenWorkdesk running against both Alfresco and IBM FileNet with a single user interface, and will also discuss how the gradual migration to Alfresco takes place.
The Kubernetes WebLogic revival (part 1)Simon Haslam
The first of two sessions Martien & I presented at UKOUG Techfest19 in Brighton, UK about:
(a) Running WebLogic in containers, managed by Kubernetes
(b) Oracle's Container Engine for Kubernetes (OKE) - Oracle Cloud's managed k8s service
Whether you are launching a simple website or a scaled application, time to go live is a key consideration for your business. Amazon Lightsail is the easiest way to get started on AWS, letting you build and scale your infrastructure faster. In this session, we will walk you through how to use Lightsail to launch your application with a few clicks and scale it as needed for redundancy, traffic spikes, or intergalactic attack. With in-browser SSH and RDP access, easy server management, and in-console guidance, Lightsail provides all the tools needed for builders of all levels – no prior AWS experience required.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
JMeter webinar - integration with InfluxDB and Grafana
Scaling up to 30M users - The Wix Story
1. Scaling up to 30M users
Scaling Software, Scaling Data & Scaling People
The Wix Experience
Devcon TLV Feb 2013
Aviran Mordo
Server Group Manager
Wix
@aviranm
3. Wix in Numbers
• Wix was founded in 2006
• 30M registered users from most countries
• Over 1,000,000 new users every month
• ~1,000,000 new websites every month
• Over 150 TByte of users media files
– More than 1 billion users media files
– More than 1.5 TByte uploaded files daily
• Over 300 Servers in 2+1 datacenters + Google + Amazon
4. Wix Initial Architecture
Wix MySQL
• Tomcat, Hibernate, Custom web framework (Tomcat) DB
– Everything generated from HBM files
– Built for fast development
– Statefull login (tomcat session), EHCache, File uploads
– Not considering performance, scalability, fast feature rollout, evaluate
– It reflected the fact that we didn’t really know what is our business
– We know that we will need to replace it when we grow.
– However, we failed to understand how difficult that can be!
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
5. Wix Initial Architecture
After two years, we have found out that
• Our initial architecture allowed us to progress vary fast
• However, as we progressed, we slowed down
• So, we learned that
– Don’t worry about ‘building it right from the start’ – you won’t
– You are going to replace stuff you are building in the initial stages
– Be ready to do it
– Get it up to customers as fast as you can. Get feedback. Evolve.
– Our mistake was not planning for gradual re-write
– Build for gradual re-write as you learn the problems and find the right
solutions
6. Distributed Cache
Next we added EHCache as Hibernate 2nd-level cache
• Why?
– Cause it is in the design
• How was it?
– Black Box cache
– How do we know what is the state of our system?
– How to invalidate the cache?
– When to invalidate it?
– How does “operations” manage the cache?
• Did we really need it? No!
• We eventually dropped it
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
7. Editor & Public Segments
• The Challenge - Updates to our Server imposed downtime for our
customer’s websites
– Any Server or Database update has the potential of bringing down all Wix sites
– Is a symptom of a larger issue
• The Server served two different concerns
– Wix Users editing websites
– Viewing Wix Sites, the sites created by the Wix editor
• The two concerns require different SLA
– Wix Sites should never ever have a downtime!
– Wix Sites should work as fast as possible, always!
– However, an editing system does not require this level of SLA.
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
8. Editor & Public Segments
• The two concerns evolve independently
– Releases of Editing feature should have no impact on
Public
existing Wix sites operations! (Tomcat)
Public
DB
• Our Solution
– Split the Server into two Segments – Public and Editor
Editor Editor
• The Public segment targets serving websites for (Tomcat) DB
Wix Users
– Has mostly read-only usage pattern – only updated
when a site is published
– Simple publishing system
– Simple and readonly means it is easier to have higher SLA and DRP
– MySQL used as NoSQL – single large table with XML text fields
• The Editor segment
– Exposes the Wix Editing APIs, as well as user account and galleries
management APIs.
– Has different release schedule compared to the Public segment
9. Editor & Public Segments
What we have learned
• MySQL is a damn good NoSQL engine
Public Public
– Our public DB was (mainly) one huge table (Tomcat) DB
– Queries & Updates are by primary key
– Instead of relations, we use text/xml or text/json columns Editor Editor
– No updates for Blobs – immutable data (Tomcat) DB
– No Transactions
• Use indirection table to blob table
– Insert a new blob value, update the pointer to the new blob, async delete
• MySql auto-generated keys cause problems
– Locks on key generation
– Require a single instance to generate keys
• We use GUID keys
– Can be generated by any client
– No locks in key value generation
– Enabler for Master-Master replication
10. Wix on Managed Hosting
Co-Location Managed Hosting Cloud
Own and maintain your Lease both hardware and Instantly lease hardware
own hardware maintenance
Provisioning == buy and Overnight provisioning Instant provisioning
deliver your new server Unlimited resources
Reliable software on Reliable software on Reliable software on
reliable hardware reliable hardware unreliable hardware
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
11. Wix Media Segment
• The Challenge – Our static storage reached over 500 GByte of small files
– The “upload to app server, post process files, copy to lighttpd server, serve by
lighttpd” pattern proved inefficient, slow and error prone
– Disk IO became slow and inefficient as the number of files increased
– We needed a solution we can grow with –
• HTTP connections
• number of files
– We needed control over caching and Http headers
• We needed dynamic image manipulations
– Rebuild a few millions of media files is not simple
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
12. Prospero – Wix Media Storage
• Our Solution
– Lighttpd based
– Sharded on the file name
– Two copies of each file
get 37D815B5.jpg Go to 37 range servers Fallback if not found
00-1f 20-ef 40-5f 60-7f
0.static HTTP 2.static HTTP 4.static HTTP 6.static
1.static HTTP 3.static HTTP 5.static HTTP 7.static
13. Prospero – Wix Media Storage
• Dynamic Image processing
– Picture Pyramid
– Picture resize, crop and sharpen “on the fly”
– Thumbnail generation
• Eventual Consistency solutions scale
– But you have to build for when eventual consistency is not consistent
• Media files caching headers are critical
– Max-age, ETag, if-modified-since, etc.
– Think how to tune those parameters for media files, as per your specific needs
• We tried Amazon S3 and Google for secondary storage
– However, Amazon proved unreliable (connections, availability)
• We found that using a CDN in front of Prospero is very effective
• Initially, files where stored on the filesystem
• T We added Tokyo Tyrant backend for small files
• M We added Memcached (Redis) layer for “in transit” files
14. Prospero – Wix Media Storage
• Our current architecture
Google Cloud x36
x36
Storage M T x32
M T
M T
Second fallback Chicago
First fallback
CDN x36
x36
M T x32
If not in CDN M T
M T
get 37D815B5.jpg Austin
15. CDN
• Use a CDN!
• CDN acts as a great connection manager
– We have CDN hit ratio’s of over 99.9%
• Use the “Cache Killer” pattern
– http://static.wix.com/client/css/viewer.css?v=327
– http://static.wix.com/client/1.3.2/css/viewer.css
– Makes flushing files from the CDN redundant
– Enabler for longer caching periods
• There are many vendors
– We started with 1 CDN vendor
– We are now working with two CDN vendors
– Different CDN vendors have advantages at different geo
• Tune HTTP Headers per CDN Vendor
– CDN Vendors interpret HTTP headers differently
16. Development Velocity
• The Challenge – Our codebase became large and entangled
– Feature rollout became harder over time, requiring longer and longer manual
regression
– The longer the regression was, the harder is became to make “a good release”
– Strange full-table scans queries generated by Hibernate, which we still have no
idea what code is responsible for…
• The solution
– Mid 2010 – Wix Framework – modern base libraries
– Beginning 2011 – CI / CD / TDD techniques + DevOps culture
– Mid 2011 – Scala
CI / CD / TDD + DevOps
– SOA Architecture (not WSDL)
Scala
Framework
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013
17. People are the key
• Train the people you already have
– We sent our entire QA department to learn Java
– Developers learn TDD and CI/CD methodologies.
• Hiring the right people is key to success
– Hire only the best developers (only seniors)
– Don’t count only on the interview, you need to test actual coding
– Anyone who interviews can drop a candidate
– Hire people who will challenge you (no “yes man”)
– Get people you can trust with “root” access to production
• Never stop hiring
– If we find an excellent person we will create a position for him even if we do
not have one open.
• Wix is doubling its size every year
– Yes we are currently hiring.
– We’re considering to start hiring and training junior developers.
18. Wix’s CI / CD / TDD + DevOps model
• Abandon “VERSION” paradigm – move feature centric life
• Make small and frequent release as soon as possible
– Today we release about 10 times a day, gaining velocity
• Empower the developer
– The developer is responsible from product idea to 100,000 active users
– Remove every obstacle in the developer’s path
– Big cultural change from waterfall – affects the whole company
– The developer is responsible for his app operations
• Automate everything – CI/CD/TDD
– CI – Continuous Integration
– CD – Continuous Delivery / Deployment
– TDD – Automated unit-tests, integration tests, GUI tests
• Measure Everything (The lean startup way)
– A/B test every new feature
– Monitor real KPIs (business, not CPU)
19. CI / CD @ Wix – Release Process
• Make an RC
– Runs build, unit-tests, integration tests
20. CI / CD @ Wix – Release Process
• Deploy as GA
– Using Chef, Noah, Artifactory
– Runs Self-Tests
21. CI / CD @ Wix – Release Process
• Monitor
– Deployment, NewRelic, App-Info, Recent Events
• Rollback
22. Products we’ve built (partial list)
• Wix Mobile
• Wix HTML5
– Full HTML 5 support – total rewrite of our Flash product
• Third Party Applications (TPAs)
– With over 200,000 installations in the 3 first months
• Answers
– Wix unique support system
• Wix Billing System (PCI Compliant)
Billing
– Support complex business models for TPAs TPA
– Support diverse geo eCommerce
App Builder
• eCommerce HTML 5
Answers
– Based on Magento
Mobile
• BI
HTML 5
Flash
2006 2007 2008 2009 2010 2011 2012 2013