Servers, Storage and Networking have all been virtualized, the next big wave is the database. SQL databases are the one thing in the cloud that require single dedicated instances. Database virtualization changes all of this, enabling full elasticity without sacrificing functionality.
Azure SQL Database Managed Instance is a new flavor of Azure SQL Database that is a game changer. It offers near-complete SQL Server compatibility and network isolation to easily lift and shift databases to Azure (you can literally backup an on-premise database and restore it into a Azure SQL Database Managed Instance). Think of it as an enhancement to Azure SQL Database that is built on the same PaaS infrastructure and maintains all it's features (i.e. active geo-replication, high availability, automatic backups, database advisor, threat detection, intelligent insights, vulnerability assessment, etc) but adds support for databases up to 35TB, VNET, SQL Agent, cross-database querying, replication, etc. So, you can migrate your databases from on-prem to Azure with very little migration effort which is a big improvement from the current Singleton or Elastic Pool flavors which can require substantial changes.
Introduction to Azure SQL Database Managed Instance SQLKonferenz 2018. Showing architecture and overview of the features that are available in public preview.
Beyond Aurora. Scale-out SQL databases for AWS Clustrix
As enterprises move to AWS, they have great choices for MySQL compatible databases. Knowing the best database for the specific job can save you time and money. In this webinar, Lokesh Khosla will discuss high-performance databases for AWS and share his findings based on a benchmark test that simulates the workload of a high-transaction AWS-based solution.
If you work with high transactional workloads, and you need a relational database to keep track of economically valuable items like revenue, inventory and monetary transactions, you'll be interested in this discussion about the strengths and weaknesses of Aurora and other MySQL solutions for AWS.
Microsoft Azure platform provides a database as a service offering that allows developers to use SQL in the same way as they would in an on-premises location.
Achieve new levels of performance for Magento e-commerce sites.Clustrix
If you run a Magento store that is impacted negatively by catalog updates or indexing/reindexing, listen in. Avoid catalog updates impacting your checkouts, site downtime and long page view load time with the ClustrixDB for Magento Bundle. Created exclusively for high-volume/complex-catalog retailers, this replacement backend is a proven upgrade for Magento sites.
Let us show you how this all works. Recently, at this year’s Magento Imagine, we ran a LIVE demo of the ClustrixDB for Magento Bundle. Stats from the demo:
System ran for 50 hours -- reindexing up to every 12 minutes.
2.6 million orders processed (14.6 per second)
147 million page views (816 per second)
Average Response time of 267ms
0% error rate, 100% checkout uptime
In this webinar, we’ll also cover:
How you can enable catalog updates to process in the background without affecting the normal operations of your site with the Clustrix Shadow (re)Indexer
A Magento-approved alternative database to MySQL that scales performance up/down as your add/subtract commodity nodes to the cluster. ClustrixDB has no read slaves, replication lag or sharding and Flexes Up and down to deliver exactly the right amount of performance and cost every month of the year.
Azure SQL Database Managed Instance is a new flavor of Azure SQL Database that is a game changer. It offers near-complete SQL Server compatibility and network isolation to easily lift and shift databases to Azure (you can literally backup an on-premise database and restore it into a Azure SQL Database Managed Instance). Think of it as an enhancement to Azure SQL Database that is built on the same PaaS infrastructure and maintains all it's features (i.e. active geo-replication, high availability, automatic backups, database advisor, threat detection, intelligent insights, vulnerability assessment, etc) but adds support for databases up to 35TB, VNET, SQL Agent, cross-database querying, replication, etc. So, you can migrate your databases from on-prem to Azure with very little migration effort which is a big improvement from the current Singleton or Elastic Pool flavors which can require substantial changes.
Introduction to Azure SQL Database Managed Instance SQLKonferenz 2018. Showing architecture and overview of the features that are available in public preview.
Beyond Aurora. Scale-out SQL databases for AWS Clustrix
As enterprises move to AWS, they have great choices for MySQL compatible databases. Knowing the best database for the specific job can save you time and money. In this webinar, Lokesh Khosla will discuss high-performance databases for AWS and share his findings based on a benchmark test that simulates the workload of a high-transaction AWS-based solution.
If you work with high transactional workloads, and you need a relational database to keep track of economically valuable items like revenue, inventory and monetary transactions, you'll be interested in this discussion about the strengths and weaknesses of Aurora and other MySQL solutions for AWS.
Microsoft Azure platform provides a database as a service offering that allows developers to use SQL in the same way as they would in an on-premises location.
Achieve new levels of performance for Magento e-commerce sites.Clustrix
If you run a Magento store that is impacted negatively by catalog updates or indexing/reindexing, listen in. Avoid catalog updates impacting your checkouts, site downtime and long page view load time with the ClustrixDB for Magento Bundle. Created exclusively for high-volume/complex-catalog retailers, this replacement backend is a proven upgrade for Magento sites.
Let us show you how this all works. Recently, at this year’s Magento Imagine, we ran a LIVE demo of the ClustrixDB for Magento Bundle. Stats from the demo:
System ran for 50 hours -- reindexing up to every 12 minutes.
2.6 million orders processed (14.6 per second)
147 million page views (816 per second)
Average Response time of 267ms
0% error rate, 100% checkout uptime
In this webinar, we’ll also cover:
How you can enable catalog updates to process in the background without affecting the normal operations of your site with the Clustrix Shadow (re)Indexer
A Magento-approved alternative database to MySQL that scales performance up/down as your add/subtract commodity nodes to the cluster. ClustrixDB has no read slaves, replication lag or sharding and Flexes Up and down to deliver exactly the right amount of performance and cost every month of the year.
SQL Server Lift & Shift on Azure - SQL Saturday 921Marco Obinu
Slides presented at SQL Saturday 921, while talking about how to plan a Lift & Shift migration for SQL Server workloads, depicting the pros & cons of using different Azure services as landing zones.
Database as a Service (DBaaS) is cloud database hosted and managed by the cloud service providers that can be accessed through public cloud or the hybrid cloud. The cloud provider takes care of provisioning, configuring, setup, maintenance, backups and patching the database. Customers are expected to export the database and start consuming the service through the pay-as-you-go model.
In his session at 5th Big Data Expo, Janakiram MSV will analyze the current market landscape while exploring the available options, strengths and weaknesses of current DBaaS players. He will highlight the key factors that enterprises should consider before adopting a cloud database platform.
How to Set Up ApsaraDB for RDS on Alibaba CloudAlibaba Cloud
See Webinar Recording at https://resource.alibabacloud.com/webinar/detail.htm?webinarId=26
Gain an introduction to ApsaraDB for RDS, a cloud-based relational database product provided by Alibaba Cloud. In this webinar you will watch over the shoulder of a Solution Architect and Trainer, as he covers the basic concepts and features of ApsaraDB for RDS including:
- HA feature (Master/Slave Architecture, Backup/Recovery, Temporary Instance),
- Scalability features (Read-only Instance), and also,
- Security and Monitoring features.
This webinar is ideally suited for database engineers and beginners to the Alibaba Cloud product suite.
ApsaraDB for RDS: www.alibabacloud.com/product/apsaradb-for-rds
The new Microsoft Azure SQL Data Warehouse (SQL DW) is an elastic data warehouse-as-a-service and is a Massively Parallel Processing (MPP) solution for "big data" with true enterprise class features. The SQL DW service is built for data warehouse workloads from a few hundred gigabytes to petabytes of data with truly unique features like disaggregated compute and storage allowing for customers to be able to utilize the service to match their needs. In this presentation, we take an in-depth look at implementing a SQL DW, elastic scale (grow, shrink, and pause), and hybrid data clouds with Hadoop integration via Polybase allowing for a true SQL experience across structured and unstructured data.
How to power microservices with MariaDBMariaDB plc
Adoption of microservices is continuing at a rapid pace, but many deployments struggle when it comes to the database topology and data modeling. This session covers the pros and cons of different approaches (e.g., giving every microservice its own database or its own schema on a shared database) and various strategies for providing a consolidated view of data when different data is managed by different microservices.
Data Integration through Data Virtualization (SQL Server Konferenz 2019)Cathrine Wilhelmsen
Data Integration through Data Virtualization - PolyBase and new SQL Server 2019 Features (Presented at SQL Server Konferenz 2019 on February 21st, 2019)
See webinar recording of this presentation at https://resource.alibabacloud.com/webinar/detail.htm?webinarId=33
Cloud migration is the first big step for any organization wishing to undertake modern digital transformation. For most companies, choosing the best cloud migration strategy is a complex puzzle to solve.
In this webinar presentation, we will look at the high-level elements that an organization should consider as they contemplate a move to Alibaba Cloud. The presentation will also help organizations to understand the different migration scenarios, business strategies, tools and methodologies available to migrate to Alibaba Cloud. This includes how to choose the optimal migration method based on business cases and a short demo of Alibaba Cloud migration tools which can help enterprises to accelerate their cloud migration goals.
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...jaxLondonConference
Presented at JAX London 2013
All too often I have observed infrastructure designs for deploying Java applications come as an afterthought by businesses, technical analysts, and application developers. Choices of technologies are frequently made with no final deployment infrastructures being discussed. The talk will cover the design considerations on building resilient applications, and application deployment platforms across multiple data centres, and how organisations can leverage technologies such as Apache Cassandra to achieve this.
Database Architecture & Scaling Strategies, in the Cloud & on the Rack Clustrix
Watch the recording here: https://www.youtube.com/watch?v=ZwERp38ynxQ&feature=youtu.be
In this webinar, Robbie Mihayli, VP of Engineering at Clustrix explores how to set up a SQL RDBMS architecture that scales out and is both elastic and consistent, while simultaneously delivering fault tolerance and ACID compliance.
He also covers how data gets distributed in this architecture, how the query processor works, how rebalancing happens and other architectural elements. Examples cited include cloud deployments and e-commerce use-cases.
In this webinar, you will learn:
1. Five RDBMS scaling strategies along with their trade offs
2. The importance of having no single point of failure for OLTP (fault tolerance)
3. The vagaries of the cloud and how it impacts using an RDBMS in the cloud
Who should watch?
1. People interested in high performance, real-time database solutions
2. Companies who have MySQL in their infrastructure and are concerned that their growth will soon overwhelm MySQL’s single-box design
3. DBA’s who implement ‘read slaves’, ‘multiple-masters’ and ‘sharding’ for MySQL databases and want to learn about better ways to scale
PaaSport to Paradise: Lifting & Shifting with Azure SQL Database/Managed Inst...Sandy Winarko
This session focuses on the all PaaS solution of Azure SQL DB/Managed Instance (MI) + SSIS in Azure Data Factory (ADF) to lift & shift, modernize, and extend ETL workflows. We will first show you how to provision Azure-SSIS Integration Runtime (IR) – dedicated ADF servers for running SSIS – with SSIS catalog (SSISDB) hosted by Azure SQL DB/MI, configure it to access data on premises using Windows authentication and Virtual Network injection/Self-Hosted IR as a proxy, and extend it with custom/Open Source/3rd party components. We will next show you how to use the familiar SSDT/SSMS tools to design/test/deploy/execute your SSIS packages in the cloud just like you do on premises. We will finally show you how to modernize your ETL workflows by invoking/scheduling SSIS package executions as first-class activities in ADF pipelines and combining/chaining them with other activities, allowing you to trigger your pipeline runs by events, automatically (de)provision SSIS IR just in time, etc.
ScaleBase Webinar: Scaling MySQL - Sharding Made Easy!ScaleBase
Home-grown sharding is hard - REALLY HARD! ScaleBase scales-out MySQL, delivering all the benefits of MySQL sharding, with NONE of the sharding headaches. This webinar explains: MySQL scale-out without embedding code and re-writing apps, Successful sharding on Amazon and private clouds, Single vs. multiple shards per server, Eliminating data silos, Creating a redundant, fault tolerant architecture with no single-point-of-failure, Re-balancing and splitting shards
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?Clustrix
At Clustrix, we think sharding is like stepping in quicksand. Once you make that step, you are stuck constantly maintaining it.
If you are trying to decide to shard or not to shard your MySQL database, or if you are just sick of living with sharding, give our webinar a listen. We’ll walk you through how to think about the problem at hand, and how to avoid getting mired in that quicksand down the road by answering these questions:
- Why do DBAs think sharding is the only end-game?
- What are the long-term costs of sharding?
- What is a better alternative to sharding MySQL?
- How real is it? Is it too good to be true?
View the webcast of this Tech Talk on our YouTube channel.
SQL Server Lift & Shift on Azure - SQL Saturday 921Marco Obinu
Slides presented at SQL Saturday 921, while talking about how to plan a Lift & Shift migration for SQL Server workloads, depicting the pros & cons of using different Azure services as landing zones.
Database as a Service (DBaaS) is cloud database hosted and managed by the cloud service providers that can be accessed through public cloud or the hybrid cloud. The cloud provider takes care of provisioning, configuring, setup, maintenance, backups and patching the database. Customers are expected to export the database and start consuming the service through the pay-as-you-go model.
In his session at 5th Big Data Expo, Janakiram MSV will analyze the current market landscape while exploring the available options, strengths and weaknesses of current DBaaS players. He will highlight the key factors that enterprises should consider before adopting a cloud database platform.
How to Set Up ApsaraDB for RDS on Alibaba CloudAlibaba Cloud
See Webinar Recording at https://resource.alibabacloud.com/webinar/detail.htm?webinarId=26
Gain an introduction to ApsaraDB for RDS, a cloud-based relational database product provided by Alibaba Cloud. In this webinar you will watch over the shoulder of a Solution Architect and Trainer, as he covers the basic concepts and features of ApsaraDB for RDS including:
- HA feature (Master/Slave Architecture, Backup/Recovery, Temporary Instance),
- Scalability features (Read-only Instance), and also,
- Security and Monitoring features.
This webinar is ideally suited for database engineers and beginners to the Alibaba Cloud product suite.
ApsaraDB for RDS: www.alibabacloud.com/product/apsaradb-for-rds
The new Microsoft Azure SQL Data Warehouse (SQL DW) is an elastic data warehouse-as-a-service and is a Massively Parallel Processing (MPP) solution for "big data" with true enterprise class features. The SQL DW service is built for data warehouse workloads from a few hundred gigabytes to petabytes of data with truly unique features like disaggregated compute and storage allowing for customers to be able to utilize the service to match their needs. In this presentation, we take an in-depth look at implementing a SQL DW, elastic scale (grow, shrink, and pause), and hybrid data clouds with Hadoop integration via Polybase allowing for a true SQL experience across structured and unstructured data.
How to power microservices with MariaDBMariaDB plc
Adoption of microservices is continuing at a rapid pace, but many deployments struggle when it comes to the database topology and data modeling. This session covers the pros and cons of different approaches (e.g., giving every microservice its own database or its own schema on a shared database) and various strategies for providing a consolidated view of data when different data is managed by different microservices.
Data Integration through Data Virtualization (SQL Server Konferenz 2019)Cathrine Wilhelmsen
Data Integration through Data Virtualization - PolyBase and new SQL Server 2019 Features (Presented at SQL Server Konferenz 2019 on February 21st, 2019)
See webinar recording of this presentation at https://resource.alibabacloud.com/webinar/detail.htm?webinarId=33
Cloud migration is the first big step for any organization wishing to undertake modern digital transformation. For most companies, choosing the best cloud migration strategy is a complex puzzle to solve.
In this webinar presentation, we will look at the high-level elements that an organization should consider as they contemplate a move to Alibaba Cloud. The presentation will also help organizations to understand the different migration scenarios, business strategies, tools and methodologies available to migrate to Alibaba Cloud. This includes how to choose the optimal migration method based on business cases and a short demo of Alibaba Cloud migration tools which can help enterprises to accelerate their cloud migration goals.
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...jaxLondonConference
Presented at JAX London 2013
All too often I have observed infrastructure designs for deploying Java applications come as an afterthought by businesses, technical analysts, and application developers. Choices of technologies are frequently made with no final deployment infrastructures being discussed. The talk will cover the design considerations on building resilient applications, and application deployment platforms across multiple data centres, and how organisations can leverage technologies such as Apache Cassandra to achieve this.
Database Architecture & Scaling Strategies, in the Cloud & on the Rack Clustrix
Watch the recording here: https://www.youtube.com/watch?v=ZwERp38ynxQ&feature=youtu.be
In this webinar, Robbie Mihayli, VP of Engineering at Clustrix explores how to set up a SQL RDBMS architecture that scales out and is both elastic and consistent, while simultaneously delivering fault tolerance and ACID compliance.
He also covers how data gets distributed in this architecture, how the query processor works, how rebalancing happens and other architectural elements. Examples cited include cloud deployments and e-commerce use-cases.
In this webinar, you will learn:
1. Five RDBMS scaling strategies along with their trade offs
2. The importance of having no single point of failure for OLTP (fault tolerance)
3. The vagaries of the cloud and how it impacts using an RDBMS in the cloud
Who should watch?
1. People interested in high performance, real-time database solutions
2. Companies who have MySQL in their infrastructure and are concerned that their growth will soon overwhelm MySQL’s single-box design
3. DBA’s who implement ‘read slaves’, ‘multiple-masters’ and ‘sharding’ for MySQL databases and want to learn about better ways to scale
PaaSport to Paradise: Lifting & Shifting with Azure SQL Database/Managed Inst...Sandy Winarko
This session focuses on the all PaaS solution of Azure SQL DB/Managed Instance (MI) + SSIS in Azure Data Factory (ADF) to lift & shift, modernize, and extend ETL workflows. We will first show you how to provision Azure-SSIS Integration Runtime (IR) – dedicated ADF servers for running SSIS – with SSIS catalog (SSISDB) hosted by Azure SQL DB/MI, configure it to access data on premises using Windows authentication and Virtual Network injection/Self-Hosted IR as a proxy, and extend it with custom/Open Source/3rd party components. We will next show you how to use the familiar SSDT/SSMS tools to design/test/deploy/execute your SSIS packages in the cloud just like you do on premises. We will finally show you how to modernize your ETL workflows by invoking/scheduling SSIS package executions as first-class activities in ADF pipelines and combining/chaining them with other activities, allowing you to trigger your pipeline runs by events, automatically (de)provision SSIS IR just in time, etc.
ScaleBase Webinar: Scaling MySQL - Sharding Made Easy!ScaleBase
Home-grown sharding is hard - REALLY HARD! ScaleBase scales-out MySQL, delivering all the benefits of MySQL sharding, with NONE of the sharding headaches. This webinar explains: MySQL scale-out without embedding code and re-writing apps, Successful sharding on Amazon and private clouds, Single vs. multiple shards per server, Eliminating data silos, Creating a redundant, fault tolerant architecture with no single-point-of-failure, Re-balancing and splitting shards
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?Clustrix
At Clustrix, we think sharding is like stepping in quicksand. Once you make that step, you are stuck constantly maintaining it.
If you are trying to decide to shard or not to shard your MySQL database, or if you are just sick of living with sharding, give our webinar a listen. We’ll walk you through how to think about the problem at hand, and how to avoid getting mired in that quicksand down the road by answering these questions:
- Why do DBAs think sharding is the only end-game?
- What are the long-term costs of sharding?
- What is a better alternative to sharding MySQL?
- How real is it? Is it too good to be true?
View the webcast of this Tech Talk on our YouTube channel.
Scaling Databricks to Run Data and ML Workloads on Millions of VMsMatei Zaharia
Keynote at Scale By The Bay 2020.
Cloud service developers need to handle massive scale workloads from thousands of customers with no downtime or regressions. In this talk, I’ll present our experience building a very large-scale cloud service at Databricks, which provides a data and ML platform service used by many of the largest enterprises in the world. Databricks manages millions of cloud VMs that process exabytes of data per day for interactive, streaming and batch production applications. This means that our control plane has to handle a wide range of workload patterns and cloud issues such as outages. We will describe how we built our control plane for Databricks using Scala services and open source infrastructure such as Kubernetes, Envoy, and Prometheus, and various design patterns and engineering processes that we learned along the way. In addition, I’ll describe how we have adapted data analytics systems themselves to improve reliability and manageability in the cloud, such as creating an ACID storage system that is as reliable as the underlying cloud object store (Delta Lake) and adding autoscaling and auto-shutdown features for Apache Spark.
Rightscale Webinar: The number one cause of poor scalable web application performance is the database. This problem is magnified in cloud environments where I/O and bandwidth are generally slower and less predictable than in dedicated data centers. Database sharding is a highly effective method of removing the database scalability barrier by operating on top of proven RDBMS products such as MySQL and PostgreSQL.
In this webinar, you'll learn what it really takes to implement sharding, the role it plays in the effective end-to-end lifecycle management of your entire database environment, and why it is crucial for ensuring reliability.
In this webinar, we will:
- Guide you on how to choose the best technology for your specific application
- Show you how to shard your existing database
- Review a case study on a Top 20 Facebook application built on dbShards
This presentation, given by Dave Rosenthal at NoSQL Now! 2013, presents the case for why he believes NoSQL databases will need to support ACID transactions in order for developers to more easily build, deploy, and scale applications in the future.
Picking the Right Clustering for MySQL - Cloud-only Services or Flexible Tung...Continuent
As businesses head into the cloud, it is tempting to use the first product that offers to make database operation relatively simple by punching a few buttons on a menu. However, there's a big difference between firing up cloud database services, such as Amazon RDS, for testing or development and finding a real data management solution, such as Continuent Tungsten, that can handle hundreds of millions of transactions daily.
This webinar explores how your business can benefit from Continuent Tungsten, a flexible clustering solution that helps data-driven businesses handle billions of transactions daily across a wide range of environments. We'll focus on the following problems in particular:
- Ensuring fully capable cloud DBMS operation
- Avoiding lock-in by choosing solutions that run across clouds as well as on-premises
- Spreading MySQL data over regions using flexible primary/DR and multi-master topologies
- Controlling maintenance intervals and the DBMS stack directly
- Integrating in real-time to data warehouses and on-premises DBMS like Oracle
- Ensuring immediate access to top-notch, 24x7 support when things go south.
Your data is too precious to take shortcuts. Learn how you can use Continuent Tungsten to build scalable management solutions that offer the economic benefits of the cloud with the enterprise capabilities required by businesses that live and die by their data.
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyContinuent
Users seeking high availability, disaster recovery and zero downtime maintenance operation for business-critical MySQL applications face confusing choices. Is multi-master or master/slave clustering better? What about synchronous versus asynchronous replication? Using a plain vanilla, stock MySQL or a modified version of it? Which of these choices are right for data-driven businesses that depend on fast, reliable data access?
This no-BS webinar cuts through the FUD to explore the real trade-offs between the different clustering and replication methods, thens show you how Continuent's asynchronous master/slave clusters support these important capabilities for business-critical applications:
- High application write rates Master/slave clustering with Continuent
- Mixed workloads consisting of large and small transactions
- Data across multiple geographically distributed locations
- Failures and more importantly recovery from them
- Zero downtime maintenance and software upgrades
- Use of off-the-shelf MySQL/MariaDB to avoid application changes and allow clusters to improve as MySQL itself does.
We illustrate key points with demonstrations and case studies from deployed systems.
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksDatabricks
The cloud has become one of the most attractive ways for enterprises to purchase software, but it requires building products in a very different way from traditional software
Supporting Hadoop in containers takes much more than the very primitive support Docker provides using the Storage Plugin. A production scale Hadoop deployment inside containers needs to honor anti/affinity, fault-domain and data-locality policies. Kubernetes alone, with primitives such as StatefulSets and PersitentVolumeClaims, is not sufficient to support a complex data-heavy application such as Hadoop. One needs to think about this problem more holistically across containers, networking and storage stacks. Also, constructs around deployment, scaling, upgrade etc in traditional orchestration platforms is designed for applications that have adopted a microservices philosophy, which doesn't fit most Big Data applications across the ingest, store, process, serve and visualization stages of the pipeline. Come to this technical session to learn how to run and manage lifecycle of containerized Hadoop and other applications in the data analytics pipeline efficiently and effectively, far and beyond simple container orchestration. #BigData, #NoSQL, #Hortonworks, #Cloudera, #Kafka, #Tensorflow, #Cassandra, #MongoDB, #Kudu, #Hive, #HBase, PARTHA SEETALA, CTO, Robin Systems.
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director...exponential-inc
Developers are leading the charge to turn consumer behavior into profitable solutions. By accessing and analyzing the explosion of data from consumer activities, any developer can create the personalized, relevant products and services that customers demand and merchants urgently need. Brian will discuss how to acquire, store, and mine information, and how to design analytics-focused software and build data-driven software engines.
Keynote Address at 2013 CloudCon: A day in the life of the SMB by Michael To...exponential-inc
How can I benefit from the cloud? I hear about the cloud all the time, but what will it really do for me and my business? These and other questions about “cloud” and IT services are part of the day in the life of every SMB (Small to Medium-sized Business) customer in the U.S. market. The reason they are in business or running a business does not center around Cloud and IT, but on their business. Whether it is keeping the retail sales flowing or food products going out the door, which is why they are in business. A good IT services and Cloud provider is there to provide the support they need to run their businesses more efficiently and effectively so they can truly focus on what they love, their business. Michael Toplisek, the EVP of Marketing and Product at EarthLink will use real customer examples to illustrate how excellent cloud services can help the smb customer lift some of the burdens of their daily business allowing them to do the things they do best.
Keynote Address at 2013 CloudCon: Future of Enterprise IT: Manage Cloud Spraw...exponential-inc
We’ve all heard again and again that the cloud enables agility and velocity, and creates independence for business lines within the enterprise. Without coordination and oversight, however, the easy and widespread access to a mix of public, private and hybrid cloud solutions across IaaS, SaaS and PaaS has resulted in unchecked cloud sprawl within organizations. Cloud sprawl is splintering applications, systems and solutions across the enterprise. It has left IT without any visibility or authority, while accountability continues to be firmly placed on their shoulders. This is creating levels of complexities and liabilities that defy business sense. It has also resulted in enterprises missing opportunities, including better cost management.
John will discuss the value of IT not only in ensuring business-critical coordination, compliance and security, as well as cost-savings, but also the role IT can play in championing innovation. He will present systems and solutions that will allow IT to deliver all the benefits of cloud adoption, all the speed and velocity, while maintaining the crucial ability to govern. This keynote is based on AppFog's own experience in meeting the challenges of running a public cloud strategy at scale, without reverting to the traditional and unsustainable option of vendor lock-in. It also draws from AppFog’s deep experience in developing, deploying and managing private and hybrid cloud solutions.
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc
Over the last few years we’ve seen a frenzy of interest and buzz around the area of Big Data. Beyond the hype, there is a solid base of growing use cases, which are becoming center stage to most businesses. 2012 was the year of awareness. There was a great amount of sharing from the early core developers of the analytic platforms – showing the rest of the world the capabilities of the tools and platforms that had been developed for special purpose high scale analytics. The big names at the core of open source analytics development include Facebook, eBay, Linkedin, Twitter – all blazing the trail with new approaches. These companies brought along with them a new and expanding interest in leveraging the same technologies for commercial interest.
This talk is focused at how a growing number of enterprises that are already heavily invested in the use cases – but by volume, most customers now have some form of big data proof-of-concept underway. These proof of concepts typically start with a thesis of how competitive advantage can be gained through insight from the data. A proof of concept can quickly validate the theory, and helps sell further investment in the analytics platform, and it snowballs from there.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
2. 2
Agenda
• Big Data: A Moving Target
• Common Understanding of Virtualization
• Database Virtualization Challenge
• Alternative 1: NoSQL
• Alternative 2: Sharding
• Introducing Database Virtualization
• Narrowing the Gap Between Databases and Big Data
3. 3
Big Data: A Moving Target
• Definition: Too much data to
handle in a traditional database
• Big Data tools leverage scale-
out architectures e.g. Hadoop
• Technology advances make Big
Data a moving target
• Databases adopting scale-
out, virtual database
architectures
DataVolume
Time
BIG Data
5. 5
The Dedicated Server
A Server
Server Utilization
Headroom (to avoid failure)
Usage Spike
(Average 10%)
6. 6
The Virtualized App Server
Shared among many customers
Plenty of room for usage peaks
Virtualization enables Cloud Providers to sell 3-4 TIMES more
servers than they actually own. This is how they make money.
7. 7
Database Virtualization Challenges
• No coordination between databases (data & locking)
Bank Balance = $10M
Withdraw $10M
Wire $8M
Wire $8M
Bank Balance = -$16M
Bank
You
• Requires a distributed locking solution
• Distributed locking is fairly easy to build…
• …but building it to perform well is extremely hard
• It took Oracle RAC 10 years …70 “cloud years”
9. 9
Alternative 1: NoSQL
Moves functionality to the application tier…more work for you
Your Application
Cons:
1. Non-relational (build this into your app)
2. Reduces consistency: different users/different answers
3. Removes transactions (build this into your app)
4. Less functionality e.g. joins (build these into your app)
The DBMS SQL
NoSQL
App App
You buy this part
You build & maintain this part
Pros:
1. Scalability
2. Elastic = high utilization
10. 10
Alternative 2: SQL Sharding
Masters
Slaves
EACH server must handle the peak for ITS data
Cons:
1. Not elastic = no bursting across servers
2. Rigid partitioning model
3. Requires slaves for fail-over (vs. high-availability)
4. You have to build & maintain routing code
Pros:
1. Relational
2. Consistent data (ACID)
3. Transactional
4. Full functionality
No elasticity means no bursting
across servers, requiring low
utilization.
Not highly-available, relies on
fail-over
11. 11
Introducing Database Virtualization
Highly-available data tier
shared across multiple
database clusters
Database Tier
(CPU)
Storage Tier
(I/O)
Virtualizes & Shares Storage Tier across Elastic Database Clusters
Shared among many customers
Plenty of room for usage peaks
Pros:
1. Relational
2. Consistent data (ACID)
3. Transactional
4. Full functionality
5. Elastic
6. No slaves
12. 12
Introducing Database Virtualization
Processed at the storage
tier, only results are sent
back to the database
Database Tier
(CPU)
Storage Tier
(I/O)
Distributed Parallel Process Across Storage Servers
Query:
What were my sales last month?
• Distributed Parallel Processing: Similar to Map-Reduce & Oracle Exadata
• This Narrows the Gap between Databases and Big Data
13. 13
Database Virtualization Enables DBaaS
Processing shared
across database nodes
Highly-available data tier
shared across multiple
database clusters
Database Tier
(CPU)
Storage Tier
(I/O)
Virtualizes & Shares Storage Tier across Elastic Database Clusters
16. 16
Performance: ScaleDB vs. InnoDB
Performance tests running on DL380 servers, large data set
0
500
1000
1500
2000
2500
550
1238
1884
2236
MariaDB
+InnoDB
ScaleDB
1-Node
ScaleDB
2-Nodes
ScaleDB
3-Nodes
Benchmark Details: YCSB Workload A, 1:1 Read/Write Ratio, Database Size: 200M Rows, MariaDB V5.3.5
OperationsperSecond
17. 17
Performance: ScaleDB vs. InnoDB
Performance tests running on HP Cloud (Read:Write Ratio = 1:1)
MySQL
+InnoDB
ScaleDB
1-Node
ScaleDB
2-Nodes
Benchmark Details: YCSB Workload A, 1:1 Read/Write Ratio, Database Size: 40M Rows, MySQL V5.1.42
OperationsperSecond
0
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
544
3542
4668
18. 18
Performance: ScaleDB vs. InnoDB
Performance tests running on HP Cloud (Read-Only)
MySQL
+InnoDB
ScaleDB
1-Node
ScaleDB
2-Nodes
Benchmark Details: YCSB Workload A, 1:0 Read/Write Ratio, Database Size: 40M Rows, MySQL V5.1.42
0
2000
4000
6000
8000
10000
12000
930
6117
11920
OperationsperSecond
19. 19
Performance: ScaleDB vs. InnoDB
Sysbench benchmark running on HP Cloud (Read-Only)
MySQL
+InnoDB
ScaleDB
1-Node
ScaleDB
2-Nodes
Benchmark Details: Sysbench, Read-Only, Database Size: 500M Rows, MySQL V5.1.42
TransactionsperSecond
0
50
100
150
200
250
7
134
250
20. 20
Performance: ScaleDB vs. InnoDB
Sysbench benchmark running on HP Cloud (10% Write )
MySQL
+InnoDB
ScaleDB
1-Node
ScaleDB
2-Nodes
Benchmark Details: Sysbench, 10% Write, Database Size: 500M Rows, MySQL V5.1.42
TransactionsperSecond
0
10
20
30
40
50
60
70
80
3
50
79
21. 21
Summary
• Database Scale-out & Parallelization Address Big Data
• Scaling-out SQL Database Problem: Distributed Locking
• Alternative 1: NoSQL
• Alternative 2: Sharding
• Both Shift Functionality to the Application Tier
• Introducing Database Virtualization…with Performance!
• Closing the Gap Between Databases and Big Data
Average server utilization runs at about 10%, that then enables your IT or your cloud provider to use/sell the unused capabilities.
Companies no longer have to
Companies no longer have to
Easy to build, you simply lock the other nodes, while one is writing….but then your performance is terrible. How hard is it to build this distributed lock manager? It took Oracle 10 years to get it right with RAC. 10 Years….That’s 70 cloud years…who has time for that?
Mitigating Factors: “It depends”Distribution of data/loadUse of slaves to handle read load
ScaleDB virtualizes the database, turning it into a database tier and a storage tier. The storage tier provides a pool of cache that is shared among various clusters, enabling it to share I/O peaks across multiple nodes. The database tier then enables very high utilization because they elastically expand to handle peaks. The only Con to this architecture is that it takes the developer a long time to build…but we’ve done that!
ScaleDB virtualizes the database, turning it into a database tier and a storage tier. The storage tier provides a pool of cache that is shared among various clusters, enabling it to share I/O peaks across multiple nodes. The database tier then enables very high utilization because they elastically expand to handle peaks.
ScaleDB virtualizes the database, turning it into a database tier and a storage tier. The storage tier provides a pool of cache that is shared among various clusters, enabling it to share I/O peaks across multiple nodes. The database tier then enables very high utilization because they elastically expand to handle peaks.
