A social game, by it's very nature, can spread very quickly to a large user population. Because the game is typically interactive, the speed of retrieving information needed for the user's interactions with the system is critical. When building their new game Animal Party, the developers at Tribal Crossing needed to get away from the complexity of sharding an SQL database. They also were looking for a solution to the administration cost associated with the operation of traditional data stores. When evaluating multiple different NoSQL solutions, they realized that Couchbase's Membase server meets most of their critical requirements in developing their game software. Simple to use, Couchbase's model allows Tribal Crossing to easily model their game interactions with the key/value data store. Fast read and write performance is required with interactive, social games, and they found that support in Membase as well. Elastic scalability is easily achieved by simply adding more nodes to the Couchbase cluster without any modifications required to the application. Relying on Couchbase's technology Tribal Crossing has been able to quickly build and scale Animal Party with a small team and no dedicated system administrators.
http://sdec.kr/
Netflix
has
built
and
deployed
a
scalable
global
Platorm
as
a
Service.
Key
components
of
the
Netflix
PaaS
are
being
released
as
Open
Source
projects
so
you
can
build
your
own
custom
PaaS
Netflix
has
built
and
deployed
a
scalable
global
Platorm
as
a
Service.
Key
components
of
the
Netflix
PaaS
are
being
released
as
Open
Source
projects
so
you
can
build
your
own
custom
PaaS
Modularizing and aggregating physical resources in a datacenter depends not only on low-latency networking, but also on software techniques to deliver such capabilities. In the session we will present some practical features and results of our work, as well as discuss implementation details. Among these features are delivering high-performance, transparent, and partially fault tolerant memory aggregation; and reducing the downtime of live migration using post-copy implementations.
We will present and discuss methods of transparently integrating with the MMU at the OS level, without impacting a running VM;
We will then introfuce the Hecatonchire project ( http://www.hecatonchire.com ) which aim at the disaggregation of datacenter resources and enable true utility computing.
Developing polyglot applications on Cloud Foundry (#oredev 2012)Chris Richardson
Developing web applications used to be simple. Your single war-file web application served up HTML to a desktop browser and used a relational database. Today however, web applications are much more complex: the front-end uses HTML5 and NodeJS, the middle tier is decomposed into multiple services, and the back-end uses a mix of SQL and NoSQL databases. Developing these kind of applications can be challenging since there are so many moving parts that need to be correctly installed and configured. Deployment is even more difficult.
In this talk, you will learn why we need to build applications with this architectural style and how Cloud Foundry, which is modern, multi-lingual, multi-service, extensible open-source PaaS, can help. We will talk about how to develop modern applications that run on Cloud Foundry and cover what’s new and different about the cloud environment. You will learn how your application can consume the various services that are provided by Cloud Foundry. We will discuss the various ways of using Cloud Foundry including the Micro Cloud that runs on a laptop as well as the hosted CloudFoundry.com.
Deskpool making vdi cost effective for smbDongLiwu
Deskpool VDI solution is very suitable for small companies looking to control IT costs , which not only provides low cost VDI software solution, but also delivery low-cost, high performance thin client products.
Variety is the spice of life, but it’s also the reality of big data. For this reason, JSON has now becoming lingua franca of data in the internet – for APIs, data exchange, data storage and data processing. In the business intelligence world, SQL is the language to analyze the data in other forms. Hence, the myriad of “SQL-on-Hadoop” projects. However, traditional SQL isn’t JSON/Parquet/etc. friendly. ETL into flattened tables is costly and not real time.
Apache Drill unifies SQL with variety of data forms on Hadoop. That enables interactive analytics using your favorite BI tool and visualization tool on you data simultaneously. In this talk, we’ll introduce Apache Drill and describe use cases.
- See more at: http://nosql2014.dataversity.net/sessionPop.cfm?confid=81&proposalid=6850#sthash.NhuLz6Dq.dpuf
Introduction to NoSQL (Use case, considerations to NoSQL). Presentation of Couchbase with update on Couchbase 4.5 and Couchbase mobile 1.2. Special thanks to Dipti Borkar who inspired a large part of this presentation.
Modularizing and aggregating physical resources in a datacenter depends not only on low-latency networking, but also on software techniques to deliver such capabilities. In the session we will present some practical features and results of our work, as well as discuss implementation details. Among these features are delivering high-performance, transparent, and partially fault tolerant memory aggregation; and reducing the downtime of live migration using post-copy implementations.
We will present and discuss methods of transparently integrating with the MMU at the OS level, without impacting a running VM;
We will then introfuce the Hecatonchire project ( http://www.hecatonchire.com ) which aim at the disaggregation of datacenter resources and enable true utility computing.
Developing polyglot applications on Cloud Foundry (#oredev 2012)Chris Richardson
Developing web applications used to be simple. Your single war-file web application served up HTML to a desktop browser and used a relational database. Today however, web applications are much more complex: the front-end uses HTML5 and NodeJS, the middle tier is decomposed into multiple services, and the back-end uses a mix of SQL and NoSQL databases. Developing these kind of applications can be challenging since there are so many moving parts that need to be correctly installed and configured. Deployment is even more difficult.
In this talk, you will learn why we need to build applications with this architectural style and how Cloud Foundry, which is modern, multi-lingual, multi-service, extensible open-source PaaS, can help. We will talk about how to develop modern applications that run on Cloud Foundry and cover what’s new and different about the cloud environment. You will learn how your application can consume the various services that are provided by Cloud Foundry. We will discuss the various ways of using Cloud Foundry including the Micro Cloud that runs on a laptop as well as the hosted CloudFoundry.com.
Deskpool making vdi cost effective for smbDongLiwu
Deskpool VDI solution is very suitable for small companies looking to control IT costs , which not only provides low cost VDI software solution, but also delivery low-cost, high performance thin client products.
Variety is the spice of life, but it’s also the reality of big data. For this reason, JSON has now becoming lingua franca of data in the internet – for APIs, data exchange, data storage and data processing. In the business intelligence world, SQL is the language to analyze the data in other forms. Hence, the myriad of “SQL-on-Hadoop” projects. However, traditional SQL isn’t JSON/Parquet/etc. friendly. ETL into flattened tables is costly and not real time.
Apache Drill unifies SQL with variety of data forms on Hadoop. That enables interactive analytics using your favorite BI tool and visualization tool on you data simultaneously. In this talk, we’ll introduce Apache Drill and describe use cases.
- See more at: http://nosql2014.dataversity.net/sessionPop.cfm?confid=81&proposalid=6850#sthash.NhuLz6Dq.dpuf
Introduction to NoSQL (Use case, considerations to NoSQL). Presentation of Couchbase with update on Couchbase 4.5 and Couchbase mobile 1.2. Special thanks to Dipti Borkar who inspired a large part of this presentation.
JavaOne 2013: «Java and JavaScript - Shaken, Not Stirred»Viktor Gamov
There is a perception in the Java community that JavaScript is a second-league interpreted language with the main purpose of making Web pages a little prettier. But JavaScript is a powerful, flexible, dynamically typed language. And today language has been experiencing its a revival driven by the interest in HTML5. Nashorn is a modern JavaScript engine available on JVM, and it’s already included with JDK8 builds. This presentation is about building polyglot application with Java and JavaScript.
Creating your own private Download Center with Bintray Baruch Sadogursky
Maintaining a download center eats up valuable resources. Bintray offers a new and effective way to distribute your software packages, both internally and externally. Whether you're distributing commercial software that requires a secure permission-based download center, or want to distribute free open source software, Bintray has the solution built-in.
DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code SF...Baruch Sadogursky
As in a good Greek Tragedy, scaling devops to big teams has 3 stages and usually end badly. In this play (it’s more than a talk!) we’ll present you with Pentagon Inc, and their way to scaling devops from a team of 3 engineers to a team of 100 (spoiler – it’s painful!)
We aren't sure about you, but working with Java 8 made one of the speakers lose all of his hair and the other lose his sleep (or was it the jetlag?). If you still haven't reached the level of Brian Goetz in mastering lambdas and strings, this talk is for you. And if you think you have, we have some bad news for you, you should attend as well.
Utilizing Arrays: Modeling, Querying and IndexingKeshav Murthy
Arrays can be simple; arrays can be complex. JSON arrays give you a method to collapse the data model while retaining structure flexibility. Arrays of scalars, objects, and arrays are common structures in a JSON data model. Once you have this, you need to write queries to update and retrieve the data you need efficiently. This talk will discuss modeling and querying arrays. Then, it will discuss using array indexes to help run those queries on arrays faster.
Testing Flex RIAs for NJ Flex user groupViktor Gamov
Why to test?
● Automation testing and tools overview
● Flex Automation 101
○ Flex Automation Framework building blocks ○ How to prepare you components for
automation testing
● Using FlexMonkey for testing custom
components
Understanding N1QL Optimizer to Tune QueriesKeshav Murthy
Every flight has a flight plan. Every query has a query plan. You must have seen its text form, called EXPLAIN PLAN. Query optimizer is responsible for creating this query plan for every query, and it tries to create an optimal plan for every query. In Couchbase, the query optimizer has to choose the most optimal index for the query, decide on the predicates to push down to index scans, create appropriate spans (scan ranges) for each index, understand the sort (ORDER BY) and pagination (OFFSET, LIMIT) requirements, and create the plan accordingly. When you think there is a better plan, you can hint the optimizer with USE INDEX. This talk will teach you how the optimizer selects the indices, index scan methods, and joins. It will teach you the analysis of the optimizer behavior using EXPLAIN plan and how to change the choices optimizer makes.
We all are professionals, e.g. software engineers, quality engineers, technical/team leaders, project/product managers, etc. But we all are humans too. Often due to different reasons, like tight deadlines, push from customers/clients, etc., we all tend to neglect common sense and omit important practices. In this talk based on my both positive and negative experience we will review some patterns how we make common mistakes and what terrible results they may lead us to.
Presented at XP Days Ukraine Conference in Kyiv in 2015.
Design by Yarko Filevych (http://www.filevych.com/)
Patterns and antipatterns in Docker image lifecycle @ DevOpsDays Charlotte 2017Baruch Sadogursky
While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.
Patterns and antipatterns in Docker image lifecycle as was presented at Oracl...Baruch Sadogursky
While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.
Patterns and antipatterns in Docker image lifecycle as was presented at Scale...Baruch Sadogursky
While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.
How AOL Advertising Uses NoSQL to Make Millions of Smart Targeting Decisions ...DATAVERSITY
Real-time content, offer and ad targeting decisions must happen quickly. When a user requests information from a web application, a processing clock starts, requiring a decision in as little as 40 msec. Delays in targeting decisions lead to delays in responding to the user. These delays can lead to user dissatisfaction and, ultimately, loss of audience and revenue.
This session describes how AOL Advertising uses Hadoop to create sophisticated user profiles and NoSQL database technology from Couchbase to access those profiles in real-time, with sub-millisecond latency. This architecture leaves the bulk of the processing time budget for improved content, offer and ad targeting and even real-time content customization.
Amazon Web Services Building Blocks for Drupal Applications and HostingAcquia
Cloud computing offers many advantages and challenges for hosting Drupal sites. Acquia Hosting is a highly available cloud-based hosting platform tuned for Drupal performance and scalability. Acquia Hosting built on Amazon Web Services (AWS), takes advantage of an industry leading cloud-computing platform to provide the highest levels of security, fault-tolerance and operational controls possible in the cloud. This Webinar, featuring Barry Jaspan, Senior Architect at Acquia and Jeff Barr, Senior Evangelist Amazon Web Services, discusses how Amazon's Web Services can help Drupal site developers and managers solve common but vexing problems, including scaling. The Elastic Compute Cloud (EC2) components will be discussed in detail.
In addition we will discuss specific best practices for:
* Creating a high-performance, high-availability Drupal tuned hosting environment on AWS
* Load balancing: Elastic IP vs. Elastic Load Balancing
* Handling user-uploaded files with multiple web nodes
* Achieving true high-availability with multiple availability zones
* Choosing between Amazon Relational Database Service and building it yourself
* Configuring and managing your cloud servers
Before joining Couchbase Phil has been a consultant on many different node.js and NoSQL projects working with many different languages and databases. By helping clients solve problems regarding scalability as well building completely new APIs he gained a broad knowledge of the available platforms and their tradeoffs in the big and small. He's a Developer Evangelist for Couchbase where he works to educate developers on the different parts of using a NoSQL database from mobile to big iron servers.
With AWS you can choose the right database for the right job. Given the myriad of choices, from relational databases to non-relational stores, this session will profile details and examples of some of the choices available to you (MySQL, RDS, Elasticache, Redis, Cassandra, MongoDB and DynamoDB), with details on real world deployments from customers using Amazon RDS, ElastiCache and DynamoDB.
Session presented at the 2nd IndicThreads.com Conference on Cloud Computing held in Pune, India on 3-4 June 2011.
http://CloudComputing.IndicThreads.com
Abstract:“With increasing demand, ever-growing datasets, unpredictable traffic patterns and need for faster response times, “scalable architecture” has become a necessity. Here, we will see how the traditional concepts and best practices for scalability have to be adopted for the cloud. Further, we will go through the unique advantages that Amazon AWS cloud offers for architecting scalable applications. As an architect, you need to identify the components and bottlenecks in your architecture and modify your application to leverage the underlying scalability.
We will cover the following topics:
Scalability principles for the cloud
Leveraging AWS services for application components
Shared nothing architecture
Asynchronous work queues for loosely coupled applications
Database scalability
Tools, connectors and enablers to help build, deploy and monitor your cloud environment
Scalability using Platform-as-a-Service offerings on top of AWS
An example of a horizontally scalable architecture for an enterprise application on Amazon AWS
This talk will act as a primer for a cloud architect to achieve an auto-scalable, highly available, fully-monitored edge-cached application.”
Speaker:
Kalpak Shah is the Founder & CEO of Clogeny Technologies Pvt. Ltd. and guides the overall strategic direction of the company. Clogeny is focused on niche software and product development in cloud computing and scalable applications domains. He is passionate about the ground-breaking economics and technology afforded by the cloud computing platforms. He has been leading and architecting cutting-edge product development across the cloud stack including IaaS, PaaS and SaaS vendors.
He has previously worked at organizations like Sun Microsystems and Symantec in the storage domain primarily distributed and disk filesystems. Kalpak has a Bachelors’ of Engineering degree in computer engineering from PICT, University of Pune.
Large-scale projects development (scaling LAMP)Alexey Rybak
This 8-hours tutorial was given at various conferences including Percona conference (London), DevConf (Moscow), Highload++ (Moscow).
ABSTRACT
During this tutorial we will cover various topics related to high scalability for the LAMP stack. This workshop is divided into three sections.
The first section covers basic principles of shared nothing architectures and horizontal scaling for the app//cache/database tiers.
Section two of this tutorial is devoted to MySQL sharding techniques, queues and a few performance-related tips and tricks.
In section three we will cover the practical approach for measuring site performance and quality, porviding a "lean" support philosophy, connecting buesiness and technology metrics.
In addition we will cover a very useful Pinba real-time statistical server, it's features and various use cases. All of the sections will be based on real-world examples built in Badoo, one of the biggest dating sites on the Internet.
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
Covers the problems of achieving scalability in server farm environments and how distributed data grids provide in-memory storage and boost performance. Includes summary of ScaleOut Software product offerings including ScaleOut State Server and Grid Computing Edition.
Similar to SDEC2011 Using Couchbase for social game scaling and speed (20)
In the SNS domain, Response time of Friend Suggestion Algorithms and several SNA algorithms is in direct proportion to square of relationship number. In addition, increasing rate of relationship number is bigger and bigger. But existing usage pattern of Relational DB is suffering poor performance. To guarantee performance and scalability, we have developed such methods for Friend Suggestion and SNA
Relation Pruning using intimacy value
No Join & Keeping all Data in-Memory Strategy
Distributed Graph Structure
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveKorea Sdec
Currently telecom companies store their data in database or data warehouse, treating them through ETL process and working on statistics and analysis by using OLAP tools or data mining engines. However, due to the data explosion along with the spread of Smart Phones traditional data storages like DB and DW aren’t sufficient to cope with these “Big Data”. As an alternative the method of storing data in Hadoop and performing ETL process and Ad-hoc Query with Hive is being introduced, and China Mobile is being mentioned as the most representative example. But, they are adopted mainly by new projects, which have low barriers in applying the new Hive data model and HQL. On the other hand, it is extremely difficult to replace the existing database with the combination of Hadoop and Hive if there are already a number of tables and SQL queries. NexR is migrating the telecom company’s data from Oracle DB to Hadoop, and converting a lot of existing Oracle SQL queries to Hive HQL queries. Though HQL supports a similar syntax to ANSI-SQL, it lacks a large portion of basic functions and hardly supports Oracle analytic functions like rank() which are utilized mainly in statistical analysis. Furthermore, the difference of data types like null value is also blocking the application of it. In this presentation, we will share the experience converting Oracle SQL to Hive HQL and developing additional functions with MapReduce. Also, we will introduce several ideas and trials to improve Hive performance.
http://sdec.kr/
SDEC2011 Mahout - the what, the how and the whyKorea Sdec
Mahout is an open source machine learning library from Apache. From its humble beginnings at Apache Lucene, the project has grown into a active community of developers, machine learning experts and enthusiasts. With v0.5 released recently, the project has been focussing full steam on developing stable APIs with an eye on our major milestone of v1.0. The speaker has been with Mahout from his days in college as a computer science student. The talk will focus on the major use cases of Mahout. The design decisions, things that worked, things that didn't, and things to expect in the future releases.
http://sdec.kr/
Key-value stores are widely used in applications that only require primary key data access, which is common in many web applications. Because developing an industrial grade key value store is expensive, the conventional solution is to use one of the existing key-value stores and layer application semantics on top of the primitives provided by the store. This approach leads to potential inefficiencies, because application specific semantics can often allow optimizations in the implementation of the store. We present an alternative approach, using the TACC platform to provide a key-value store implementation that is both performant and easily customizable. The TACC programming model separates state from logic: state is stored in a collection of distributed in-memory database instances, while logic is performed by distributed agents that react asynchronously to changes in objects stored in the database instances. Agents can selectively subscribe to updates using a fine-grain hierarchical directory system to mount objects into a local namespace. TACC provides performance comparable to hand-coded C while reducing the actual source code size to a fraction of that. We describe the implementation and performance of a scalable and fault tolerant key-value store using TACC, pointing out the benefits realized by using TACC's strong, user-defined types and triggering/notification.Key-value stores are widely used in applications that only require primary key data access, which is common in many web applications. Because developing an industrial grade key value store is expensive, the conventional solution is to use one of the existing key-value stores and layer application semantics on top of the primitives provided by the store. This approach leads to potential inefficiencies, because application specific semantics can often allow optimizations in the implementation of the store. We present an alternative approach, using the TACC platform to provide a key-value store implementation that is both performant and easily customizable. The TACC programming model separates state from logic: state is stored in a collection of distributed in-memory database instances, while logic is performed by distributed agents that react asynchronously to changes in objects stored in the database instances. Agents can selectively subscribe to updates using a fine-grain hierarchical directory system to mount objects into a local namespace. TACC provides performance comparable to hand-coded C while reducing the actual source code size to a fraction of that. We describe the implementation and performance of a scalable and fault tolerant key-value store using TACC, pointing out the benefits realized by using TACC's strong, user-defined types and triggering/notification.
http://sdec.kr/
Arcus is data caching cloud developed on Memcached which is a memory-based Key-Value repository. It was developed meeting requirements from various NHN services. Arcus is capable of having up-to-date cache server list of clients using ZooKeeper and also able to possess cloud architecture flexible to add or delete caching servers while eliminating extra network latency between client and server. Furthermore, to support save/ computation function of data collection which is becoming a requirement among many services, it provides list, set, b+tree structures.
http://sdec.kr/
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
2. USING
COUCHBASE
FOR
SOCIAL
GAME
SCALING
AND
SPEED
Chiyoung Seo, Couchbase Inc.
Matt Ingenthron, Couchbase Inc.
2
3. Agenda
• Introduc-on
• What
is
Couchbase
Server?
– Simple,
Fast,
Elas-c
– Technology
Overview
(Architecture,
data
flow,
rebalancing)
• Tribal
Crossing
Inc:
Animal
Party
– Challenges
before
Couchbase
• Original
Architecture
– Why
Couchbase?
• Simplicity
• Performance
• Flexibility
– Deploying
Couchbase
• New
Architecture
• EC2
• Data
Model
• Accessing
data
in
Couchbase
• Product
Roadmap
• Q&A
3
4. Couchbase
Inc.
• Membase
and
CouchOne
have
merged
to
form
Couchbase
Inc.
(headquartered
in
Silicon
Valley)
• Team
– Brings
together
the
creators
and
core
contributors
of
Memcached,
Membase
and
CouchDB
technologies
– Doubles
technical
team
size,
accelerates
roadmaps
by
over
a
year
• Products
– Couchbase
Server
(Formerly
Membase)
– Couchbase
Single
Server
– Mobile
Couchbase
(iPhone
and
Android)
• Technology
– Most
mature,
reliable
and
widely
deployed
NoSQL
technologies
– Fully
featured,
open
source
document
datastore
– First
complete,
end-‐to-‐end
NoSQL
database
product
4
5. Modern Interactive Web Application Architecture
Application Scales Out
Just add more commodity web servers
www.facebook.com/animalparty
Load
Balancer
Web
Servers
Rela-onal
Database Scales Up
Get a bigger, more complex server
Database
-‐
Expensive
and
disrup-ve
sharding
-‐
Doesn’t
perform
at
Web
Scale
5
6. Couchbase
Server
is
a
distributed
database
Couchbase
Web
Console
Applica-on
user
Web
applica-on
server
Couchbase
Servers
6
7. Couchbase data layer scales like application logic tier
Data layer now scales with linear cost and constant performance.
Application Scales Out
www.facebook.com/animalparty
Just add more commodity web servers
Load
Balancer
Web
Servers
Couchbase
Servers
Database Scales Out
Just add more commodity data servers
Horizontally
scalable,
schema-‐less,
auto-‐sharding,
high-‐performance
at
Web
Scale
Scaling out flattens the cost and performance curves. 7
8. Couchbase
Server
is
Simple,
Fast,
Elas-c
• Five
minutes
or
less
to
a
working
cluster
– Downloads
for
Windows,
Linux
and
OSX
– Start
with
a
single
node
– One
bucon
press
joins
nodes
to
a
cluster
• Easy
to
develop
against
– Just
SET
and
GET
–
no
schema
required
– Drop
it
in.
10,000+
exis-ng
applica-ons
already
“speak
Couchbase”
(via
memcached)
– Prac-cally
every
language
and
applica-on
framework
is
supported,
out
of
the
box
• Easy
to
manage
– One-‐click
failover
and
cluster
rebalancing
– Graphical
and
programma-c
interfaces
– Configurable
aler-ng
8
9. Couchbase
Server
is
Simple,
Fast,
Elas-c
• Predictable
– “Never
keep
an
applica-on
wai-ng”
– Quasi-‐determinis-c
latency
and
throughput
• Low
latency
– Built-‐in
Memcached
technology
– Auto-‐migra-on
of
hot
data
to
lowest
latency
storage
technology
(RAM,
SSD,
Disk)
– Selectable
write
behavior
–
asynchronous,
synchronous
(on
replica-on,
persistence)
• High
throughput
– Mul--‐threaded
– Low
lock
conten-on
– Asynchronous
wherever
possible
– Automa-c
write
de-‐duplica-on
9
10. Couchbase
Server
is
Simple,
Fast,
Elas-c
• Zero-‐down-me
elas-city
Couchbase
Web
Console
– Spread
I/O
and
data
across
commodity
servers
(or
VMs)
– Consistent
performance
with
linear
cost
– Dynamic
rebalancing
of
a
live
cluster
• All
nodes
are
created
equal
– No
special
case
nodes
– Clone
to
grow
• Extensible
– Change
feeds
– Real-‐-me
map-‐reduce
– RESTful
interface
for
management
10
11. Proven
at
Small,
and
Extra
Large
Scale
• Leading cloud service (PAAS) • Social game leader – FarmVille,
provider Mafia Wars, Empires and Allies,
• Over 150,000 hosted applications Café World, FishVille
• Couchbase Server serving over • Over 230 million monthly users
6,200 Heroku customers • Couchbase Server is the primary
database behind key Zynga
properties
11
13. Couchbase
Server
Architecture
11211
11210
memcapable
1.0
memcapable
2.0
moxi
REST
management
API/Web
UI
vBucket
state
and
replica-on
manager
Global
singleton
supervisor
Rebalance
orchestrator
Configura-on
manager
memcached
Node
health
monitor
Process
monitor
protocol
listener/sender
Heartbeat
Data
Manager
Cluster
Manager
engine
interface
Couchbase
Storage
Engine
hcp
on
each
node
one
per
cluster
Erlang/OTP
HTTP
erlang
port
mapper
distributed
erlang
8091
4369
21100
–
21199
13
14. Couchbase
Server
Architecture
11211
11210
memcapable
1.0
memcapable
2.0
moxi
vBucket
state
and
replica-on
manager
REST
management
API/Web
UI
Global
singleton
supervisor
Rebalance
orchestrator
Configura-on
manager
memcached
Node
health
monitor
Process
monitor
protocol
listener/sender
Heartbeat
engine
interface
Couchbase
Storage
Engine
hcp
on
each
node
one
per
cluster
Erlang/OTP
HTTP
erlang
port
mapper
distributed
erlang
8091
4369
21100
–
21199
14
15. Couchbase
“write”
Data
Flow
–
applica-on
view
User
ac-on
results
in
the
need
to
change
the
VALUE
of
KEY
1
Applica-on
updates
key’s
VALUE,
2
performs
SET
opera-on
4
Couchbase
client
hashes
KEY,
iden-fies
3
KEY’s
master
server
SET
request
sent
over
network
to
master
server
5
Couchbase
replicates
KEY-‐VALUE
pair,
caches
it
in
memory
and
stores
it
to
disk
15
16. Couchbase
Data
Flow
–
under
the
hood
SET
request
arrives
at
SET
acknowledgement
KEY’s
master
server
1
3
returned
to
applica-on
Listener-‐Sender
2
2
Listener-‐Sender
Listener-‐Sender
RAM* RAM*
RAM*
Couchbase
storage
engine
membase
storage
engine
membase
storage
engine
2
SSD SSD SSD SSD SSD SSD
SSD
SSD
SSD
Disk Disk Disk
4
Disk Disk Disk
Disk
Disk
Disk
Replica
Server
1
for
KEY
Master
server
for
KEY
Replica
Server
2
for
KEY
16
17. Elas-city
-‐
Rebalancing
Node
1
Node
2
Node
3
Before
vBucket
1
vBucket
7
vBucket
2
vBucket
8
• Adding
Node
3
vBucket
3
vBucket
9
• Node
3
is
in
pending
state
vBucket
4
vBucket
10
Pending
state
• Clients
talk
to
Node
1,2
only
vBucket
5
vBucket
11
vBucket
6
vBucket
12
vBucket
1
vBucket
7
During
vBucket
2
vBucket
8
vBucket
3
vBucket
9
• Rebalancing
orchestrator
recalculates
Rebalancing
vBucket
4
vBucket
10
the
vBucket
map
(including
replicas)
vBucket
5
vBucket
11
• Migrate
vBuckets
to
the
new
server
vBucket
6
vBucket
12
• Finalize
migra-on
vBucket
migrator
vBucket
migrator
Client
AOer
vBucket
1
vBucket
7
vBucket
5
• Node
3
is
balanced
vBucket
2
vBucket
8
vBucket
6
• Clients
are
reconfigured
to
talk
to
vBucket
3
vBucket
9
vBucket
11
Node
3
vBucket
4
vBucket
10
vBucket
12
17
18. Data
buckets
are
secure
Couchbase
“slices”
Applica-on
user
Web
applica-on
server
Bucket
1
Bucket
2
Aggregate
Cluster
Memory
and
Disk
Capacity
Couchbase
data
servers
In
the
data
center
On
the
administrator
console
18
19. Couchbase
and
Hadoop
Integra-on
• Support
large-‐scale
analy-cs
on
applica-on
data
by
streaming
data
from
Couchbase
to
Hadoop
– Real-‐-me
integra-on
using
Flume
– Batch
integra-on
using
Sqoop
• Examples
– Various
game
sta-s-cs
(e.g.,
monthly
/
daily
/
hourly
rankings)
– Analyze
game
pacerns
from
users
to
enhance
various
game
metrics
Flume
memcached
TAP
protocol
listener/sender
Sqoop
engine
interface
Couchbase
Storage
Engine
19
20. Agenda
• Introduc-on
• What
is
Couchbase
Server?
– Simple,
Fast,
Elas-c
– Technology
Overview
(Architecture,
data
flow,
rebalancing)
• Tribal
Crossing
Inc:
Animal
Party
– Challenges
before
Couchbase
• Original
Architecture
– Why
Couchbase?
• Simplicity
• Performance
• Flexibility
– Deploying
Couchbase
• New
Architecture
• EC2
• Data
Model
• Accessing
data
in
Couchbase
• Product
Roadmap
• Q&A
20
21. Tribal
Crossing:
Challenges
Common
steps
on
scaling
up
database:
● Tune
queries
(indexing,
explain
query)
● Denormaliza-on
● Cache
data
(APC
/
Memcache)
● Tune
MySQL
configura-on
● Replica-on
(read
slaves)
Where
do
we
go
from
here
to
prepare
for
the
scale
of
a
successful
social
game?
21
22. Tribal
Crossing:
Challenges
● Write-‐heavy
requests
– Caching
does
not
help
– MySQL
/
InnoDB
limita-on
(Percona)
● Need
to
scale
dras-cally
over
night
– My
Polls
–
100
to
1m
users
over
a
weekend
● Small
team,
no
dedicated
sysadmin
– Focus
on
what
we
do
best
–
making
games
● Keeping
cost
down
22
23. Tribal
Crossing:
“Old”
Architecture
and
Op-ons
● MySQL
with
master-‐to-‐master
replica-on
and
sharding
– Complex
to
setup,
high
administra-on
cost
– Requires
applica-on
level
changes
● Cassandra
– High
write,
but
low
read
throughput
– Live
cluster
reconfigura-on
and
rebalance
is
quite
complicated
– Eventual
consistency
gives
too
much
burden
to
applica-on
developers
● MongoDB
– High
read/write,
but
unpredictable
latency
– Live
cluster
rebalance
for
exis-ng
nodes
only
– Eventual
consistency
with
slave
nodes
23
24. Tribal
Crossing:
Why
Couchbase
Server?
● SPEED,
SPEED,
SPEED
● Immediate
consistency
● Interface
is
dead
simple
to
use
– We
are
already
using
Memcache
● Low
sysadmin
overhead
● Schema-‐less
data
store
● Used
and
Proven
by
big
guys
like
Zynga
● …
and
lastly,
because
Tribal
CAN
– Bigger
firms
with
legacy
code
base
=
hard
to
adapt
– Small
team
=
ability
to
get
on
the
cuung
edge
24
25. Tribal
Crossing:
New
Challenges
With
Couchbase
● But,
there
are
some
different
challenges
in
using
Couchbase
(currently
1.7)
to
handle
the
game
data:
– No
easy
way
to
query
data
– No
transac-on
/
rollback
➔ Couchbase
Server
2.0
resolves
them
by
using
CouchDB
as
the
underlying
database
engine
● Can
this
work
for
an
online
game?
– Break
out
of
the
old
ORM
/
rela-onal
paradigm!
– We
are
not
handling
bank
transac-ons
25
26. Tribal
Crossing:
Deploying
Couchbase
in
EC2
Web Server
Apache ● Basic
produc-on
Client-side Moxi
environment
setup
● Dev/Stage
environment
–
feel
free
to
install
Cluster Mgmt. Requests
Couchbase
on
your
web
DNS Entry
server
Couchbase …
Couchbase
Couchbase Cluster
26
27. Tribal
Crossing:
Deploying
Couchbase
in
EC2
Web Server
● Amazon
Linux
AMI,
Apache 64-‐bit,
EBS
backed
instance
Client-side Moxi ● Setup
swap
space
Cluster Mgmt. Requests
● Install
Couchbase’s
Membase
Server
1.7
DNS Entry ● Access
web
console
http://<hostname>:8091
● Start
the
new
cluster
with
a
…
Couchbase
single
node
Couchbase
● Add
the
other
nodes
to
the
Couchbase Cluster cluster
and
rebalance
27
28. Tribal
Crossing:
Deploying
Couchbase
in
EC2
Web Server
Apache Moxi
figures
out
which
node
in
the
cluster
holds
data
for
a
given
key.
Client-side Moxi
● On
each
web
server,
install
Moxi
Cluster Mgmt. Requests
proxy
● Start
Moxi
by
poin-ng
it
to
the
DNS Entry
DNS
entry
you
created
● Web
apps
connect
to
Moxi
that
is
running
locally
memcache->addServer(‘localhost’,
11211);
Couchbase …
Couchbase
Couchbase Cluster
28
29. Tribal
Crossing:
Represen-ng
Game
Data
in
Couchbase
Use
case
-‐
simple
farming
game:
● A
player
can
have
a
variety
of
plants
on
their
farm.
● A
player
can
add
or
remove
plants
from
their
farm.
● A
Player
can
see
what
plants
are
on
another
player's
farm.
29
30. Tribal
Crossing:
Represen-ng
Game
Data
in
Couchbase
RepresenUng
Objects
● Simply
treat
an
object
as
an
associa-ve
array
● Determine
the
key
for
an
object
using
the
class
name
(or
type)
of
the
object
and
an
unique
ID
RepresenUng
Object
Lists
● Denormaliza-on
● Save
a
comma
separated
list
or
an
array
of
object
IDs
30
32. Tribal
Crossing:
Schema-‐less
Game
Data
● No
need
to
“ALTER
TABLE”
● Add
new
“fields”
all
objects
at
any
-me
– Specify
default
value
for
missing
fields
– Increased
development
speed
● Using
JSON
for
data
objects
though,
owing
to
the
ability
to
query
on
arbitrary
fields
in
Couchbase
2.0
32
33. Tribal
Crossing:
Accessing
Game
Data
in
Couchbase
Get
all
plants
belong
to
a
given
player
Request: GET /player/1/farm
$plant_ids = couchbase->get('Player1_PlantList');
$response = array();
foreach ($plant_ids as $plant_id)
{
$plant = couchbase->get('Plant' . $plant_id);
$response[] = $plant;
}
echo json_encode($response);
33
34. Tribal
Crossing:
Modifying
Game
Data
in
Couchbase
Give
a
player
a
new
plant
// Create the new plant
$new_plant = array (
'id' => 100,
'name' => 'Mushroom'
);
$couchbase->set('Plant100', $new_plant);
// Update the player plant list
$plant_ids = $couchbase->get('Player1_PlantList');
$plant_ids[] = $new_plant['id'];
$couchbase->set('Player1_PlantList', $plant_ids);
34
35. Tribal
Crossing:
Concurrency
Concurrency
issue
can
occur
when
mul-ple
requests
are
working
with
the
same
piece
of
data.
Solu-on:
● CAS
(check-‐and-‐set)
– Client
can
know
if
someone
else
has
modified
the
data
while
you
are
trying
to
update
– Implement
op-mis-c
concurrency
control
● Locking
(try/wait
cycle)
– GETL
(get
with
lock
+
-meout)
opera-ons
– Pessimis-c
concurrency
control
35
36. Tribal
Crossing:
Data
Rela-onship
● Record
object
rela-onships
both
ways
– Example:
Plots
and
Plants
● Plot
object
stores
id
of
the
plant
that
it
hosts
● Plant
object
stores
id
of
the
plot
that
it
grows
on
– Resolu-on
in
case
of
mismatch
● Don't
sweat
the
extra
calls
to
load
data
in
a
one-‐to-‐
many
rela-onship
– Use
mul3Get
– We
can
s-ll
cache
aggregated
results
in
a
Memcache
bucket
if
needed
36
37. Tribal
Crossing:
Migra-ng
to
Couchbase
Servers
First
migrated
large
or
slow
performing
tables
and
frequently
updated
fields
from
MySQL
to
Couchbase
Web
Server
Apache
+
PHP
Client-‐side
Moxi
MySQL
memcached
TAP
protocol
listener/sender
engine
interface
Repor-ng
TAP
Client
Applica-ons
Couchbase
Storage
Engine
37
40. Tribal
Crossing:
Conclusion
• Significantly
reduced
the
cost
incurred
by
scaling
up
database
servers
and
managing
them.
• Achieved
significant
improvements
in
various
performance
metrics
(e.g.,
read,
write,
latency,
etc.)
• Allowed
them
to
focus
more
on
game
development
and
op-mizing
key
metrics
• Plan
to
use
real-‐-me
MapReduce,
querying,
and
indexing
abili-es
provided
by
the
upcoming
Elas-c
Couchbase
2.0
40
41. Agenda
• Introduc-on
• What
is
Couchbase
Server?
– Simple,
Fast,
Elas-c
– Technology
Overview
(Architecture,
data
flow,
rebalancing)
• Tribal
Crossing
Inc:
Animal
Party
– Challenges
before
Couchbase
• Original
Architecture
– Why
Couchbase?
• Simplicity
• Performance
• Flexibility
– Deploying
Couchbase
• New
Architecture
• EC2
• Data
Model
• Accessing
data
in
Couchbase
• Product
Roadmap
• Q&A
41
42. Product
Roadmap:
Couchbase
Server
2.0
• Mobile
to
cloud
data
synchroniza-on
• Cross
data
center
replica-on
US
West
Coast
Data
Center
US
East
Coast
Data
Center
Couchbase
Couchbase
Server
CouchSync
Server
CouchSync
CouchSync
Couchbase
Single
Server
Couchbase
Single
Server
CouchSync
CouchSync
…
…
… … … …
42
43. Product
Roadmap:
Couchbase
Server
2.0
• Replace
Sqlite-‐based
storage
engine
with
CouchDB
• Support
indexing
and
querying
on
values
• Integrate
real-‐-me
MapReduce
into
Couchbase
server
• SDK
for
Couchbase
server
Membase
Server
1.7
CouchDB
1.1
Couchbase
Server
2.0
The
world’s
leading
caching
The
most
reliable
and
full-‐ The
fastest,
most
complete
and
and
clustering
technology
featured
document
database
most
reliable
database
on
the
planet
43
44. Couchbase
Product
Download
• Community
Edi-on
– Open
source
build
– Free
forum
support
• Enterprise
Edi-on
– Free
for
non-‐produc-on
use
– Cer-fied,
QA
tested
version
of
open
source
– Case
tracking
and
guaranteed
SLA
for
produc-on
environments
• Partner
in
Korea
– N2M
Inc.
(hcp://www.n2m.co.kr)
44
45. Q&A
Matt Ingenthron, Couchbase Inc.
(matt@couchbase.com, @ingenthr)
Chiyoung Seo, Couchbase Inc.
(chiyoung@couchbase.com, @chiyoungseo)
45