The document discusses NoSQL and NewSQL databases, focusing on VMware's GemFire and SQLFire which provide a distributed in-memory data platform for big data processing and analytics. GemFire offers a key-value store and SQLFire adds SQL capabilities on top of GemFire. The document also describes how GemFire/SQLFire is typically deployed to provide high performance data access across application servers and a global data backbone.
Countdown to PostgreSQL v9.5 - Foriegn Tables can be part of Inheritance Tree Ashnikbiz
Distributed databases and horizontal scale up is one of the key demands in today's date. PostgreSQL already had some vertical scaling features and horizontal scale-up by adding disks and table partitioning/child tables. With release of v9.5, PostgreSQL will get basic foundation for native sharing capability. From v9.5 Foreign Tables will be able to participate in Inheritance Tree as a child or parent table i.e. one can have table partitions residing on different system.
In our countdown to v9.5 series of hangouts, we will be covering some of the great features of PostgreSQL v9.5 and what is their real life applicability. In the first hangout in this series we will be talking about-
- The feature of foreign partitions/child tables
- Syntax and usage
- EXPLAIN plan demo
- Use cases and benefits
Join us for more and send us your queries on success@ashnik.com
Introduction to SQL Server Memory Management - for the DBAiKosmik
Introduction to SQL Server Memory Management, especially concepts related to Caching in SQL Server. Explained in really simple way, that even a layman can understand! Dedicated to the SQL Server DBA ! :)
For queries, comments and if you need slides on some specific topic in SQL Server, write to us at info@ikosmik.com ! Keep watching our space for more slides on SQL Server!
Asynchronous cascading master to multiple replicas
Asynchronous multi-master
Can be used for:
Improved performance for geographically dispersed users
High availability
Load distribution (OLTP vs. reporting)
Countdown to PostgreSQL v9.5 - Foriegn Tables can be part of Inheritance Tree Ashnikbiz
Distributed databases and horizontal scale up is one of the key demands in today's date. PostgreSQL already had some vertical scaling features and horizontal scale-up by adding disks and table partitioning/child tables. With release of v9.5, PostgreSQL will get basic foundation for native sharing capability. From v9.5 Foreign Tables will be able to participate in Inheritance Tree as a child or parent table i.e. one can have table partitions residing on different system.
In our countdown to v9.5 series of hangouts, we will be covering some of the great features of PostgreSQL v9.5 and what is their real life applicability. In the first hangout in this series we will be talking about-
- The feature of foreign partitions/child tables
- Syntax and usage
- EXPLAIN plan demo
- Use cases and benefits
Join us for more and send us your queries on success@ashnik.com
Introduction to SQL Server Memory Management - for the DBAiKosmik
Introduction to SQL Server Memory Management, especially concepts related to Caching in SQL Server. Explained in really simple way, that even a layman can understand! Dedicated to the SQL Server DBA ! :)
For queries, comments and if you need slides on some specific topic in SQL Server, write to us at info@ikosmik.com ! Keep watching our space for more slides on SQL Server!
Asynchronous cascading master to multiple replicas
Asynchronous multi-master
Can be used for:
Improved performance for geographically dispersed users
High availability
Load distribution (OLTP vs. reporting)
WiredTiger is rethinking data management for modern hardware with a focus on multi-core scalability and maximizing the value of every byte of RAM.
CPUs are no longer getting faster, and the cost of additional CPUs is approaching zero. Disk transfer speeds are relatively slower, compared to memory speeds, than a decade ago. Finally, power is the single biggest cost of the data center. For these reasons, WiredTiger is focused on more efficient use of I/O bandwidth, multiple CPUs and large memory in a single server.
Inside CynosDB: MariaDB optimized for the cloud at TencentMariaDB plc
Qinglin Zhang, Database Kernel Engineer at Tencent, introduces CynosDB, Tencent's self-developed database for the cloud. CynosDB is based on MariaDB Server, but separates computing and storage. Zhang goes on to provide a detailed explanation of the architecture with a focus on how Tencent implemented the computing and storage layers, and created Tencent’s MariaDB-based “Aurora”.
Scylla Summit 2018: Rebuilding the Ceph Distributed Storage Solution with Sea...ScyllaDB
RedHat built a distributed object storage solution named Ceph which first debuted ten years ago. Now we are seeing rapid developments in the industry and we want to take advantage of them. In this talk, we will briefly introduce Ceph, revisit the problems we are seeing when profiling its I/O performance with flash device, and explain why we want to embrace the future by switching to Seastar. We’ll share our experiences with the audience of how and when we are porting our software to this framework.
From the Gaming Scalability event, June 2009 in London (http://gamingscalability.org).
Today's electronic markets are demanding lower and lower end-to-end latency. The acceptable time from an event occurring to reporting the effect of the event to consumers around the world has gone down to seconds and even sub-second in some cases. This presentation shows how the combination of an Enterprise Data Fabric inside the firewall and Push Technology for delivery over the Internet ("the last mile") can effectively address this problem and turn it into competitive advantage.
Christian James is the product manager of Push Technology's high performance and low latent messaging product suite Diffusion. Christian leverages his knowledge and experience of the delivery of e-Commerce/betting and trading platforms, within the sports and financial markets, to expand and align Push Technology's product offering to the gaming fraternity. Prior to joining Push Technology Christian was head of IT for Cantor Spreadfair, a peer to peer spread betting exchange, and, prior to that, a lead within Deutsche Bank's FX e-Commerce team responsible for the design and development of Deutsche Bank's award winning autobahn�FX e-Commerce trading platform.
Mike Stolz is vice president of architecture and strategy for financial services at GemStone Systems. In his role, Stolz leverages his expertise in targeting, developing and delivering innovative technology solutions to expand GemStone's global financial services offering and cultivate its growing capital markets division. During the ten years prior to joining GemStone Stolz served as director and chief architect of Merrill Lynch's global markets and investment banking debt division. In this role, Stolz was responsible for the design and development of trading systems and trading support systems for Fixed Income, Currencies, Commodities, Liquidity and Risk.
Presented at WordCamp San Francisco 2013 #wcsf
P2 from Automattic is an atypical WordPress theme that works for longer posts but really lends itself to quick updates, inline commenting, and real-time communication. In this session, see how a P2-powered internal blog has improved staff communication and cohesion at UCSF Library resulting in a much better user experience for the researchers and students we support.
Quotes have the power to inspire, energise and motivate mentors and mentees. This Slideshare shares Inspirational Mentoring Quotes to support mentoring in your organisation.
For more resources, check out www.antoinetteoglethorpe.com/resources
Here's a quick history of Haiku Deck (www.haikudeck.com). If you feel inspired by our startup story, please consider joining our movement! Learn more about our free app (iPad and Web) for creating beautiful presentations available at www.haikudeck.com.
5 secret steps to becoming a travel virtuosoMark Crocker
What is the difference between a tourist and a traveller? A traveller has learned how to understand the stress of travel and make it work for them!
Here are the tools for you to become a Travel Virtuoso (a person highly skilled in an artistic pursuit)
Check out a little story about Mark' vacation in Vietnam. Lots of tips and great overview of major sites in Nha Trang and Ho Chi Min. Made entirely on the iPad in 4 hours.
Your brain is capable of incredible healing and constant reshaping. Through a new relationship with your brain you can transform your life. With increased self-awareness and conscious intention, the brain can be taught to reach far beyond its present limitations.
This is a visual excerpt from my book "Super Brain," which I co-authored with Rudolph Tanzi, PhD. To read more, go to: http://www.chopra.com/
WiredTiger is rethinking data management for modern hardware with a focus on multi-core scalability and maximizing the value of every byte of RAM.
CPUs are no longer getting faster, and the cost of additional CPUs is approaching zero. Disk transfer speeds are relatively slower, compared to memory speeds, than a decade ago. Finally, power is the single biggest cost of the data center. For these reasons, WiredTiger is focused on more efficient use of I/O bandwidth, multiple CPUs and large memory in a single server.
Inside CynosDB: MariaDB optimized for the cloud at TencentMariaDB plc
Qinglin Zhang, Database Kernel Engineer at Tencent, introduces CynosDB, Tencent's self-developed database for the cloud. CynosDB is based on MariaDB Server, but separates computing and storage. Zhang goes on to provide a detailed explanation of the architecture with a focus on how Tencent implemented the computing and storage layers, and created Tencent’s MariaDB-based “Aurora”.
Scylla Summit 2018: Rebuilding the Ceph Distributed Storage Solution with Sea...ScyllaDB
RedHat built a distributed object storage solution named Ceph which first debuted ten years ago. Now we are seeing rapid developments in the industry and we want to take advantage of them. In this talk, we will briefly introduce Ceph, revisit the problems we are seeing when profiling its I/O performance with flash device, and explain why we want to embrace the future by switching to Seastar. We’ll share our experiences with the audience of how and when we are porting our software to this framework.
From the Gaming Scalability event, June 2009 in London (http://gamingscalability.org).
Today's electronic markets are demanding lower and lower end-to-end latency. The acceptable time from an event occurring to reporting the effect of the event to consumers around the world has gone down to seconds and even sub-second in some cases. This presentation shows how the combination of an Enterprise Data Fabric inside the firewall and Push Technology for delivery over the Internet ("the last mile") can effectively address this problem and turn it into competitive advantage.
Christian James is the product manager of Push Technology's high performance and low latent messaging product suite Diffusion. Christian leverages his knowledge and experience of the delivery of e-Commerce/betting and trading platforms, within the sports and financial markets, to expand and align Push Technology's product offering to the gaming fraternity. Prior to joining Push Technology Christian was head of IT for Cantor Spreadfair, a peer to peer spread betting exchange, and, prior to that, a lead within Deutsche Bank's FX e-Commerce team responsible for the design and development of Deutsche Bank's award winning autobahn�FX e-Commerce trading platform.
Mike Stolz is vice president of architecture and strategy for financial services at GemStone Systems. In his role, Stolz leverages his expertise in targeting, developing and delivering innovative technology solutions to expand GemStone's global financial services offering and cultivate its growing capital markets division. During the ten years prior to joining GemStone Stolz served as director and chief architect of Merrill Lynch's global markets and investment banking debt division. In this role, Stolz was responsible for the design and development of trading systems and trading support systems for Fixed Income, Currencies, Commodities, Liquidity and Risk.
Presented at WordCamp San Francisco 2013 #wcsf
P2 from Automattic is an atypical WordPress theme that works for longer posts but really lends itself to quick updates, inline commenting, and real-time communication. In this session, see how a P2-powered internal blog has improved staff communication and cohesion at UCSF Library resulting in a much better user experience for the researchers and students we support.
Quotes have the power to inspire, energise and motivate mentors and mentees. This Slideshare shares Inspirational Mentoring Quotes to support mentoring in your organisation.
For more resources, check out www.antoinetteoglethorpe.com/resources
Here's a quick history of Haiku Deck (www.haikudeck.com). If you feel inspired by our startup story, please consider joining our movement! Learn more about our free app (iPad and Web) for creating beautiful presentations available at www.haikudeck.com.
5 secret steps to becoming a travel virtuosoMark Crocker
What is the difference between a tourist and a traveller? A traveller has learned how to understand the stress of travel and make it work for them!
Here are the tools for you to become a Travel Virtuoso (a person highly skilled in an artistic pursuit)
Check out a little story about Mark' vacation in Vietnam. Lots of tips and great overview of major sites in Nha Trang and Ho Chi Min. Made entirely on the iPad in 4 hours.
Your brain is capable of incredible healing and constant reshaping. Through a new relationship with your brain you can transform your life. With increased self-awareness and conscious intention, the brain can be taught to reach far beyond its present limitations.
This is a visual excerpt from my book "Super Brain," which I co-authored with Rudolph Tanzi, PhD. To read more, go to: http://www.chopra.com/
How do you successfully pitch your business to investors? As an entrepreneur and venture capitalist, I've been on both sides of the funding process. Here are 7 myths of startup financing -- and the truths you should follow.
As more and more people are coming to realize, there is far more to living a truly successful life than just earning a bigger salary and capturing a corner office. Our relentless pursuit of the two traditional metrics of success - money and power - has led to an epidemic of burnout and stress-related illnesses, and an erosion in the quality of our relationships, family life, and, ironically, our careers. In being connected to the world 24/7, we're losing our connection to what truly matters.
Drawing on the latest groundbreaking research and scientific findings in the fields of psychology, sports, sleep, and physiology that show the profound and transformative effects of meditation, mindfulness, unplugging, and giving, I show us the way to a revolution in our culture, our thinking, our workplace, and our lives.
This presentation is a visual excerpt of my book, Thrive. To read more, go to: http://thrive.huffingtonpost.com/
Virtualizing Latency Sensitive Workloads and vFabric GemFireCarter Shanklin
This presentation was made by Emad Benjamin of VMware Technical Marketing. Normally I wouldn't upload someone else's preso but I really insisted this get posted and he asked me to help him out.
This deck covers tips and best practices for virtualizing latency sensitive apps on vSphere in general, and takes a deep dive into virtualizing vFabric GemFire, which is a high-performance distributed and memory-optimized key/value store.
Best practices include how to configure the virtual machines and how to tune them appropriately to the hardware the application runs on.
Kubernetes is quickly becoming the de facto deployment platform for container runtimes. New applications can be written with containers in mind, but existing applications are not always aligned to the new best practices.
In this talk we will present how an existing application can be deployed on a Kubernetes platform, exploring various patterns such as scaling out, centralised logging and monitoring, content distribution and persistence.
After this talk participants will gain a better understanding about how existing applications can be molded into a cloud-native ones with reasonable effort.
This presentation will discuss best practices for designing and building a solid, robust and flexible Hadoop platform on an enterprise virtual infrastructure. Attendees will learn the flexibility and operational advantages of Virtual Machines such as fast provisioning, cloning, high levels of standardization, hybrid storage, vMotioning, increased stabilization of the entire software stack, High Availability and Fault Tolerance. This is a can`t miss presentation for anyone wanting to understand design, configuration and deployment of Hadoop in virtual infrastructures.
SQLFire is a high-performance, memory-optimized distributed SQL database.
SQLFire databases run on multiple servers simultaneously, but present a standard SQL interface to client applications, and appear to be just one database. SQLFi
re also makes it easy to add or remove servers at any time, which makes redundan
cy and elastic scaling very simple.
This presentation has an overview of SQLFire as well as a walkthrough of the SQL
extensions SQLFire uses to create a real distributed SQL database. Importantly
all of the extensions are in the way tables are defined (i.e. the DDL commands) rather than extentions to data inserts or queries so clients are completely unaw
are of SQLFire's distributed nature.
Building an Oracle Grid with Oracle VM on Dell Blade Servers and EqualLogic i...Lindsey Aitchison
Having tested and validated Oracle Grid reference configurations, Dell Global Solutions engineers share their insight of how best to set up and implement this computing resource to enable networked computers to share on-demand resource pools.
Présentation effectuée le 25 Novembre 2015 au Toulouse Data Science.
Les ingénieurs de Google avaient du mal à suivre le rythme de croissance de leurs données. Le nombre d’utilisateurs de Gmail augmentait constamment et était de l’ordre de centaines de millions; Il y avait plus de 100 milliards de recherches Google effectuées chaque mois.
Essayer de donner un sens à toutes ces données prenait un temps fou et était une expérience très frustrante pour les équipes de Google.
Ce problème de données a conduit l’élaboration en 2008 d’un outil interne appelé Dremel, qui a permis aux employés de Google d’exécuter des requêtes SQL extrêmement rapides sur un grand ensemble de données.
En 2012 lors de la Google I/O, Google à annoncé la sortie de Google BigQuery, l'implémentation externe de Dremel...
Spark-HandsOn
In this Hands-On, we are going to show how you can use Apache Spark and some components of it ecosystem for data processing. This workshop is split in four parts. We will use a dataset that consists of tweets containing just a few fields like id, user, text, country and place.
In the first one, you will play with the Spark API for basic operations like counting, filtering, aggregating.
After that, you will get to know Spark SQL to query structured data (here in json) using SQL.
In the third part, you will use Spark Streaming and the twitter streaming API to analyse a live stream of Tweets.
To finish we will build a simple model to identify the language in a text. For that you will use MLLib.
Let's go and have fun !
Prerequisites
Java > 6 (8 is better to use the lambdas)
IDE
Some links
Apache Spark https://spark.apache.org
https://speakerdeck.com/nivdul/lightning-fast-machine-learning-with-spark
https://speakerdeck.com/samklr/scalable-machine-learning-with-spark
Slide deck de la présentation de Duchess France et du bilan de l'année en ouverture de l'anniversaire des 2 ans de Duchess France.
La capture video de la présentation avec les animations se trouve ici http://www.youtube.com/my_videos_edit?ns=1&video_id=xU-3_-LaJuo
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
2. Big, Fast and Flexible Data – VMware’s Platform
Big Fast Flexible
Data Data Data
Big Data Developer
Analytics Frameworks
OSS Relational
In-Memory
Data Fabric
Big Data vPostgres
Processing
NewSQL DBs
GemFire
Serengeti
3. NoSQL and NewSQL: GemFire and SQLFire
GemFire
Region.put / get (key, object) CREATE TABLE FLIGHTAVAILABILITY (
Region.query(…) Java / .Net / C/C++ FLIGHT_ID CHAR(6) NOT NULL , …)
PARTITION BY COLUMN (FLIGHT_ID)
Region.read / write / through & behind
REDUNDANCY 1
Grid.ParallelExecute (….) COLOCATE WITH (FLIGHTS);
Low latency SQL
distributed memory Automatic dynamic shards
Parallel query
Parallel compute Parallel stored procedure
Frontend to legacy DB and mainframe
Map/Reduce
Flights Flights Flights
FlightsR FlightsR FlightsR WAN
FlightAvailability FlightAvailability FlightAvailability replication
FlightAvailabilityR FlightAvailabilityR FlightAvailabilityR
Airlines Airlines Airlines
Elastic capacity
Optional shared nothing
async disk writes / overflow with runtime rebalancing
4. How vFabric GemFire/SQLFire is Typically Deployed
HTTP Session State App Data Cache,
Global Data Backbone
Management and L2 Cache In-memory DB
Client Client Client Client Client Client
Application Servers
GemFire GemFire
Shopping cart state Shared data grid populated by
High performance OLTP
management multiple data feeds and
serving many clients