Reltio: Powering Enterprise Data-driven Applications with Cassandra

•

1 like•2,429 views

Cassandra's flexibility and scalability make it an ideal foundation for a modern data management architecture. Come hear how Reltio is using Cassandra, in combination with graph technologies and Spark to deliver a new breed of data-driven applications. In this presentation you'll find out: - How we ended up selecting Cassandra - The unique characteristics of data-driven applications - The best practices we learned by combining Cassandra, graph technology, Spark and more

Technology

Powering Enterprise Data-driven Applications with Cassandra

“ 2
Be Right Faster
with
Reliable Data,
Relevant Insights,
Recommended Actions
TM
#DataManagement
#BigData
#ML
© 2015. All Rights Reserved.

Anastasia Zamyshlyaeva
VP Platform Product Management and Co-founder @ Reltio
• 2011 – started working with C*
• 2012 – selected C* as the persistence store for creating a hybrid
Columnar & Graph data-store
• Since 2012 – Running in Production to support:
– 24/7 uptime with 99.995% availability
– Multi-Tenancy across customers
– both Operational and Analytical workloads
stasia@reltio.com
www.linkedin.com/in/azamyshlyaeva
© 2015. All Rights Reserved. 3

“If you focus on the smallest details,
you never get the big picture right”
~ Leroy Hood
© 2015. All Rights Reserved. 4

© 2015. All Rights Reserved. 8
Sales
Web site
Support
Supply
Marketing

© 2015. All Rights Reserved. 9
Sales
Web site
Supply
MarketingSupport

© 2015. All Rights Reserved. 10
Sales
Web site
Supply
MarketingSupport

Enterprise Applications Ecosystem
11© 2015. All Rights Reserved.
Is data up-to-date?
Is data
correct?
?
? ?Is data complete?

© 2015. All Rights Reserved. 13
Sales
Web site
Data Unification Application
Supply
(based on Relational Databases)
• Fixed structure
• No big data
• Expensive
• Hard to support graphs and complex attributes
• Single point of failure (often) MarketingSupport

© 2015. All Rights Reserved. 14
Sales
Web site
Supply
MarketingSupport (based on Cassandra)

Why Cassandra?
üHigh performance
üFault tolerance
üLinear scalability
üMulti-datacenter
© 2015. All Rights Reserved. 15

Reltio Metadata-driven
Model and Operations
© 2015. All Rights Reserved. 16
Doctors and
Hospitals
Schema
configure
UI, REST API,
Analytics

© 2015. All Rights Reserved. 17
Oil & Gas
Schema
Reltio Metadata-driven
Model and Operations
UI, REST API,
Analyticsconfigure

© 2015. All Rights Reserved. 18
Asset
Catalog
Schema
Reltio Metadata-driven
Model and Operations
UI, REST API,
Analyticsconfigure
AMan

Cassandra is a primary datastore
© 2015. All Rights Reserved. 19

© 2015. All Rights Reserved. 20
ID: doc1
Type: Individual
Name: John
Email: john@gmail.com
john@yahoo.com
Address: CA, shipping
NY, billing
Entity type: Individual
- Name: String
- Email: List
- Address: Complex
- State: String
- Type: List
Metadata Entity
doc1
<Name>.1 …
John
Simple metadata-driven attributes in Cassandra (Thrift API)
Metadata-driven Documents in Columnar storage

ID: doc1
Type: Individual
Name: John
Email: john@gmail.com
john@yahoo.com
Address: CA, shipping
NY, billing
Entity type: Individual
- Name: String
- Email: List
- Address: Complex
- State: String
- Type: List
© 2015. All Rights Reserved. 21
Entity
doc1
… <Email>.1 <Email>.2 …
… john@gmail.com john@yahoo.com
Multi-value metadata-driven attributes in Cassandra (Thrift API)
Metadata
Metadata-driven Documents in Columnar storage

ID: doc1
Type: Individual
Name: John
Email: john@gmail.com
john@yahoo.com
Address: CA, shipping (1)
NY, billing (2)
© 2015. All Rights Reserved. 22
Entity
doc1
… <Address>.1.<State>.1 <Address>.1.<Type>.1 <Address>.2.<State>.1 …
… CA billing NY
Complex metadata-driven attributes in Cassandra (Thrift API)
Metadata
Metadata-driven Documents in Columnar storage
Entity type: Individual
- Name: String
- Email: List
- Address: Complex
- State: String
- Type: List

© 2015. All Rights Reserved. 23
Metadata-driven Documents – CQL wide rows
CREATE TABLE ENTITIES(
doc_id int,
attribute_name String,
attribute_value String,
…
PRIMARY KEY (doc_id, attribute_name)
);
SELECT * -- select all addresses
FROM ENTITIES
WHERE doc_id = 1
AND attribute_name >= Address.0
AND attribute_name <= Address.9;

© 2015. All Rights Reserved. 24
John
Dunder
Mifflin
Dwight
Copy
Paper
Employee Individual
ProductOrganization Cassandra
- Records storage
across datacenters
Reltio
- Metadata-driven graphs
- Rich model for entities, relations
- Partitioning
- Effective joins
- Graph operations
Hybrid Graphs - linked entities with infinite attribution

25
Reltio de-duplication
John Smith
Jon Smith

© 2015. All Rights Reserved. 26
Cassandra+ = Hybrid searchElasticsearch*
* excluded documents
Hybrid Search – without documents!
0
0.5
1
1.5
Data volume in
Elasticsearch index (Tb)
0
1000
2000
Elasticsearch indexing
performance (OPS)
0
10
20
30
Search performance on
large documents (sec)
- Elasticsearch
- Hybrid search: Elasticsearch + Cassandra

Reltio Cloud Data Components
© 2015. All Rights Reserved.
Spark
AWS
AWS Redshift
Cassandra
Elasticsearch

Reltio Use Cases
© 2015. All Rights Reserved. 28
AManag

What's hot

Data Platform Architecture Principles and Evaluation Criteria

ScyllaDB

In essence, a data lake is commodity distributed file system that acts as a repository to hold raw data file extracts of all the enterprise source systems, so that it can serve the data management and analytics needs of the business. A data lake system provides means to ingest data, perform scalable big data processing, and serve information, in addition to manage, monitor and secure the it environment. In these slide, we discuss building data lakes using Azure Data Factory and Data Lake Analytics. We delve into the architecture if the data lake and explore its various components. We also describe the various data ingestion scenarios and considerations. We introduce the Azure Data Lake Store, then we discuss how to build Azure Data Factory pipeline to ingest the data lake. After that, we move into big data processing using Data Lake Analytics, and we delve into U-SQL.

Building the Data Lake with Azure Data Factory and Data Lake Analytics

Khalid Salama

Data Mesh for Dinner

Kent Graziano

Data Mesh is a trending approach to building a decentralized data architecture by leveraging a domain-oriented, self-service design. However, the pure definition of Data Mesh lacks a center of excellence or central data team and doesn’t address the need for a common approach for sharing data products across teams. The semantic layer is emerging as a key component to supporting a Hub and Spoke style of organizing data teams by introducing data model sharing, collaboration, and distributed ownership controls. This session will explain how data teams can define common models and definitions with a semantic layer to decentralize analytics product creation using a Hub and Spoke architecture. Attend this session to learn about: - The role of a Data Mesh in the modern cloud architecture. - How a semantic layer can serve as the binding agent to support decentralization. - How to drive self service with consistency and control.

How a Semantic Layer Makes Data Mesh Work at Scale

DATAVERSITY

Azure Data Factory Data Flows Training (Sept 2020 Update)

Mark Kromer

The traditional data warehouse has served us well for many years, but new trends are causing it to break in four different ways: data growth, fast query expectations from users, non-relational/unstructured data, and cloud-born data. How can you prevent this from happening? Enter the modern data warehouse, which is able to handle and excel with these new trends. It handles all types of data (Hadoop), provides a way to easily interface with all these types of data (PolyBase), and can handle “big data” and provide fast queries. Is there one appliance that can support this modern data warehouse? Yes! It is the Analytics Platform System (APS) from Microsoft (formally called Parallel Data Warehouse or PDW) , which is a Massively Parallel Processing (MPP) appliance that has been recently updated (v2 AU1). In this session I will dig into the details of the modern data warehouse and APS. I will give an overview of the APS hardware and software architecture, identify what makes APS different, and demonstrate the increased performance. In addition I will discuss how Hadoop, HDInsight, and PolyBase fit into this new modern data warehouse.

Modern Data Warehousing with the Microsoft Analytics Platform System

James Serra

Data Mesh is a new socio-technical approach to data architecture, first described by Zhamak Dehghani and popularised through a guest blog post on Martin Fowler's site. Since then, community interest has grown, due to Data Mesh's ability to explain and address the frustrations that many organisations are experiencing as they try to get value from their data. The 2022 publication of Zhamak's book on Data Mesh further provoked conversation, as have the growing number of experience reports from companies that have put Data Mesh into practice. So what's all the fuss about? On one hand, Data Mesh is a new approach in the field of big data. On the other hand, Data Mesh is application of the lessons we have learned from domain-driven design and microservices to a data context. In this talk, Chris and Pablo will explain how Data Mesh relates to current thinking in software architecture and the historical development of data architecture philosophies. They will outline what benefits Data Mesh brings, what trade-offs it comes with and when organisations should and should not consider adopting it.

Data Mesh 101

ChrisFord803185

DW Migration Webinar-March 2022.pptx

Databricks

Data Con LA 2020 Description In this session, I introduce the Amazon Redshift lake house architecture which enables you to query data across your data warehouse, data lake, and operational databases to gain faster and deeper insights. With a lake house architecture, you can store data in open file formats in your Amazon S3 data lake. Speaker Antje Barth, Amazon Web Services, Sr. Developer Advocate, AI and Machine Learning

Owning Your Own (Data) Lake House

Data Con LA

Watch full webinar here: https://bit.ly/3rwWhyv The Data Mesh architectural design was first proposed in 2019 by Zhamak Dehghani, principal technology consultant at Thoughtworks, a technology company that is closely associated with the development of distributed agile methodology. A data mesh is a distributed, de-centralized data infrastructure in which multiple autonomous domains manage and expose their own data, called “data products,” to the rest of the organization. Organizations leverage data mesh architecture when they experience shortcomings in highly centralized architectures, such as the lack domain-specific expertise in data teams, the inflexibility of centralized data repositories in meeting the specific needs of different departments within large organizations, and the slow nature of centralized data infrastructures in provisioning data and responding to changes. In this session, Pablo Alvarez, Global Director of Product Management at Denodo, explains how data virtualization is your best bet for implementing an effective data mesh architecture. You will learn: - How data mesh architecture not only enables better performance and agility, but also self-service data access - The requirements for “data products” in the data mesh world, and how data virtualization supports them - How data virtualization enables domains in a data mesh to be truly autonomous - Why a data lake is not automatically a data mesh - How to implement a simple, functional data mesh architecture using data virtualization

Enabling a Data Mesh Architecture with Data Virtualization

Denodo

Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021

Tristan Baker

Enterprise Architecture (EA) provides a visual blueprint of the organization, and shows key interrelationships between data, process, applications, and more. By abstracting these assets in a graphical view, it’s possible to see key interrelationships, particularly as they relate to data and its business impact across the organization. Join us for a discussion on how data architecture is a key component of an overall enterprise architecture for enhanced business value and success.

Enterprise Architecture vs. Data Architecture

DATAVERSITY

It’s very easy to be distracted by the latest and greatest approaches with technology, but sometimes there’s a reason old approaches stand the test of time. Star Schemas & Kimball is one of those things that isn’t going anywhere, but as we move towards the “Data Lakehouse” paradigm – how appropriate is this modelling technique, and how can we harness the Delta Engine & Spark 3.0 to maximise it’s performance?

Achieving Lakehouse Models with Spark 3.0

Databricks

Data catalogs are in wide use today across hundreds of enterprises as a means to help data scientists and business analysts find and collaboratively analyze data. Over the past several years, customers have increasingly used data catalogs in applications beyond their search & discovery roots, addressing new use cases such as data governance, cloud data migration, and digital transformation. In this session, the founder and CEO of Alation will discuss the evolution of the data catalog, the many ways in which data catalogs are being used today, the importance of machine learning in data catalogs, and discuss the future of the data catalog as a platform for a broad range of data intelligence solutions.

Data Catalog as the Platform for Data Intelligence

Alation

In this talk we will present how Databricks has enabled the author to achieve more with data, enabling one person to build a coherent data project with data engineering, analysis and science components, with better collaboration, better productionalization methods, with larger datasets and faster. The talk will include a demo that will illustrate how the multiple functionalities of Databricks help to build a coherent data project with Databricks jobs, Delta Lake and auto-loader for data engineering, SQL Analytics for Data Analysis, Spark ML and MLFlow for data science, and Projects for collaboration.

Databricks: A Tool That Empowers You To Do More With Data

Databricks

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 1 | Part 1

Databricks

Data Mesh is an innovative concept addressing many data challenges from an architectural, cultural, and organizational perspective. But is the world ready to implement Data Mesh? In this session, we will review the importance of core Data Mesh principles, what they can offer, and when it is a good idea to try a Data Mesh architecture. We will discuss common challenges with implementation of Data Mesh systems and focus on the role of open-source projects for it. Projects like Apache Spark can play a key part in standardized infrastructure platform implementation of Data Mesh. We will examine the landscape of useful data engineering open-source projects to utilize in several areas of a Data Mesh system in practice, along with an architectural example. We will touch on what work (culture, tools, mindset) needs to be done to ensure Data Mesh is more accessible for engineers in the industry. The audience will leave with a good understanding of the benefits of Data Mesh architecture, common challenges, and the role of Apache Spark and other open-source projects for its implementation in real systems. This session is targeted for architects, decision-makers, data-engineers, and system designers.

Architect’s Open-Source Guide for a Data Mesh Architecture

Databricks

Data Literacy is an increasing concern, as organizations look to become more data-driven. As the rise of the citizen data scientist and self-service data analytics becomes increasingly common, the need for business users to understand core Data Management fundamentals is more important than ever. At the same time, technical roles need a strong foundation in Data Architecture principles and best practices. Join this webinar to understand the key components of Data Literacy, and practical ways to implement a Data Literacy program in your organization.

Improving Data Literacy Around Data Architecture

DATAVERSITY

Watch full webinar here: https://buff.ly/2Vq9FR0 Data catalogs are en vogue answering critical data governance questions like “Where all does my data reside?” “What other entities are associated with my data?” “What are the definitions of the data fields?” and “Who accesses the data?” Data catalogs maintain the necessary business metadata to answer these questions and many more. But that’s not enough. For it to be useful, data catalogs need to deliver these answers to the business users right within the applications they use. In this session, you will learn: *How data catalogs enable enterprise-wide data governance regimes *What key capability requirements should you expect in data catalogs *How data virtualization combines dynamic data catalogs with delivery

Data Catalog for Better Data Discovery and Governance

Denodo

Getting Started with Delta Lake on Databricks

Knoldus Inc.

What's hot (20)

Data Platform Architecture Principles and Evaluation Criteria

Building the Data Lake with Azure Data Factory and Data Lake Analytics

Data Mesh for Dinner

How a Semantic Layer Makes Data Mesh Work at Scale

Azure Data Factory Data Flows Training (Sept 2020 Update)

Modern Data Warehousing with the Microsoft Analytics Platform System

Data Mesh 101

DW Migration Webinar-March 2022.pptx

Owning Your Own (Data) Lake House

Enabling a Data Mesh Architecture with Data Virtualization

Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021

Enterprise Architecture vs. Data Architecture

Achieving Lakehouse Models with Spark 3.0

Data Catalog as the Platform for Data Intelligence

Databricks: A Tool That Empowers You To Do More With Data

Data Lakehouse Symposium | Day 1 | Part 1

Architect’s Open-Source Guide for a Data Mesh Architecture

Improving Data Literacy Around Data Architecture

Data Catalog for Better Data Discovery and Governance

Getting Started with Delta Lake on Databricks

Viewers also liked

Applying Graph DB to Enterprise MDM

Brant Boehmann

Graph databases are seeing a spike in popularity as their value in leveraging large data sets for key areas such as fraud detection, marketing, and network optimization become increasingly apparent. With graph databases, it’s been said that ‘the data model and the metadata are the database’. What does this mean in a practical application, and how can this technology be optimized for maximum business value?

Data Modeling & Metadata for Graph Databases

DATAVERSITY

Big MDM Part 2: Using a Graph Database for MDM and Relationship Management

Caserta

Using a Graph Database for Next-Gen MDM

Neo4j

Graph Databases for Master Data Management

Neo4j

Graph database Use Cases

Max De Marzi

How to identify the correct Master Data subject areas & tooling for your MDM...

Christopher Bradley

Viewers also liked (7)

Applying Graph DB to Enterprise MDM

Data Modeling & Metadata for Graph Databases

Big MDM Part 2: Using a Graph Database for MDM and Relationship Management

Using a Graph Database for Next-Gen MDM

Graph Databases for Master Data Management

Graph database Use Cases

How to identify the correct Master Data subject areas & tooling for your MDM...

Similar to Reltio: Powering Enterprise Data-driven Applications with Cassandra

Sydney: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cloud

Certus Solutions

Tapdata Product Intro

Tapdata

Building applications on streaming data has its challenges. If you are trying to use programs such as Apache Spark or Storm to build applications, this presentation will explain the advantages and disadvantages of each solution and how to choose the right tool for your next streaming data project. Building streaming data applications that can manage the massive quantities of data generated from mobile devices, M2M, sensors and other IoT devices, is a big challenge that many organizations face today. Traditional tools, such as conventional database systems, do not have the capacity to ingest data, analyze it in real-time, and make decisions. New technologies such as Apache Spark and Storm are now coming to the forefront as possible solutions to handing fast data streams. Typical technology choices fall into one of three categories: OLAP, OLTP, and stream-processing systems. Each of these solutions has its benefits, but some choices support streaming data and application development much better than others. Employing a solution that handles streaming data, provides state, ensures durability, and supports transactions and real-time decisions is key to benefitting from fast data. During this presentation you will learn: - The difference between fast OLAP, stream-processing, and OLTP database solutions. - The importance of state, real-time analytics and real-time decisions when building applications on streaming data. - How streaming applications deliver more value when built on a super-fast in-memory, SQL database.

Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...

NoSQLmatters

Whether to take data ingestion cycles off the ETL tool and the data warehouse or to facilitate competitive Data Science and building algorithms in the organization, the data lake – a place for unmodeled and vast data – will be provisioned widely in 2020. Though it doesn’t have to be complicated, the data lake has a few key design points that are critical, and it does need to follow some principles for success. Avoid building the data swamp, but not the data lake! The tool ecosystem is building up around the data lake and soon many will have a robust lake and data warehouse. We will discuss policy to keep them straight, send data to its best platform, and keep users’ confidence up in their data platforms. Data lakes will be built in cloud object storage. We’ll discuss the options there as well. Get this data point for your data lake journey.

When and How Data Lakes Fit into a Modern Data Architecture

DATAVERSITY

When you received your Uber ‘Tuesday Evening Ride Receipt’ or Spotify’s ‘This Week’s New Music’ email, did you think about how they got there? SendGrid’s reliable email platform delivers each month over 20 Billion transactional and marketing emails on behalf of many of your favorite brands, including Uber, Airbnb, Spotify, Foursquare and NextDoor. SendGrid was looking to evolve its data warehouse architecture in order to improve decision making and optimize customer experience. They needed a scalable and reliable architecture that would allow them to move nimbly and efficiently with a relatively small IT organization, while supporting the needs of both business and technical users at SendGrid. SendGrid’s Director of Enterprise Data Operations will be joining architects from Amazon Web Services (AWS) and Informatica to discuss SendGrid’s journey to a hybrid cloud architecture and how a hybrid data warehousing solution is optimized to support SendGrid’s analytics initiative. Speakers will also review common technologies and use cases being deployed in hybrid cloud today, common data management challenges in hybrid cloud and best practices for addressing these challenges. Join us to learn: • How to evolve to a hybrid data warehouse with Amazon Redshift for scalability, agility and cost efficiency with minimal IT resources • Hybrid cloud data management use cases • Best practices for addressing hybrid cloud data management challenges

SendGrid Improves Email Delivery with Hybrid Data Warehousing

Amazon Web Services

This presentation reviews the key methodologies that all members of your team should consider, before planning a migration from Oracle to Postgres including: • Prioritizing the right application or project for your first Oracle migration • Planning a well-defined, phased migration process to minimize risk and increase time to value • Handling common concerns and pitfalls related to a migration project • Leveraging resources before, during, and after your migration • Becoming independent from an Oracle database – without sacrificing performance With EDB Postgres’ database compatibility for Oracle, it is easy to migrate from your existing Oracle databases. The compatibility feature set includes compatibility for PL/SQL, Oracle’s SQL syntax, and built in SQL functions. This means that many applications can be easily migrated over to EDB Postgres. It also allows you to continue using your existing Oracle skills. For more information please contact us at sales@enterprisedb.com

Key Methodologies for Migrating from Oracle to Postgres

EDB

The Briefing Room with Rick van der Lans and Think Big, a Teradata Company Live Webcast on June 16, 2015 Watch the archive: https://bloorgroup.webex.com/bloorgroup/lsr.php?RCID=197f8106531874cc5c14081ca214eaff Hadoop is arguably one of the most disruptive technologies of the last decade. Once lauded solely for its ability to transform the speed of batch processing, it has marched steadily forward and promulgated an array of performance-enhancing accessories, notably Spark and YARN. Hadoop has evolved into much more than a file system and batch processor, and it now promises to stand as the data management and analytics backbone for enterprises. Register for this episode of The Briefing Room to learn from veteran Analyst Rick van der Lans, as he discusses the emerging roles of Hadoop within the analytics ecosystem. He’ll be briefed by Ron Bodkin of Think Big, a Teradata Company, who will explore Hadoop’s maturity spectrum, from typical entry use cases all the way up the value chain. He’ll show how enterprises that already use Hadoop in production are finding new ways to exploit its power and build creative, dynamic analytics environments. Visit InsideAnalysis.com for more information.

The Maturity Model: Taking the Growing Pains Out of Hadoop

Inside Analysis

Watch full webinar here: https://bit.ly/2QaVfE7 Faster, more agile data management is at the heart of government modernization. However, Traditional data delivery systems are limited in realizing a modernized and future-proof data architecture. This webinar will address how data virtualization can modernize existing systems and enable new data strategies. Join this session to learn how government agencies can use data virtualization to: - Enable governed, inter-agency data sharing - Simplify data acquisition, search and tagging - Streamline data delivery for transition to cloud, data science initiatives, and more

Modern Data Management for Federal Modernization

Denodo

Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...

Dataconomy Media

Watch full webinar here: https://bit.ly/39AhUB7 Enterprise organizations are shifting to self-service analytics as business users need real-time access to holistic and consistent views of data regardless of its location, source or type for arriving at critical decisions. Data Virtualization and Data Visualization work together through a universal semantic layer. Learn how they enable self-service data discovery and improve performance of your reports and dashboards. In this session, you will learn: - Challenges faced by business users - How data virtualization enables self-service analytics - Use case and lessons from customer success - Overview of the highlight features in Tableau

Accelerate Self-Service Analytics with Data Virtualization and Visualization

Denodo

Watch this webinar in full here: https://buff.ly/2MVTKqL Self-Service BI promises to remove the bottleneck that exists between IT and business users. The truth is, if data is handed over to a wide range of data consumers without proper guardrails in place, it can result in data anarchy. Attend this session to learn why data virtualization: • Is a must for implementing the right self-service BI • Makes self-service BI useful for every business user • Accelerates any self-service BI initiative

Self-Service Analytics with Guard Rails

Denodo

Andrew McIntyre, Director of Strategic ISV Alliances, ‎Informatica Modernizing your analytics capabilities to deliver rapid new insights is critical to successfully drive data-driven digital transformation. Many organizations find it challenging to connect, understand and deliver the right data to generate new insights. Learn about the latest patterns, solutions and benefits of Informatica's next-generation Enterprise Data Management platform to unleash the power of your data through the modern cloud data infrastructure of AWS. See how you can accelerate AI-driven next-generation analytics by cataloging and integrating structured and unstructured data from hundreds of data sources from multiple on-premises and cloud data sources.

Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...

Amazon Web Services

AWS Summit Singapore - Accelerate Digital Transformation through AI-powered C...

Amazon Web Services

Datastax - The Architect's guide to customer experience (CX)

DataStax

Speaker: Eddie Hui, Principal Sales Consultant, Informatica These Informatica Cloud offerings are pre-built packages for quick time-to-value for customers looking to fast-track cloud data management initiatives. For example, customers can quickly kick start a new Amazon Redshift data warehouse project and use Informatica Cloud Connector for Amazon Redshift to load it with meaningful connected data from cloud sources such as Salesforce.com or on-premises sources such as relational databases -- all within hours, not months.

Turn Big Data into Big Value on Informatica and AWS

Amazon Web Services

Oil and gas big data edition

Mark Kerzner

Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...

Certus Solutions

Anzo smart data integration february 2015

John Rueter

Watch Mike's keynote presentation from Fast Data Strategy Virtual Summit here: https://goo.gl/cC3bCq Mike Ferguson is an independent analyst and the Managing Director for Intelligent Business Strategies. In this session, he will be discussing how Denodo Platform 7.0 enables and redefines data management for the next generation. Attend this session to discover: • Perspectives from independent industry analyst Mike Ferguson • Why data virtualization is gaining momentum • How Denodo Platform 7.0 enables next generation data management

Leap to Next Generation Data Management with Denodo 7.0

Denodo

Data Provisioning & Optimization

Ambareesh Kulkarni

Similar to Reltio: Powering Enterprise Data-driven Applications with Cassandra (20)

Sydney: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cloud

Tapdata Product Intro

Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...

When and How Data Lakes Fit into a Modern Data Architecture

SendGrid Improves Email Delivery with Hybrid Data Warehousing

Key Methodologies for Migrating from Oracle to Postgres

The Maturity Model: Taking the Growing Pains Out of Hadoop

Modern Data Management for Federal Modernization

Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...

Accelerate Self-Service Analytics with Data Virtualization and Visualization

Self-Service Analytics with Guard Rails

Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...

AWS Summit Singapore - Accelerate Digital Transformation through AI-powered C...

Datastax - The Architect's guide to customer experience (CX)

Turn Big Data into Big Value on Informatica and AWS

Oil and gas big data edition

Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...

Anzo smart data integration february 2015

Leap to Next Generation Data Management with Denodo 7.0

Data Provisioning & Optimization

More from DataStax Academy

Forrester CXNYC 2017 - Delivering great real-time cx is a true craft

DataStax Academy

DataStax Enterprise (DSE) Graph is a built to manage, analyze, and search highly connected data. DSE Graph, built on NoSQL Apache Cassandra delivers continuous uptime along with predictable performance and scales for modern systems dealing with complex and constantly changing data. Download DataStax Enterprise: Academy.DataStax.com/Download Start free training for DataStax Enterprise Graph: Academy.DataStax.com/courses/ds332-datastax-enterprise-graph

Introduction to DataStax Enterprise Graph Database

DataStax Academy

DataStax Enterprise Advanced Replication supports one-way distributed data replication from remote database clusters that might experience periods of network or internet downtime. Benefiting use cases that require a 'hub and spoke' architecture. Learn more at http://www.datastax.com/2016/07/stay-100-connected-with-dse-advanced-replication Advanced Replication docs – https://docs.datastax.com/en/latest-dse/datastax_enterprise/advRep/advRepTOC.html

Introduction to DataStax Enterprise Advanced Replication with Apache Cassandra

DataStax Academy

Cassandra on Docker @ Walmart Labs

DataStax Academy

Cassandra 3.0 Data Modeling

DataStax Academy

Cassandra Adoption on Cisco UCS & Open stack

DataStax Academy

Data Modeling is the one of the first things to sink your teeth into when trying out a new database. That's why we are going to cover this foundational topic in enough detail for you to get dangerous. Data Modeling for relational databases is more than a touch different than the way it's approached with Cassandra. We will address the quintessential query-driven methodology through a couple of different use cases, including working with time series data for IoT. We will also demo a new tool to get you bootstrapped quickly with MovieLens sample data. This talk should give you the basics you need to get serious with Apache Cassandra.

Data Modeling for Apache Cassandra

DataStax Academy

Hear about how Coursera uses Cassandra as the core of its scalable online education platform. I'll discuss the strengths of Cassandra that we leverage, as well as some limitations that you might run into as well in practice. In the second part of this talk, we'll dive into how best to effectively use the Datastax Java drivers. We'll dig into how the driver is architected, and use this understanding to develop best practices to follow. I'll also share a couple of interesting bug we've run into at Coursera.

Coursera Cassandra Driver

DataStax Academy

Production Ready Cassandra

DataStax Academy

Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python

DataStax Academy

Cassandra @ Sony: The good, the bad, and the ugly part 1

DataStax Academy

Cassandra @ Sony: The good, the bad, and the ugly part 2

DataStax Academy

Standing Up Your First Cluster

DataStax Academy

Real Time Analytics with Dse

DataStax Academy

Introduction to Data Modeling with Apache Cassandra

DataStax Academy

Cassandra Core Concepts

DataStax Academy

Enabling Search in your Cassandra Application with DataStax Enterprise

DataStax Academy

Bad Habits Die Hard

DataStax Academy

Advanced Data Modeling with Apache Cassandra

DataStax Academy

Advanced Cassandra

DataStax Academy

More from DataStax Academy (20)

Forrester CXNYC 2017 - Delivering great real-time cx is a true craft

Introduction to DataStax Enterprise Graph Database

Introduction to DataStax Enterprise Advanced Replication with Apache Cassandra

Cassandra on Docker @ Walmart Labs

Cassandra 3.0 Data Modeling

Cassandra Adoption on Cisco UCS & Open stack

Data Modeling for Apache Cassandra

Coursera Cassandra Driver

Production Ready Cassandra

Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python

Cassandra @ Sony: The good, the bad, and the ugly part 1

Cassandra @ Sony: The good, the bad, and the ugly part 2

Standing Up Your First Cluster

Real Time Analytics with Dse

Introduction to Data Modeling with Apache Cassandra

Cassandra Core Concepts

Enabling Search in your Cassandra Application with DataStax Enterprise

Bad Habits Die Hard

Advanced Data Modeling with Apache Cassandra

Advanced Cassandra

Recently uploaded

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Presentation on how to chat with PDF using ChatGPT code interpreter

naman860154

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

In an era where artificial intelligence (AI) stands at the forefront of business innovation, Information Architecture (IA) is at the core of functionality. See “There’s No AI Without IA” – (from 2016 but even more relevant today) Understanding and leveraging how Information Architecture (IA) supports AI synergies between knowledge engineering and prompt engineering is critical for senior leaders looking to successfully deploy AI for internal and externally facing knowledge processes. This webinar be a high-level overview of the methodologies that can elevate AI-driven knowledge processes supporting both employees and customers. Core Insights Include: Strategic Knowledge Engineering: Delve into how structuring AI's knowledge base is required to prevent hallucinations, enable contextual retrieval of accurate information. This will include discussion of gold standard libraries of use cases support testing various LLMs and structures and configurations of knowledge base. Precision in Prompt Engineering: Learn the art of crafting prompts that direct AI to deliver targeted, relevant responses, thereby optimizing customer experiences and business outcomes. Unified Approach for Enhanced AI Performance: Explore the intersection of knowledge and prompt engineering to develop AI systems that are not only more responsive but also aligned with overarching business strategies. Guiding Principles for Implementation: Equip yourself with best practices, ethical guidelines, and strategic considerations for embedding these technologies into your business ecosystem effectively. This webinar is designed to empower business and technology leaders with the knowledge to harness the full potential of AI, ensuring their organizations not only keep pace with digital transformation but lead the charge. Join us to map a roadmap to fully leverage Information Architecture (IA) and AI chart a course towards a future where AI is a key pillar of strategic innovation and business success.

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

Earley Information Science

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

How to convert PDF to text with Nanonets

naman860154

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Histor y of HAM Radio presentation slide

vu2urc

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Civil Lines Women Seeking Men

Delhi Call girls

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker

Presentation on how to chat with PDF using ChatGPT code interpreter

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Data Cloud, More than a CDP by Matt Robison

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

🐬 The future of MySQL is Postgres 🐘

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Boost Fertility New Invention Ups Success Rates.pdf

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Automating Google Workspace (GWS) & more with Apps Script

Artificial Intelligence: Facts and Myths

How to convert PDF to text with Nanonets

A Domino Admins Adventures (Engage 2024)

Histor y of HAM Radio presentation slide

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

08448380779 Call Girls In Civil Lines Women Seeking Men

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Axa Assurance Maroc - Insurer Innovation Award 2024

Finology Group – Insurtech Innovation Award 2024

Reltio: Powering Enterprise Data-driven Applications with Cassandra

1. Powering Enterprise Data-driven Applications with Cassandra

3. Anastasia Zamyshlyaeva VP Platform Product Management and Co-founder @ Reltio • 2011 – started working with C* • 2012 – selected C* as the persistence store for creating a hybrid Columnar & Graph data-store • Since 2012 – Running in Production to support: – 24/7 uptime with 99.995% availability – Multi-Tenancy across customers – both Operational and Analytical workloads stasia@reltio.com www.linkedin.com/in/azamyshlyaeva © 2015. All Rights Reserved. 3

13. © 2015. All Rights Reserved. 13 Sales Web site Data Unification Application Supply (based on Relational Databases) • Fixed structure • No big data • Expensive • Hard to support graphs and complex attributes • Single point of failure (often) MarketingSupport

20. © 2015. All Rights Reserved. 20 ID: doc1 Type: Individual Name: John Email: john@gmail.com john@yahoo.com Address: CA, shipping NY, billing Entity type: Individual - Name: String - Email: List - Address: Complex - State: String - Type: List Metadata Entity doc1 <Name>.1 … John Simple metadata-driven attributes in Cassandra (Thrift API) Metadata-driven Documents in Columnar storage

21. ID: doc1 Type: Individual Name: John Email: john@gmail.com john@yahoo.com Address: CA, shipping NY, billing Entity type: Individual - Name: String - Email: List - Address: Complex - State: String - Type: List © 2015. All Rights Reserved. 21 Entity doc1 … <Email>.1 <Email>.2 … … john@gmail.com john@yahoo.com Multi-value metadata-driven attributes in Cassandra (Thrift API) Metadata Metadata-driven Documents in Columnar storage

22. ID: doc1 Type: Individual Name: John Email: john@gmail.com john@yahoo.com Address: CA, shipping (1) NY, billing (2) © 2015. All Rights Reserved. 22 Entity doc1 … <Address>.1.<State>.1 <Address>.1.<Type>.1 <Address>.2.<State>.1 … … CA billing NY Complex metadata-driven attributes in Cassandra (Thrift API) Metadata Metadata-driven Documents in Columnar storage Entity type: Individual - Name: String - Email: List - Address: Complex - State: String - Type: List

23. © 2015. All Rights Reserved. 23 Metadata-driven Documents – CQL wide rows CREATE TABLE ENTITIES( doc_id int, attribute_name String, attribute_value String, … PRIMARY KEY (doc_id, attribute_name) ); SELECT * -- select all addresses FROM ENTITIES WHERE doc_id = 1 AND attribute_name >= Address.0 AND attribute_name <= Address.9;

24. © 2015. All Rights Reserved. 24 John Dunder Mifflin Dwight Copy Paper Employee Individual ProductOrganization Cassandra - Records storage across datacenters Reltio - Metadata-driven graphs - Rich model for entities, relations - Partitioning - Effective joins - Graph operations Hybrid Graphs - linked entities with infinite attribution

25. 25 Reltio de-duplication John Smith Jon Smith

26. © 2015. All Rights Reserved. 26 Cassandra+ = Hybrid searchElasticsearch* * excluded documents Hybrid Search – without documents! 0 0.5 1 1.5 Data volume in Elasticsearch index (Tb) 0 1000 2000 Elasticsearch indexing performance (OPS) 0 10 20 30 Search performance on large documents (sec) - Elasticsearch - Hybrid search: Elasticsearch + Cassandra

29. Thank you

Reltio: Powering Enterprise Data-driven Applications with Cassandra

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to Reltio: Powering Enterprise Data-driven Applications with Cassandra

Similar to Reltio: Powering Enterprise Data-driven Applications with Cassandra (20)

More from DataStax Academy

More from DataStax Academy (20)

Recently uploaded

Recently uploaded (20)

Reltio: Powering Enterprise Data-driven Applications with Cassandra