#GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

•

3 likes•2,581 views

This talk introduces an open-source solution that integrates cloud native apps running on Cloud Foundry with an open-source hybrid transactions + analytics real-time solution. The architecture is based on the fastest scalable, highly available and fully consistent In-Memory Data Grid (Apache Geode / GemFire), natively integrated to the first open-source massive parallel data warehouse (Greenplum Database) in a hybrid transactional and analytical architecture that is extremely fast, horizontally scalable, highly resilient and open source. This session also features a live demo running on Cloud Foundry, showing a real case of real-time closed-loop analytics and machine learning using the featured solution.

Technology

© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.
Smarter data-driven apps 
2
Real-time decision making

© Copyright 2014 Pivotal. All rights reserved.
X

© Copyright 2014 Pivotal. All rights reserved.

© Copyright 2014 Pivotal. All rights reserved.
Transactional Analytical
X

© Copyright 2014 Pivotal. All rights reserved.
Transactional Analytical
User Mgmt
Order Mgmt
Shipping
Inventory
Payment X

© Copyright 2014 Pivotal. All rights reserved.
Transactional
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Analytical

© Copyright 2014 Pivotal. All rights reserved.
Old and coldNew and fresh

© Copyright 2014 Pivotal. All rights reserved.
X
Hybrid

© Copyright 2014 Pivotal. All rights reserved.
Hybrid
Transactional
Analytical
SQL
API

© Copyright 2014 Pivotal. All rights reserved.
Transactional
Analytical
SQL
API
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Cloud

© Copyright 2014 Pivotal. All rights reserved.
Transactional
Analytical
SQL
API
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Order
Mgmt
Contract
Inventory
Contract
Payment
Contract
User
Mgmt
Contract
RDBMs Polyglot Persistence

© Copyright 2014 Pivotal. All rights reserved.
SQL
Machine Learning
Results

© Copyright 2014 Pivotal. All rights reserved.
Greenplum
Data
Temperature
Hot
Warm
ANSI SQL
Parallel Configurable
Data Load
GemFire
Rest / HTTP
Push updates
Transactional
data write
behind
Analytical
data to
cache
Data Science, Analytics & ML
Pivotal Cloud Foundry
Web Console
PoS Emulator
PoS EmulatorPoS Emulator

© Copyright 2014 Pivotal. All rights reserved.
GemFire
Greenplum

© Copyright 2014 Pivotal. All rights reserved.
Challenge:
• Fraudsters use ID theft to file false tax returns, defrauding the
government and costing tax payers significantly
• Need to enable complex fraud detection logic to stop billions in
fraud while ingesting large amounts of data over a short time period
(1 million tax returns/hour)
• Existing Rules engine architecture used to detect fraud is doesn’t
allow for real-time analysis
Solution:
• Pivotal Data Engineering re-architected the Rules engine by
leveraging GemFire and Greenplum DB to achieve much faster
data processing
• Reduced tax return processing time with real-time technology
Pivotal Solution includes: BDS, Data Labs
U.S. Government Agency Tackles ID Theft in Real-time Speed with In-Memory Technology

© Copyright 2014 Pivotal. All rights reserved.
Telco Network Quality KPIs

Fast Data Ingest and Real-time Analytics

Challenge:
• Provide network quality KPIs to Brazil's National Telco
Agency
• Capture, analyze and guarantee data consistency for
millions of data points / sec.
• Enable near real-time analytics over the high volume and
fast data being transacted
Solution:
• Pivotal GemFire and Greenplum DB allow combined fast
low-latency in-memory transactions and near real-time
analytics
• Real-time data insights on cell phone network quality KPIs
• Data Science engagement for improving the network
quality

24
Join the Apache Geode Community!
• Check out http://geode.incubator.apache.org
• Subscribe: user-subscribe@geode.incubator.apache.org
• Download: http://geode.incubator.apache.org/releases/

What's hot

The proliferation of digital channels has made it mandatory for marketers to understand an individual across multiple touchpoints. In order to develop market effectiveness, marketers need have a pretty good sense of its consumer’s identity so that it can reach him via mobile device, desktop or a big TV screen on living room. Examples of such identity tokens include cookies, app IDs etc.A consumer can use multiple devices at the same time and so the same consumer should not be treated as different people in the advertising space. The idea of identity resolution comes with this mission and goal to have an omnichannel view of a consumer.

Building Identity Graph at Scale for Programmatic Media Buying Using Apache S...

Databricks

The CDO bears responsibility for the firm’s data and information strategy, governance, control, policy development, and exploitation of data assets to create business value” Source – Gartner In this session we will show how the CDO can manage and exploit all of a company’s data assets on Hadoop, in a controlled manner where the quality of the data is verified and security access is controlled, and all data activities are logged and recorded automatically on Atlas. We will demonstrate how to use Bluemetrix Data Manager (BDM) and show how easy it is to ingest, transform and control data on Hadoop, while automatically deploying governance on Atlas. Speaker Liam English, CEO, Bluemetrix

Data Offload for the Chief Data Officer – how to move data onto Hadoop withou...

DataWorks Summit

Hear how Manulife Asia has built an environment that enables the company to solve business-critical problems across many countries. What began in 2017 as an update to their enterprise architecture now spans everything from infrastructure to applications, powering their entire digital backbone. It includes fraud identification, real-time investment dashboards, advanced analytics and machine learning, and digital connection apps that talk to customers for claims, support, and more. Learn the importance hard work, coordination, discipline, and an agile methodology play in deciding which use cases they will focus on to deliver new services in an environment where everything is time sensitive and business requirements shift regularly. Speaker: Ellen Wu, Head of Asia Data Office, Global Data Enablement and Governance, Manulife

The Manulife Journey

DataWorks Summit

Hadoop is sparking a Big Data analytics revolution. But all the Hadoop insights in the world are worth nothing unless they lead to new, profitable action. To translate Hadoop insights into action in real time, more and more enterprises are combining Hadoop with the power of in-memory computing. Join us as we outline the tremendous benefits of merging Hadoop with in-memory data management, the challenges of doing so, and tips for getting started.

Terracotta Hadoop & In-Memory Webcast

Terracotta, a product line at Software AG

Big Data Application Architectures - Fraud Detection

DataWorks Summit/Hadoop Summit

Stora Enso&Wipro - Stora Enso Rethinks Supply Chain - ProcessForum Nordic, No...

Software AG

Real-time Streaming Analytics for Enterprises based on Apache Storm - Impetus...

Impetus Technologies

Many Federal agencies can benefit from the real-world experience of the financial services sector when it comes to best practices for big data management, cybersecurity, and fraud detection and mitigation. The reality is that most government organizations struggle to manage and reconcile financial information, as they must rely on a mix of legacy systems and newer applications to make fundamental business decisions. If you have big data challenges and are looking for a better way to streamline and secure data management to support your agency’s business and IT operations, plan to attend this session. This is your opportunity to understand how Hadoop can support your specific financial management mandates and help you use your organizational information to make defensible, data-driven decisions.

Relying on Data for Strategic Decision-Making--Financial Services Experience

Cloudera, Inc.

Financial firms are under pressure to grow their business while containing risk and complying with many regulations world-wide. In addition, there is the growing demand from customers to improve their experience and offer new services over multiple channels. Data is at the core of these capabilities but there are many challenges to overcome: fragmentation, security, quality, privacy, retention, to name a few. We are going to hear about trends in the industry from IDC Financial Insights Research Director Bill Fearnley, followed by a discussion about how Cloudera has helped Transamerica turn their data into competitive advantage by creating an Enterprise Marketing and Analytics Engine.

Big Data as Competitive Advantage in Financial Services

Cloudera, Inc.

The Big Data Ecosystem for Financial Services

DataStax

Financial institutions today are under intense pressure to provide more value add to the customers, reduce IT costs and also grow year to year. This challenge has been further complicated by huge amounts of data being generated as well as mandatory federal compliances in place. Similarly, Manufacturing industry today also is facing the challenge to process huge amount of data in real time and predict failures as early as possible to reduce cost and increase production efficiency. The session will cover some high level Big Data use cases applicable to financial and manufacturing domain and how big data technologies are being used successfully to solve these challenges using some examples in credit card/banking industry in financial domain and semi-conductor production in manufacturing domain.

Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases

Sanjay Sharma

(Bjørn Kvernstuen + Tommy Jocumsen, Norwegian Directorate for Work and Welfare) Kafka Summit SF 2018 NAV (Norwegian Work and Welfare Department) currently distributes more than one third of the national budget to citizens in Norway or abroad. We’re there to assist people through all phases of life within the domains of work, family, health, retirement and social security. Events happening throughout a person’s life determines which services we provide to them, how we provide them and when we provide them. Today, each person has to apply for these services resulting in many tasks that are largely handled manually by various case workers in the organization. Their access to insight and useful information is limited and often hard to find, causing frustration to both our case workers and our users. By streaming a person’s life events through our Kafka pipelines, we can revolutionize the way our users experience our services and the way we work. NAV and the government as a whole have access to vast amounts of data about our citizens, reported by health institutions, employers, various government agencies or the users themselves. Some data is distributed by large batches, while others are available on-demand through APIs. We’re changing these patterns into streams using Kafka, Streams API and Java microservices. We aim to distribute and act on events about birth, death, relationships, employment, income and business processes to vastly improve the user experience, provide real-time insight and reduce the need to apply for services we already know are needed. This talk will touch on the following topics: -How we move from data-on-demand to streams -How streams of life events will free our case workers from mundane tasks -How life and business events make valuable insight -How we protect our users and comply with GDPR -Why we chose Confluent Platform

Life is a Stream of Events

confluent

Hadoop is regarded as a key capability for implementing Big Data initiatives in the enterprise, but organizations have yet to realize its full business benefits. In this webinar, Pivotal and guest Forrester Research, Inc. Identify the use cases driving Hadoop adoption, and explore what is needed to transform initial investments into results. Learn about: Challenges Hadoop introduces, and how the right tools and platforms can help address them Shifts in the industry with regards to SQL and NoSQL systems and their implications to Big Data analytics Applying in-memory technologies for data management systems, data analytics, transactional processing and operational databases Watch the on-demand webinar here: http://www.pivotal.io/big-data/pivotal-forrester-operationalizing-data-analytics-webinar Learn how to maximize business value from all of your data here: http://www.pivotal.io/big-data/pivotal-hd

Operationalizing Data Analytics

VMware Tanzu

The SMART Forecasting team at Walmart Labs has built an innovative, cloud-agnostic, scalable platform to improve Walmart’s ability to predict customer demand while improving item in-stocks and reducing food waste. Over a period of two years, all of Walmart’s key departments in the US, Canada and Mexico have adopted our forecasting solution with planned extensions to other Walmart operated international markets. Over 100M store-item combinations are forecasted every week for the next 52 weeks. We continue to enhance our modelling suite for COVID impact, pricing in international markets, and weekend sales corrections. We will present a general overview of our scaled forecasting solution and follow it by a concrete use case for in week adjustments which provides consistent business value for produce and is currently in the process of being scaled out to more Walmart departments.

Weekday Demand Sensing at Walmart

Databricks

Modern Data Platform Part 1: Data Ingestion

Nilesh Shah

Getting Started with Apache Ignite as a Distributed Database

Roman Shtykh

For years, the healthcare industry has had problems of data scarcity and latency. Clearsense solved the problem by building an open-source Hortonworks Data Platform (HDP) solution while providing decades worth of clinical expertise. Clearsense is delivering smart, real-time streaming data, to its healthcare customers enabling mission-critical data to feed clinical decisions. https://hortonworks.com/webinar/delivering-smart-real-time-streaming-data-healthcare-customers-clearsense/

Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense

Hortonworks

Machine learning development brings many new complexities beyond the traditional software development lifecycle. Unlike traditional software development, ML developers want to try multiple algorithms, tools and parameters to get the best results, and they need to track this information to reproduce work. In addition, developers need to use many distinct systems to productionize models. In this talk, learn how to operationalize ML across the full lifecycle with Databricks Machine Learning.

Learn to Use Databricks for the Full ML Lifecycle

Databricks

Analytic workloads and the ability to determine “what happened” are some of the most common use cases across enterprises today - helping you understand and adapt based on changing trends. However, for most businesses today, they are only able to see a piece of the story. Analytics are limited by the amount of data able to be stored and ultimately accessed, it’s time-intensive to bring in new datasets or fit unstructured data into rigid schemas, and user access is constrained to a select few who must already know the questions they’re trying to answer. It’s no surprise that big data is disrupting this modus operandi for analytics. A modern, Hadoop-based platform is designed to help businesses break free of these analytic limitations, providing a new kind of adaptive, high-performance analytic database. The recent release of Cloudera 5.8 continues to advance Cloudera Enterprise as the foundation for these analytic workloads. Join Justin Erickson, Senior Director of Product Management at Cloudera, and Andy Frey, Chief Technology Officer at Marketing Associates, as they discuss: -What technology is needed to build a modern analytic database with Hadoop -What’s new with Cloudera 5.8 -How to align your teams around agile analytics -Real world success from Marketing Associates -What’s next for Cloudera Enterprise’s Analytic Database

Building a Modern Analytic Database with Cloudera 5.8

Cloudera, Inc.

Introduction: Architecting for Scale

DataStax

What's hot (20)

Building Identity Graph at Scale for Programmatic Media Buying Using Apache S...

Data Offload for the Chief Data Officer – how to move data onto Hadoop withou...

The Manulife Journey

Terracotta Hadoop & In-Memory Webcast

Big Data Application Architectures - Fraud Detection

Stora Enso&Wipro - Stora Enso Rethinks Supply Chain - ProcessForum Nordic, No...

Real-time Streaming Analytics for Enterprises based on Apache Storm - Impetus...

Relying on Data for Strategic Decision-Making--Financial Services Experience

Big Data as Competitive Advantage in Financial Services

The Big Data Ecosystem for Financial Services

Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases

Life is a Stream of Events

Operationalizing Data Analytics

Weekday Demand Sensing at Walmart

Modern Data Platform Part 1: Data Ingestion

Getting Started with Apache Ignite as a Distributed Database

Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense

Learn to Use Databricks for the Full ML Lifecycle

Building a Modern Analytic Database with Cloudera 5.8

Introduction: Architecting for Scale

Viewers also liked

#GeodeSummit - Wall St. Derivative Risk Solutions Using Geode

PivotalOpenSourceHub

#GeodeSummit: Easy Ways to Become a Contributor to Apache Geode

PivotalOpenSourceHub

Today, if events change the decision model, we wait until the next batch model build for new insights. By extending fast “time-to-decisions” into the world of Big Data Analytics to get fast “time-to-insights”, apps will get what used to be batch insights in near real time. The technology enabling this includes smart in-memory data storage, new storage class memory, and products designed to do one or more parts of an analysis pipeline very well. In this talk we describe how Ampool is building on Apache Geode to allow Big Data analysis solutions to work together with a scalable smart storage class memory layer to allow fast and complex end-to-end pipelines to be built -- closing the loop and providing dramatically lower time to critical insights.

#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode)

PivotalOpenSourceHub

The financial sector is an exciting mix of challenges regarding throughput, high availability as well as specific constraints regarding latency and consistency. In the continuous evolution of its platform, Murex relies on open source technologies like Apache Geode and Apache Storm in a "kind of" lambda architecture to ensure storage, near-real time (around the milliseconds) aggregation of thousands of events per second, advanced notification mechanisms and on-demand deployments. This talk will focus on the technical architecture, the underlying principles as well as the technologies used to support this mix of functional and non-functional requirements.

#GeodeSummit: Combining Stream Processing and In-Memory Data Grids for Near-R...

PivotalOpenSourceHub

#GeodeSummit - Spring Data GemFire API Current and Future

PivotalOpenSourceHub

#GeodeSummit - Off-Heap Storage Current and Future Design

PivotalOpenSourceHub

#GeodeSummit - Redis to Geode Adaptor

PivotalOpenSourceHub

In this session we explore a case study of a large-scale government fraud detection program that prevents billions of dollars in fraudulent payments each year leveraging the beta release of the GemFire+Greenplum Connector, which is planned for release in GemFire 9. Topics will include an overview of the system architecture and a review of the new GemFire+Greenplum Connector features that simplify use cases requiring a blend of massively parallel database capabilities and accelerated in-memory data processing.

#GeodeSummit - Large Scale Fraud Detection using GemFire Integrated with Gree...

PivotalOpenSourceHub

#GeodeSummit - Integration & Future Direction for Spring Cloud Data Flow & Geode

PivotalOpenSourceHub

#GeodeSummit Keynote: Creating the Future of Big Data Through 'The Apache Way"

PivotalOpenSourceHub

In this talk, Eitan Suez explores the question: Where does Geode fit in an organization's system architecture? Geode is a unique and feature-rich product that perhaps hasn't seen as much adoption as it deserves. Today's apps are no longer the straightforward, database-backed web applications we used to build a few years ago. Applications have become more sophisticated, as they've had to meet the need to scale, to be reliable, fault-tolerant, and to integrate with other systems. In this talk, Eitan will suggest one particular fit for Geode in the context of a CQRS architecture, and welcomes you to attend, and to contribute by sharing how you've put Geode to use in your organization.

#GeodeSummit - Where Does Geode Fit in Modern System Architectures

PivotalOpenSourceHub

Apache Apex and Apache Geode are two of the most promising incubating open source projects. Combined, they promise to fill gaps of existing big data analytics platforms. Apache Apex is an enterprise grade native YARN big data-in-motion platform that unifies stream and batch processing. Apex is highly scalable, performant, fault tolerant, and strong in operability. Apache Geode provides a database-like consistency model, reliable transaction processing and a shared-nothing architecture to maintain very low latency performance with high concurrency processing. We will also look at some use cases where how these two projects can be used together to form distributed, fault tolerant, reliable in memory data processing layer.

#GeodeSummit - Apex & Geode: In-memory streaming, storage & analytics

PivotalOpenSourceHub

How Southwest Airlines Uses Geode Distributed systems and fast data require new software patterns and implementation skills. Learn how Southwest Airlines uses Apache Geode, organizes team responsibilities, and approaches design tradeoffs. Drawing inspiration from real whiteboard conversations, we’ll explore: common development pitfalls, environment capacity planning, streaming data patterns like consumer checkpointing, support roles, and production lessons learned. Every day, Apache Geode improves how Southwest Airlines schedules nearly 4,000 flights and serves over 500,000 passengers. It’s an essential component of Southwest’s ability to reduce flight delays and support future growth.

#GeodeSummit - Design Tradeoffs in Distributed Systems

PivotalOpenSourceHub

Apache Geode Meetup, London

Apache Geode

Build your first Internet of Things app today with Open Source

Apache Geode

Viewers also liked (15)

#GeodeSummit - Wall St. Derivative Risk Solutions Using Geode

#GeodeSummit: Easy Ways to Become a Contributor to Apache Geode

#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode)

#GeodeSummit: Combining Stream Processing and In-Memory Data Grids for Near-R...

#GeodeSummit - Spring Data GemFire API Current and Future

#GeodeSummit - Off-Heap Storage Current and Future Design

#GeodeSummit - Redis to Geode Adaptor

#GeodeSummit - Large Scale Fraud Detection using GemFire Integrated with Gree...

#GeodeSummit - Integration & Future Direction for Spring Cloud Data Flow & Geode

#GeodeSummit Keynote: Creating the Future of Big Data Through 'The Apache Way"

#GeodeSummit - Where Does Geode Fit in Modern System Architectures

#GeodeSummit - Apex & Geode: In-memory streaming, storage & analytics

#GeodeSummit - Design Tradeoffs in Distributed Systems

Apache Geode Meetup, London

Build your first Internet of Things app today with Open Source

Similar to #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

Pivotal CenturyLink Cloud Platform Seminar Presentations: Software Kept Eatin...

VMware Tanzu

Time series data can bring value to organizations in many ways, beyond simply metrics to help them understand how their infrastructure is performing. It also can help illuminate other issues that can have an impact on performance. Join us for this informative webinar where we discuss the value and benefits of a Purpose-built platform, how to deal with large amounts of data, and the importance of “time to awesome.” And make sure you are up-to-date with viewing the InfluxData Video Series on Devops.com!

How to Handle the Realities of DevOps Monitoring Today

DevOps.com

DevOps, CD and [Data] Microservices

Fred Melo

TIAD : Automation day by Jerôme Labat

The Incredible Automation Day

Cloud Foundry open Platform as a Service makes it easy to operate, scale and deploy application for your dedicated cloud environments. It enables developers and operators to be significantly more agile, writing great applications and deliver them in days instead of months. Cloud Foundry takes care of all the infrastructure and network plumbing that you need to build, run and operate your applications and can do this while patching and updating systems and services without any downtime.

The Cloud Foundry Story

VMware Tanzu

"The data coming into Kafka is fresh and hot. And you can deliver a new level of operational visibility and intelligence fueling applications with it. But streaming data is no longer real-time when the sink is batch. So the challenge is processing it and analyzing it at scale and extracting those insights - before they go stale. So what’s the right architecture? Should you ingest streams into a data warehouse or data lake? Maybe use a stream processor or a database? Engineering teams love using Apache Flink, but they also love using Apache Druid, a popular real-time analytics database used by 1000s of companies like Confluent and Netflix. Do you need Flink and Druid? When does it make sense vs when does it not? Join this session to learn about Apache Druid and why companies use it in combination with Kafka and Flink for real-time applications. Learn how Apache Druid complements Flink and Kafka - and what makes it purpose-built for analyzing streams and events. This talk shows real-world examples from companies that use Apache Druid with Kafka and Flink in production today and the best-practices that every dev can take advantage of."

A Trifecta of Real-Time Applications: Apache Kafka, Flink, and Druid

HostedbyConfluent

There are 250 Database products, are you running the right one?

Aerospike, Inc.

An in depth look at how Confluent is being used in the financial services industry. Gain an understanding of how organisations are utilising data in motion to solve common problems and gain benefits from their real time data capabilities. It will look more deeply into some specific use cases and show how Confluent technology is used to manage costs and mitigate risks. This session is aimed at Solutions Architects, Sales Engineers and Pre Sales, and also the more technically minded business aligned people. Whilst this is not a deeply technical session, a level of knowledge around Kafka would be helpful.

Confluent & GSI Webinars series - Session 3

confluent

Innovation Day Paris 10 avril 2014 - IBO Fuels Smarter Business Operations fo...

Software AG France Community

Atmosphere Coffee Break - Scripting & Order Entry

IntelePeer

The Time is Now for Big Data Issue 1.5 - Lisbon Edition 03FEV2015

Luis Moreno Campos

Patrick Shields, CTO at Software AG, describes the rich history of innovation that Software AG has traveled over the last 4 decades. Software AG was on the bleeding edge at the dawn of enterprise computing, providing mainframe customers with IT sourced competitive advantage. Software AG continues this heritage of innovation, making digitization practical and meaningful for businesses today. Software AG has taken technologies that were industry "buzz words" a few short years ago and made them practical viable solutions that can be leveraged now, to create differentiation in the today's ever changing marketplace. This presentation was a keynote address at Software AG's 2014 Innovation Forum, held in Johannesburg, South Africa.

The Road Map to Digitization - Software AG's Heritage of Innovation - Patrick...

Software AG South Africa

Hortonworks - IBM Cognitive - The Future of Data Science

Thiago Santiago

Stream Processing is a concept used to create a high-performance system for rapidly building applications that analyze and act on real-time streaming data. Benefits, amongst others, are faster processing and reaction to real-time complex event streams and the flexibility to quickly adapt to changing business and analytic needs. Big data, cloud, mobile and internet of things are the major drivers for stream processing and streaming analytics. This session discusses the technical concepts of stream processing and how it is related to big data, mobile, cloud and internet of things. Different use cases such as predictive fault management or fraud detection are used to show and compare alternative frameworks and products for stream processing and streaming analytics. The audience will understand when to use open source frameworks such as Apache Storm, Apache Spark or Esper, and powerful engines from software vendors such as IBM InfoSphere Streams or TIBCO StreamBase. Live demos will give the audience a good feeling about how to use these frameworks and tools. The session will also discuss how stream processing is related to Hadoop and statistical analysis with software such as SAS, Apache Spark’s MLlib or R language.

Streaming Analytics - Comparison of Open Source Frameworks and Products

Kai Wähner

The CSC Big Data Analytics Insights service enables clients who do not have an analytics capability to implement the business, data and technology changes to gain business benefit from an initial set of analytics based on a roadmap of changes created by CSC or provided from a compatible set of inputs. CSC Analytic Insights Implementation has four phases: Stage 1: Analytic Engagement Stage 2: Analytic Discovery Stage 3: Implementation Planning Stage 4: Embedding Analysis .

Big Data and Analytics

Cameron. A. Bradbury

Big Data and Analytics

Cameron. A. Bradbury

The Business Justification for APM

Jonah Kowall

PRGX is the world's leading provider of accounts payable audit services and works with leading global retailers. As new forms of data started to flow into their organizations, standard RDBMS systems were not allowing them to scale. Now, by using Talend with Cloudera Enterprise, they are able to acheive a 9-10x performance benefit in processing data, reduce errors, and now provide more innovative products and services to end customers. Watch this webinar to learn how PRGX worked with Cloudera and Talend to create a high-performance computing platform for data analytics and discovery that rapidly allows them to process, model, and serve massive amount of structured and unstructured data.

Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...

Cloudera, Inc.

Real Time Business Platform by Ivan Novick from Pivotal

VMware Tanzu Korea

Real time applications using the R Language

Lou Bajuk

Similar to #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making (20)

Pivotal CenturyLink Cloud Platform Seminar Presentations: Software Kept Eatin...

How to Handle the Realities of DevOps Monitoring Today

DevOps, CD and [Data] Microservices

TIAD : Automation day by Jerôme Labat

The Cloud Foundry Story

A Trifecta of Real-Time Applications: Apache Kafka, Flink, and Druid

There are 250 Database products, are you running the right one?

Confluent & GSI Webinars series - Session 3

Innovation Day Paris 10 avril 2014 - IBO Fuels Smarter Business Operations fo...

Atmosphere Coffee Break - Scripting & Order Entry

The Time is Now for Big Data Issue 1.5 - Lisbon Edition 03FEV2015

The Road Map to Digitization - Software AG's Heritage of Innovation - Patrick...

Hortonworks - IBM Cognitive - The Future of Data Science

Streaming Analytics - Comparison of Open Source Frameworks and Products

Big Data and Analytics

The Business Justification for APM

Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...

Real Time Business Platform by Ivan Novick from Pivotal

Real time applications using the R Language

More from PivotalOpenSourceHub

Here are the slides for Greenplum Chat #8. You can view the replay here: https://www.youtube.com/watch?v=FKFiyJDgdQk The increased frequency and sophistication of high-profile data breaches and malicious hacking is putting organizations at continued risk of data theft and significant business disruption. Complicating this scenario is the unbounded growth of Big Data and petabyte-scale data storage, new open source database and distribution schemes, and the continued adoption of cloud services by enterprises. Pivotal Greenplum customers often look for additional encryption of data-at-rest and data-in-motion. The massively parallel processing (MPP) architecture of Pivotal Greenplum provides an architecture that is unlike traditional OLAP on RDBMS for data warehousing, and encryption capabilities must address the scale-out architecture. The Zettaset Big Data Encryption Suite has been designed for optimal performance and scalability in distributed Big Data systems like Greenplum Database and Apache HAWQ. Here is a replay of our recent Greenplum Chat with Zettaset: 00:59 What is Greenplum’s approach for encryption and why Zettaset? 02:17 Results of field testing Zettaset with Greenplum 03:50 Introduction to Zettaset, the security company 05:36 Overview of Zettaset and their solutions 14:51 Different layers for encrypting data at rest 16:50 Encryption key management for big data 20:51 Zettaset BD Encrypt for data at rest and data in motion 22:19 How to mitigate encryption overhead with an MPP scale-out system 24:12 How to deploy BD Encrypt 25:50 Deep dive on data at rest encryption 30:44 Deep dive on data in motion encryption 36:72 Q: How does Zettaset deal with encrypting Greenplums multiple interfaces? 38:08 Q: Can I encrypt data for a particular column? 40:26 How Zettaset fits into a security strategy 41:21 Q: What is the performance impact on queries by encrypting the entire database? 43:28 How Zettaset helps Greenplum meet IT compliance requirements 45:12 Q: How authentication for keys is obtained 48:50 Q: How can Greenplum users try out Zettaset? 50:53 Q: What is a ‘Zettaset Security Coach’?

Zettaset Elastic Big Data Security for Greenplum Database

PivotalOpenSourceHub

New Security Framework in Apache Geode

PivotalOpenSourceHub

Apache Geode Clubhouse - WAN-based Replication

PivotalOpenSourceHub

Building Apps with Distributed In-Memory Computing Using Apache Geode

PivotalOpenSourceHub

GPORCA is newly open source advanced query optimizer that is a subproject of Greenplum Database open source project. GPORCA is the query optimizer used in commercial distributions of both Greenplum and HAWQ. In these distributions GPORCA has achieved 1000x performance improvement across TPC-DS queries by focusing on three distinct areas: Dynamic Partition Elimination, SubQuery Unnesting, and Common Table Expression. Now that GPORCA is open source, we are looking for collaborators to help us realize the ultimate dream for GPORCA - to work with any database. The new breed of data management systems in Big Data have to process so much data that optimization mistakes are magnified in traditional optimizers. Furthermore, coding and manual optimization of complex queries has proven to be hard. In this session, Venkatesh will discuss: - Overview of GPORCA - How to add GPORCA to HAWQ with a build option - How GPORCA could be made to work with any database - Future vision for GPORCA and more immediate plans - How to work with GPORCA, and how to contribute to GPORCA

GPORCA: Query Optimization as a Service

PivotalOpenSourceHub

Pivoting Spring XD to Spring Cloud Data Flow: A microservice based architecture for stream processing Microservice based architectures are not just for distributed web applications! They are also a powerful approach for creating distributed stream processing applications. Spring Cloud Data Flow enables you to create and orchestrate standalone executable applications that communicate over messaging middleware such as Kafka and RabbitMQ that when run together, form a distributed stream processing application. This allows you to scale, version and operationalize stream processing applications following microservice based patterns and practices on a variety of runtime platforms such as Cloud Foundry, Apache YARN and others. About Sabby Anandan Sabby Anandan is a Product Manager at Pivotal. Sabby is focused on building products that eliminate the barriers between application development, cloud, and big data.

Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan

PivotalOpenSourceHub

Apache Geode Offheap Storage

PivotalOpenSourceHub

Apache Zeppelin Meetup Christian Tzolov 1/21/16

PivotalOpenSourceHub

Build & test Apache Hawq

PivotalOpenSourceHub

Postgre sql linuxcontainers by Jignesh Shah

PivotalOpenSourceHub

kafka for db as postgres

PivotalOpenSourceHub

Geode Transactions by Swapnil Bawaskar

PivotalOpenSourceHub

Greenplum Database Open Source December 2015

PivotalOpenSourceHub

MADlib Architecture and Functional Demo on How to Use MADlib/PivotalR

PivotalOpenSourceHub

Data Science Perspective and DS demo

PivotalOpenSourceHub

More from PivotalOpenSourceHub (15)

Zettaset Elastic Big Data Security for Greenplum Database

New Security Framework in Apache Geode

Apache Geode Clubhouse - WAN-based Replication

Building Apps with Distributed In-Memory Computing Using Apache Geode

GPORCA: Query Optimization as a Service

Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan

Apache Geode Offheap Storage

Apache Zeppelin Meetup Christian Tzolov 1/21/16

Build & test Apache Hawq

Postgre sql linuxcontainers by Jignesh Shah

kafka for db as postgres

Geode Transactions by Swapnil Bawaskar

Greenplum Database Open Source December 2015

MADlib Architecture and Functional Demo on How to Use MADlib/PivotalR

Data Science Perspective and DS demo

Recently uploaded

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Recently uploaded (20)

CNIC Information System with Pakdata Cf In Pakistan

[BuildWithAI] Introduction to Gemini.pdf

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MS Copilot expands with MS Graph connectors

presentation ICT roal in 21st century education

Six Myths about Ontologies: The Basics of Formal Ontology

WSO2's API Vision: Unifying Control, Empowering Developers

Vector Search -An Introduction in Oracle Database 23ai.pptx

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategies for Landing an Oracle DBA Job as a Fresher

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Introduction to Multilingual Retrieval Augmented Generation (RAG)

How to Troubleshoot Apps for the Modern Connected Worker

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Understanding the FAA Part 107 License ..

#GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

1. A NEW PLATFORM FOR A NEW ERA

14. © Copyright 2014 Pivotal. All rights reserved. Transactional Analytical SQL API User Mgmt Order Mgmt Shipping Inventory Payment Order Mgmt Contract Inventory Contract Payment Contract User Mgmt Contract RDBMs Polyglot Persistence

15. © Copyright 2014 Pivotal. All rights reserved. Transactional Analytical SQL API User Mgmt Order Mgmt Shipping Inventory Payment Order Mgmt Contract Inventory Contract Payment Contract User Mgmt Contract RDBMs Polyglot Persistence

17. © Copyright 2014 Pivotal. All rights reserved. Greenplum Data Temperature Hot Warm ANSI SQL Parallel Configurable Data Load GemFire Rest / HTTP Push updates Transactional data write behind Analytical data to cache Data Science, Analytics & ML Pivotal Cloud Foundry Web Console PoS Emulator PoS EmulatorPoS Emulator

22. © Copyright 2014 Pivotal. All rights reserved. Challenge: • Fraudsters use ID theft to file false tax returns, defrauding the government and costing tax payers significantly • Need to enable complex fraud detection logic to stop billions in fraud while ingesting large amounts of data over a short time period (1 million tax returns/hour) • Existing Rules engine architecture used to detect fraud is doesn’t allow for real-time analysis Solution: • Pivotal Data Engineering re-architected the Rules engine by leveraging GemFire and Greenplum DB to achieve much faster data processing • Reduced tax return processing time with real-time technology Pivotal Solution includes: BDS, Data Labs U.S. Government Agency Tackles ID Theft in Real-time Speed with In-Memory Technology

23. © Copyright 2014 Pivotal. All rights reserved. Telco Network Quality KPIs Fast Data Ingest and Real-time Analytics Challenge: • Provide network quality KPIs to Brazil's National Telco Agency • Capture, analyze and guarantee data consistency for millions of data points / sec. • Enable near real-time analytics over the high volume and fast data being transacted Solution: • Pivotal GemFire and Greenplum DB allow combined fast low-latency in-memory transactions and near real-time analytics • Real-time data insights on cell phone network quality KPIs • Data Science engagement for improving the network quality

24. 24 Join the Apache Geode Community! • Check out http://geode.incubator.apache.org • Subscribe: user-subscribe@geode.incubator.apache.org • Download: http://geode.incubator.apache.org/releases/

25. A NEW PLATFORM FOR A NEW ERA

#GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (15)

Similar to #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making

Similar to #GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making (20)

More from PivotalOpenSourceHub

More from PivotalOpenSourceHub (15)

Recently uploaded

Recently uploaded (20)

#GeodeSummit: Architecting Data-Driven, Smarter Cloud Native Apps with Real-Time Decision-Making