Migrating to the Cloud – Is Application Performance Monitoring still required?eG Innovations
As more businesses adopt cloud technologies for their various benefits it must be noted that not all cloud offerings are the same and provide different services or infra SLA. Do you know that not all SLA from cloud providers mean your application will be ensured similar availability?
Depending on whether you are leveraging Saas, Paas, Iaas, etc to deliver your applications, you will have a different level of visibility and control of how you manage performance and deliver the user experience expected by your users.
Join the session and find out what remains within your responsibility and how you can monitor the various cloud infrastructure/services to give yourself the needed visibility to deliver the expected user experience without over-provisioning to ensure better performance.
CTO of ParStream Joerg Bienert hold a presentation on February 25, 2014 about Big Data for Business Users. He talked about several use cases of current ParStream customers and ParStreams' technology itself.
Is Your Data Paying You Dividends? Data innovation is a means to an end where data as an asset can be managed, developed, monetized, and eventually expected to pay dividends to the business.While 70% of CEOs surveyed expect investments in data, analytics, ML and AI initiatives to improve their bottom-line, 56% stated concerns over the integrity of their data1. Data science teams are now tasked to deliver true business value but fundamental issues remain in data preparation, data cleansing which impedes speed to market.Join Karan Sachdeva as he demonstrates capabilities of the all-new IBM Cloud Private for Data –a single containerized platform - that bridges the gap between data consumability, governance, integration, and visualization, accelerating speed to market and dividends to your business.by Karan Sachdeva, Sales Leader Big Data Analytics, IBM Asia Pacific
Unlock Data-driven Insights in Databricks Using Location IntelligencePrecisely
Today’s data-driven organisations are turning to Databricks for a cloud-based, open, unified platform for data and AI. Yet many companies struggle to unlock the value of the data they have in Databricks. To capitalise on the promise of a competitive edge through increased efficiency and insight, data scientists are turning to location to make sense of massive volumes of business data.
Watch this on-demand to hear from The Spatial Distillery Co. and Databricks on how to leverage advanced location intelligence and enrichment solutions in Databricks to:
- Simplify the complexity of location data and transform it into valuable insights
- Enrich data with thousands of attributes for better, more accurate analytics, AI, and ML models
- Leverage the power of Databricks to integrate geospatial data into business processes for real-time answers
- Create more meaningful and timely customer interactions by streamlining customer-facing and operational tasks
Migrating to the Cloud – Is Application Performance Monitoring still required?eG Innovations
As more businesses adopt cloud technologies for their various benefits it must be noted that not all cloud offerings are the same and provide different services or infra SLA. Do you know that not all SLA from cloud providers mean your application will be ensured similar availability?
Depending on whether you are leveraging Saas, Paas, Iaas, etc to deliver your applications, you will have a different level of visibility and control of how you manage performance and deliver the user experience expected by your users.
Join the session and find out what remains within your responsibility and how you can monitor the various cloud infrastructure/services to give yourself the needed visibility to deliver the expected user experience without over-provisioning to ensure better performance.
CTO of ParStream Joerg Bienert hold a presentation on February 25, 2014 about Big Data for Business Users. He talked about several use cases of current ParStream customers and ParStreams' technology itself.
Is Your Data Paying You Dividends? Data innovation is a means to an end where data as an asset can be managed, developed, monetized, and eventually expected to pay dividends to the business.While 70% of CEOs surveyed expect investments in data, analytics, ML and AI initiatives to improve their bottom-line, 56% stated concerns over the integrity of their data1. Data science teams are now tasked to deliver true business value but fundamental issues remain in data preparation, data cleansing which impedes speed to market.Join Karan Sachdeva as he demonstrates capabilities of the all-new IBM Cloud Private for Data –a single containerized platform - that bridges the gap between data consumability, governance, integration, and visualization, accelerating speed to market and dividends to your business.by Karan Sachdeva, Sales Leader Big Data Analytics, IBM Asia Pacific
Unlock Data-driven Insights in Databricks Using Location IntelligencePrecisely
Today’s data-driven organisations are turning to Databricks for a cloud-based, open, unified platform for data and AI. Yet many companies struggle to unlock the value of the data they have in Databricks. To capitalise on the promise of a competitive edge through increased efficiency and insight, data scientists are turning to location to make sense of massive volumes of business data.
Watch this on-demand to hear from The Spatial Distillery Co. and Databricks on how to leverage advanced location intelligence and enrichment solutions in Databricks to:
- Simplify the complexity of location data and transform it into valuable insights
- Enrich data with thousands of attributes for better, more accurate analytics, AI, and ML models
- Leverage the power of Databricks to integrate geospatial data into business processes for real-time answers
- Create more meaningful and timely customer interactions by streamlining customer-facing and operational tasks
ServiceNow + Precisely: Getting Business Value and Visibility from Mainframe ...Precisely
Your team has a huge responsibility to enable IT services without disruption for your organization. ServiceNow Service Mapping gives you a clear idea of how services are affected by infrastructure issues. However, you are missing one critical piece – visibility into the mainframe (IBM Z). To drive business value, you need visibility into service performance by automatically connecting mainframe CIs into your CMDB and ServiceNow Service Mapping.
In this webinar, Ian Hartley, Director of Product Management at Precisely, will discuss how Precisely Ironstream can help you with ITOM visibility by automatically linking your mainframe to ServiceNow Service Mapping in just a few clicks.
Watch this on-demand webcast to learn:
• The “must-dos” for a proactive approach to mainframe visibility in ServiceNow Service Mapping
• How to auto-populate the CMDB and ServiceNow with mainframe CIs
• The immediate value Ironstream can bring to your business by connecting the mainframe to ServiceNow
Accelerate Innovation with Databricks and Legacy DataPrecisely
Getting the best AI models and analytics results mean quickly and efficiently delivering data to the cloud with accuracy, consistency, and context. But when you must connect legacy systems like mainframe and IBM i to the cloud, your project can become expensive, time-consuming, and reliant on highly specialized skillsets. So much for speed and efficiency!
View this on-demand webinar to explore how data from mainframe and IBM i can deliver the trusted data required for advanced analytics and artificial intelligence within Databrick’s Unified Analytics Platform.
Using Modern Cloud Technologies to Power Business ProcessesPrecisely
Today’s high-tech businesses need agile solutions to work with their evolving modern cloud technologies. In this session, learn how Precisely clients are deploying our solutions in cloud native architectures to take advantage of the scalable, elastic nature of the cloud. We will review example client deployments where Precisely solutions were used for powerful batch processes using Spark within exciting platforms like Databricks and AWS EMR.
During this on-demand webinar, we will also discuss deployment patterns using Kubernetes for scalable, transactional systems that deliver deep business insights to operational and analytical applications.
Building the Next Generation IoT & Telematics PlatformCloudera, Inc.
IoT is fundamentally revolutionizing the automotive insurance space, by enabling insurers to gain powerful insights into the behavior, risk, and habits of individual drivers.
With over 180 Billion miles of driving data analyzed from connected cars, Octo Telematics has emerged as the leading global provider of telematics and data analytics solutions for the auto insurance industry.
Join Cloudera, Ovum and Octo Telematics for a joint webinar to learn more about how Octo built their next generation IoT & Telematics platform. In this session, Jonathan, the Global Chief Marketing Officer of Octo will share their transformational journey into how they are building the world’s largest insurance telematics database powered by analytics and machine learning.
As part of this webinar you can learn more about:
Octo’s transformation to the Next Generation Platform (NGP) for Telematics & IoT
How they process and analyze data from 5.4 million connected cars every day
How Octo implemented the data management and analytics infrastructure
How they are using machine learning to analyze risks and driving behavior
3 things to learn:
Octo’s transformation to the Next Generation Platform (NGP) for Telematics & IoT
How they process and analyze data from 5.4 million connected cars every day
How Octo implemented the data management and analytics infrastructure
Keine Angst vorm Dinosaurier: Mainframe-Integration und -Offloading mit Confl...Precisely
Mainframes sind immer noch weit verbreitet im Einsatz und verarbeiten täglich über 70 Prozent der wichtigsten Rechentransaktionen der Welt. Sehr hohe Kosten, monolithische Architekturen und fehlende Experten sind die größten Herausforderungen für Mainframe-Anwendungen. Es ist an der Zeit, innovativer zu werden, auch mit dem Mainframe! Stellen wir uns gemeinsam dem Dinosaurier!
Mainframe Offloading mit Confluent, Apache Kafka und dem zugehörigen Ökosystem kann genutzt werden, um moderne Dateninfrastrukturen in Echtzeit mit dem Mainframe synchron zu halten. Dabei ermöglich Kafka sowohl die Datenverarbeitung als auch die Integration mit Systemen wie Data Warehouses und Analytics-Plattformen. Dabei können via Change Data Capture (CDC) permanent Mainframe-Änderungen im hochvoluminösen Bereich nach Kafka gepusht werden.
In dieser on-demand-präsentation zeigen Confluent und Precisely, wie Unternehmen diesen Schritt zur Legacy-Migration machen, Kosten sparen, eine skalierbare und offene Architektur schaffen und so neue Dienste und Anwendungen ermöglichen.
Webinar: The Death of Traditional Data IntegrationSnapLogic
In this webinar, we hear from industry analyst, middleware expert and author David Linthicum on why “existing approaches to data integration won’t meet future needs as the use of technology continues to change.” David also says that, “drastic measures must be taken now to prepare enterprises for the arrival of this technology, and to position enterprises to take full advantage.”
This webinar will show you how the game is changing, and what you can do about it right now. We summarize the changes that are happening, and review new and emerging patterns of data integration, as well as data integration technology that you can buy today that lives up to these new expectations.
To learn more, visit: www.snaplogic.com/big-data
Emergence of ITOA: An Evolution in IT Monitoring and ManagementHCL Technologies
IT operations analytics(ITOA) plays key role by providing intelligence that makes business sense out of the real-time data being generated by infrastructure components and applications.
Cortana Analytics Workshop: Milliman Integrate for Cortana AnalyticsMSAdvAnalytics
Paul Maher. Milliman Integrate is a SaaS offering from Milliman for the life insurance market to democratize actuarial modeling and financial reporting. Actuaries use mathematics, statistics, financial models, and simulations on a customer's profile to evaluate short- and long-term risks. The goal of Milliman Integrate is to allow actuaries to focus on business processes and analysis rather than complex infrastructure details. Come join this session to learn how Milliman is using Cortana Analytics and Azure to power Milliman Integrate, which reimagines the relationships between people, process, and technology to manage risk and maximize efficiencies. Go to https://channel9.msdn.com/ to find the recording of this session.
(Bjørn Kvernstuen + Tommy Jocumsen, Norwegian Directorate for Work and Welfare) Kafka Summit SF 2018
NAV (Norwegian Work and Welfare Department) currently distributes more than one third of the national budget to citizens in Norway or abroad. We’re there to assist people through all phases of life within the domains of work, family, health, retirement and social security. Events happening throughout a person’s life determines which services we provide to them, how we provide them and when we provide them.
Today, each person has to apply for these services resulting in many tasks that are largely handled manually by various case workers in the organization. Their access to insight and useful information is limited and often hard to find, causing frustration to both our case workers and our users. By streaming a person’s life events through our Kafka pipelines, we can revolutionize the way our users experience our services and the way we work.
NAV and the government as a whole have access to vast amounts of data about our citizens, reported by health institutions, employers, various government agencies or the users themselves. Some data is distributed by large batches, while others are available on-demand through APIs. We’re changing these patterns into streams using Kafka, Streams API and Java microservices. We aim to distribute and act on events about birth, death, relationships, employment, income and business processes to vastly improve the user experience, provide real-time insight and reduce the need to apply for services we already know are needed.
This talk will touch on the following topics:
-How we move from data-on-demand to streams
-How streams of life events will free our case workers from mundane tasks
-How life and business events make valuable insight
-How we protect our users and comply with GDPR
-Why we chose Confluent Platform
Vistara is the only comprehensive IT operations management solution that enables enterprise IT teams to act as service provider to lines of business, offering common operations management functions as a service.
Your LAN can now be delivered as a cloud-orchestrated service. Learn about key benefits, differentiators and business outcomes, while we deep dive into the Network as a Service (NaaS) concept, end-user experience and analytics.
- What is and Why NaaS?
- NaaS Utility Model
- Analytics to Optimize Your Cloud Network
- Live Q&A
ServiceNow + Precisely: Getting Business Value and Visibility from Mainframe ...Precisely
Your team has a huge responsibility to enable IT services without disruption for your organization. ServiceNow Service Mapping gives you a clear idea of how services are affected by infrastructure issues. However, you are missing one critical piece – visibility into the mainframe (IBM Z). To drive business value, you need visibility into service performance by automatically connecting mainframe CIs into your CMDB and ServiceNow Service Mapping.
In this webinar, Ian Hartley, Director of Product Management at Precisely, will discuss how Precisely Ironstream can help you with ITOM visibility by automatically linking your mainframe to ServiceNow Service Mapping in just a few clicks.
Watch this on-demand webcast to learn:
• The “must-dos” for a proactive approach to mainframe visibility in ServiceNow Service Mapping
• How to auto-populate the CMDB and ServiceNow with mainframe CIs
• The immediate value Ironstream can bring to your business by connecting the mainframe to ServiceNow
Accelerate Innovation with Databricks and Legacy DataPrecisely
Getting the best AI models and analytics results mean quickly and efficiently delivering data to the cloud with accuracy, consistency, and context. But when you must connect legacy systems like mainframe and IBM i to the cloud, your project can become expensive, time-consuming, and reliant on highly specialized skillsets. So much for speed and efficiency!
View this on-demand webinar to explore how data from mainframe and IBM i can deliver the trusted data required for advanced analytics and artificial intelligence within Databrick’s Unified Analytics Platform.
Using Modern Cloud Technologies to Power Business ProcessesPrecisely
Today’s high-tech businesses need agile solutions to work with their evolving modern cloud technologies. In this session, learn how Precisely clients are deploying our solutions in cloud native architectures to take advantage of the scalable, elastic nature of the cloud. We will review example client deployments where Precisely solutions were used for powerful batch processes using Spark within exciting platforms like Databricks and AWS EMR.
During this on-demand webinar, we will also discuss deployment patterns using Kubernetes for scalable, transactional systems that deliver deep business insights to operational and analytical applications.
Building the Next Generation IoT & Telematics PlatformCloudera, Inc.
IoT is fundamentally revolutionizing the automotive insurance space, by enabling insurers to gain powerful insights into the behavior, risk, and habits of individual drivers.
With over 180 Billion miles of driving data analyzed from connected cars, Octo Telematics has emerged as the leading global provider of telematics and data analytics solutions for the auto insurance industry.
Join Cloudera, Ovum and Octo Telematics for a joint webinar to learn more about how Octo built their next generation IoT & Telematics platform. In this session, Jonathan, the Global Chief Marketing Officer of Octo will share their transformational journey into how they are building the world’s largest insurance telematics database powered by analytics and machine learning.
As part of this webinar you can learn more about:
Octo’s transformation to the Next Generation Platform (NGP) for Telematics & IoT
How they process and analyze data from 5.4 million connected cars every day
How Octo implemented the data management and analytics infrastructure
How they are using machine learning to analyze risks and driving behavior
3 things to learn:
Octo’s transformation to the Next Generation Platform (NGP) for Telematics & IoT
How they process and analyze data from 5.4 million connected cars every day
How Octo implemented the data management and analytics infrastructure
Keine Angst vorm Dinosaurier: Mainframe-Integration und -Offloading mit Confl...Precisely
Mainframes sind immer noch weit verbreitet im Einsatz und verarbeiten täglich über 70 Prozent der wichtigsten Rechentransaktionen der Welt. Sehr hohe Kosten, monolithische Architekturen und fehlende Experten sind die größten Herausforderungen für Mainframe-Anwendungen. Es ist an der Zeit, innovativer zu werden, auch mit dem Mainframe! Stellen wir uns gemeinsam dem Dinosaurier!
Mainframe Offloading mit Confluent, Apache Kafka und dem zugehörigen Ökosystem kann genutzt werden, um moderne Dateninfrastrukturen in Echtzeit mit dem Mainframe synchron zu halten. Dabei ermöglich Kafka sowohl die Datenverarbeitung als auch die Integration mit Systemen wie Data Warehouses und Analytics-Plattformen. Dabei können via Change Data Capture (CDC) permanent Mainframe-Änderungen im hochvoluminösen Bereich nach Kafka gepusht werden.
In dieser on-demand-präsentation zeigen Confluent und Precisely, wie Unternehmen diesen Schritt zur Legacy-Migration machen, Kosten sparen, eine skalierbare und offene Architektur schaffen und so neue Dienste und Anwendungen ermöglichen.
Webinar: The Death of Traditional Data IntegrationSnapLogic
In this webinar, we hear from industry analyst, middleware expert and author David Linthicum on why “existing approaches to data integration won’t meet future needs as the use of technology continues to change.” David also says that, “drastic measures must be taken now to prepare enterprises for the arrival of this technology, and to position enterprises to take full advantage.”
This webinar will show you how the game is changing, and what you can do about it right now. We summarize the changes that are happening, and review new and emerging patterns of data integration, as well as data integration technology that you can buy today that lives up to these new expectations.
To learn more, visit: www.snaplogic.com/big-data
Emergence of ITOA: An Evolution in IT Monitoring and ManagementHCL Technologies
IT operations analytics(ITOA) plays key role by providing intelligence that makes business sense out of the real-time data being generated by infrastructure components and applications.
Cortana Analytics Workshop: Milliman Integrate for Cortana AnalyticsMSAdvAnalytics
Paul Maher. Milliman Integrate is a SaaS offering from Milliman for the life insurance market to democratize actuarial modeling and financial reporting. Actuaries use mathematics, statistics, financial models, and simulations on a customer's profile to evaluate short- and long-term risks. The goal of Milliman Integrate is to allow actuaries to focus on business processes and analysis rather than complex infrastructure details. Come join this session to learn how Milliman is using Cortana Analytics and Azure to power Milliman Integrate, which reimagines the relationships between people, process, and technology to manage risk and maximize efficiencies. Go to https://channel9.msdn.com/ to find the recording of this session.
(Bjørn Kvernstuen + Tommy Jocumsen, Norwegian Directorate for Work and Welfare) Kafka Summit SF 2018
NAV (Norwegian Work and Welfare Department) currently distributes more than one third of the national budget to citizens in Norway or abroad. We’re there to assist people through all phases of life within the domains of work, family, health, retirement and social security. Events happening throughout a person’s life determines which services we provide to them, how we provide them and when we provide them.
Today, each person has to apply for these services resulting in many tasks that are largely handled manually by various case workers in the organization. Their access to insight and useful information is limited and often hard to find, causing frustration to both our case workers and our users. By streaming a person’s life events through our Kafka pipelines, we can revolutionize the way our users experience our services and the way we work.
NAV and the government as a whole have access to vast amounts of data about our citizens, reported by health institutions, employers, various government agencies or the users themselves. Some data is distributed by large batches, while others are available on-demand through APIs. We’re changing these patterns into streams using Kafka, Streams API and Java microservices. We aim to distribute and act on events about birth, death, relationships, employment, income and business processes to vastly improve the user experience, provide real-time insight and reduce the need to apply for services we already know are needed.
This talk will touch on the following topics:
-How we move from data-on-demand to streams
-How streams of life events will free our case workers from mundane tasks
-How life and business events make valuable insight
-How we protect our users and comply with GDPR
-Why we chose Confluent Platform
Vistara is the only comprehensive IT operations management solution that enables enterprise IT teams to act as service provider to lines of business, offering common operations management functions as a service.
Your LAN can now be delivered as a cloud-orchestrated service. Learn about key benefits, differentiators and business outcomes, while we deep dive into the Network as a Service (NaaS) concept, end-user experience and analytics.
- What is and Why NaaS?
- NaaS Utility Model
- Analytics to Optimize Your Cloud Network
- Live Q&A
This presentation gives an overview of StreamCentral technology targeted for IT professionals. StreamCentral is software to model and build Big Data Solutions. StreamCentral consists of a Big Data Solutions Modeler that not only makes it easy to model traditional BI/DW and Big Data solutions but also auto deploys the model on the latest innovations in Big Data Management solutions (like HP Vertica and SQL Server Parallel Data Warehouse). StreamCentral Big Data Server executes the model definition in real-time. StreamCentral drastically reduces the time to market, risk and cost associated with building traditional BI/DW and Big Data solutions!
The CSC Big Data Analytics Insights service enables clients who do not have an analytics capability to implement the business, data and technology changes to gain business benefit from an initial set of analytics based on a roadmap of changes created by CSC or provided from a compatible set of inputs.
CSC Analytic Insights Implementation has four phases:
Stage 1: Analytic Engagement
Stage 2: Analytic Discovery
Stage 3: Implementation Planning
Stage 4: Embedding Analysis .
The CSC Big Data Analytics Insights service enables clients who do not have an analytics capability to implement the business, data and technology changes to gain business benefit from an initial set of analytics based on a roadmap of changes created by CSC or provided from a compatible set of inputs.
CSC Analytic Insights Implementation has four phases:
Stage 1: Analytic Engagement
Stage 2: Analytic Discovery
Stage 3: Implementation Planning
Stage 4: Embedding Analysis
OpsRamp and Mystic River are joining forces to bring you this interactive webinar. Can we create gateways between IT and OT? IT/OT convergence has been defined as the integration of information technology (IT) systems used for data-centric computing with operational technology (OT) systems used to monitor events, processes and devices and make adjustments in enterprise and industrial operations. But what this will look like and what is the new role of IT operations management? What is changing in IT and OT to align these worlds? This Tech Talk features our partner Mystic River Consulting, a firm with proven, repeatable service delivery methodologies and a proprietary platform that drives transformational IT project results, at a game changing speed. We’ll discuss the convergence of IT and OT and dive into a demonstration to show what’s possible with OpsRamp.
Watch the recording: https://www.brighttalk.com/webcast/17791/416457
Learn more at https://www.opsramp.com
Also, follow us on social media channels to learn about product highlights, news, announcements, events, conferences and more:
Twitter - https://www.twitter.com/OpsRamp
LinkedIn - https://www.linkedin.com/company/opsramp
Facebook - https://www.facebook.com/OpsRampHQ/
Accelerate Self-Service Analytics with Data Virtualization and VisualizationDenodo
Watch full webinar here: https://bit.ly/3fpitC3
Enterprise organizations are shifting to self-service analytics as business users need real-time access to holistic and consistent views of data regardless of its location, source or type for arriving at critical decisions.
Data Virtualization and Data Visualization work together through a universal semantic layer. Learn how they enable self-service data discovery and improve performance of your reports and dashboards.
In this session, you will learn:
- Challenges faced by business users
- How data virtualization enables self-service analytics
- Use case and lessons from customer success
- Overview of the highlight features in Tableau
Microsoft cloud profitability scenariosMedhy Sandjak
La demande des clients pour les services sur le Cloud ne cesse de grandir.
Identifiez de nouvelles opportunités pour étendre votre rentabilité grâce à des exemples de modèles financiers et de scénarios dans le Cloud via Microsoft CSP.
A Key to Real-time Insights in a Post-COVID World (ASEAN)Denodo
Watch full webinar here: https://bit.ly/2EpHGyd
Presented at Data Champions, Online Asia 2020
Businesses and individuals around the world are experiencing the impact of a global pandemic. With many workers and potential shoppers still sequestered, COVID-19 is proving to have a momentous impact on the global economy. Regardless of the current situation and post-pandemic era, real-time data becomes even more critical to healthcare practitioners, business owners, government officials, and the public at large where holistic and timely information are important to make quick decisions. It enables doctors to make quick decisions about where to focus the care, business owners to alter production schedules to meet the demand, government agencies to contain the epidemic, and the public to be informed about prevention.
In this on-demand session, you will learn about the capabilities of data virtualization as a modern data integration technique and how can organisations:
- Rapidly unify information from disparate data sources to make accurate decisions and analyse data in real-time
- Build a single engine for security that provides audit and control by geographies
- Accelerate delivery of insights from your advanced analytics project
Confluent & GSI Webinars series - Session 3confluent
An in depth look at how Confluent is being used in the financial services industry. Gain an understanding of how organisations are utilising data in motion to solve common problems and gain benefits from their real time data capabilities.
It will look more deeply into some specific use cases and show how Confluent technology is used to manage costs and mitigate risks.
This session is aimed at Solutions Architects, Sales Engineers and Pre Sales, and also the more technically minded business aligned people. Whilst this is not a deeply technical session, a level of knowledge around Kafka would be helpful.
Streaming and Visual Data Discovery for the Internet of ThingsDatawatchCorporation
Sensor devices and their associated data streams are rapidly becoming a big source of differentiation for organizations that can effectively harness this information to drive new insights and take action. The breakthrough is enabled by new solutions for applying visual data discovery to streaming data in motion. This session will focus on industrial analytics and how best to apply new technologies that drive synergies between IT and OT.
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...Amazon Web Services
"This presentation will introduce Kinesis, the new AWS service for real-time streaming big data ingestion and processing.
We’ll provide an overview of the key scenarios and business use cases suitable for real-time processing, and discuss how AWS designed Amazon Kinesis to help customers shift from a traditional batch-oriented processing of data to a continual real-time processing model. We’ll provide an overview of the key concepts, attributes, APIs and features of the service, and discuss building a Kinesis-enabled application for real-time processing. We’ll also contrast with other approaches for streaming data ingestion and processing. Finally, we’ll also discuss how Kinesis fits as part of a larger big data infrastructure on AWS, including S3, DynamoDB, EMR, and Redshift."
Similar to 2016 DSG Webinar Azure HDInsight 2 V4 (20)
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
2016 DSG Webinar Azure HDInsight 2 V4
1. How to Act on Big Data in Real Time – Part 2
Name · Title · Dunn SolutionsJanani Eshwaran
Renata Simanjuntak
2. Today’s Agenda
Introduction
Impact of Real Time Analytics in Telecom Industry
Microsoft Azure HDInsight
Demo –Telecom Real Time Fraud Detection
What’s Next
3. Dunn Solutions is a Full-Service IT Consulting Firm
Founded in 1988
Raleigh, NC
Delivery Training
Bangalore, India
Delivery
Minneapolis
Delivery Training
Chicago
Delivery
4. Practice Areas
Application
Development
• Portals
• eCommerce &
Content Managed
Websites
• Mobile App
Development
• Custom App
Development
Training
• Certified
SAP/Liferay
• Classroom, On-
site, Computer
Based & Virtual
• Mentoring &
Custom Training
Frameworks
• Accountable Care
Orgs (ACO’s)
• Corporate Legal
• Higher Education
• Optical Shop
Solutions
Analytics
• Analytics & BI
Platforms
• Data Warehouse
& Data
Integration
Big Data
Predictive
Analytics
7. Analytics Practice
Business Intelligence
Big Data
Data IntegrationBusiness Analytics
Data Warehousing
• KPI’s and Metrics
• Dashboards
• Data Exploration and
Visualization
• Ad Hoc Analysis &
Reporting
• Data Mining
• Predictive Analytics
• Prescriptive Analytics
• R, AzureML
• Hadoop, MapReduce
• AWS and Azure
• Hive, Sqoop, Spark
• NoSQL
• Data Lake
• Columnar
• In-memory
• EIM (Data Integration
and Data Quality
• Dimensional Modeling
8. Today’s Agenda
Introduction
Impact of Real Time Analytics in Telecom Industry
Microsoft Azure HDInsight
Demo –Telecom Real Time Fraud Detection
What’s Next
9. Real Time Big Data Analytics
• It is not only to store and analyze streaming
BIG data
• It is more about making better decision and
taking meaningful action at the right time
Traditional Enterprise Data Warehouse plus analytics are no longer enough
10. • Fraud detection while a
credit card is swiped
• Triggering an offer while a
shopper is standing on a
checkout line
• Placing an ad on a website
while someone is reading a
specific article
Real Time Business Benefit
11. • Service improvement
• Cost savings
• Fraud detection
• Keep up with customer trends
• Sales insights enhancement
• Instantly errors detection
• Immediate new strategies of your competition
notification
Power of Real Time Analytics
12. • Financial Loss
• External Confidence
• Company Morale
• Increased Audit Costs
How Fraud Hurts You & Your Organization
13. Impact of Fraud in Telecom Industry
Communications Fraud Control Association (CFCA) Global Fraud Loss Survey
Telecom Fraud cost the industry 2015 over 38 Billion USD annually
14. Today’s Agenda
Introduction
Impact of Real Time Analytics in Telecom Industry
Microsoft Azure HDInsight
Demo –Telecom Real Time Fraud Detection
What’s Next
15. Azure Event Hub
Customer Name / 16
• Benefits:
• Stream millions of events per second
• Process events with variable load profiles
• Connect millions of devices across platforms
• How much data? Throughput units
• To scale the traffic coming in or out
• Key pricing parameter
• In (Publisher): 1mb or 1000 events/sec
• Out (Consumer): 2mb/sec
16. Azure HDInsight - Ecosystem
• Big Data with No
Hassle
• Open and
Flexible
• Insight in MS
Excel
• Build Big Data
Apps your Way
17. • Scalable
• High-throughput
• Fault-tolerant
• Stream processing of live data streams
• Data collected can be later post-processed
• Code and business logic can be shared and reused
Spark Streaming for Real Time Analytics
Spark
Streaming
Spark
Engine
Input Data
Stream
Batches of
input data
Batches of
processed data
Less time learning, implementing, and maintaining different frameworks
More focus on developing smarter applications
18. Hive
Customer Name / 19
• Data warehouse in Hadoop
• Project structure on largely unstructured data
• Work with structured and semi-structured data
• Hive QL
• Low cost data storage
19. • Empower user
• Q&A function
• Dashboard visualization
• Innovative technology
• In memory engine
• Columnar database
• You own your data
• Faster turn around
• Lower cost
Power BI
Customer Name / 20
Enterprise-level data is yours for free or at a very low monthly cost
20. • Email
• Link
• Website
• Phone: text or call
• Application
Real Time Alert
Customer Name / 21
You are informed in real time when errors or frauds or anomalies exist
Take action in real time for real results
21. Today’s Agenda
Introduction
Impact of Real Time Analytics in Telecom Industry
Microsoft Azure HDInsight
Demo –Telecom Real Time Fraud Detection
What’s Next
22. Big Data Real Time Use Case for Telecom (1)
• Real-time fraud prevention
• Can be passed on to customer bills
• Prevent revenue loss and additional expense to correct
• Visibility of service performance, costs and
discounts to the customer
• Cannot monitor customer bills to provide services
• Analyze and offer products and discounts
• Optimization of Least Cost Routing (LCR)
• Choose lost cost network in real time
• Select optimized and high performing network quickly
23. Big Data Real Time Use Case for Telecom (2)
• Call performance monitoring
• Cannot prevent dropped calls and issues
• Can identify issues to resolve immediately
• Real-time profitability analysis
• Make use of long term trend data offline
• Can learn service provided to customer for
understanding gross margin
24. What if I wanted to…
• Capture data from any application in real time
• Store the data
• Perform analysis on the streamed data
• Visualize the information interactively
Demonstration: Setting the Stage
25. Big Data, Real time project checklist
• Azure Event Hub
• Azure HDInsight cluster
• Spark Streaming
• Hive
• Azure SQL database
• Power BI
• Real Time Notification (email)
What Do I Need?
27. Step 1: Start The Event Hub Event To Collect The Events
Streaming data sources
(Call Records)
Azure Event Hub
28. Step 2: Prepare Your Receiver To Receive Events
Streaming data sources
(Call Records)
Azure Event Hub
Consume
29. Step 3: Persist The Events In Hive Table
Streaming data sources
(Call Records)
Azure Event Hub
Consume Store
30. Step 4: Alert /Notify the anomaly
Streaming data sources
(Call Records)
Azure Event Hub
Consume Store
31. Step 5: Visualization in Power BI
Streaming data
sources
(Call Records)
Azure
Event Hub
Consume Store
Streaming
data
Enrichment
data
32. Today’s Agenda
Introduction
Impact of Real Time Analytics in Telecom Industry
Microsoft Azure HDInsight
Demo –Telecom Real Time Fraud Detection
What’s Next
34. • What is your Big Data strategy?
• Do you have a Big Data project in mind?
• Are you wondering how you can use Big Data for
real time data analysis to benefit your company?
• Should you do it on premise or in the cloud?
• Contact us and we’ll help you execute!
• info@dunnsolutions.com
Let’s Get You Started with Real-Time Big Data
35. Thank You
Janani Eshwaran· Analytics Consultant · Dunn Solutions
jeshwaran@dunnsolutions.com
Renata Simanjuntak· Analytics Manager· Dunn Solutions
renatas@dunnsolutions.com