By Anjana Fernando. Senior Technical Lead, WSO2

1. Patterns for Deploying Analytics
in the Real World
Anjana Fernando
Senior Technical Lead, WSO2

2. Analytics Patterns
• Batch Analytics
• Real-time Analytics
• Interactive Analytics
• Predictive Analytics
• Batch + Real-time
• Real-time + Predictive
• WSO2 Solutions
Source: data-analytics.github.io

3. Batch Analytics
Generating insight by processing large amounts of stored data
● KPI Statistics
○ Application Statistics Monitoring
○ Network / Service Statistics
○ Sensor Data Aggregation
● Solving Optimization Problems
○ Urban Planning
○ Revenue Distribution Analysis
Source: www.e-
deal.com

4. Batch Analytics In Action: API Statistics

5. Batch Analytics In Action: API Statistics

6. Batch Analytics In Action: HTTP Monitoring

7. Real-time Analytics
Making sense of fast moving data
● Sports
○ Real-time Analysis of Player Performance
○ Real-time Match Analysis
● Geo-Spatial
○ Traffic Monitoring and Alerting
○ Geo-fencing
● Anomaly Detection
○ Fraud Detection
○ Network Intrusion Detection
○ Server Health Monitoring
Source: www.promojam.com

8. Real-time Analytics In Action: TFL

9. Real-time Analytics In Action: TFL

10. Interactive Analytics
Near Real-time Indexed Data Search
● Log Analysis
○ Application / System Logs
● Activity Monitoring
○ Tracking Message Flows
● Fraud Detection
○ Executing queries to lookup related
data in a detected fraud situation
● HL7 Data Exploration
○ ESB HL7 Transport Interfaced with
DAS
Source: befoundonline.com

11. Interactive Analytics In Action: WSO2 DAS

12. Predictive Analytics
Analyze Existing Data to Predict Future Events
● Next Value Prediction
○ Sales Forecasts
○ Electricity Loads
● Classification
○ Product Categorization
○ Customer Segmentation
● Anomaly Detection
○ Fraud Detection
○ Preventive Maintenance

13. Predictive Analytics In Action: WSO2 ML

14. Batch + Real-time Analytics
Using batch processing results in real-time flows
● Batch Processing done for processing historical data
● Real-time Processing done at the same time for
understanding present snapshot situation
● Overlay summarized historical data with real-time
data to compare current vs past behavior
Source: marketplace.rackspace.com

15. Batch + Real-time Analytics In Action: CEP Event
Tables
● WSO2 DAS Analytics Event Tables
○ CEP Event Table extension used to lookup
persisted analytics table data in DAS
○ Used in CEP execution plans to
lookup/join/enrich real-time event streams
Batch + Real-time Analytics In Action: Notifications
● WSO2 DAS Spark Event Publish Relation Provider
○ Spark SQL jobs are able to send batch job
results as events back to the server as events,
to be processed by CEP and send notifications

16. Real-time + Predictive Analytics
Using Predictive Analytics results in real-time flows
● Machine learning models first created
● The ML model is used in real-time execution by
applying the model with parameters extracted from
the flow
● Use Case: Unknown Fraud Modelling
● WSO2 CEP meets ML
○ WSO2 CEP StreamProcessor extension for
ML provides a way to apply ML models in
execution plans
e.g. :-
from InputStream#ml:predict('registry:/_system/governance/ml/indian-
diabetes-model', 'double') select * insert into PredictionStream;

17. WSO2 Solutions Based on the Analytics Platform
● WSO2 Fraud Detection Solution
○ Built for detecting credit card fraud
○ The rules extensible with customized Siddhi
execution plans for any type of fraud detection
○ Currently uses Real-time and Interactive
Analytics features
● WSO2 Log Analytics Solution
○ Distributed indexing and searching of any type
of logs stored in the system
○ Notifications support with Real-time event
processing features
○ Application / Server health prediction with
Machine Learning
○ Uses Interactive + Real-time Analytics +
Machine Learning features Source: www.retrospective.centeractive.com
Source: multichannelmerchant.com

18. Thank You