SlideShare a Scribd company logo
Real-time analytics in applications: New
Architectures - Bahaa Al Zubaidi
Recent technological advancements have made real-time analytics a reality for
modern applications. The advances in computing power, data storage, and analytics
software have enabled organizations to move from batch analytics to real-time
analytics. This provides increased insights and helps companies make better
decisions in shorter time frames.
Naturally, the increasing complexity of real-time applications has led to the
emergence of various architectures to support the different levels of real-time
analytics requirements. This post explores the various emerging architectures for
real-time analytics in applications.
Data Collection Architecture
The first step in any real-time analytics architecture is collecting data from various
data sources. This involves having an efficient data collection architecture that
efficiently ingests and stores data as it comes in. You need to make sure that the
data collection architecture supports key capabilities, such as scalability, fault
tolerance, and ease of integration with other parts of the analytics architecture.
Event Processing Architecture
Once the data is collected, it needs to be processed. Event processing architectures
are micro-services designed to process the data and extract insights in real time.
The goal is to detect patterns and provide notifications in near-real-time. For
example, fraud detection systems must quickly and automatically detect fraud
events.
Analytics Platform Architecture
The analytics platform architecture is an approach to designing and building an
analytics system that enables the organization to effectively manage data sources,
data flows, data stores, and applications. It helps you develop a plan for your
application architecture, including how data will be integrated or processed before it’s
ready to be analyzed.
The typical analytics platform architecture consists of several components:
Data sources: The raw data you want to analyze. Examples include website
clickstreams, server logs, inventory levels, and customer records.
Data flows: The steps needed to transform this data into a format that can be
analyzed by an analytic application. This can include extracting fields from log files or
joining multiple tables together in a database query.
Analytic applications: A software application that analyzes the transformed data (for
example, performing regression analysis on sales data).
Data stores: A place for storing the processed data until it’s time for analysis (for
example, a database).
Presentation Layer Architecture
The presentation layer architecture is responsible for presenting the insights
generated from the analytics platform. This could involve a dashboard for visualizing
the insights or providing the insights to an external application. The goal is to ensure
that the insights are presented efficiently and effectively.
Final words
Real-time analytics architectures are becoming increasingly important as companies
look to utilize insights in near-real-time.
Additionally, the emergence of new tools, such as streaming analytics platforms, is
making it easier to build real-time analytics architectures. Understanding the different
architectures is key to developing and deploying effective real-time analytics
systems.
Thank you for your interest in Bahaa Al Zubaidi blogs. For more stories, please stay
tuned to www.bahaaalzubaidi.com

More Related Content

Similar to Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf

Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
Elasticsearch
 
Understanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics PlatformUnderstanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics Platform
Anametrix
 
Elastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and actionElastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and action
Elasticsearch
 
Dh Government
Dh GovernmentDh Government
Dh Government
Sainakhan
 
Big data and oracle
Big data and oracleBig data and oracle
Big data and oracle
Sourabh Saxena
 
Confluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPointConfluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPoint
confluent
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdf
Karishma Chaudhary
 
BrownResearch_CV
BrownResearch_CVBrownResearch_CV
BrownResearch_CVAbby Brown
 
Data Warehousing AWS 12345
Data Warehousing AWS 12345Data Warehousing AWS 12345
Data Warehousing AWS 12345
AkhilSinghal21
 
Alteryx Desktop Designer Overview
Alteryx Desktop Designer OverviewAlteryx Desktop Designer Overview
Alteryx Desktop Designer Overview
Tridant
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
jonasaleena059
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
jonasaleena059
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data Governance
Vladimiro Borsi
 
Information management
Information managementInformation management
Information management
David Champeau
 
Event Stream Processing SAP
Event Stream Processing SAPEvent Stream Processing SAP
Event Stream Processing SAPGaurav Ahluwalia
 
E017413647
E017413647E017413647
E017413647
IOSR Journals
 
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
ijitjournal
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
Elasticsearch
 
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Paulo Lacerda
 
Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017
gapariciojr
 

Similar to Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf (20)

Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
 
Understanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics PlatformUnderstanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics Platform
 
Elastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and actionElastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and action
 
Dh Government
Dh GovernmentDh Government
Dh Government
 
Big data and oracle
Big data and oracleBig data and oracle
Big data and oracle
 
Confluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPointConfluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPoint
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdf
 
BrownResearch_CV
BrownResearch_CVBrownResearch_CV
BrownResearch_CV
 
Data Warehousing AWS 12345
Data Warehousing AWS 12345Data Warehousing AWS 12345
Data Warehousing AWS 12345
 
Alteryx Desktop Designer Overview
Alteryx Desktop Designer OverviewAlteryx Desktop Designer Overview
Alteryx Desktop Designer Overview
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data Governance
 
Information management
Information managementInformation management
Information management
 
Event Stream Processing SAP
Event Stream Processing SAPEvent Stream Processing SAP
Event Stream Processing SAP
 
E017413647
E017413647E017413647
E017413647
 
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
 
Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017
 

More from Bahaa Al Zubaidi

RPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations EverywhereRPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations Everywhere
Bahaa Al Zubaidi
 
Integrating Push Notifications in PWAs
Integrating Push Notifications in PWAsIntegrating Push Notifications in PWAs
Integrating Push Notifications in PWAs
Bahaa Al Zubaidi
 
BAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docxBAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docx
Bahaa Al Zubaidi
 
PWAs Vs. Native Apps
PWAs Vs. Native AppsPWAs Vs. Native Apps
PWAs Vs. Native Apps
Bahaa Al Zubaidi
 
Offline Capabilities of the PWAs
Offline Capabilities of the PWAsOffline Capabilities of the PWAs
Offline Capabilities of the PWAs
Bahaa Al Zubaidi
 
Introduction to PWAs
Introduction to PWAsIntroduction to PWAs
Introduction to PWAs
Bahaa Al Zubaidi
 
Psycology of Digital Trust
Psycology of Digital TrustPsycology of Digital Trust
Psycology of Digital Trust
Bahaa Al Zubaidi
 
Blockchain & Digital Trust
Blockchain & Digital TrustBlockchain & Digital Trust
Blockchain & Digital Trust
Bahaa Al Zubaidi
 
Evolution of Digital Trust
Evolution of Digital TrustEvolution of Digital Trust
Evolution of Digital Trust
Bahaa Al Zubaidi
 
Data Protection in Smart Cities Apps
Data Protection in Smart Cities AppsData Protection in Smart Cities Apps
Data Protection in Smart Cities Apps
Bahaa Al Zubaidi
 
Role of Biometrics in Smart Cities
Role of Biometrics in Smart CitiesRole of Biometrics in Smart Cities
Role of Biometrics in Smart Cities
Bahaa Al Zubaidi
 
Digital Trust in the Work Place
Digital Trust in the Work PlaceDigital Trust in the Work Place
Digital Trust in the Work Place
Bahaa Al Zubaidi
 
Testing in a DevOps Environment
Testing in a DevOps EnvironmentTesting in a DevOps Environment
Testing in a DevOps Environment
Bahaa Al Zubaidi
 
Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps
Bahaa Al Zubaidi
 
Optimizing Mobile App Development
Optimizing Mobile App Development Optimizing Mobile App Development
Optimizing Mobile App Development
Bahaa Al Zubaidi
 
Revolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CDRevolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CD
Bahaa Al Zubaidi
 
Exploring Automation with DevOps
Exploring Automation with DevOpsExploring Automation with DevOps
Exploring Automation with DevOps
Bahaa Al Zubaidi
 
Implementing Continuous Integration
Implementing Continuous IntegrationImplementing Continuous Integration
Implementing Continuous Integration
Bahaa Al Zubaidi
 
CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery
Bahaa Al Zubaidi
 
Continuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating ReleasesContinuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating Releases
Bahaa Al Zubaidi
 

More from Bahaa Al Zubaidi (20)

RPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations EverywhereRPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations Everywhere
 
Integrating Push Notifications in PWAs
Integrating Push Notifications in PWAsIntegrating Push Notifications in PWAs
Integrating Push Notifications in PWAs
 
BAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docxBAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docx
 
PWAs Vs. Native Apps
PWAs Vs. Native AppsPWAs Vs. Native Apps
PWAs Vs. Native Apps
 
Offline Capabilities of the PWAs
Offline Capabilities of the PWAsOffline Capabilities of the PWAs
Offline Capabilities of the PWAs
 
Introduction to PWAs
Introduction to PWAsIntroduction to PWAs
Introduction to PWAs
 
Psycology of Digital Trust
Psycology of Digital TrustPsycology of Digital Trust
Psycology of Digital Trust
 
Blockchain & Digital Trust
Blockchain & Digital TrustBlockchain & Digital Trust
Blockchain & Digital Trust
 
Evolution of Digital Trust
Evolution of Digital TrustEvolution of Digital Trust
Evolution of Digital Trust
 
Data Protection in Smart Cities Apps
Data Protection in Smart Cities AppsData Protection in Smart Cities Apps
Data Protection in Smart Cities Apps
 
Role of Biometrics in Smart Cities
Role of Biometrics in Smart CitiesRole of Biometrics in Smart Cities
Role of Biometrics in Smart Cities
 
Digital Trust in the Work Place
Digital Trust in the Work PlaceDigital Trust in the Work Place
Digital Trust in the Work Place
 
Testing in a DevOps Environment
Testing in a DevOps EnvironmentTesting in a DevOps Environment
Testing in a DevOps Environment
 
Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps
 
Optimizing Mobile App Development
Optimizing Mobile App Development Optimizing Mobile App Development
Optimizing Mobile App Development
 
Revolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CDRevolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CD
 
Exploring Automation with DevOps
Exploring Automation with DevOpsExploring Automation with DevOps
Exploring Automation with DevOps
 
Implementing Continuous Integration
Implementing Continuous IntegrationImplementing Continuous Integration
Implementing Continuous Integration
 
CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery
 
Continuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating ReleasesContinuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating Releases
 

Recently uploaded

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 

Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf

  • 1. Real-time analytics in applications: New Architectures - Bahaa Al Zubaidi Recent technological advancements have made real-time analytics a reality for modern applications. The advances in computing power, data storage, and analytics software have enabled organizations to move from batch analytics to real-time analytics. This provides increased insights and helps companies make better decisions in shorter time frames. Naturally, the increasing complexity of real-time applications has led to the emergence of various architectures to support the different levels of real-time analytics requirements. This post explores the various emerging architectures for real-time analytics in applications. Data Collection Architecture The first step in any real-time analytics architecture is collecting data from various data sources. This involves having an efficient data collection architecture that efficiently ingests and stores data as it comes in. You need to make sure that the data collection architecture supports key capabilities, such as scalability, fault tolerance, and ease of integration with other parts of the analytics architecture. Event Processing Architecture Once the data is collected, it needs to be processed. Event processing architectures are micro-services designed to process the data and extract insights in real time. The goal is to detect patterns and provide notifications in near-real-time. For example, fraud detection systems must quickly and automatically detect fraud events. Analytics Platform Architecture The analytics platform architecture is an approach to designing and building an analytics system that enables the organization to effectively manage data sources, data flows, data stores, and applications. It helps you develop a plan for your application architecture, including how data will be integrated or processed before it’s ready to be analyzed. The typical analytics platform architecture consists of several components: Data sources: The raw data you want to analyze. Examples include website clickstreams, server logs, inventory levels, and customer records.
  • 2. Data flows: The steps needed to transform this data into a format that can be analyzed by an analytic application. This can include extracting fields from log files or joining multiple tables together in a database query. Analytic applications: A software application that analyzes the transformed data (for example, performing regression analysis on sales data). Data stores: A place for storing the processed data until it’s time for analysis (for example, a database). Presentation Layer Architecture The presentation layer architecture is responsible for presenting the insights generated from the analytics platform. This could involve a dashboard for visualizing the insights or providing the insights to an external application. The goal is to ensure that the insights are presented efficiently and effectively. Final words Real-time analytics architectures are becoming increasingly important as companies look to utilize insights in near-real-time. Additionally, the emergence of new tools, such as streaming analytics platforms, is making it easier to build real-time analytics architectures. Understanding the different architectures is key to developing and deploying effective real-time analytics systems. Thank you for your interest in Bahaa Al Zubaidi blogs. For more stories, please stay tuned to www.bahaaalzubaidi.com