SlideShare a Scribd company logo
GEN Z BI PARADIGM
- A Scalable , hybrid and collaborative
Visualization Architecture using Spark, No
SQL and RESTFUL API
Agenda
◦ What is Gen Z BI?
◦ Key features of Gen Z BI
◦ How is it structured - Architecture?
◦ How does data flow?
◦ Real-life examples
◦ Challenges in implementation
◦ Key takeaways
What is Gen Z BI?
INTEGRATED INTELLIGENCE : BI WITHOUT LIMITATIONS
◦ Operational / Informed Intelligence – Data discovery in Real time with interactive Capabilities
◦ Social Intelligence – Social Media Sentiment Analysis , Online Feeds
◦ Competitive Intelligence – Competitive Strategies by correlation of external data
◦ Machine Intelligence - Search Capabilities powered by NLP and ML
◦ Conversational Intelligence – Personalized Chat bots
Key Features of Gen Z BI
◦ Customized, interactive, Real-Time, Collaborative Rich Visualization framework integrated
with competitive analytics, Natural Language Processing, social media Sentiment Analysis,
online news feeds
◦ Stand alone plug and play REST FUL APIs to integrate with existing Applications and UI
Interfaces
◦ Highly scalable , reliable and flexible hybrid architecture
◦ Multiple caching layers in API, DAO
◦ Available anytime , anywhere - Hybrid model in Web, iPad and Mobile form factors.
How is it Structured?
Files Tables Social Media &
News Feed
DATA LAYER
MID - TIER
SECURITY LAYER
USER INTERFACE
LIVE Stream Data
SSO
DATA INGESTION
APP LAYER
How does Data Flow?
Interpreter
• Detects the Data layer
• Converts to Queryable format
Optimizer
• Runs the Explain plan
• Takes the most Optimal Path
• Redirects to Cache
Cache (May Fly/EH/Mem)
• Accepts requests from Optimizer
• Based on the Key passed by
Optimizer looks up the cache
• Returns the output as Response
Request JSON
ELASTIC SEARCH
Not
Cached
jSON Object
(Key: Value Pair)
Response JSON
Un- cached (Huge Volumes)
shards shards
shards shards
cached
shards shards
shards shards
DATA LAYER
TERADATAFILESAPIs
ETL Layer
KAFKA
Real-Life Examples
◦ In-built Management Information Systems
◦ Showing Monthly/Daily snapshot of the Performance of our company with Top vital KPI’s.
◦ Curated huge terabytes of data with response time < 5ms
◦ Master Product Dashboard
◦ Whole list of Products from an organization
◦ Details about subscriptions, targets and performance
◦ Suggested new avenues to grow
◦ Competitive insights from external data, online feeds etc.
◦ Customer insights
◦ Tailored for different segments and by industry, understanding their growth model
◦ Enabling the company to provide highly customized data spread across the globe
◦ Self Service Monitoring tool
◦ Monitoring all the operational processes inside the organization , SLAs ,tracking effort , performance, budget
etc.
Challenges in Implementation
◦ In-Memory Analytics
◦ Batch Vs Data Streaming
◦ Subscriptions
◦ Metadata
◦ Usage Stats
◦ How to overcome:
◦ Choosing apt Data Ingestion / Mid-Tier tools for in-memory analytics and data processing
depending upon use cases.
◦ Blending traditional BI Tools with cutting edge technologies to take advantages from
either side
Key Takeaways
◦ Gen Z BI will help unleash the power of Big data technologies , NoSQL databases.
◦ Gen Z BI can draw upon the best of existing technologies to provide new ways of
visualizing real-time and interactive data in a flexible, scalable and reliable manner.
◦ It is structured as a plug-n-play architecture upon which varied cross functional / cross
platform / self service portal can be built on.
◦ The full stack architecture allows for seamless data flow with fast response times.
Q&A

More Related Content

What's hot

Next generation big data bi
Next generation big data biNext generation big data bi
Next generation big data bi
Stanley Wang
 
Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1
Lucidworks
 
Self Service BI for Enterprise and SMB Applications
Self Service BI for Enterprise and SMB ApplicationsSelf Service BI for Enterprise and SMB Applications
Self Service BI for Enterprise and SMB Applications
JReport
 
AI Data Acquisition and Governance: Considerations for Success
AI Data Acquisition and Governance: Considerations for SuccessAI Data Acquisition and Governance: Considerations for Success
AI Data Acquisition and Governance: Considerations for Success
Databricks
 
Let's analyze how world reacts to road traffic by sentiment analysis final
Let's analyze how world reacts to road traffic by sentiment analysis finalLet's analyze how world reacts to road traffic by sentiment analysis final
Let's analyze how world reacts to road traffic by sentiment analysis final
Sajeetharan
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
SIBICHAKKARAVARTHYCM
 
Oracle business intelligence 11g overview by aorta
Oracle business intelligence 11g overview by aortaOracle business intelligence 11g overview by aorta
Oracle business intelligence 11g overview by aorta
Aorta business intelligence
 
Birst
BirstBirst
"Building Data Foundations and Analytics Tools Across The Product" by Crystal...
"Building Data Foundations and Analytics Tools Across The Product" by Crystal..."Building Data Foundations and Analytics Tools Across The Product" by Crystal...
"Building Data Foundations and Analytics Tools Across The Product" by Crystal...
Tech in Asia ID
 
Sabana Bandopadhyay Resume
Sabana Bandopadhyay ResumeSabana Bandopadhyay Resume
Sabana Bandopadhyay Resume
SabanaBandopadhyay
 
Emerging Technologies in Retail
Emerging Technologies in RetailEmerging Technologies in Retail
Emerging Technologies in Retail
SAP Customer Experience
 
Work samples
Work samplesWork samples
Work samples
Ravi Iyer
 
Why MicroStrategy
Why MicroStrategyWhy MicroStrategy
Why MicroStrategy
BigClasses Com
 
Vadlamudi saketh30 (ml)
Vadlamudi saketh30 (ml)Vadlamudi saketh30 (ml)
Vadlamudi saketh30 (ml)
Vadlamudi Saketh
 
Birst for SAP HANA
Birst for SAP HANABirst for SAP HANA
Birst for SAP HANA
Birst
 

What's hot (15)

Next generation big data bi
Next generation big data biNext generation big data bi
Next generation big data bi
 
Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1
 
Self Service BI for Enterprise and SMB Applications
Self Service BI for Enterprise and SMB ApplicationsSelf Service BI for Enterprise and SMB Applications
Self Service BI for Enterprise and SMB Applications
 
AI Data Acquisition and Governance: Considerations for Success
AI Data Acquisition and Governance: Considerations for SuccessAI Data Acquisition and Governance: Considerations for Success
AI Data Acquisition and Governance: Considerations for Success
 
Let's analyze how world reacts to road traffic by sentiment analysis final
Let's analyze how world reacts to road traffic by sentiment analysis finalLet's analyze how world reacts to road traffic by sentiment analysis final
Let's analyze how world reacts to road traffic by sentiment analysis final
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
Oracle business intelligence 11g overview by aorta
Oracle business intelligence 11g overview by aortaOracle business intelligence 11g overview by aorta
Oracle business intelligence 11g overview by aorta
 
Birst
BirstBirst
Birst
 
"Building Data Foundations and Analytics Tools Across The Product" by Crystal...
"Building Data Foundations and Analytics Tools Across The Product" by Crystal..."Building Data Foundations and Analytics Tools Across The Product" by Crystal...
"Building Data Foundations and Analytics Tools Across The Product" by Crystal...
 
Sabana Bandopadhyay Resume
Sabana Bandopadhyay ResumeSabana Bandopadhyay Resume
Sabana Bandopadhyay Resume
 
Emerging Technologies in Retail
Emerging Technologies in RetailEmerging Technologies in Retail
Emerging Technologies in Retail
 
Work samples
Work samplesWork samples
Work samples
 
Why MicroStrategy
Why MicroStrategyWhy MicroStrategy
Why MicroStrategy
 
Vadlamudi saketh30 (ml)
Vadlamudi saketh30 (ml)Vadlamudi saketh30 (ml)
Vadlamudi saketh30 (ml)
 
Birst for SAP HANA
Birst for SAP HANABirst for SAP HANA
Birst for SAP HANA
 

Similar to Gen Z BI Paradigm

Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Dataconomy Media
 
Transition to a modern data platform
Transition to a modern data platform Transition to a modern data platform
Transition to a modern data platform
Michael Ghen
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics Training
Natalija Pavic
 
Big Data in Azure
Big Data in AzureBig Data in Azure
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
DATAVERSITY
 
SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?
Nicolas Georgeault
 
Take Action: The New Reality of Data-Driven Business
Take Action: The New Reality of Data-Driven BusinessTake Action: The New Reality of Data-Driven Business
Take Action: The New Reality of Data-Driven Business
Inside Analysis
 
IBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training PurposesIBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training Purposes
Natalija Pavic
 
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BI
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BIAugmentation, Collaboration, Governance: Defining the Future of Self-Service BI
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BI
Denodo
 
A developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure DatabricksA developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure Databricks
Microsoft Tech Community
 
SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?
Nicolas Georgeault
 
Derfor skal du bruge en DataLake
Derfor skal du bruge en DataLakeDerfor skal du bruge en DataLake
Derfor skal du bruge en DataLake
Microsoft
 
How to Empower Your Business Users with Oracle Data Visualization
How to Empower Your Business Users with Oracle Data VisualizationHow to Empower Your Business Users with Oracle Data Visualization
How to Empower Your Business Users with Oracle Data Visualization
Perficient, Inc.
 
Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?
Inside Analysis
 
OC Big Data Monthly Meetup #6 - Session 1 - IBM
OC Big Data Monthly Meetup #6 - Session 1 - IBMOC Big Data Monthly Meetup #6 - Session 1 - IBM
OC Big Data Monthly Meetup #6 - Session 1 - IBM
Big Data Joe™ Rossi
 
SD Big Data Monthly Meetup #4 - Session 1 - IBM
SD Big Data Monthly Meetup #4 - Session 1 - IBMSD Big Data Monthly Meetup #4 - Session 1 - IBM
SD Big Data Monthly Meetup #4 - Session 1 - IBM
Big Data Joe™ Rossi
 
Power BI Overview
Power BI Overview Power BI Overview
Power BI Overview
Gal Vekselman
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDS
Nicolas Georgeault
 
BAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneyBAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, Sydney
Sai Paravastu
 
20220205 Getting started with power bi
20220205 Getting started with power bi20220205 Getting started with power bi
20220205 Getting started with power bi
Aroh Shukla
 

Similar to Gen Z BI Paradigm (20)

Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
 
Transition to a modern data platform
Transition to a modern data platform Transition to a modern data platform
Transition to a modern data platform
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics Training
 
Big Data in Azure
Big Data in AzureBig Data in Azure
Big Data in Azure
 
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
 
SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?
 
Take Action: The New Reality of Data-Driven Business
Take Action: The New Reality of Data-Driven BusinessTake Action: The New Reality of Data-Driven Business
Take Action: The New Reality of Data-Driven Business
 
IBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training PurposesIBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training Purposes
 
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BI
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BIAugmentation, Collaboration, Governance: Defining the Future of Self-Service BI
Augmentation, Collaboration, Governance: Defining the Future of Self-Service BI
 
A developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure DatabricksA developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure Databricks
 
SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?SPSNYC2019 - What is Common Data Model and how to use it?
SPSNYC2019 - What is Common Data Model and how to use it?
 
Derfor skal du bruge en DataLake
Derfor skal du bruge en DataLakeDerfor skal du bruge en DataLake
Derfor skal du bruge en DataLake
 
How to Empower Your Business Users with Oracle Data Visualization
How to Empower Your Business Users with Oracle Data VisualizationHow to Empower Your Business Users with Oracle Data Visualization
How to Empower Your Business Users with Oracle Data Visualization
 
Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?
 
OC Big Data Monthly Meetup #6 - Session 1 - IBM
OC Big Data Monthly Meetup #6 - Session 1 - IBMOC Big Data Monthly Meetup #6 - Session 1 - IBM
OC Big Data Monthly Meetup #6 - Session 1 - IBM
 
SD Big Data Monthly Meetup #4 - Session 1 - IBM
SD Big Data Monthly Meetup #4 - Session 1 - IBMSD Big Data Monthly Meetup #4 - Session 1 - IBM
SD Big Data Monthly Meetup #4 - Session 1 - IBM
 
Power BI Overview
Power BI Overview Power BI Overview
Power BI Overview
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDS
 
BAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneyBAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, Sydney
 
20220205 Getting started with power bi
20220205 Getting started with power bi20220205 Getting started with power bi
20220205 Getting started with power bi
 

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 

Gen Z BI Paradigm

  • 1. GEN Z BI PARADIGM - A Scalable , hybrid and collaborative Visualization Architecture using Spark, No SQL and RESTFUL API
  • 2. Agenda ◦ What is Gen Z BI? ◦ Key features of Gen Z BI ◦ How is it structured - Architecture? ◦ How does data flow? ◦ Real-life examples ◦ Challenges in implementation ◦ Key takeaways
  • 3. What is Gen Z BI? INTEGRATED INTELLIGENCE : BI WITHOUT LIMITATIONS ◦ Operational / Informed Intelligence – Data discovery in Real time with interactive Capabilities ◦ Social Intelligence – Social Media Sentiment Analysis , Online Feeds ◦ Competitive Intelligence – Competitive Strategies by correlation of external data ◦ Machine Intelligence - Search Capabilities powered by NLP and ML ◦ Conversational Intelligence – Personalized Chat bots
  • 4. Key Features of Gen Z BI ◦ Customized, interactive, Real-Time, Collaborative Rich Visualization framework integrated with competitive analytics, Natural Language Processing, social media Sentiment Analysis, online news feeds ◦ Stand alone plug and play REST FUL APIs to integrate with existing Applications and UI Interfaces ◦ Highly scalable , reliable and flexible hybrid architecture ◦ Multiple caching layers in API, DAO ◦ Available anytime , anywhere - Hybrid model in Web, iPad and Mobile form factors.
  • 5. How is it Structured? Files Tables Social Media & News Feed DATA LAYER MID - TIER SECURITY LAYER USER INTERFACE LIVE Stream Data SSO DATA INGESTION APP LAYER
  • 6. How does Data Flow? Interpreter • Detects the Data layer • Converts to Queryable format Optimizer • Runs the Explain plan • Takes the most Optimal Path • Redirects to Cache Cache (May Fly/EH/Mem) • Accepts requests from Optimizer • Based on the Key passed by Optimizer looks up the cache • Returns the output as Response Request JSON ELASTIC SEARCH Not Cached jSON Object (Key: Value Pair) Response JSON Un- cached (Huge Volumes) shards shards shards shards cached shards shards shards shards DATA LAYER TERADATAFILESAPIs ETL Layer KAFKA
  • 7. Real-Life Examples ◦ In-built Management Information Systems ◦ Showing Monthly/Daily snapshot of the Performance of our company with Top vital KPI’s. ◦ Curated huge terabytes of data with response time < 5ms ◦ Master Product Dashboard ◦ Whole list of Products from an organization ◦ Details about subscriptions, targets and performance ◦ Suggested new avenues to grow ◦ Competitive insights from external data, online feeds etc. ◦ Customer insights ◦ Tailored for different segments and by industry, understanding their growth model ◦ Enabling the company to provide highly customized data spread across the globe ◦ Self Service Monitoring tool ◦ Monitoring all the operational processes inside the organization , SLAs ,tracking effort , performance, budget etc.
  • 8. Challenges in Implementation ◦ In-Memory Analytics ◦ Batch Vs Data Streaming ◦ Subscriptions ◦ Metadata ◦ Usage Stats ◦ How to overcome: ◦ Choosing apt Data Ingestion / Mid-Tier tools for in-memory analytics and data processing depending upon use cases. ◦ Blending traditional BI Tools with cutting edge technologies to take advantages from either side
  • 9. Key Takeaways ◦ Gen Z BI will help unleash the power of Big data technologies , NoSQL databases. ◦ Gen Z BI can draw upon the best of existing technologies to provide new ways of visualizing real-time and interactive data in a flexible, scalable and reliable manner. ◦ It is structured as a plug-n-play architecture upon which varied cross functional / cross platform / self service portal can be built on. ◦ The full stack architecture allows for seamless data flow with fast response times.
  • 10. Q&A

Editor's Notes

  1. Customized, interactive ,Real-Time, Rich visualization integrated with data discovery ,competitive analytics, Natural Language Processing, social media Sentiment Analysis, online news feeds .