Presented at the Bitkom Big-Data.AI Summit on 14 September 2022. We introduce Analyst-2 (https://analyst-2.ai/) a stand-alone version of Inspirient's Automated Analytics Engine that in Q1 2022 autonomously analyzed all structured and semi-structured datasets from data.europa.eu (and also govdata.de, data.gov and kaggle.com). Our three key conclusions from this experiment are that... 1) Data analysis can be automated, just like playing chess was automated 25 years ago 2) Automation scales 10,000s of datasets per day, and beyond 3) Automation easily reaches the proficiency level of a Junior Data Analyst This talk is a follow-on to the SXSW 2022 panel 'Putting Open Data to Work – at Scale' (https://schedule.sxsw.com/2022/events/PP118764) Full abstract at https://big-data.ai/programme#Lessons-from-Analysing-all-of-Europes-Data

1. Lessons from Analyzing All of Europe's Data
Dr. Guillaume Aimetti ▪ Dr. Georg Wittenburg
Inspirient GmbH
Bitkom Big-Data.AI Summit
Berlin, 14 September 2022

2. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 1
Dr. Guillaume Aimetti
Co-founder and Managing Director
at Inspirient
Dr. Georg Wittenburg
Co-founder and Managing Director
at Inspirient

3. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 2

4. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 3

5. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 4

6. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Germany and Europe are Building
Data Lakes – so what?
Bitkom Big-Data.AI Summit 2022, 14.09.2022 5

7. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
The Cost of Analyzing a Data Lake
• Assume a Data Lake contains 10,000 datasets
• A data analyst may need three days on
average for each initial exploratory analysis
– One analyst can explore 68 datasets per
year (255 work days with 20% overhead)
• A data analyst earns €60K p.a.
Exploratory analysis of the Data Lake takes
~147 person years and cost >€8.8M
Bitkom Big-Data.AI Summit 2022, 14.09.2022 6

8. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 7
Autonomous Data Analysis
“Analyst-2”
A system that autonomously reasons about
previously unknown structured or semi-
structured, just like a data analyst would

9. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 8
Autonomous Data Analysis
“Analyst-2”
A system that autonomously reasons about
previously unknown structured or semi-
structured, just like a data analyst would

10. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 9
Autonomous Data Analysis
“Analyst-2”
A system that autonomously reasons about
previously unknown structured or semi-
structured, just like a data analyst would

11. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 10
Autonomous Data Analysis
“Analyst-2”
A system that autonomously reasons about
previously unknown structured or semi-
structured, just like a data analyst would
Online at analyst-2.ai

12. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Bitkom Big-Data.AI Summit 2022, 14.09.2022 11
Autonomous Data Analysis
“Analyst-2”
A system that autonomously reasons about
previously unknown structured or semi-
structured, just like a data analyst would
Online at analyst-2.ai

13. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Many questions…
• What did you find in all that data?
• How does it work?
• Are the results any good?
Bitkom Big-Data.AI Summit 2022, 14.09.2022 12

14. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Many questions…
• What did you find in all that data?
• How does it work?
• Are the results any good?
Bitkom Big-Data.AI Summit 2022, 14.09.2022 13
 @analyst2_ai

15. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
How does it work?
Intuition: Analytical reasoning closely resembles a game of chess
Computer Chess Automated Data Analysis
Bitkom Big-Data.AI Summit 2022, 14.09.2022 14
• Enumerate and score all valid moves, anticipating
opponents counter-moves
• Select next move based on best score
• Enumerate and score all valid analysis steps, e.g., …
 Data classifications, aggregations, regressions
• Visualize results as searchable slides
AI
Human nothing to do
• Select relevant results based on context specific to the
client and/or survey
Numeric?
Country?
ZIP code?
Likert Scale?
Aggregation?
Outliers?
String?

16. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Analytics is automated by orchestrating 420+ custom built classifiers to
emulate the reasoning process of a human statistician
Bitkom Big-Data.AI Summit 2022, 14.09.2022 15
Analyst-2, Inspirient’s Hybrid AI, uses 420+ custom built
classifiers to autonomously apply human-level analytical reasoning

17. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
…but are the results any good?
Bitkom Big-Data.AI Summit 2022, 14.09.2022 16
What makes the results
of a human analyst good?

18. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Two key dimensions: Speed and level of insight
Bitkom Big-Data.AI Summit 2022, 14.09.2022 17
Speed
Insight
months weeks days hours minutes seconds
$
$$
$$$
$$$$
$$$$$
?
?
?
?

19. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Speed and Level of Insight
Analyst-2’s trajectory so far
Bitkom Big-Data.AI Summit 2022, 14.09.2022 18
Speed
Insight
months weeks days hours minutes seconds
$
$$
$$$
$$$$
$$$$$
@
Ops Optimization
(Big-Data.AI 2017)
@
Fraud Detection
(Big-Data.AI 2019)
@
Survey Analytics
(Big-Data.AI 2022)
@
Scalability
(Big-Data.AI 2022)
?
Today, 16:20h, right here!

20. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Lessons from Analyzing All of Europe’s Data
Bitkom Big-Data.AI Summit 2022, 14.09.2022 19
• Data analysis can be automated just like
playing chess was automated 25 years ago
• Automation scales 10,000s of datasets per
day
• Automation easily reaches the proficiency
level of a Junior Data Analyst

21. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Thank you for your time today!
Bitkom Big-Data.AI Summit 2022, 14.09.2022 20
Dr. Georg Wittenburg
georg.wittenburg@inspirient.com
Dr. Guillaume Aimetti
guillaume.aimetti@inspirient.com

22. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Autonomous Analytics
Also known as the “Self-driving Car of Data Science”
Bitkom Big-Data.AI Summit 2022, 14.09.2022 21
… to autonomously generated, relevant results
From diverse dataset…
Autonomous
Analytics

23. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
For our processes, this means we can get now up to 80% of our client-
facing deliverables in less than 30% of the time
Bitkom Big-Data.AI Summit 2022, 14.09.2022 22
1–2 minutes 5 mins – 2 hours
Data Upload
Analysis Guidance
(optional)
Review of
Generated Reports
Discovery of
Additional Insights
• Datasets in Microsoft Excel,
SPSS, CSV or from
SQL data sources
• One or multiple files
• Prioritizing dimensions
• Guiding the analysis
 Survey meta information
 Multiple-choice variables
• Advanced customization
• Survey quality assessment
 Straightliners and
interviewer effect
• Contingency tables and
cross tabulations
• Most significant multivariate
regressions
• Browsing all results
• Finding most significant
statistical patterns
• Finding something new
and unusual
• Compiling a custom report
• Sharing results and reports
Automated data scan Automated analysis

24. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
Metadata Enrichment
Datasets prioritized by quality and richness (# detected patterns)
Bitkom Big-Data.AI Summit 2022, 14.09.2022 23

25. Copyright
©
2022
by
Inspirient
GmbH.
All
rights
reserved.
State of the Art and Way Forward
An informal assessment, focused on structured data
• Descriptive Analytics
• Predictive Analytics
• Prescriptive Analytics
Bitkom Big-Data.AI Summit 2022, 14.09.2022 24
current 2025 2030