2. Big Data and Data Security
Challenges and Opportunities
Office 365 and SharePoint Connect Conference | 15.11.2018 | Sascha Fredrich
3. |
Big Data – some numbers.
15.11.2018 Big Data and Data Security
HUMAN BRAIN
2,5 PB1 PB - 15 Zeros
WORLD OF WARCRAFT
2,5 PB1 PB - 15 Zeros
END OF 2020
40 ZB1ZB – 21 Zeros
GROWTH IN 2 YEARS
2xdouble every year
Estimated amount of
Date which can be
stored in the human
brain.
Blizzard Entertainment
needs this amount of
data for his game.
Estimated amount of
Data been stored,
copied or consumed by
2020. Study of IDC and
EMC.
The Data been stored or
consumed will double
every two years.
4. |
Widely available
unstructured data
Deliver powerful insights
over big data
The data landscape is changing.
That means big opportunity for your business
Massive
data growth
Build data
into all your apps
50ZB
1010
0101
0010
{}
Analytics driving
digital transformation
Modernize your apps
with built-in analytics
15.11.2018 Big Data and Data Security
5. |
A world of unprecedented change.
Average lifespan of a company on S&P 500
15.11.2018 Big Data and Data Security
6. |
Pioneers are Engineering and Automotive
15.11.2018 Big Data and Data Security
Wemanagetotransformthe
findingsfromtheanalysisinto
benefitsforthecompany
Relevant decisions in our company are based on insights Source: KPMG 2016
Avarage / n = 706
7. |
More than a third are using BIG DATA Solutions.
15.11.2018 Big Data and Data Security
Source: KPMG 2016
% of Companys / n = 706
We use Big Data; 35
We are planing to use;
24
We diskuss to use; 18
No Issue at the Moment;
22
We did not look at Big
Data til now; 1
Percentage of Companies
9. |
Transforming with data: your opportunity.
15.11.2018 Big Data and Data Security
8%ADDITIONAL OPERATING INCOME
Generated by the most digitally
transformed enterprises
$430B
EXTRA PRODUCTIVITY BENEFITS BY 2020
Gained by organizations able to
analyze all relevant data and deliver
actionable information
10. |
Data Sources could be everywhere
15.11.2018 Big Data and Data Security
Usage/User
Data
Machines and
Sensors
Social Media
Public Data
Business Data
DATA
KNOWLEDGE
INFORMATION
11. |
One Example – Business and Big Data.
15.11.2018 Big Data and Data Security
14. |
Three trends looking for building blocks.
IntelligenceCloudBig Data
15.11.2018 Big Data and Data Security
15. |
Security and privacyFlexibility of choiceReason over any data, anywhere
Data warehouses
Data lakes
Operational databases
HYBRID
On-premises
Private cloud
Cloud
Data warehouses
Data lakes
Operational databases
The modern data estate.
15.11.2018 Big Data and Data Security
SocialLOB Graph IoTImageCRM
16. |
Its more than only store data.
15.11.2018 Big Data and Data Security
Business
apps
Custom
apps
Sensors
and
devices
People
Automated
systems
Data Intelligence
Intelligence &
Learning
Action
Apps
17. |
Get it more concrete based on Microsoft Azure Services.
Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards &
Visualizations
Cortana
Bot
Framework
Cognitive
Services
Power BI
Information
Management
Event Hubs
Data Catalog
Data Factory
Machine Learning
and Analytics
HDInsight
(Hadoop and
Spark)
Stream Analytics
Intelligence
Data Lake
Analytics
Machine
Learning
Big Data Stores
SQL Data
Warehouse
Data Lake Store
Data
Sources
Apps
Sensors
and
devices
Data
15.11.2018 Big Data and Data Security
Cosmos DB
24. |
Computer Vision API
Distill actionable
information from
images
Video API
Analyze, edit, and
process videos within
your app
Face API
Detect, identify,
analyze, organize, and
tag faces in photos
Emotion API
Personalize
experiences with
emotion recognition
Vision
Content
Moderator
Automated image,
text, and video
moderation
25. |
Clip Art Type 0 Non-clipart
Line Drawing Type 0 Non-Line Drawing
Black & White Image False
Type of image
Categories [{ “name”: “people_swimming”, “score”: 0.099609375 }]
Adult Content False
Adult Score 0.18533889949321747
Faces [{ “age”: 27, “gender”: “Male”, “faceRectangle”:
{“left”: 472, “top”: 258, “width”: 199, “height”: 199}}]
Content of image
Image colors
Dominant Color Background White
Dominant Color Foreground Grey
Dominant Colors White
Accent Color
Analyze image
15.11.2018 Big Data and Data Security
26. |
Face detection
"faceRectangle": {"width": 193,
"height": 193,
"left": 326,
"top": 204} …
Emotion scores
“scores": { "anger": 5.182241e-8,
"contempt": 0.0000242813,
"disgust": 5.621025e-7,
"fear": 0.00115027453,
"happiness": 1.06114619e-8,
"neutral": 0.003540177,
"sadness": 9.30888746e-7,
"surprise": 0.9952837}
Emotion APIs
15.11.2018 Big Data and Data Security
27. |
Time (sec) Face ID x, y Width, height
0 0 0.59, 0.23 0.09, 0.16
0 1 0.38, 0.15 0.07, 0.12
1 0 0.54, 0.25 0.09, 0.15
1 1 0.23, 0.18 0.07, 0.12
Face detection and tracking
High precision face location detection and tracking
Can detect up to 64 human faces in a video (no smaller than 24x24 pixels)
Detected and tracked faces are returned with coordinates and a Face ID
to track throughout the video
15.11.2018 Big Data and Data Security
28. |
BUT – there are challanges.
15.11.2018 Big Data and Data Security
• Big Data is also a challange - a
challenge for data protection and
personal rights
• The linking of unproblematic
information can lead to problematic
findings
• The ethics of information asks about the
moral implications of big data in terms of
digital patronizing (big data as Big Brother)
, informational autonomy, and the fairness
of justice.
• Data protection laws and facilities can help
prevent a lot of excesses and protect
consumers
GDPR – and now…
29. |
Providing clarity and consistency
for the protection of personal data.
Enhanced personal privacy rights
Increased duty for protecting data
Mandatory breach reporting
Significant penalties for non-compliance
The General Data Protection
Regulation (GDPR) imposes new rules
on organizations that offer goods and
services to people in the European
Union (EU), or that collect and analyze
data tied to EU residents, no matter
where they are located.
15.11.2018 Big Data and Data Security
30. |
What are the key changes with the GDPR?
15.11.2018 Big Data and Data Security
PERSONAL
PRIVACY
CONTROLS AND
NOTIFICATIONS
TRANSPARENT
POLICIES
IT AND
TRAINING
Individuals have the right to:
• Access their personal
data
• Correct errors in their
personal data
• Erase their personal data
• Object to processing of
their personal data
• Export personal data
Organizations will need to:
• Protect personal data
using appropriate security
• Notify authorities of
personal data breaches
• Obtain appropriate
consents for processing
data
• Keep records detailing
data processing
Organizations are required to:
• Provide clear notice of
data collection
• Outline processing
purposes and use cases
• Define data retention and
deletion policies
Organizations will need to:
• Train privacy personnel &
employee
• Audit and update data
policies
• Employ a Data Protection
Officer (if required)
• Create & manage
compliant vendor contracts
31. |
SECURITY
Summary
15.11.2018 Big Data and Data Security
VOLUME
ANALYSIS OF DATA FLOW
SCALE OF DATA
BIG DATA
VELOCITY
PRIVACY
VARIETY
FORMS OF DATA
VERACITY
UNGERTAINTY OF DATA
?
32. |15.11.2018 Big Data and Data Security
Any questions?
Learn more at
bechtle.com
Feel free to contact me
Sascha.Fredrich@bechtle.com