Security &
Governance
in Big Data
Security
BIG DATA IS STILL A NEW
TECHNOLOGY FOR MOST
ORGANISATIONS,
AND ANY TECHNOLOGY THAT IS NOT
WELL UNDERSTOOD WILL
INTRODUCE NEW VULNERABILITIES
Many businesses already use Big Data to
store data. However they may not have
the access rights control required from a
security perspective.
Big Data breaches can be big, so data
security becomes even more critical
CRITICAL RISKS IN BIG DATA
PLATFORMS
∎ BIG data, BIGGER security leaks
∎ The attack surface of the nodes in a cluster may not be adequately hardened
∎ Access to data from multiple locations may not be sufficiently controlled
∎ Regulatory requirements with logs and audit trails may not be fulfilled,
BIGCHALLENGE∎Platform must have a comprehensive security solution
∎A secure integration into BBVA security is a need
GOSEC is a centralized security
component managing fine-grained
access control across Big Data
services: HDFS, Cassandra, Kafka
and Big Data web applications such
as Viewer.
WHAT IS IT?
GOSEC allows management policies
controlling access to files, topics,
tables, databases… These policies
can be set for individual users or
groups
GOSEC currently covers:
Authentication
Authorization
Audit
OVERVIEW
GOSEC
MANAGER
USERS & GROUPS MANAGEMENT
Users & groups are not directly managed in GOSEC.
They are always recovered from organization Identity
Provider (LDAP).
USERS & GROUPS MANAGEMENT
Roles & profiles are an easy way to set up security
policies for dynamic group memberships or user tasks.
USERS & GROUPS MANAGEMENT
ACLs can be created
to grant or revoke
access to different
resources.
USERS & GROUPS MANAGEMENT
Every operation is
audited by GOSEC.
Only security admins
have access to the audit
log.
SO, WHAT MUST WE DO NOW ?
BBVA INTEGRATION
Synchronized
IDP
Armadillo
and Global
Directory
Data Encoding
for Security
Strategy to
prevent
internal and
external data
leakage
Governance
“DATA IS GOING TO DEFINE THE COMPETITIVE ADVANTAGE
IN THE GLOBAL FINANCIAL ECOSYSTEM OF THE FUTURE”
“WE ARE BEGINNING TO BUILD DATA-DRIVEN BANK”
Francisco González, November 2015
WHY IS DATA GOVERNANCE
NECESSARY?
Large data
volumes and
various data
types
Democratize
the use of the
data with
new flexible
and agile
exploitation
Data
management
policies that
ensure quality
& traceability
Data Centric
GOVERNANCE MODEL TRANSVERSAL
AND CONVERGENT ACROSS ALL
GEOGRAPHIES OF GROUP
GLOBAL
WHAT WE EXPECT OF
DATA GOVERNANCE?
Data Dictionary
Functional and Technical Level
Lineage
Traceability of data throughout its life cycle
Quality
Data Quality and Process Quality
Standards and Best Practices
Standards for each platform technology
Visualization and Exploration
Graphical solution for governance data
THANKS!
Any questions?
@datiobd
info@datiobd.com
datio-big-data

Security&Governance

  • 1.
  • 2.
  • 3.
    BIG DATA ISSTILL A NEW TECHNOLOGY FOR MOST ORGANISATIONS, AND ANY TECHNOLOGY THAT IS NOT WELL UNDERSTOOD WILL INTRODUCE NEW VULNERABILITIES
  • 4.
    Many businesses alreadyuse Big Data to store data. However they may not have the access rights control required from a security perspective. Big Data breaches can be big, so data security becomes even more critical
  • 5.
    CRITICAL RISKS INBIG DATA PLATFORMS ∎ BIG data, BIGGER security leaks ∎ The attack surface of the nodes in a cluster may not be adequately hardened ∎ Access to data from multiple locations may not be sufficiently controlled ∎ Regulatory requirements with logs and audit trails may not be fulfilled,
  • 6.
    BIGCHALLENGE∎Platform must havea comprehensive security solution ∎A secure integration into BBVA security is a need
  • 7.
    GOSEC is acentralized security component managing fine-grained access control across Big Data services: HDFS, Cassandra, Kafka and Big Data web applications such as Viewer. WHAT IS IT? GOSEC allows management policies controlling access to files, topics, tables, databases… These policies can be set for individual users or groups
  • 8.
  • 9.
  • 10.
    USERS & GROUPSMANAGEMENT Users & groups are not directly managed in GOSEC. They are always recovered from organization Identity Provider (LDAP).
  • 11.
    USERS & GROUPSMANAGEMENT Roles & profiles are an easy way to set up security policies for dynamic group memberships or user tasks.
  • 12.
    USERS & GROUPSMANAGEMENT ACLs can be created to grant or revoke access to different resources.
  • 13.
    USERS & GROUPSMANAGEMENT Every operation is audited by GOSEC. Only security admins have access to the audit log.
  • 14.
    SO, WHAT MUSTWE DO NOW ?
  • 15.
    BBVA INTEGRATION Synchronized IDP Armadillo and Global Directory DataEncoding for Security Strategy to prevent internal and external data leakage
  • 16.
  • 17.
    “DATA IS GOINGTO DEFINE THE COMPETITIVE ADVANTAGE IN THE GLOBAL FINANCIAL ECOSYSTEM OF THE FUTURE” “WE ARE BEGINNING TO BUILD DATA-DRIVEN BANK” Francisco González, November 2015
  • 18.
    WHY IS DATAGOVERNANCE NECESSARY? Large data volumes and various data types Democratize the use of the data with new flexible and agile exploitation Data management policies that ensure quality & traceability Data Centric
  • 19.
    GOVERNANCE MODEL TRANSVERSAL ANDCONVERGENT ACROSS ALL GEOGRAPHIES OF GROUP GLOBAL
  • 20.
    WHAT WE EXPECTOF DATA GOVERNANCE? Data Dictionary Functional and Technical Level Lineage Traceability of data throughout its life cycle Quality Data Quality and Process Quality Standards and Best Practices Standards for each platform technology Visualization and Exploration Graphical solution for governance data
  • 21.