Sqrrl September Webinar: Cell-Level Security

427 views

Published on

On-demand slides provide a technical overview of the open source, NoSQL database Apache Accumulo. We will discuss how Accumulo was born out of the security and performance needs of the National Security Agency (NSA) and cover the concept of "cell-level security".

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
427
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sqrrl September Webinar: Cell-Level Security

  1. 1. sqrrl Secure.'Scale.'Adapt.' Sqrrl Data, Inc. All Rights Reserved Sqrrl,&Apache&Accumulo,&and&Cell3Level&Security& Adam'Fuchs,'CTO' Sqrrl'Data,'Inc.' September'12,'2013'
  2. 2. 2' Sqrrl Data, Inc. All Rights Reserved •  Introduc@on'to'Sqrrl'and'Accumulo' •  Security'In'The'Wild' •  Sqrrl'and'Accumulo'Technology' •  The'DataECentric'Security'Ecosystem' •  How'to'Learn'More' Outline
  3. 3. 3' Sqrrl Data, Inc. All Rights Reserved •  What'is'your'level'of'familiarity'with' Accumulo?' a.  Only'heard'of'it' b.  Well'read'on'it' c.  Downloaded'and'experimented'with'it' d.  Currently'using'it' Poll
  4. 4. 4' Sqrrl Data, Inc. All Rights Reserved Who We Are Google’s( BigTable(Paper( 2006& NSA(Builds( Accumulo( 2008& NSA(Open( Sources( Accumulo( 2011& Sqrrl(Founded( 2012& 3rd(Sqrrl(Release( September&2013& Investors
  5. 5. 5' Sqrrl Data, Inc. All Rights Reserved Security' Adap@vity'Scalability' The Value of Sqrrl and Accumulo
  6. 6. 6' Sqrrl Data, Inc. All Rights Reserved •  Introduc@on'to'Sqrrl'and'Accumulo' •  Security'In'The'Wild' •  Sqrrl'and'Accumulo'Technology' •  The'DataECentric'Security'Ecosystem' •  How'to'Learn'More' Outline
  7. 7. 7' Sqrrl Data, Inc. All Rights Reserved Secure Data Lake Concept NonEsensi@ve'data' Sensi@ve'data' Highly'sensi@ve'data' Highly'sensi@ve'data' Sensi@ve'data' NonEsensi@ve'data' NonEsensi@ve'data' Real>Time(Apps( Sqrrl( Enterprise(
  8. 8. 8' Sqrrl Data, Inc. All Rights Reserved Healthcare Security Requirements PII( SensiBve(Diagnoses( Doctor’s(Notes(
  9. 9. 9' Sqrrl Data, Inc. All Rights Reserved •  Introduc@on'to'Sqrrl'and'Accumulo' •  Security'In'The'Wild' •  Sqrrl'and'Accumulo'Technology' •  The'DataECentric'Security'Ecosystem' •  How'to'Learn'More' Outline
  10. 10. 10' Sqrrl Data, Inc. All Rights Reserved Sqrrl Enterprise Built on Apache Accumulo Sqrrl(Server( Bulk%Processing% Integra2on% Exploratory%/% Opera2onal%Apps% Graph%+% Document%I/O% Sqrrl&API&over&Apache&ThriC&RPC& (JSON,(Graph,(AggregaBon,(Search,(etc.)( •  Sqrrl(proprietary( •  Automated(indexing( •  Custom(iterators( •  Lucene(integraBon( •  Security(extensions( Accumulo&RPC& (Sorted(Key/Value(I/O)( Hadoop&RPC& (File(I/O)( •  Open(source((including( Sqrrl(contribuBons)( •  Open(source(or( commercial(distribuBons(
  11. 11. 11' Sqrrl Data, Inc. All Rights Reserved Hadoop(Distributed(File(System((commercial(or(open(source)( Commodity(Hardware(( Private(Cloud( Public(Cloud( Sqrrl(AnalyBcs(Sqrrl(Security( Apache(Accumulo( Data(Structures( Languages( Processing( Sqrrl(Data(Loaders( Lucene( Documents( (JSON)( EncrypBon>At>Rest( EncrypBon>In>MoBon( Audit( IdM(IntegraBon( Indexing( Tools( Policy(&(Labeling(Engines( Sqrrl&Enterprise& SQL( Subset( MapReduce( Connector( Pig( Connector( (Sqrrl( Iterators( User(Interface( D3(Demos( Flume( ThriY(API( Sqrrl(Ingest( Graphs( Sqrrl Architecture
  12. 12. 12' Sqrrl Data, Inc. All Rights Reserved An(Accumulo(key(is(a(5>tuple,(consisBng(of:(( "   Row:(Controls'Atomicity' "   Column(Family:(Controls'Locality'' "   Column(Qualifier:((Controls'Uniqueness' "   Visibility(Label:((Controls'Access' "   Timestamp:((Controls'Versioning' Row( Col.(Fam.( Col.(Qual.( Visibility( Timestamp( Value( John'Doe' Notes' PCP' PCP_JD' 20120912' Pa@ent'suffers' from'an'acute'…' John'Doe' Test'Results' Cholesterol' JD|PCP_JD' 20120912' 183' John'Doe' Test'Results' Mental'Health' JD|PSYCH_JD' 20120801' Pass' John'Doe' Test'Results' XERay' JD|PHYS_JD' 20120513' 1010110110100…' Accumulo(Key/Value(Example( Accumulo Data Format
  13. 13. 13' Sqrrl Data, Inc. All Rights Reserved Accumulo Technology InEMemory' Map' Write'Ahead' Log' (For'Recovery)' Sorted,' Indexed' File' Sorted,' Indexed' File' Sorted,' Indexed' File' Tablet(Data(Flow( Reads% Iterator' Tree' Minor% Compac2 on% Merging%/%Major% Compac2on% Iterator' Tree' Writes% Iterator' Tree' Scan% Fate'States' Tablet'Server' Tablet' Tablet'Server' Tablet' Tablet'Server' Tablet' Applica@on' Zookeeper' Zookeeper' Zookeeper' Master' HDFS' Read/Write% Store/Replicate% Assign/Balance% Delegate%Authority% Delegate%Authority% Applica@on' Applica@on'
  14. 14. 14' Sqrrl Data, Inc. All Rights Reserved Table Design Patterns Table:( Row:( Column(Family:( Column(Qualifier:( Value:( Forward(Index( <UUID>( <Type>( <Field>( <Term>( Inverted(Index( <Term>( <Type>(+(<Field>( <UUID>( <Digest(of(Event>( Table:( Row:( Column(Family:( Column(Qualifier( (Tuples):( Value:( Shard(Table( <ParBBon(ID>( “Docs”( “Inv.(Index”( “Field(Index”( <UUID>( <Value>( <Term>( <UUID>( <Field:Term>( <UUID>(<Field>( “Geo”( <Hash>( <UUID>( Event( Term( Ingest(Process( Query(Process( Indexed(Event(Table( Event(Columns( Index(Columns( Event(Columns( Index(Columns( Event(Columns( Index(Columns( Event(Columns( Index(Columns( Event(Columns( Index(Columns(
  15. 15. 15' Sqrrl Data, Inc. All Rights Reserved •  Introduc@on'to'Sqrrl'and'Accumulo' •  Security'In'The'Wild' •  Sqrrl'and'Accumulo'Technology' •  The'DataECentric'Security'Ecosystem' •  How'to'Learn'More' Outline
  16. 16. 16' Sqrrl Data, Inc. All Rights Reserved Data-Centric Security Row Col Value 1 Name Jones 1 Sales 100 1 Age 28 2 Name Smith 2 Sales 350 2 Age 25 2' Quota' 1000' Row Col Value 1 Name Anon1 1 Sales 100 2 Name Smith 2 Sales 350 2' Age' 25' 2' Quota' 1000' User 1 User 2 Sqrrl/( Accumulo( DefiniBon:'Data'carries'with'it'informa@on'that'is'required'to' make'policy'decisions'on'its'releasability.'
  17. 17. 17' Sqrrl Data, Inc. All Rights Reserved Security for Transformed Data Logs/ Observa@ons' Input' Indexes' Ques@onE Focused' Datasets' Transforma@on' Simple(Provenance:( Row(+(Column(Security(OK( Complex(Provenance:( Cell>Level(Security(Needed(
  18. 18. 18' Sqrrl Data, Inc. All Rights Reserved Security Row( Col.(Fam.( Col.(Qual.( Visibility( Timestamp( Value( John'Doe' Notes' PCP' PCP_JD' 20120912' Pa@ent'suffers' from'an'acute'…' John'Doe' Test'Results' Cholesterol' JD|PCP_JD' 20120912' 183' John'Doe' Test'Results' Mental'Health' JD|PSYCH_JD' 20120801' Pass' John'Doe' Test'Results' XERay' JD|PHYS_JD' 20120513' 1010110110100…' Example(Accumulo(Key/Value(Pairs( Accumulo&is&the&only& NoSQL&database&with&cell3 level&access&controls&
  19. 19. 19' Sqrrl Data, Inc. All Rights Reserved •  JSON'maps'to'document'and'index'entries,'all' of'which'preserve'the'security'labels' •  Labels'follow'the'document'hierarchy' •  The'label'is'part'of'the'name'of'the'field' (affects'uniqueness)' JSON Document Security Labels
  20. 20. 20' Sqrrl Data, Inc. All Rights Reserved Data-Centric Security Ecosystem Data( Labeler( Sqrrl( Enterprise( Apps( User( Acributes( Audits( Policies( End(Users( Auth.( Service( Policy( Engine( Key(Mgmt(
  21. 21. 21' Sqrrl Data, Inc. All Rights Reserved •  Introduc@on'to'Sqrrl'and'Accumulo' •  Security'In'The'Wild' •  Sqrrl'and'Accumulo'Technology' •  The'DataECentric'Security'Ecosystem' •  How'to'Learn'More' Outline
  22. 22. 22' Sqrrl Data, Inc. All Rights Reserved hip://accumulo.apache.org' Current'Developer'Base:' •  18'Commiiers' •  39'Addi@onal'Recognized' Contributors' Contribu@ng'Organiza@ons:' 'Sqrrl,'Koverse,'Basis,' Hortonworks,'Praxis,'NSA,'Texeltek,' Objec@ve'Solu@ons,'Booz'Allen' Hamilton,'SW'Complete,'Endgame,' SRA,'Peterson'Technologies,' Cloudera,'Agile'Technology'Group,' Data'Tac@cs,'Tetra'Concepts,'JHU/ APL,'Applied'Technical'Systems,'and' more.' Accumulo Community Growth
  23. 23. 23' Sqrrl Data, Inc. All Rights Reserved •  Download'our'White'Paper' – www.sqrrl.com/whitepaper' •  Watch'a'video' – www.sqrrl.com/downloads#videos' •  Request'a'demo'or'oneEonEone'workshop' – 'www.sqrrl.com/contact' •  Come'meet'us' – Strata'Rx'(Sept'25E27,'Boston)' – Hadoop'World'(Oct'28'–'30,'New'York)' How To Learn More
  24. 24. 24' Sqrrl Data, Inc. All Rights Reserved Thank you Thanks(for(acending!( To(keep(up(to(date(with( Sqrrl,(check(out(or(social( media(sites:( www.twicer.com/sqrrl_inc( www.linkedin.com/company/sqrrl((

×