Download as PDF, PPTX
Uploaded bySameer Maggon
Securing Solr Search Data in the Cloud
This document discusses the challenges and solutions for securing search data in the cloud, focusing on Apache Solr and its applications. It highlights the importance of encryption and introduces Hitachi's searchable encryption technology to protect confidential search data while maintaining usability. The presentation includes information about the speakers, an overview of search platforms, and a demo of securing Solr search in the cloud.
More Related Content
Similar to Securing Solr Search Data in the Cloud
Securing Solr Search Data in the Cloud
- 1. Securing Search Datain the Cloud Sameer Maggon Measured Search Harry Ochiai Hitachi Solutions New York Enterprise Cloud Meetup Jan 25, 2017
- 2. 2 Agenda • About theSpeakers • About Measured Search & Hitachi Solutions • What is Apache Solr? • Where is Apache Solr used? • How Search Data is stored • Data Security Challenge in the Cloud • Protecting Confidential Search Data • Challenges of Encrypted Search Index • Encryption Solution • Demo • Q&A © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 3. 3 About the Speakers HarryOchiai • Senior Business Development Manager of Hitachi Solutions • Worked on networking, cyber security, and storage • Focus on cloud encryption solutions since 2013 • New Yorker Sameer Maggon • Founder / Technologist at Measured Search • Been working in Open Source Search since 2001 (Lucene/Solr/Elastic) • USC Engineering Alumni • Works and Lives in Los Angeles, CA © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 4. 4 About Hitachi Solutions GlobalIT Solutions Company • A Hitachi Company • Japan(HQ), North America, Europe, China, India and Southeast Asia • 12,000 Employees Leading security solution provider in Japan • Innovator and leading provider of encryption technology for over 20 years • HIBUN: 40% market share in the endpoint encryption segment in Japan • Launched new security solution Credeon globally in 2013 © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 5. 5 About Measured Search MeasuredSearch® enables companies to elevate the experience of Search based applications faster and with more confidence. Managed Services & Support SearchStax® Platform as a Service On-Demand Expertise & Consulting © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 6. 6 by Measured SearchSearchStax® SearchStax® SolrCloud Manager SearchStax® Pulse SearchStax® Analytics Comprehensive Solr Monitoring & Alerting with service level reporting to proactively manage your clusters. Realtime feedback & user insights to help optimize your Search Experience Easiest way to run & manage Solr in the cloud - saves time, money and reduces risk. © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 7. 7 What is ApacheSolr? Solr is the popular, blazing-fast, open source enterprise search platform built on Apache Lucene™ © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 8. 8 Where is ApacheSolr used? Government eCommerce Education Life Sciences Entertainment Healthcare Financial Services High Tech © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 9. 9 Where is ApacheSolr used? finding tickets finding job finding restaurant/services Enterprise Search Media Search Retail Customer Search Fraud Analytics Publishing RecruitingTravelResearch Business Intelligence © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 10. 10 Search Index Search platformsmaintains internal indices of terms and properties of each indexed document in plaintext. Plain Search Index Encrypted Search Index © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 11. 11 Data Security Challengesin the Cloud Solr / Search Cluster Backups Threats Managed Service Provider (MSP) Rogue EmployeeManaged Service Provider Rogue Employee Hacker Accidental Data Access © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 12. 12 Challenges of EncryptedSearch Index Challenges • To search through encrypted data, data must be decrypted • Decryption slows down the process • Encryption limits usability Goals • Maintain encrypted state without sacrificing security level • Encrypt using your own key • Maintain search performance and usability • Protect against unauthorized users and rogue system administrators • Regulatory compliance Solution • Searchable Encryption technology © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 13. 13 Protecting Confidential SearchData Solr/Lucene text Key word result value Solr/Lucene text Key word result File System Encryption value Solr/Lucene text Key word result value Simple Encryption Solr/Lucene text Key word result value Searchable Encryption text Key word result value Searchable Encryption Storage Storage Storage Storage Storage Client Server App Server OS No Encryption OS Encryption Simple Encryption with Solr Plugin Client-Side Searchable Encryption Searchable Encryption with Solr Plugin Low Security High Security No Security Decryption at storage layer X Difficult to separate key Decrypt first and match X Very slow X plaintextin memory Match first and decrypt O Key separation O High Performance(1) O Semantically Secure(2) X plaintextin memory Client Client Client Client Client Decryption at client-side O Key separation O High Performance(1) O Semantically Secure(2) O no plaintexton server Solr/Lucene (1) Use of Symmetric Key (2) Probabilistic Encryption Scheme © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 14. 14 Search Encryption 101 SearchableEncryption is an encryption technology for searching data in an encrypted state. • Fully Homomorphic Encryption • Homomorphic Encryption • Functional Encryption • Hitachi Searchable Encryption Practical CKA CPA Tokenization 103 10610010-3 Hitachi Searchable Encryption Functional Encryption Homomorphic Encryption Fully Homomorphic Encryption Security Performance (Search / sec) EncryptedPlain CKA: Chosen Keyword Attack CPA: Chosen Phrase Attack © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 15. 15 Search Encryption 101 EncryptionSchemes • Deterministic • Constant value • Vulnerable to statistical attacks • Probabilistic • Random value • Semantically secure Encryption Key Exchange • Symmetric • Asymmetric / PKI © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 16. 16 Solution: Searchable Encryptionwith Solr Plugin Hitachi Credeon Secure Full-Text Search • Searchable Encryption plugin for Apache Solr and Elasticsearch • Deterministic Encryption Scheme • 128 bit randomization • AES 256, FIPS 140-2 • Symmetric Key • Real-time search (15%+ overhead) • Key Management System, Java KeyStore © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 17. 17 Solution: Client SideSearchable Encryption Credeon Secure Document Solution for SharePoint Online • Client-side encryption for search index and data • Searchable encryption on Solr • Search Engine and Key Management are independent of Microsoft Search Server SharePoint Server Key Management Server Search Engine SharePoint Online Client PC 1. Get a key 2. Index the file contents and encrypt index 4. Upload encrypted file 4. Upload encrypted index 3. Encrypt file © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 18. 18 Demo: Securing SolrSearch in the Cloud SearchStax with Credeon © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 19. 19 Q&A © Hitachi SolutionsAmerica, Ltd. and Measured Search, Inc. 2017, All rights reserved.
- 20. 20 Contact Info Sameer Maggon @maggon sameer@measuredsearch.com https://www.measuredsearch.com HarryOchiai @credeon hochiai@hitachi-solutions.com https://psg.hitachi-solutions.com/credeon/overview © Hitachi Solutions America, Ltd. and Measured Search, Inc. 2017, All rights reserved.