Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SAP HANA SPS10- Hadoop Integration

8,935 views

Published on

See what's new in SAP HANA SPS10- Hadoop Integration

Published in: Technology
  • Be the first to comment

SAP HANA SPS10- Hadoop Integration

  1. 1. 1© 2014 SAP AG or an SAP affiliate company. All rights reserved. SAP HANA SPS 10 - What’s New? Hadoop integration Balaji Krishna, SAP HANA Product Management (Delta from SPS 09 to SPS 10)
  2. 2. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 3Public New Features for Hadoop/Spark integration • HANA SparkSQL integration using native Spark Adapter  Parallel pushing data to Spark  Parallel fetching data/result from Spark  Enable join- relocation when connecting to Hadoop as Remote Source • Ambari integration with HANA Cockpit  Unified UI to administer HANA and Hadoop nodes  First step towards a more integrated monitoring • Data Lifecycle Management with Hadoop (Beta)*  Hadoop Relocation Agent for Data Lifecycle Manager (DLM) tool
  3. 3. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 4Public Spark Adapter for HANA HANA Spark SQL Adapter is the key components in HANA – Spark SQL integration. Its main responsibilities are: • Managing connection and communication to a remote Spark SQL Controller, an SAP component deployed on a Hadoop cluster. • Managing access to Spark SQL Controller services. • Translating HANA requests. • Deserialization of data received from Hadoop back HANA. • Browsing Hadoop data structures through the remote source interface. • Enabling the creation of virtual tables through the remote source interface.
  4. 4. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 5Public Steps to configure Spark controller • Install SAP Spark controller from SMP (sap.hana.spark.controller-1.0-1.noarch.rpm) • Verify new OS user ‘hanaes’ is created • Copy assembly file (spark.controller-1.0.1.jar) to controller lib folder • Perform post install steps like updating hive-site.xml file and adding Hadoop version info • Finally go to Ambari > Resource Manager to check if SAP HANA Spark Controller is running • Detailed instructions are available at SAP Note 2177933
  5. 5. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 6Public Ambari Integration with HANA Cockpit • New Cockpit dynamic tile to manage Hadoop clusters • Naive integration using redirect to Ambari Web interface • Requires import of cockpit DU package • Add new roles to the user • com.sap.hana.hadoop.cockpit.ambari.data::Administrator • sap.hana.uis.db::SITE_DESIGNER • sap.hana.uis.db::SITE_USER
  6. 6. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 7Public How to find SAP HANA documentation on this topic? SAP HANA Platform documentation  What’s New – Release Notes  Modeling Information – SAP HANA Admin Guide  Development Information – SAP HANA Developer Guide  References – SAP HANA SQL Reference • In addition to this learning material, you find SAP HANA documentation on SAP Help Portal knowledge center at http://help.sap.com/hana_platform. • The knowledge center is structured according to the product lifecycle: installation > security > administration > modeling > development. So you can find e.g. the SAP HANA Developer Guide in the Develepment section and so forth …
  7. 7. © 2015 SAP SE or an SAP affiliate company. All rights reserved. Thank you Contact information Balaji Krishna SAP HANA Product Management AskSAPHANA@sap.com

×