Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Apache Sqoop Tutorial | Sqoop: Import & Export Data From MySQL To HDFS | Hadoop Training | Edureka

225 views

Published on

** Hadoop Training: https://www.edureka.co/hadoop **
This Edureka PPT on Sqoop Tutorial will explain you the fundamentals of Apache Sqoop. It will also give you a brief idea on Sqoop Architecture. In the end, it will showcase a demo of data transfer between Mysql and Hadoop
Below topics are covered in this video:

1. Problems with RDBMS
2. Need for Apache Sqoop
3. Introduction to Sqoop
4. Apache Sqoop Architecture
5. Sqoop Commands
6. Demo to transfer data between Mysql and Hadoop

Check our complete Hadoop playlist here: https://goo.gl/hzUO0m

Follow us to never miss an update in the future.
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka

Published in: Technology
  • Be the first to comment

Apache Sqoop Tutorial | Sqoop: Import & Export Data From MySQL To HDFS | Hadoop Training | Edureka

  1. 1. Copyright © 2017, edureka and/or its affiliates. All rights reserved. Topics to be covered… Problems with RDBMS Need for Sqoop Introduction to Sqoop Features of Sqoop Sqoop Architecture Sqoop Commands & Demo using MySQL 1 2 3 4 5 6
  2. 2. Copyright © 2017, edureka and/or its affiliates. All rights reserved. Problems with Relational Database Data Importing was Tedious task Difficult to handle large datasets Cant store Unstructured Data Time Consuming Task RDBMS
  3. 3. Copyright © 2017, edureka and/or its affiliates. All rights reserved. Need for Sqoop Data Analysis Command Line Interface High Performance
  4. 4. Copyright © 2017, edureka and/or its affiliates. All rights reserved. What is Sqoop? RDBMS HDFS Import Tool used to transfer bulk data between HDFS & Relational Database Servers
  5. 5. Copyright © 2017, edureka and/or its affiliates. All rights reserved. What is Sqoop? RDBMS HDFS Export Tool used to transfer bulk data between HDFS & Relational Database Servers
  6. 6. Copyright © 2017, edureka and/or its affiliates. All rights reserved. Features of Sqoop Full Load Incremental Load Parallel Import/Export Compression Kerberos Security Integration Data loading directly to HIVE
  7. 7. Copyright © 2017, edureka and/or its affiliates. All rights reserved. Sqoop Architecture
  8. 8. Copyright © 2017, edureka and/or its affiliates. All rights reserved. How Sqoop Import & Export Works?
  9. 9. Sqoop Commands
  10. 10. IMPORT EXPORT LIST DATABASE LIST TABLES CODEGEN Sqoop Import Command Import Import each table of the RDBMS in Hadoop $ sqoop import --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> --username <username_for_mysql_user> --password <Password> --target-dir <target directory where data needs to be imported>
  11. 11. IMPORT EXPORT LIST DATABASE LIST TABLES CODEGEN Sqoop Export Command Exports data from HDFS to RDBMS Export $ sqoop export --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> --username <username_for_mysql_user> --password <Password> --export-dir <directory name where data needs to be exported>
  12. 12. IMPORT EXPORT LIST DATABASE LIST TABLES CODEGEN Sqoop List Database It lists the databases present in the relational database Sqoop $ sqoop list databases --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> --username <username_for_mysql_user> --password <Password>
  13. 13. IMPORT EXPORT LIST DATABASE LIST TABLES CODEGEN Sqoop List Tables ID Name Age Address 1 Jino 25 Kottayam 2 Neha 22 Dharwad 3 Chaitra 23 Bangalore It lists the available tables in the database $ sqoop list tables --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> --username <username_for_mysql_user> --password <Password>
  14. 14. IMPORT EXPORT LIST DATABASE LIST TABLES CODEGEN Sqoop Codegen Generates DAO Class automatically Generates Java Class file Source code can be recreated $ sqoop codegen --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> --username <username_for_mysql_user> --password <Password>

×