The Transporter
4
MySQL
A visual Guide 4 Importing & Exporting
csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
contents
• Export 2 csv
• Import csv
• Exporting 2 sql
• Importing sql
• Exporting 2 xml
• Importing xml
• Exporting 2 tsv...
open MySQL
exporting to CSV
exporting CSV – Problem ?
check Appamor status
AA Status
AA
go to apparmor.d
edit usr.sbin.mysqld
usr.sbin.mysqld
after editing usr.sbin.mysqld
make /tmp/data directory
make /data directory
mounting
reload apparmor
restarting apparmor . . .
exporting .csv
Importing csv
importing .csv – problem ?
importing .csv
edit my.cnf
my.cnf file
after editing my.cnf
importing .csv
exporting sql
view tables
create country table
inserting data into country table
exporting .sql
exported .sql file
Importing sql
importing .sql
exporting xml
exporting .xml
importing xml
importing xml
exporting tsv
exporting .tsv
exported .tsv file
exporting txt
exporting .txt
exported .txt file
exporting to HDFS
installing Apache Sqoop
Apache Sqoop Home Page
Sqoop folder structure
add mysqlJ connector in SqoopHome/lib
export & check version
sqoop help
list databases
make dir in HDFS
check mysql tables
grant permissions
exporting 2 HDFS
exporting completes
Intermediate .java file (mapReduce)
HDFS table
exporting to HDFS
exporting to HDFS
importing to MySQL (4m HDFS)
HDFS table
make MySQL table structure
importing to MySQL
importing completes
imported table
exporting to Hive
check Hive for redundant table
exporting 2 Hive
libthrift version error
export fake HBase_Home
check Hive tables
export to HBase
mysql table
employee table
start HBase daemons
exporting to HBase
exporting completes
all Sqoop queries
finish
Upcoming SlideShare
Loading in …5
×

The Transporter 4 MySQL

460 views

Published on

import & exports for MySQL to HDFS (Hadoop), HBase, Hive, csv, sql, tsv, text, xml, installing Apache Sqoop,problems associated with import & export

Published in: Self Improvement, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
460
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
4
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

The Transporter 4 MySQL

  1. 1. The Transporter 4 MySQL A visual Guide 4 Importing & Exporting csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
  2. 2. contents • Export 2 csv • Import csv • Exporting 2 sql • Importing sql • Exporting 2 xml • Importing xml • Exporting 2 tsv • Exporting 2 text • Exporting 2 HDFS • Installing Apache Sqoop • exporting 2 HDFS • Importing 2 MySQL • Exporting 2 Hive • Exporting 2 HBase
  3. 3. open MySQL
  4. 4. exporting to CSV
  5. 5. exporting CSV – Problem ?
  6. 6. check Appamor status
  7. 7. AA Status
  8. 8. AA
  9. 9. go to apparmor.d
  10. 10. edit usr.sbin.mysqld
  11. 11. usr.sbin.mysqld
  12. 12. after editing usr.sbin.mysqld
  13. 13. make /tmp/data directory
  14. 14. make /data directory
  15. 15. mounting
  16. 16. reload apparmor
  17. 17. restarting apparmor . . .
  18. 18. exporting .csv
  19. 19. Importing csv
  20. 20. importing .csv – problem ?
  21. 21. importing .csv
  22. 22. edit my.cnf
  23. 23. my.cnf file
  24. 24. after editing my.cnf
  25. 25. importing .csv
  26. 26. exporting sql
  27. 27. view tables
  28. 28. create country table
  29. 29. inserting data into country table
  30. 30. exporting .sql
  31. 31. exported .sql file
  32. 32. Importing sql
  33. 33. importing .sql
  34. 34. exporting xml
  35. 35. exporting .xml
  36. 36. importing xml
  37. 37. importing xml
  38. 38. exporting tsv
  39. 39. exporting .tsv
  40. 40. exported .tsv file
  41. 41. exporting txt
  42. 42. exporting .txt
  43. 43. exported .txt file
  44. 44. exporting to HDFS
  45. 45. installing Apache Sqoop
  46. 46. Apache Sqoop Home Page
  47. 47. Sqoop folder structure
  48. 48. add mysqlJ connector in SqoopHome/lib
  49. 49. export & check version
  50. 50. sqoop help
  51. 51. list databases
  52. 52. make dir in HDFS
  53. 53. check mysql tables
  54. 54. grant permissions
  55. 55. exporting 2 HDFS
  56. 56. exporting completes
  57. 57. Intermediate .java file (mapReduce)
  58. 58. HDFS table
  59. 59. exporting to HDFS
  60. 60. exporting to HDFS
  61. 61. importing to MySQL (4m HDFS)
  62. 62. HDFS table
  63. 63. make MySQL table structure
  64. 64. importing to MySQL
  65. 65. importing completes
  66. 66. imported table
  67. 67. exporting to Hive
  68. 68. check Hive for redundant table
  69. 69. exporting 2 Hive
  70. 70. libthrift version error
  71. 71. export fake HBase_Home
  72. 72. check Hive tables
  73. 73. export to HBase
  74. 74. mysql table
  75. 75. employee table
  76. 76. start HBase daemons
  77. 77. exporting to HBase
  78. 78. exporting completes
  79. 79. all Sqoop queries
  80. 80. finish

×