Integration with hdfs using WebDFS and NFS

1,138 views

Published on

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,138
On SlideShare
0
From Embeds
0
Number of Embeds
19
Actions
Shares
0
Downloads
12
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Integration with hdfs using WebDFS and NFS

  1. 1. Integration with HDFS Using NFS and WebHDFS Christophe Marchal | Software Architect
  2. 2. Access your files in HDFS
  3. 3. Network File System WebHDFS
  4. 4. NFS support Motivations 1. File browsing and downloading 2. File uploading 3. Data streaming
  5. 5. Network File System Stack
  6. 6. NFS Gateway
  7. 7. NFS Gateway
  8. 8. Hands on mount -t nfs -o vers=3,proto=tcp,nolock HOSTIP:/ /PATH/TO/MOUNTPOINT
  9. 9. WebHDFS
  10. 10. API HTTP http://<HOST>:<HTTP_PORT>/webhdfs/v1/<PATH>?op= WebHDFS webhdfs://<HOST>:<HTTP_PORT>/<PATH> hdfs://<HOST>:<RPC_PORT>/<PATH>
  11. 11. API HTTP GET HTTP PUT OPEN GETFILESTATUS LISTSTATUS GETCONTENTSUMMARY GETFILECHECKSUM GETHOMEDIRECTORY GETDELEGATIONTOKEN CREATE MKDIRS RENAME SETREPLICATION SETOWNER SETPERMISSION SETTIMES RENEWDELEGATIONTOKEN CANCELDELEGATIONTOKEN HTTP POST HTTP DELETE APPEND DELETE
  12. 12. File status
  13. 13. Read File
  14. 14. Append Append to a File
  15. 15. Append Example of use
  16. 16. Thanks Christophe Marchal | Software Architect @toff63

×