Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

DATA ACCESS HIVE PIG HCatalog Big Data Analytics with Hadoop

447,297 views

Published on

DATA ACCESS
HIVE PIG HCatalog
• Data Warehouse
infrastructure that provides
data summarization and ad
hoc querying on top of
Hadoop
- MapReduce for execution
- HDFS for storage
• MetaStore
- Table/Partitions properties
- Thrift API : Current clients
in PHP (Web Interface),
Python interface to Hive,
Java (Query Engine and
CLI)
- Metadata stored in any
SQL backend
• Hive Query Language
- Basic SQL : Select, From,
Join, Group By
- Equi-Join, Multi-Table
Insert, Multi-Group-By
- Batch query
• A high-level data-flow language
and execution framework for
parallel computation
• Pig Latin
- Data processing language
- Compiler to translate to
MapReduce
• Simple to write MapReduce
program
• Abstracts you from specific detail
• Focus on data processing
• Data flow
• Data manipulation
28 Big Data Analytics with Hadoop
• Table and storage
management service for
data created using Apache
Hadoop
• Providing a shared schema
and data type mechanism
• Providing a table
abstraction so that users
need not be concerned
with where or how their
data is stored.
• Providing interoperability
across data processing
tools such as Pig, Map
Reduce and Hive
• HCatalog DDL (Data
Definition Language)
• HCatalog CLI (Common
Language Interface)

Published in: Technology, Education, Business
  • Earn $500 for taking a 1 hour paid survey! read more... ■■■ https://tinyurl.com/realmoneystreams2019
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Want to preview some of our plans? You can get 50 Woodworking Plans and a 440-Page "The Art of Woodworking" Book... Absolutely FREE ★★★ http://ishbv.com/tedsplans/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Want to preview some of our plans? You can get 50 Woodworking Plans and a 440-Page "The Art of Woodworking" Book... Absolutely FREE ●●● http://tinyurl.com/yy9yh8fu
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Sex in your area for one night is there tinyurl.com/hotsexinarea Copy and paste link in your browser to visit a site)
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • And if you've ever taken a girl home, gotten hot and heavy and then felt embarrassment and PANIC when you take off your pants and see the look of DISAPPOINTMENT on her face, you need to go check this out right now. ◆◆◆ https://tinyurl.com/ydaetwbk
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

×