Introduction to Pig
•Download as PPTX, PDF•
0 likes•623 views
Pig is a platform for analyzing large datasets that runs on Hadoop. It uses a language called Pig Latin to describe data flows and transformations. Pig Latin scripts allow users to express data analysis workflows like joins and groups. While similar to SQL, Pig Latin describes how data flows rather than producing an inside-out query. Pig makes Hadoop data analysis easier through a simple language and execution on parallel hardware.
Report
Share
Report
Share
Recommended
MongoDB PhillyDB database throw down
This document provides an overview of MongoDB, including what it is, its key features and how it works. MongoDB is a document-based database where data is stored in BSON format similar to JSON. It uses a master-slave replication model for high availability and has built-in sharding for horizontal scaling. MongoDB is an open-source database that is supported by 10gen and has a large community supporting a variety of programming languages.
Php workshop L03 superglobals
This document discusses PHP web programming basics including includes, GET, POST, and sessions. It explains that includes allow inserting one PHP file into another, GET passes URL parameters in an array, POST passes form data in an array, and sessions store user information across multiple pages using session variables. The document provides code examples and compares GET and POST, noting that POST is more secure but both require security efforts.
Php workshop L04 database
This document provides an overview of basic MySQL concepts and commands for working with databases in PHP, including connecting to a database, creating databases and tables, inserting, selecting, updating and deleting data, and using where clauses. Key points covered include what a database is, benefits over files, what MySQL is and how it works, connecting and selecting databases in PHP code, writing queries, and common SQL commands like create, insert, select, update and delete.
04 web optimization
This document discusses various techniques for optimizing website performance, including: reducing page generation time through caching and opcode caching; minimizing round-trip times by leveraging browser caching, combining files, and parallel downloads; decreasing response sizes by gzipping files, image optimization, and cookieless domains; and tools for analyzing performance like XDebug. The goal is to share experiences helping to increase traffic to websites with average resources.
Rest services caching
The document discusses caching strategies for REST services using HTTP. It explains the different states a resource representation can be in (up-to-date, fresh, stale) and caching directives like Cache-Control headers, expiration dates, and ETags that control caching and cache validation. Optimistic locking using ETags, If-Match, and If-None-Match is described as a way to handle concurrent data changes in a RESTful manner without transactions.
Ship WordPress Projects Like a Boss
The document discusses best practices for shipping WordPress sites, including using frameworks like Genesis and themes with parent-child functionality for easier updates, maintaining staging environments for testing new features, employing version control systems, performing regular backups, and utilizing WordPress maintenance tools to manage updates and backups. The overall message is about adopting a healthy workflow that avoids overcomplicating processes and makes maintenance a habit.
WordPress Migrations 101 - WordCamp Orlando
This document provides instructions for migrating a WordPress site to a new hosting provider. It recommends migrating for reasons like site growth, slow performance, or hosting problems. The main steps outlined are: transferring files and database, reconfiguring WordPress settings, testing the migration, and changing nameservers. Plugins are suggested to simplify the process, but manual migration steps are also covered, including exporting/importing the database and files, editing wp-config.php, and testing before changing domain nameservers. Tips are included like planning downtime, setting a maintenance page, using remote MySQL, and communicating with hosting support.
Install Word Press with xampp
This document provides instructions for installing WordPress using Xampp on Windows.
1) Install Xampp to get Apache, MySQL, PHP and PhpMyAdmin. Create a database called "wordpress" and user "wordpress" in PhpMyAdmin.
2) Extract the WordPress files to Xampp's htdocs folder. Rename the wp-config sample file and enter the database details.
3) Run the WordPress install script from the browser to complete the installation. The blog is now ready to use.
Recommended
MongoDB PhillyDB database throw down
This document provides an overview of MongoDB, including what it is, its key features and how it works. MongoDB is a document-based database where data is stored in BSON format similar to JSON. It uses a master-slave replication model for high availability and has built-in sharding for horizontal scaling. MongoDB is an open-source database that is supported by 10gen and has a large community supporting a variety of programming languages.
Php workshop L03 superglobals
This document discusses PHP web programming basics including includes, GET, POST, and sessions. It explains that includes allow inserting one PHP file into another, GET passes URL parameters in an array, POST passes form data in an array, and sessions store user information across multiple pages using session variables. The document provides code examples and compares GET and POST, noting that POST is more secure but both require security efforts.
Php workshop L04 database
This document provides an overview of basic MySQL concepts and commands for working with databases in PHP, including connecting to a database, creating databases and tables, inserting, selecting, updating and deleting data, and using where clauses. Key points covered include what a database is, benefits over files, what MySQL is and how it works, connecting and selecting databases in PHP code, writing queries, and common SQL commands like create, insert, select, update and delete.
04 web optimization
This document discusses various techniques for optimizing website performance, including: reducing page generation time through caching and opcode caching; minimizing round-trip times by leveraging browser caching, combining files, and parallel downloads; decreasing response sizes by gzipping files, image optimization, and cookieless domains; and tools for analyzing performance like XDebug. The goal is to share experiences helping to increase traffic to websites with average resources.
Rest services caching
The document discusses caching strategies for REST services using HTTP. It explains the different states a resource representation can be in (up-to-date, fresh, stale) and caching directives like Cache-Control headers, expiration dates, and ETags that control caching and cache validation. Optimistic locking using ETags, If-Match, and If-None-Match is described as a way to handle concurrent data changes in a RESTful manner without transactions.
Ship WordPress Projects Like a Boss
The document discusses best practices for shipping WordPress sites, including using frameworks like Genesis and themes with parent-child functionality for easier updates, maintaining staging environments for testing new features, employing version control systems, performing regular backups, and utilizing WordPress maintenance tools to manage updates and backups. The overall message is about adopting a healthy workflow that avoids overcomplicating processes and makes maintenance a habit.
WordPress Migrations 101 - WordCamp Orlando
This document provides instructions for migrating a WordPress site to a new hosting provider. It recommends migrating for reasons like site growth, slow performance, or hosting problems. The main steps outlined are: transferring files and database, reconfiguring WordPress settings, testing the migration, and changing nameservers. Plugins are suggested to simplify the process, but manual migration steps are also covered, including exporting/importing the database and files, editing wp-config.php, and testing before changing domain nameservers. Tips are included like planning downtime, setting a maintenance page, using remote MySQL, and communicating with hosting support.
Install Word Press with xampp
This document provides instructions for installing WordPress using Xampp on Windows.
1) Install Xampp to get Apache, MySQL, PHP and PhpMyAdmin. Create a database called "wordpress" and user "wordpress" in PhpMyAdmin.
2) Extract the WordPress files to Xampp's htdocs folder. Rename the wp-config sample file and enter the database details.
3) Run the WordPress install script from the browser to complete the installation. The blog is now ready to use.
Drupal Installation & Configuration
This document provides instructions for installing and configuring Drupal on a Windows system. It outlines the necessary software requirements including a web server, database, and PHP version. It then describes downloading and extracting the Drupal files, creating a database and user, and configuring Drupal by filling in site information and enabling modules. Finally, it recommends starting to add content and provides examples of existing Drupal websites.
Ui perf
Optimizing web page performance involves minimizing round trips, request sizes, and payload sizes. This includes leveraging browser caching, combining and minifying assets, gzip compression, and optimizing images. Developer tools can identify optimization opportunities like unused resources and suggest techniques for faster loading and rendering.
초보자를 위한 분산 캐시 이야기
This document discusses using caching to improve performance for web applications. It provides three key points:
1. Cache stores data to serve future requests faster by avoiding accessing the database. It is commonly used for things like login information, page content, and API responses.
2. There are different cache architectures like memcached and Redis that support storing data in-memory for fast retrieval. Factors like data size, update frequency, and consistency requirements determine the appropriate caching strategy.
3. Real-world examples show how companies like Facebook, Twitter, and Wonga use caching extensively to handle high volumes of traffic and database requests. Caching is critical to scaling applications in a cost-effective way.
[drupalday2017] - Drupal come frontend che consuma servizi: HTTP Client Manager
Proviamo a gettare un nuovo standard per la gestione delle sorgenti e per la presentazione di dati nelle istanze Drupal che consumano servizi. Perchè ne abbiamo bisogno e come i Guzzle Service Description possono salvarci la vita.
di Adriano Cori
WordPress Need For Speed
WordPress performance can be improved by optimizing rendering speed and processing speed. Rendering speed focuses on front-end optimizations like minimizing page size through image optimization and concatenating/minifying scripts and stylesheets. Processing speed focuses on back-end optimizations like caching, using a CDN, adding expire headers, and leveraging reverse proxies and caching plugins. Nginx can be configured for caching, gzip compression, and load balancing to improve WordPress performance.
Less and faster – Cache tips for WordPress developers
Otto Kekäläinen, the code-loving CEO of Seravo held a webinar on May 12, 2020, that focused on the cache: what should a WordPress developer know and which are the best practices to follow?
Introduction to performance tuning perl web applications
This document provides an introduction to performance tuning Perl web applications. It discusses identifying performance bottlenecks, benchmarking tools like ab and httperf to measure performance, profiling tools like Devel::NYTProf to find where time is spent, common causes of slowness like inefficient database queries and lack of caching, and approaches for improvement like query optimization, caching, and infrastructure changes. The key messages are that performance issues are best identified through measurement and profiling, database queries are often the main culprit, and caching can help but adds complexity.
Wordpress optimization
This document provides tips for optimizing and speeding up a WordPress site. It recommends optimizing themes by using well-coded, lightweight themes without unnecessary code. Images and CSS should be optimized using techniques like sprites and compression. Plugins should be selectively chosen and unnecessary plugins deactivated. Caching can be improved using plugins like W3 Total Cache as well as browser caching in .htaccess. The database can be optimized using tools to repair and optimize it, and caching like Memcache. Server-side optimizations include using opcode caching. Overall, reducing HTTP requests and file sizes are keys to site speed.
High Performance Drupal
Presentation from BADCamp 2009 on high performance Drupal: how to make your website fast and scalable.
Php
This document provides an introduction and overview of PHP (Hypertext Preprocessor), a popular server-side scripting language used for web development. It discusses what PHP is, why it should be used, common tasks it can perform, required syntax and tools. Specific PHP functions and concepts explained include echo, isset(), loops, conditional statements, and functions for connecting to and querying MySQL databases like mysqli_connect() and mysqli_query(). Overall statistics on PHP usage are also provided.
Search in WordPress - how it works and howto customize it
WordPress search customization is a topic we at Seravo get asked about on a frequent basis. There are many different ways to customize the search, and customers understandably want to learn the best practices. The search can be customized quite easily with small changes on PHP code level, and by utilizing MariaDB database’s built-in search functionality. You can also choose a more robust way to do this, and build a new ElasticSearch server just for your case.
These slides are from the webinar on January 14th, 2021: https://seravo.com/blog/webinar-search-function-and-how-to-customize-it/
PHP BASIC PRESENTATION
PHP is a widely-used open source scripting language that can be used to create dynamic web pages. PHP code is executed on the server and generates HTML that is sent to the browser. PHP files have a .php extension and can contain HTML, CSS, JavaScript, and PHP code. PHP can connect to databases, collect form data, generate dynamic content, and more. It runs on many platforms and is compatible with popular web servers. Many large sites like Facebook use PHP due to its capabilities and flexibility.
Translating WordPress themes and plugins WordCamp Bhopal 2015
The document discusses translating WordPress themes and plugins into different languages. It explains that WordPress uses the GNU gettext localization framework, which uses POT, PO, and MO files. It provides tips for making themes translatable, such as wrapping text in translation functions and including a POT file. Lastly, it discusses how to set up a translated theme in WordPress by defining the language code in wp-config.php.
Debugging Drupal - How to Debug your Drupal Application
A presentation on how to debug your Drupal code. Drupal is a very powerful system and the same time it is also a very complex system. Only somebody really good at Drupal and PHP would be able to master debugging Drupal. Here is a presentation on how to equip yourself to debugging Drupal.
High Performance - Joomla!Days NL 2009 #jd09nl
This document provides an overview of optimizing the performance of Joomla! websites. It discusses basic principles like using content delivery networks and combining files. It recommends preparing Joomla! with tools like Firebug and enabling caching. Specific optimizations for templates and content are covered, like image resizing and subdomain delivery. Hosting configuration tips include MySQL optimization and using a CDN. The document uses a case study example and concludes with thanks.
Improving PHP Application Performance with APC
This document discusses how to improve PHP application performance using the APC opcode cache. Installing APC yields a performance gain with default settings by caching opcodes for faster execution. Further optimization includes increasing the shared memory size and disabling file stat checks, which requires a server restart when files change. Caching variables like database query results with APC can also boost performance. In conclusion, APC is an effective way to enhance PHP application speed with only minor configuration changes required.
PHP and PDFLib
This document discusses using PHP and PDFlib to generate PDF documents. It covers installing PDFlib, the differences between the free and commercial versions, basic capabilities like merging PDFs and filling forms, and the basic structure needed in PHP code to instantiate a PDFlib object, add content, and output the generated PDF either as a download or saving to disk.
Introduction to Thrift
Apache Thrift is a framework for defining and implementing service interfaces and generating code to facilitate remote procedure calls across multiple languages. It handles networking, serialization, and other low-level details, allowing developers to focus on implementing service logic. Services are defined using an interface definition language (IDL) that specifies data types, service methods, and exceptions. The Thrift compiler then generates code to implement clients and servers for the defined services in various languages. On the server side, developers implement handlers that define the logic for each service method. The generated code provides a simple way to deploy the service by connecting the various networking and serialization layers. Many large companies use Thrift for building scalable distributed systems across multiple languages and platforms.
Migrating a Site Quickly with SSH and WP-CLI (It's not as scary as you think!)
This document provides instructions for migrating a WordPress site using SSH and WP-CLI. It discusses connecting to servers via SSH, using WP-CLI commands like wp db export and wp db import to backup and restore the database, and scp to transfer files between servers. Key steps include exporting the database with wp db export, archiving files with tar, copying files to the new server with scp, importing the database with wp db import, and searching and replacing URLs with wp search-replace.
I Can Haz More Performanz?
This document summarizes Andy Melichar's presentation at WordCamp Omaha about optimizing WordPress performance. He began with introductions and explained his background in web development. He then discussed common performance issues hosting companies see and why performance matters for user experience and revenue. Andy outlined key areas to optimize like WordPress plugins/themes, web server configuration, and using content delivery networks. He demonstrated the significant impact of enabling caching, compression, browser caching and switching to Nginx on a test site's performance. In the end, Andy emphasized there are many options to try and the WordPress community can help with configurations.
Lesson 6 - power point presentation 3
Licensing and merchandising allows companies to pay fees to use brands, logos, and intellectual property on products. The licensor grants these licenses, while the licensee pays fees to use the property. Licensed products can feature league, team, or individual names and images. Licensing agreements apply to many product types but licensors must select products that suit their brand image. Licensed merchandise is available through various retail channels beyond just event venues.
Chapter 3 - Presentation 1
This document defines various types of business entities including corporations, shareholders, stocks, dividends, C-corporations, S-corporations, LLCs, non-profits, and cooperatives. It explains that a corporation is a legally defined business owned by shareholders who hold shares of stock. It also outlines some key advantages like limited liability for owners, but notes corporations are more expensive to set up and maintain than sole proprietorships or partnerships. The document provides brief descriptions of characteristics for each type of business entity.
More Related Content
What's hot
Drupal Installation & Configuration
This document provides instructions for installing and configuring Drupal on a Windows system. It outlines the necessary software requirements including a web server, database, and PHP version. It then describes downloading and extracting the Drupal files, creating a database and user, and configuring Drupal by filling in site information and enabling modules. Finally, it recommends starting to add content and provides examples of existing Drupal websites.
Ui perf
Optimizing web page performance involves minimizing round trips, request sizes, and payload sizes. This includes leveraging browser caching, combining and minifying assets, gzip compression, and optimizing images. Developer tools can identify optimization opportunities like unused resources and suggest techniques for faster loading and rendering.
초보자를 위한 분산 캐시 이야기
This document discusses using caching to improve performance for web applications. It provides three key points:
1. Cache stores data to serve future requests faster by avoiding accessing the database. It is commonly used for things like login information, page content, and API responses.
2. There are different cache architectures like memcached and Redis that support storing data in-memory for fast retrieval. Factors like data size, update frequency, and consistency requirements determine the appropriate caching strategy.
3. Real-world examples show how companies like Facebook, Twitter, and Wonga use caching extensively to handle high volumes of traffic and database requests. Caching is critical to scaling applications in a cost-effective way.
[drupalday2017] - Drupal come frontend che consuma servizi: HTTP Client Manager
Proviamo a gettare un nuovo standard per la gestione delle sorgenti e per la presentazione di dati nelle istanze Drupal che consumano servizi. Perchè ne abbiamo bisogno e come i Guzzle Service Description possono salvarci la vita.
di Adriano Cori
WordPress Need For Speed
WordPress performance can be improved by optimizing rendering speed and processing speed. Rendering speed focuses on front-end optimizations like minimizing page size through image optimization and concatenating/minifying scripts and stylesheets. Processing speed focuses on back-end optimizations like caching, using a CDN, adding expire headers, and leveraging reverse proxies and caching plugins. Nginx can be configured for caching, gzip compression, and load balancing to improve WordPress performance.
Less and faster – Cache tips for WordPress developers
Otto Kekäläinen, the code-loving CEO of Seravo held a webinar on May 12, 2020, that focused on the cache: what should a WordPress developer know and which are the best practices to follow?
Introduction to performance tuning perl web applications
This document provides an introduction to performance tuning Perl web applications. It discusses identifying performance bottlenecks, benchmarking tools like ab and httperf to measure performance, profiling tools like Devel::NYTProf to find where time is spent, common causes of slowness like inefficient database queries and lack of caching, and approaches for improvement like query optimization, caching, and infrastructure changes. The key messages are that performance issues are best identified through measurement and profiling, database queries are often the main culprit, and caching can help but adds complexity.
Wordpress optimization
This document provides tips for optimizing and speeding up a WordPress site. It recommends optimizing themes by using well-coded, lightweight themes without unnecessary code. Images and CSS should be optimized using techniques like sprites and compression. Plugins should be selectively chosen and unnecessary plugins deactivated. Caching can be improved using plugins like W3 Total Cache as well as browser caching in .htaccess. The database can be optimized using tools to repair and optimize it, and caching like Memcache. Server-side optimizations include using opcode caching. Overall, reducing HTTP requests and file sizes are keys to site speed.
High Performance Drupal
Presentation from BADCamp 2009 on high performance Drupal: how to make your website fast and scalable.
Php
This document provides an introduction and overview of PHP (Hypertext Preprocessor), a popular server-side scripting language used for web development. It discusses what PHP is, why it should be used, common tasks it can perform, required syntax and tools. Specific PHP functions and concepts explained include echo, isset(), loops, conditional statements, and functions for connecting to and querying MySQL databases like mysqli_connect() and mysqli_query(). Overall statistics on PHP usage are also provided.
Search in WordPress - how it works and howto customize it
WordPress search customization is a topic we at Seravo get asked about on a frequent basis. There are many different ways to customize the search, and customers understandably want to learn the best practices. The search can be customized quite easily with small changes on PHP code level, and by utilizing MariaDB database’s built-in search functionality. You can also choose a more robust way to do this, and build a new ElasticSearch server just for your case.
These slides are from the webinar on January 14th, 2021: https://seravo.com/blog/webinar-search-function-and-how-to-customize-it/
PHP BASIC PRESENTATION
PHP is a widely-used open source scripting language that can be used to create dynamic web pages. PHP code is executed on the server and generates HTML that is sent to the browser. PHP files have a .php extension and can contain HTML, CSS, JavaScript, and PHP code. PHP can connect to databases, collect form data, generate dynamic content, and more. It runs on many platforms and is compatible with popular web servers. Many large sites like Facebook use PHP due to its capabilities and flexibility.
Translating WordPress themes and plugins WordCamp Bhopal 2015
The document discusses translating WordPress themes and plugins into different languages. It explains that WordPress uses the GNU gettext localization framework, which uses POT, PO, and MO files. It provides tips for making themes translatable, such as wrapping text in translation functions and including a POT file. Lastly, it discusses how to set up a translated theme in WordPress by defining the language code in wp-config.php.
Debugging Drupal - How to Debug your Drupal Application
A presentation on how to debug your Drupal code. Drupal is a very powerful system and the same time it is also a very complex system. Only somebody really good at Drupal and PHP would be able to master debugging Drupal. Here is a presentation on how to equip yourself to debugging Drupal.
High Performance - Joomla!Days NL 2009 #jd09nl
This document provides an overview of optimizing the performance of Joomla! websites. It discusses basic principles like using content delivery networks and combining files. It recommends preparing Joomla! with tools like Firebug and enabling caching. Specific optimizations for templates and content are covered, like image resizing and subdomain delivery. Hosting configuration tips include MySQL optimization and using a CDN. The document uses a case study example and concludes with thanks.
Improving PHP Application Performance with APC
This document discusses how to improve PHP application performance using the APC opcode cache. Installing APC yields a performance gain with default settings by caching opcodes for faster execution. Further optimization includes increasing the shared memory size and disabling file stat checks, which requires a server restart when files change. Caching variables like database query results with APC can also boost performance. In conclusion, APC is an effective way to enhance PHP application speed with only minor configuration changes required.
PHP and PDFLib
This document discusses using PHP and PDFlib to generate PDF documents. It covers installing PDFlib, the differences between the free and commercial versions, basic capabilities like merging PDFs and filling forms, and the basic structure needed in PHP code to instantiate a PDFlib object, add content, and output the generated PDF either as a download or saving to disk.
Introduction to Thrift
Apache Thrift is a framework for defining and implementing service interfaces and generating code to facilitate remote procedure calls across multiple languages. It handles networking, serialization, and other low-level details, allowing developers to focus on implementing service logic. Services are defined using an interface definition language (IDL) that specifies data types, service methods, and exceptions. The Thrift compiler then generates code to implement clients and servers for the defined services in various languages. On the server side, developers implement handlers that define the logic for each service method. The generated code provides a simple way to deploy the service by connecting the various networking and serialization layers. Many large companies use Thrift for building scalable distributed systems across multiple languages and platforms.
Migrating a Site Quickly with SSH and WP-CLI (It's not as scary as you think!)
This document provides instructions for migrating a WordPress site using SSH and WP-CLI. It discusses connecting to servers via SSH, using WP-CLI commands like wp db export and wp db import to backup and restore the database, and scp to transfer files between servers. Key steps include exporting the database with wp db export, archiving files with tar, copying files to the new server with scp, importing the database with wp db import, and searching and replacing URLs with wp search-replace.
I Can Haz More Performanz?
This document summarizes Andy Melichar's presentation at WordCamp Omaha about optimizing WordPress performance. He began with introductions and explained his background in web development. He then discussed common performance issues hosting companies see and why performance matters for user experience and revenue. Andy outlined key areas to optimize like WordPress plugins/themes, web server configuration, and using content delivery networks. He demonstrated the significant impact of enabling caching, compression, browser caching and switching to Nginx on a test site's performance. In the end, Andy emphasized there are many options to try and the WordPress community can help with configurations.
What's hot (20)
[drupalday2017] - Drupal come frontend che consuma servizi: HTTP Client Manager
[drupalday2017] - Drupal come frontend che consuma servizi: HTTP Client Manager
Less and faster – Cache tips for WordPress developers
Less and faster – Cache tips for WordPress developers
Introduction to performance tuning perl web applications
Introduction to performance tuning perl web applications
Search in WordPress - how it works and howto customize it
Search in WordPress - how it works and howto customize it
Translating WordPress themes and plugins WordCamp Bhopal 2015
Translating WordPress themes and plugins WordCamp Bhopal 2015
Debugging Drupal - How to Debug your Drupal Application
Debugging Drupal - How to Debug your Drupal Application
Migrating a Site Quickly with SSH and WP-CLI (It's not as scary as you think!)
Migrating a Site Quickly with SSH and WP-CLI (It's not as scary as you think!)
Viewers also liked
Lesson 6 - power point presentation 3
Licensing and merchandising allows companies to pay fees to use brands, logos, and intellectual property on products. The licensor grants these licenses, while the licensee pays fees to use the property. Licensed products can feature league, team, or individual names and images. Licensing agreements apply to many product types but licensors must select products that suit their brand image. Licensed merchandise is available through various retail channels beyond just event venues.
Chapter 3 - Presentation 1
This document defines various types of business entities including corporations, shareholders, stocks, dividends, C-corporations, S-corporations, LLCs, non-profits, and cooperatives. It explains that a corporation is a legally defined business owned by shareholders who hold shares of stock. It also outlines some key advantages like limited liability for owners, but notes corporations are more expensive to set up and maintain than sole proprietorships or partnerships. The document provides brief descriptions of characteristics for each type of business entity.
Lesson 6 - power point presentation 4
Endorsements involve celebrities or public figures promoting and representing a company's product or service to help sell the product. Companies choose endorsers who have a successful career and positive image that matches the demographic profile of their target customers, believing the association between the endorser and product will help boost sales. Image is a key factor in deciding whether to renew endorsement deals with athletes.
Lesson 6 - power point presentation 2
This document discusses 3 types of brands: 1) Manufacturer brands which are owned by the producer and can use multi-product, multi-branding, or co-branding strategies. 2) Intermediary brands which are developed by wholesalers, retailers or catalog houses. 3) Generic brands which represent a general product category without a company name. It also provides tips for developing a brand name such as offering a benefit, being simple, different, positive, reflecting an image, and being unregistered.
Novo anexo iii_2013-11-14_10_17_52
Este documento é uma declaração de cumprimento dos requisitos de habilitação para o Pregão Presencial no 198/2013 da Prefeitura Municipal de Campinas para contratação de serviços de manutenção de áreas verdes. A empresa declara cumprir os requisitos através dos documentos apresentados e está ciente das penalidades caso não cumpra.
Gestion de desechos y reciclaje
Este documento trata sobre la gestión de desechos y el reciclaje. Explica que el compostaje es una herramienta barata que convierte los desechos orgánicos en abono natural rico en nutrientes a través de un proceso de descomposición natural. Detalla las tres fases del proceso de compostaje y los factores como la humedad, el pH y la oxigenación que influyen en él. Finalmente, discute los beneficios del compostaje y diferentes tipos de residuos que se pueden utilizar para hacer compost.
Guide to camera work and editing techniques
This document discusses various techniques used in media studies including continuity editing, montage editing, the 180 degree rule, shot reverse shot, cut aways, and graphic matches which are editing techniques used to transition between shots and scenes.
Sales Sheet
Set #1 contains 10 English greeting cards for $25, Set #2 contains 10 English greeting cards for $25 with Set #3 containing Spanish greeting cards for $12.50 per set of 5 cards. Additionally, all greeting cards and art from the gift baskets can be purchased individually or in sets ranging in price from $12.50 to $40.
Adriana esther rodriguez gafaro hardware.ppt.
El documento describe los diferentes componentes hardware de una computadora, incluyendo el teclado, mouse, impresora, cámara web, cornetas, monitor, disco duro, memorias USB, CD-ROM, DVD, tarjeta madre, tarjeta de video, tarjeta de sonido, memoria RAM y microprocesador. También explica cómo funcionan estos componentes y sus diferentes tipos.
Best iphone App for Video Resumes- Jobma
The document describes a new mobile application called Jobma that allows job seekers to search for jobs on their mobile device based on their skills, qualifications, and location. The application allows users to create a profile, upload a video resume, search and apply for jobs, and share their resume on social media. It aims to help job seekers worldwide by making the job search process more convenient and accessible regardless of location.
Realnumbersystemnotes
This document provides tips for creating effective PowerPoint slides by avoiding common pitfalls. It addresses how to structure slides with outlines and bullet points, use fonts and colors that are easy to read, include graphs and charts to visualize data, check for spelling and grammar errors, and conclude with a clear summary and invitation for questions. Key recommendations include using a large font size, limiting each slide to 4-5 main points in point form, employing high-contrast colors, including descriptive titles on all visuals, and proofreading for errors.
Cameren battley journey to career
West Virginia University was founded in 1867 as a land-grant university under the Morrill Act, which provided land grants to states to establish colleges teaching agriculture, engineering, and mechanic arts. There are 184 academic programs across 15 colleges at WVU. Undergraduate tuition is around $3,444 per year for in-state students and $10,140 for out-of-state students, with additional fees. Popular majors of interest include computer science and welding. Notable alumnus Tavon Austin attended WVU and later played in the NFL.
Seabolt, Michael L. Jr.
Michael Seabolt has over 30 years of experience in welding, foundry operations, and safety compliance. He has held roles as a millwright, welding supervisor, foundry superintendent, and safety specialist across several companies. Seabolt has a wide range of skills including welding, welding inspection, Six Sigma processes, lean manufacturing, and OSHA compliance. He has a proven track record of lowering scrap rates and improving safety.
Ministério firma parcerias para desenvolver 19 novos produtos de Saúde
O Ministério da Saúde anunciou novos investimentos na indústria brasileira e a ampliação da lista de equipamentos, medicamentos e materiais ofertados no Sistema Único de Saúde (SUS) em 2014. Instituições públicas e privadas produzirão equipamentos para problemas cardíacos
e renais, além de materiais para oftalmologia, oncologia, transplante e diagnóstico. Saiba mais, no Blog da Saúde: http://goo.gl/sYmtB9
el maravilloso mundo de los cuentos
El documento presenta un resumen de tres cuentos infantiles clásicos: Peter Pan, Blancanieves y los siete enanitos, y La Cenicienta. Describe las tramas principales de cada cuento, incluyendo los personajes y eventos clave como Peter Pan llevando a los niños al País de Nunca Jamás, la reina malvada envenenando a Blancanieves, y Cenicienta asistiendo al baile del príncipe gracias a la ayuda de un hada.
Chapter 2 presentation - 1
Economics is concerned with how people satisfy their demand for goods and services when supply is limited. It studies the flow of goods and services between people and how different economic systems allocate scarce resources. The main types of economic systems are market economies, command economies, and mixed economies, which combine elements of both. Market economies rely on supply and demand while command economies involve centralized government control over production, distribution, and prices.
Chapter 2 presentation - 2
In a market economy, suppliers produce goods and services and set prices based on what consumers are willing to pay. Prices respond to consumer demand, and transactions occur voluntarily when both parties benefit. A supply curve graphs the quantity suppliers will provide at different prices, while a demand curve shows what quantity consumers will buy. When graphed together, they determine the equilibrium price where supply and demand intersect. Competition between suppliers drives prices down and innovation up, while competition among consumers pushes prices up. Profit is an incentive for entrepreneurs to take business risks. International trade involves exporting goods and services to foreign consumers or importing them from abroad. Governments regulate trade with barriers like tariffs and quotas. Different currencies are used in various countries.
Viewers also liked (20)
Ministério firma parcerias para desenvolver 19 novos produtos de Saúde
Ministério firma parcerias para desenvolver 19 novos produtos de Saúde
Similar to Introduction to Pig
Introduction to Apache Pig
Pig is a platform for analyzing large datasets that uses a high-level language to express data analysis programs. It compiles programs into MapReduce jobs that can run in parallel on a Hadoop cluster. Pig provides built-in functions for common tasks and allows users to define their own custom functions (UDFs). Programs can be run locally or on a Hadoop cluster by placing commands in a script or Grunt shell.
Get your teeth into Plack
Plack is an interface for web request handlers that simplifies the interface and makes code more portable. It allows developers to focus on request handling rather than API specifics. Plack addresses issues with traditional CGI and mod_perl approaches by running handlers outside of servers in a standardized way. This encapsulation improves performance, debugging, and code reuse across different server implementations. Plack includes modules for common tasks like routing, middleware, and running PSGI applications on various web servers.
January 2011 HUG: Pig Presentation
1) Pig 0.8 focuses on usability, integration, performance, and backwards compatibility with 0.7.
2) It allows UDFs to be written in scripting languages like Jython and provides better statistics and integration with Hadoop job history.
3) Other new features include invoking static Java functions as UDFs, improved HBase integration, and casting relations to scalars.
Apache Hadoop India Summit 2011 talk "Pig - Making Hadoop Easy" by Alan Gate
This document summarizes Alan F. Gates' presentation on Pig, an open source tool for analyzing large datasets. Pig provides a high-level language called Pig Latin for expressing data analysis processes, which are executed as MapReduce jobs on a Hadoop cluster. Key points include:
- Pig Latin scripts are compiled into MapReduce jobs for parallel execution on Hadoop
- Pig supports common operations like load, filter, group, join, and store and integrates with user-defined functions
- Pig is used by many companies for large-scale data processing tasks like analyzing web server logs and building user behavior models
03 pig intro
Apache Pig is a platform for analyzing large datasets that consists of a high-level data flow language called Pig Latin and an infrastructure for evaluating Pig Latin programs. Pig Latin scripts are compiled into sequences of MapReduce jobs that can run on Hadoop for large scale parallel processing. Pig aims to provide a simpler programming model than raw MapReduce while still allowing for optimization and parallelization of queries. Pig programs can be run interactively using the Grunt shell or by specifying a Pig Latin script to execute.
Build your own discovery index of scholary e-resources
Providing discovery systems for eresourcesis essential for library services today.
Commercial search engine indices have been a widely used solution in recent years. In
contrast, running an own discovery service is undoubtedly a challenging task but promises
full control over data processing, enrichment, performance and quality. Building an own
aggregated index of eresourcesincludes gathering the right mix of data sources, clearing
licensing issues, and negotiating data availability. Technically, these threads are resumed by
data harvesters, filters and workflow orchestration tools.
A Brief Introduce to WSGI
WSGI is a specification for connecting HTTP servers to web applications through a common interface. It defines an application as a callable object that receives environment variables from the server and returns a response. WSGI also supports middleware as callable objects that can process requests and responses between the server and application.
Apache Pig
This document provides an overview of Apache Pig and Pig Latin for querying large datasets. It discusses why Pig was created due to limitations in SQL for big data, how Pig scripts are written in Pig Latin using a simple syntax, and how PigLatin scripts are compiled into MapReduce jobs and executed on Hadoop clusters. Advanced topics covered include user-defined functions in PigLatin for custom data processing and sharing functions through Piggy Bank.
node.js: Javascript's in your backend
The document is a presentation about Node.js, a JavaScript runtime built on Chrome's V8 JavaScript engine. It discusses how Node.js uses an event-driven, non-blocking I/O model that makes it particularly suited for real-time web applications and I/O-intensive applications compared to traditional threaded server models. It provides examples of Node.js features like asynchronous I/O, event loops, modules and the npm package manager.
Hadoop basics
Owen O'Malley is an architect at Yahoo who works full-time on Hadoop. He discusses Hadoop's origins, how it addresses the problem of scaling applications to large datasets, and its key components including HDFS and MapReduce. Yahoo uses Hadoop extensively, including for building its Webmap and running experiments on large datasets.
NoSQL, Hadoop, Cascading June 2010
This document discusses NoSQL, Hadoop, and Cascading. It begins by explaining why NoSQL databases were created, as not all data fits relational schemas and some problems are not relational. It then describes different types of NoSQL databases like key-value stores, document databases, and graph databases. The document outlines how Hadoop uses MapReduce to process large datasets in parallel. It introduces Cascading as a way to define complex multi-step data processing flows in Hadoop more easily than raw MapReduce. The document provides an example of how to use Cascading to analyze user engagement data across millions of records.
NodeJS
This document provides an introduction and overview of Node.js. It discusses the brief history of server-side JavaScript, how Node.js was created to enable easy push capabilities for websites, and its growth in popularity in the following years. The document also covers key aspects of Node.js like non-blocking I/O, event loops, streams, modules, and dependency management with NPM. Popular frameworks like Express, Hapi, and tools/concepts like IoT, desktop apps, and real-time apps are also mentioned.
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
This talk describes how open source Hue was built in order to provide a better Hadoop User Experience. The underlying technical details of its architecture, the lessons learned and how it integrates with Impala, Search and Spark under the cover will be explained.
The presentation continues with real life analytics business use cases. It will show how data can be easily imported into the cluster and then queried interactively with SQL or through a visual search dashboard. All through your Web Browser or your own custom Web application!
This talk aims at organizations trying to put a friendly “face” on Hadoop and get productive. Anybody looking at being more effective with Hadoop will also learn best practices and how to quickly get ramped up on the main data scenarios. Hue can be integrated with existing Hadoop deployments with minimal changes/disturbances. We cover details on how Hue interacts with the ecosystem and leverages the existing authentication and security model of your company.
To sum-up, attendees of this talk will learn how Hadoop can be made more accessible and why Hue is the ideal gateway for using it more efficiently or being the starting point of your own Big Data Web application.
Plugin-based software design with Ruby and RubyGems
Talk at RubyKaigi 2015.
Plugin architecture is known as a technique that brings extensibility to a program. Ruby has good language features for plugins. RubyGems.org is an excellent platform for plugin distribution. However, creating plugin architecture is not as easy as writing code without it: plugin loader, packaging, loosely-coupled API, and performance. Loading two versions of a gem is a unsolved challenge that is solved in Java on the other hand.
I have designed some open-source software such as Fluentd and Embulk. They provide most of functions by plugins. I will talk about their plugin-based architecture.
"Xapi-lang For declarative code generation" By James Nelson
Xapi-lang is a Java parser enhanced with an XML-like syntax that can be used for code generation, templating, and creating domain-specific languages. It works by parsing code into an abstract syntax tree and then applying visitors to analyze and transform the AST to produce output. Examples shown include class templating, API generation from templates, and UI component generation. The document also discusses best practices for code generation and outlines plans for rebuilding the GWT toolchain to support GWT 3 and J2CL. It promotes a new company, Vertispan, for GWT support and consulting and introduces another project called We The Internet for building tools to improve political systems using distributed democracy.
Experiences using CouchDB inside Microsoft's Azure team
Co-presented with Will Perry (@willpe). Real-world experiences using CouchDB inside Microsoft, and also how to get started with CouchDB on Microsoft Azure.
Hadoop content
This 40-hour course provides training to become a Hadoop developer. It covers Hadoop and big data fundamentals, Hadoop file systems, administering Hadoop clusters, importing and exporting data with Sqoop, processing data using Hive, Pig, and MapReduce, the YARN architecture, NoSQL programming with MongoDB, and reporting tools. The course includes hands-on exercises, datasets, installation support, interview preparation, and guidance from instructors with over 8 years of experience working with Hadoop.
Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...
Michael Sun presented on CBS Interactive's use of Hadoop for web analytics processing. Some key points:
- CBS Interactive processes over 1 billion web logs daily from hundreds of websites on a Hadoop cluster with over 1PB of storage.
- They developed an ETL framework called Lumberjack in Python for extracting, transforming, and loading data from web logs into Hadoop and databases.
- Lumberjack uses streaming, filters, and schemas to parse, clean, lookup dimensions, and sessionize web logs before loading into a data warehouse for reporting and analytics.
- Migrating to Hadoop provided significant benefits including reduced processing time, fault tolerance, scalability, and cost effectiveness compared to their
Matt Gauger - Lamp vs. the world - MKE PHP Users Group - December 14, 2010
This document summarizes a talk comparing PHP and Rails web development frameworks. It discusses the evolution of web servers from Apache to more scalable options like Nginx. Nginx acts as a reverse proxy, passing requests to application servers like FastCGI that execute code and return responses. This represents a shift from simply serving static files to building full-featured web applications using the MVC pattern. Node.js is presented as the next step, allowing JavaScript to be used for server-side development in an event-driven, non-blocking way.
Drupal in 30 Minutes
A brief intro summarising 'Hello Drupal' introducing the basic terms used in Drupal and how to install it.
This was the talk given at Drupal Camp Scotland 25 May 2012.
Similar to Introduction to Pig (20)
Apache Hadoop India Summit 2011 talk "Pig - Making Hadoop Easy" by Alan Gate
Apache Hadoop India Summit 2011 talk "Pig - Making Hadoop Easy" by Alan Gate
Build your own discovery index of scholary e-resources
Build your own discovery index of scholary e-resources
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Plugin-based software design with Ruby and RubyGems
Plugin-based software design with Ruby and RubyGems
"Xapi-lang For declarative code generation" By James Nelson
"Xapi-lang For declarative code generation" By James Nelson
Experiences using CouchDB inside Microsoft's Azure team
Experiences using CouchDB inside Microsoft's Azure team
Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...
Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...
Matt Gauger - Lamp vs. the world - MKE PHP Users Group - December 14, 2010
Matt Gauger - Lamp vs. the world - MKE PHP Users Group - December 14, 2010
Recently uploaded
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
OpenID AuthZEN Interop Read Out - Authorization
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Digital Marketing Trends in 2024 | Guide for Staying Ahead
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Recently uploaded (20)
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Introduction to Pig
- 2. Why are we talking about Pig? Originally developed at Yahoo! now an apache project Engine for executing data flows in parallel on Hadoop Includes a language called Pig Latin for expressing data flows Easy to learn and extensible Open source
- 3. What is a data flow language Allows us to describe how data should be loaded, read, processed and stored. Can be simple linear flows e.g. word count Complex workflows that include joins
- 4. Is it like SQL? Pig Latin does look a bit like SQL e.g. Join, Group By But SQL is declarative In Pig you describe how the data flows SQL you end up producing an inside out query whereas with Pig you describe a pipeline.
- 5. SQL example SELECT CustomerName,TotalOrders, PostCode FROM Customers c INNER JOIN ( SELECT CustomerId, count(OrderId) as FROM Orders GROUP BY CustomerId ) as t on t.CustomerId = c.CustomerId
- 6. Same Query in Pig orders = load ‘Orders’ as (CustomerId, OrderId); grouped = group orders by CustomerId; total = foreach grouped generate group, COUNT(OrderId) customer = load ‘Customers’ as (CustomerId, CustomerName) result = join total by group, customer by customerId dump result;
- 7. Installing Pig http://pig.apache.org/docs/r0.11.1/ Requires Java Hadoop (it does have a built in version of hadoop which is currently v0.20.2.) Requires Cygwin on windows
- 8. What do you get? Pig Grunt Shell Piggy Bank
- 9. Basic Pig Operators FOREACH FILTER GROUP BY ORDER BY UNION CROSS
- 10. Same Query in Pig orders = load ‘Orders’ as (CustomerId, OrderId); grouped = group orders by CustomerId; total = foreach grouped generate group, COUNT(OrderId) customer = load ‘Customers’ as (CustomerId, CustomerName) result = join total by group, customer by customerId dump result;
- 12. How does Pig become a MR job?
- 13. Advantages of Pig Easy to learn Can achieve a lot with a small amount of code E.g. Join example Well written scripts can be easy to read and easy to maintain Has a local mode for testing scripts Has a unit testing framework
- 14. Limitations of Pig Unit testing High level – often need to drop down into custom UDFs If you are proficient at C# or F# sometimes this can be easier to test e.g. Streaming unit allows unit testing. Still doesn’t play nicely in a windows environment