Publisher: O'Reilly Media Released: September 2011 Pages: 224
This guide is an ideal learning tool and reference for Apache Pig, the open source engine for executing parallel data flows on Hadoop. With Pig, you can batch-process data without having to create a full-fledged application—making it easy for you to experiment with new datasets. Programming Pig introduces new users to Pig, and provides experienced users with comprehensive coverage on key features such as the Pig Latin scripting language, the Grunt shell, and User Defined Functions (UDFs) for extending Pig. If you need to analyze terabytes of data, this book shows you how to do it efficiently with Pig. - Delve into Pig’s data model, including scalar and complex data types
- Write Pig Latin scripts to sort, group, join, project, and filter your data
- Use Grunt to work with the Hadoop Distributed File System (HDFS)
- Build complex data processing pipelines with Pig’s macros and modularity features
- Embed Pig Latin in Python for iterative processing and other advanced tasks
- Create your own load and store functions to handle data formats and storage mechanisms
- Get performance tips for running scripts on Hadoop clusters in less time
|
-
Chapter 1 Introduction -
What Is Pig? -
Pig’s History -
Chapter 2 Installing and Running Pig -
Downloading and Installing Pig -
Running Pig -
Chapter 3 Grunt -
Entering Pig Latin Scripts in Grunt -
HDFS Commands in Grunt -
Controlling Pig from Grunt -
Chapter 4 Pig’s Data Model -
Types -
Schemas -
Chapter 5 Introduction to Pig Latin -
Preliminary Matters -
Input and Output -
Relational Operations -
User Defined Functions -
Chapter 6 Advanced Pig Latin -
Advanced Relational Operations -
Integrating Pig with Legacy Code and MapReduce -
Nonlinear Data Flows -
Controlling Execution -
Pig Latin Preprocessor -
Chapter 7 Developing and Testing Pig Latin Scripts -
Development Tools -
Testing Your Scripts with PigUnit -
Chapter 8 Making Pig Fly -
Writing Your Scripts to Perform Well -
Writing Your UDF to Perform -
Tune Pig and Hadoop for Your Job -
Using Compression in Intermediate Results -
Data Layout Optimization -
Bad Record Handling -
Chapter 9 Embedding Pig Latin in Python -
Compile -
Bind -
Run -
Utility Methods -
Chapter 10 Writing Evaluation and Filter Functions -
Writing an Evaluation Function in Java -
Algebraic Interface -
Accumulator Interface -
Python UDFs -
Writing Filter Functions -
Chapter 11 Writing Load and Store Functions -
Load Functions -
Store Functions -
Chapter 12 Pig and Other Members of the Hadoop Community -
Pig and Hive -
Cascading -
NoSQL Databases -
Metadata in Hadoop -
Appendix Built-in User Defined Functions and Piggybank -
Built-in UDFs -
Piggybank -
Appendix Overview of Hadoop -
MapReduce -
Hadoop Distributed File System -
Colophon |
- Title:
- Programming Pig
- By:
- Alan Gates
- Publisher:
- O'Reilly Media
- Formats:
-
- Print
- Ebook
- Safari Books Online
- Print:
- October 2011
- Ebook:
- September 2011
- Pages:
- 224
- Print ISBN:
- 978-1-4493-0264-1
- | ISBN 10:
- 1-4493-0264-5
- Ebook ISBN:
- 978-1-4493-0303-7
- | ISBN 10:
- 1-4493-0303-X
|
-
Alan Gates Alan is an original member of the engineering team that took Pig from a Yahoo! Labs research project to a successful Apache open source project. In this role he oversaw the implementation of the language, including programming interfaces and the overall design. He has presented Pig at numerous conferences and user groups, universities, and companies. Alan is a member of the Apache Software Foundation and a co-founder of Hortonworks. He has a BS in Mathematics from Oregon State University and a MA in Theology from Fuller Theological Seminary. View Alan Gates's full profile page. |
Colophon The animal on the cover of Programming Pig is a domestic pig (Sus scrofa domesticus or Sus domesticus). While the larger pig family is naturally distributed in Africa, Asia, and Europe, domesticated pigs can now be found in nearly every part of the world that people inhabit. In fact, some pigs have been specifically bred to best equip them for various climates; for example, heavily coated varieties have been bred in colder climates. People have brought pigs with them almost wherever they go for good reason: in addition to their primary use as a source of food, humans have been using the skin, bones, and hair of pigs to make various tools and implements for millennia. Domestic pigs are directly descended from wild boars, and evidence suggests that there have been three distinct domestication events; the first took place in the Tigris River Basin as early as 13,000 BC, the second in China, and the third in Europe, though the last likely occurred after Europeans were introduced to domestic pigs from the Middle East. Despite the long history, however, taxonomists do not agree as to the proper classification for the domestic pig. Some believe that domestic pigs remain simply a subspecies of the larger pig group including the wild boar (Sus scrofa), while others insist that they belong to a species all their own. In either case, there are several hundred breeds of domestic pig, each with its own particular characteristics. Perhaps because of their long history and prominent role in human society, and their tendency toward social behavior, domestic pigs have appeared in film, literature, and other cultural media with regularity. Examples include “The Three Little Pigs,” Miss Piggy, and Porky the Pig. Additionally, domestic pigs have recently been recognized for their intelligence and their ability to be trained (similar to dogs), and have consequently begun to be treated as pets. |
|
Description
|
Table of Contents
|
Product Details
|
About the Author
|
Colophon
|
 |
|
|
|
|
|
Recommended for You
|
Recently Viewed
|
|
|
By Matthew A. Russell
January 2011
By Chris Walker
February 2012
Ebook: $15.99
Print & Ebook: $21.99
Print: $19.99
By Gabe Zichermann
May 2011
|
Customer Reviews
3/27/2012 (0 of 1 customers found this review helpful) 4.0I am always looking good from Oreilly By Polineni from India About Me Developer, Sys Admin - Easy to understand
- Helpful examples
- Well-written
- Expert
- Intermediate
- Novice
- Student
2/15/2012 4.0Great book, clear and well written By Walter from Turin, Italy - Accurate
- Concise
- Easy to understand
- Well-written
8/12/2011 (1 of 1 customers found this review helpful) 3.0Review of Programming Pig by Alan Gates By Levon from Long Island, NY 7/26/2011 (1 of 4 customers found this review helpful) 5.0eBook for a fraction of the price?? By Ulrich from Switzerland 6/4/2011 (1 of 2 customers found this review helpful) 4.0Indispensable if you use Pig By Dean Wampler from Chicago, IL - Accurate
- Concise
- Easy to understand
- Helpful examples
- Well-written
|
|
|
