Questions tagged [apache-pig]

Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization which enables them to handle very large data sets.

Filter by
Sorted by
Tagged with
0 votes
1 answer
947 views

Convert date into number - Apache PIG

Imagine that I've a field called date in this format: "yyyy-mm-dd" and I want to convert to number like "yyymmdd". For that I'm trying to use this: ...
João_testeSW's user avatar
2 votes
2 answers
595 views

unable to parse XML in pig

I have a XML file has this structure (not exactly a tree though) ...
sc3339's user avatar
  • 21
1 vote
0 answers
261 views

Pig is not able to read the complete data

I am trying to load a huge dataset of around 3.4 TB with approximately 1.4 million files in Pig on Amazon EMR. The operations on the data are simple (JOIN and STORE), but the data is not getting ...
shanky_thebearer's user avatar
0 votes
1 answer
5k views

Extract company names/job titles from free text

I have a complete Hadoop platform with HDFS, MR, Hive, PIG, Hbase, etc., Python, R, Java. All data sets have a large size. The data set A, describing the jobs of people working in a company, is ...
user17241's user avatar
  • 151
2 votes
1 answer
2k views

Error when using MAX in Apache Pig (Hadoop)

I am trying to calculate maximum values for different groups in a relation in Pig. The relation has three columns patientid, featureid and featurevalue (all int). I group the relation based on ...
Akshay Gupta's user avatar
1 vote
0 answers
216 views

Hadoop/Pig Aggregate Data

I am working on a project with two data sets. A time vs. speed data set (let's call it traffic), and a time vs. weather data set (called weather). I am looking to find a correlation between these ...
BigDataDude's user avatar
2 votes
0 answers
840 views

Pig Rank function not generating rank in output [closed]

I am facing this bizarre issue while using Apache Pig rank utility. I am executing the following code: ...
Ankit's user avatar
  • 406