All Questions
Tagged with pig or apache-pig
7 questions
0
votes
1
answer
952
views
Convert date into number - Apache PIG
Imagine that I've a field called date in this format: "yyyy-mm-dd" and I want to convert to number like "yyymmdd". For that I'm trying to use this:
...
- 179
2
votes
2
answers
599
views
1
vote
0
answers
265
views
Pig is not able to read the complete data
I am trying to load a huge dataset of around 3.4 TB with approximately 1.4 million files in Pig on Amazon EMR.
The operations on the data are simple (JOIN and STORE), but the data is not getting ...
- 373
0
votes
1
answer
5k
views
Extract company names/job titles from free text
I have a complete Hadoop platform with HDFS, MR, Hive, PIG, Hbase, etc., Python, R, Java. All data sets have a large size.
The data set A, describing the jobs of people working in a company, is ...
- 151
2
votes
1
answer
2k
views
Error when using MAX in Apache Pig (Hadoop)
I am trying to calculate maximum values for different groups in a relation in Pig. The relation has three columns patientid, featureid and featurevalue (all int).
I group the relation based on ...
- 131
1
vote
0
answers
216
views
Hadoop/Pig Aggregate Data
I am working on a project with two data sets. A time vs. speed data set (let's call it traffic), and a time vs. weather data set (called weather).
I am looking to find a correlation between these ...
- 91
2
votes
0
answers
843
views
Pig Rank function not generating rank in output [closed]
I am facing this bizarre issue while using Apache Pig rank utility. I am executing the following code:
...
- 406