1
$\begingroup$

I was trying to execute a hive query:

select name, count(*) 
from amazon 
where review != NULL 
group by name ;

Number of reduce tasks not specified. Estimated from input data size: 1

In order to change the average load for a reducer (in bytes):

  set hive.exec.reducers.bytes.per.reducer=<number>

In order to limit the maximum number of reducers:

  set hive.exec.reducers.max=<number>

In order to set a constant number of reducers:

  set mapreduce.job.reduces=<number>

Starting Job = job_1564815666993_0001, Tracking URL = http://aamir-VirtualBox:8088/proxy/application_1564815666993_0001/

Kill Command = /usr/local/hadoop/bin/hadoop job  -kill job_1564815666993_0001

It works only till here. The table is all right but it is just stuck and doesn't work . Can anyone help me please?

$\endgroup$
3
  • 1
    $\begingroup$ any other information you can provide? $\endgroup$
    – oW_
    Jul 31 '19 at 16:12
  • $\begingroup$ Yes , i have 5000 rows and all the reducers settings are working on default , in the end I have to kill the command and it specifies $\endgroup$ Aug 3 '19 at 7:30
  • $\begingroup$ Ended Job = job_1564815666993_0001 with errors Error during job, obtaining debugging information... FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask $\endgroup$ Aug 3 '19 at 7:30

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.