Questions tagged [hive]

Hive is a data warehouse system for Hadoop that facilitates easy data summarization, ad-hoc queries, and the analysis of large datasets stored in Hadoop compatible file systems. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL.

Filter by
Sorted by
Tagged with
0
votes
1answer
126 views

Hive / Impala best practice code structuring

Coming from a DWH-background I am used to putting subqueries almost everywhere in my queries. On a Hadoop project (with Hive version 1.1.0 on Cloudera), I noticed we can forego subqueries in some ...
1
vote
0answers
5 views

Hive Bring Table to Local Driver for Fast Debugging on CLI

I have a large Hive table on HDFS. Every time I query it, it runs a map reduce job which is slow. For debugging my code on CLI, I want a fast query. Is it possible to sample rows of the table and ...
1
vote
0answers
972 views

cannot access hive from spark [closed]

I am trying to install a hadoop + spark + hive cluster. I am using hadoop 3.1.2, spark 2.4.5 (scala 2.11 prebuilt with user-provided hadoop) and hive 2.3.3 (also tried 3.1.2 with the exact same ...
2
votes
0answers
91 views

Can i access data on one spark cluster from another? [closed]

What if I want to sample a table over hive on Spark-cluster-1, but I'm logged in on Spark-cluster-2? ...
0
votes
1answer
106 views

How to store subset of columns from a csv file?

I need to create a table in hive (or Impala) by reading from a csv file (named file.csv), ...
3
votes
0answers
50 views

Hive query to get all rows where a particular column value lies in a particular precentile

I am trying to filter my rows in hive table named id_counts based on percentile values. Lets considers the following table. ...
1
vote
0answers
221 views

Mapreduce jobs not working in hive

I was trying to execute a hive query: select name, count(*) from amazon where review != NULL group by name ; Number of reduce tasks not specified. Estimated ...
2
votes
2answers
2k views

COUNT on External Table in HIVE [closed]

I have been trying around the EXTERNAL table concepts in HIVE ...
0
votes
1answer
949 views

Find outliers in Hive - SemanticException

I'm trying to find some outliers on my database using HIVE and I'm using Standard Deviation technique. My query is: ...
1
vote
1answer
5k views

how to disable query from beeline results

I am occuring a strange hive-client beeline behavior. In the outputed file with query results there is also a queary at the ...
2
votes
1answer
3k views

How to extract a column that has the highest value within row in Hive?

I have a table, more or less in the following format col1 col2 col3 ... col100 val1 val2 val3 ... val100 Where val* are doubles. Is there a way to extract for ...
1
vote
1answer
3k views

How to paste string and int from map to an array in hive?

I am trying to paste a string and int from map in Hive ...
-2
votes
1answer
4k views

getting error:-Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable [closed]

I am trying to connect to hive from java but getting error. I searched in google but not got any helpfull solution. I have added all jars also. The code is:- ...
0
votes
3answers
896 views

How to proceed 2 executions in 1 step in hive?

I am wondering if there is a way to proceed 2 exectuions in 1 step in hive. For example: SELECT * FROM TABLE1 SELECT * FROM TABLE2 ; Do this in one window, and ...
4
votes
1answer
2k views

Hive: How to calculate the Kendall coefficient of correlation of a pair of a numeric columns in the group?

In this wiki page there is a function corr() that calculates the Pearson coefficient of correlation, but my question is that: is there any function in Hive that ...