Questions tagged [hive]
Hive is a data warehouse system for Hadoop that facilitates easy data summarization, ad-hoc queries, and the analysis of large datasets stored in Hadoop compatible file systems. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL.
14 questions
0
votes
1
answer
550
views
Hive / Impala best practice code structuring
Coming from a DWH-background I am used to putting subqueries almost everywhere in my queries. On a Hadoop project (with Hive version 1.1.0 on Cloudera), I noticed we can forego subqueries in some ...
- 103
1
vote
0
answers
7
views
Hive Bring Table to Local Driver for Fast Debugging on CLI
I have a large Hive table on HDFS. Every time I query it, it runs a map reduce job which is slow.
For debugging my code on CLI, I want a fast query. Is it possible to sample rows of the table and ...
- 11
1
vote
0
answers
1k
views
cannot access hive from spark [closed]
I am trying to install a hadoop + spark + hive cluster.
I am using hadoop 3.1.2, spark 2.4.5 (scala 2.11 prebuilt with user-provided hadoop) and hive 2.3.3 (also tried 3.1.2 with the exact same ...
- 11
2
votes
0
answers
174
views
Can i access data on one spark cluster from another? [closed]
What if I want to sample a table over hive on Spark-cluster-1, but I'm logged in on Spark-cluster-2?
...
- 121
1
vote
1
answer
167
views
How to store subset of columns from a csv file?
I need to create a table in hive (or Impala) by reading from a csv file (named file.csv), ...
3
votes
0
answers
484
views
Hive query to get all rows where a particular column value lies in a particular precentile
I am trying to filter my rows in hive table named id_counts based on percentile values.
Lets considers the following table.
...
- 411
2
votes
2
answers
3k
views
COUNT on External Table in HIVE [closed]
I have been trying around the EXTERNAL table concepts in HIVE
...
- 133
0
votes
1
answer
1k
views
Find outliers in Hive - SemanticException
I'm trying to find some outliers on my database using HIVE and I'm using Standard Deviation technique. My query is:
...
- 173
1
vote
2
answers
6k
views
how to disable query from beeline results
I am occuring a strange hive-client beeline behavior.
In the outputed file with query results there is also a queary at the ...
- 235
2
votes
1
answer
4k
views
How to extract a column that has the highest value within row in Hive?
I have a table, more or less in the following format
col1 col2 col3 ... col100
val1 val2 val3 ... val100
Where val* are doubles. Is there a way to extract for ...
- 235
1
vote
1
answer
3k
views
How to paste string and int from map to an array in hive?
I am trying to paste a string and int from map in Hive ...
- 235
-2
votes
1
answer
4k
views
getting error:-Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable [closed]
I am trying to connect to hive from java but getting error. I searched in google but not got any helpfull solution. I have added all jars also.
The code is:-
...
- 165
0
votes
3
answers
2k
views
How to proceed 2 executions in 1 step in hive?
I am wondering if there is a way to proceed 2 exectuions in 1 step in hive.
For example:
SELECT * FROM TABLE1
SELECT * FROM TABLE2
;
Do this in one window, and ...
- 235
4
votes
1
answer
2k
views
Hive: How to calculate the Kendall coefficient of correlation of a pair of a numeric columns in the group?
In this wiki page there is a function corr() that calculates the Pearson coefficient of correlation, but my question is that: is there any function in Hive that ...
- 235