Questions tagged [apache-hadoop]
Hadoop is an Apache open-source project that provides software for reliable and scalable distributed computing. The project itself includes a variety of other complementary additions.
119
questions
2
votes
0
answers
103
views
Using Shark with Apache Spark [closed]
Have anyone used Shark as repository from resulting datasets from Apache Spark?
I'm starting some tests with Spark and read about this database tecnology. Have anyone been using it?
- 151
2
votes
0
answers
837
views
Pig Rank function not generating rank in output [closed]
I am facing this bizarre issue while using Apache Pig rank utility. I am executing the following code:
...
- 406
8
votes
4
answers
1k
views
Data science and MapReduce programming model of Hadoop
What are the different classes of data science problems that can be solved using mapreduce programming model?
- 369
3
votes
1
answer
112
views
Pig latin code error [duplicate]
While running the below pig script I am getting error in line4: If it is GROUP then I am getting error. If I change from GROUP ...
- 243
4
votes
2
answers
97
views
Pig script code error?
While running the below pig script I am getting an error in line4:
If it is GROUP then I am getting error.
If I change from 'GROUP' TO 'group' in line4, then the script is running.
What is the ...
- 243
3
votes
2
answers
12k
views
Hadoop Resource Manager Won't Start [closed]
I am a relatively new user to Hadoop (using version 2.4.1). I installed hadoop on my first node without a hitch, but I can't seem to get the Resource Manager to start on my second node.
I cleared up ...
- 91
3
votes
2
answers
1k
views
Cloudera QuickStart VM Error [closed]
I have installed cloudera CDH5 Quick start VM on VM player. When I login through HUE in the first page I am the following error
“Potential misconfiguration detected. Fix and restart Hue.”
How to ...
- 243
2
votes
3
answers
2k
views
Cannot make user directory on a new CDH5 installation (Hadoop)
I download and installed CDH 5 package succesfully on a single linux node in pseudo-distributed Mode on my CentOS 6.5
Starting Hadoop and verifying it is Working Properly as in this link
I ...
- 243
7
votes
1
answer
1k
views
Linear Regression in R Mapreduce(RHadoop)
I m new to RHadoop and also to RMR...
I had an requirement to write a Mapreduce Job in R Mapreduce. I have Tried writing but While executing this it gives an Error.
Tring to read the file from hdfs
...
- 101
2
votes
1
answer
860
views
Difference Between Hadoop Mapreduce(Java) and RHadoop mapreduce
I understand Hadoop MapReduce and its features but I am confused about R MapReduce.
One difference I have read is that R utilizes maximum RAM. So do perform parallel processing integrated R with ...
- 101
34
votes
5
answers
13k
views
What are the use cases for Apache Spark vs Hadoop
With Hadoop 2.0 and YARN Hadoop is supposedly no longer tied only map-reduce solutions. With that advancement, what are the use cases for Apache Spark vs Hadoop considering both sit atop of HDFS? I've ...
- 521
12
votes
3
answers
3k
views
Does Amazon RedShift replace Hadoop for ~1XTB data?
There is plenty of hype surrounding Hadoop and its eco-system. However, in practice, where many data sets are in the terabyte range, is it not more reasonable to use Amazon RedShift for querying ...
- 253
40
votes
10
answers
21k
views
Do I need to learn Hadoop to be a Data Scientist?
An aspiring data scientist here. I don't know anything about Hadoop, but as I have been reading about Data Science and Big Data, I see a lot of talk about Hadoop. Is it absolutely necessary to learn ...
- 591
3
votes
1
answer
874
views
HBase connector - Thrift or REST
There seem to be at least 2 ways to connect to HBase from external application, with language other then Java (i.e. Python):
HBase Thrift API
HBase Stargate (REST API)
Does anyone know which one ...
- 1,071
8
votes
1
answer
75
views
Cascaded Error in Apache Storm
Going through the presentation and material of Summingbird by Twitter, one of the reasons that is mentioned for using Storm and Hadoop clusters together in Summingbird is that processing through Storm ...
- 347
12
votes
2
answers
7k
views
Tradeoffs between Storm and Hadoop (MapReduce)
Can someone kindly tell me about the trade-offs involved when choosing between Storm and MapReduce in Hadoop Cluster for data processing? Of course, aside from the obvious one, that Hadoop (processing ...
- 347
11
votes
3
answers
704
views
Can map-reduce algorithms written for MongoDB be ported to Hadoop later?
In our company, we have a MongoDB database containing a lot of unstructured data, on which we need to run map-reduce algorithms to generate reports and other analyses. We have two approaches to select ...
- 1,393
11
votes
3
answers
1k
views
What are R's memory constraints?
In reviewing “Applied Predictive Modeling" a reviewer states:
One critique I have of statistical learning (SL) pedagogy is the
absence of computation performance considerations in the evaluation ...
- 1,922
15
votes
2
answers
4k
views
What is the difference between Hadoop and noSQL
I heard about many tools / frameworks for helping people to process their data (big data environment).
One is called Hadoop and the other is the noSQL concept. What is the difference in point of ...
- 295