hadoop

Hi i am trying to run the simple Hive Jdbc client program i am getting FileNotFoundException. But when i try with local file path it's working fine.…

I am using PhantomJS to dynamically generate 10 large images of websites at a time in each request. Therefore it is important that I cache these…

My mapper emits 'uniq key' - 'very large value' pair. My reducer doesn't know the key is unique. Thus, reducer waits all the mappers are completed.…

I am using eclipse to write mapreduce program. I imported hadoop library (hadoop-0.13.0-core.jar) I imported Mapper class import…

Sorry for cross-posting this on the hadoop user mailing list and here, but this is getting an urgent matter for me. My problem is as follows: I have…

Our organization has hundreds of batch jobs that run overnight. Many of these jobs require 2, 3, 4 hours to complete; some even require up to 7…

I'm an intermediate Hibernate user. I am trying to get some traction with Hadoop at my company. I'm using a library called spring-hadoop…

How could i combine with map/reduce these two files: File1. Data. 1 name:foo1,position:bar1 2 name:foo2,position:bar2 3 name:foo3,position:bar3 4…

I wanted to know if anyone had success running the CDH3 Cloudera release of Hadoop and HBase on the latest version of Ubuntu - natty 11.04..? I have…

I have 6 servers and each contains a lot of logs. I'd like to put these logs to hadoop fs via rsync. Now I'm using fuse and rsync writes directly to…

I'd like to copy whole local directory with some subdirectories and files to HDFS. HDFS already contains the root directory and some subdirectories…

I'm new to hadoop and is in learning phase. As per Hadoop Definitve guide, i have set up my hadoop in pseudo distributed mode and everything was…

I would like to implement a parallel-for in on hadoop. Basically parallel-for receives a sub-skeleton (it could be a function like map() ) and an…

Is there a way to keep the duplicates in a collected set in Hive, or simulate the sort of aggregate collection that Hive provides using some other…

I've recently started working with Hadoop and have been learning how to write MapReduce jobs. All over the internet, I can find examples and…

I have a use case where I want to process data and generate output of fixed size , say 1 GB i.e. each map-reduce job output should be 1 Gb. Does…

I have a use case where I want to upload big gzipped text data files (~ 60 GB) on HDFS. My code below is taking about 2 hours to upload these files…

I just learned about the collect_set() function in Hive, and I started a job on a development 3-node cluster. I only have about 10 GB to process.…

I am not sure if this question is correct, but I am asking to resolve the doubts I have. For Machine Learning/Data Mining , we need to learn about…

Trying to install hbase, but the word on the street is that if I don't use a hadoop from the 20-append branch, I'll lose data. This tutorial says…