hdfs

I have a use case where I want to upload big gzipped text data files (~ 60 GB) on HDFS. My code below is taking about 2 hours to upload these files…

I have read in HBase Book that it's now possible to delete rows from table. How does it exactly works? Is this data moved somewhere for later…

Thanks for taking interest in my question. Before I begin, I'd like to let you know that I'm very new to Hadoop & HBase. So far, I find Hadoop…

Basically whole question is in the title. I'm wondering if it's possible to append to file located on HDFS from multiple computers simultaneously?…

I have bunch of zip files of CSVs, that I want to create Hive table from. I'm trying to figure out what's the best way to do so. Unzip the files,…

What is the maximum number of files and directories allowed in a HDFS (hadoop) directory?

I'm currently learning hadoop and I'm trying to setup a single node test as defined in…

I am looking for some performance review on Hadoop (300-600 boxes cluster), especially on the following aspects: High concurrent read & write…

Now i am trying to export data from a db table, and write it into hdfs. And the problem is: will the name node become bottleneck? and how is the…

Looking at running a HDFS based storage cluster, and looking at a simple method of using the Mountable HDFS system through the Cloudera release. The…

I have written a class(es) that writes and reads from hdfs. Given certain conditions that are occurring when these classes are instantiated they…

I'm trying to write/read data from a hdfs server using the thrift libraries in PHP. The thrift server is started on the hadoop machine and when I'm…

I am a newbie to Hadoop. I have managed to develop a simple Map/Reduce application that works fine in 'pseudo distributed mode'.I want to test that…

Hi, I'm consider to use HDFS as horizontal scaling file storage sistem for our client video hosting service. My main concern that HDFS wasn't…

In my application the reducer saves all the part files in HDFS but I want only the reducer will write the part files whose sizes are not…

I'm using Eucalyptus and am considering putting hdfs and hbase on our node controllers. Would running hbase on some of our instances improve…

I'm trying to modify the hdfs script so that it still functions although not located in $HADOOP_HOME/bin anymore, but when I execute the modified…

I am using Hadoop example program WordCount to process large set of small files/web pages (cca. 2-3 kB). Since this is far away from optimal file…

Hello, I'm planning to use HBase without MapReduce (only with HDFS), I'm wondering if it makes sense to use multicpu/multicore machines to run only…

I am trying to execute a Hadoop job on a remote hadoop cluster. Below is my code. Configuration conf = new Configuration();…