Best unofficial Apache Server developers community |
Home >> discussions >> HDFS users
HDFS users Recent threads
| Threads | Replies | First post | Last post | |
|---|---|---|---|---|
|
Hadoop HA By: Martinus Martinus Hi, Is there any hadoop HA distribution out there? Thanks.
|
10 | May 22 2012 01:25 |
May 25 2012 03:54 |
|
|
datanode hang up after socket connection reset By: Maoke hi, we encountered the trouble that a datanode is hung up when a
socket exception connection reset happened with it. since then on, the
hbase running over the hdfs cannot have access to the data tables (but
-ROOT- and .META. are not affected),…
|
0 | May 24 2012 22:00 |
May 24 2012 22:00 |
|
|
Accessing secure kerberized HDFS from Java code By: IGZ Nick I am trying to access some file in a secure HDFS cluster through java
like this: private static Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(conf); However, this fails on the
FileSystem.get() line with this exception: …
|
1 | May 16 2012 13:59 |
May 24 2012 16:31 |
|
|
setting up https in hdfs-site.xml By: Marc Sturm Hi All, I would like to setup https so a user is required to
authenticate to browse the filesystem and look at dfshealth. Right
now, we are just starting to get familiar with hadoop hdfs and MR on a
pseudo distributed environment. My…
|
0 | May 24 2012 15:32 |
May 24 2012 15:32 |
|
|
New bie questions re: namenode and masters By: Chao Huang Hello experts, I'm new to hdfs/hadoop. After reading the hdfs
documents, I'm getting confused by the differences between a namenode
and a master server. It's my understanding that the namenode is
responsible for managing metadata, while the…
|
2 | May 24 2012 06:30 |
May 24 2012 08:22 |
|
|
Storing millions of small files By: Brendan cheng Hi, I read HDFS architecture doc and it said HDFS is tuned for at
storing large file, typically gigabyte to terabytes.What is the
downsize of storing million of small files like <10MB? or what
setting of HDFS is suitable for storing small…
|
7 | May 22 2012 04:40 |
May 23 2012 05:14 |
|
|
FW: Storing millions of small files By: Jayaseelan E -----Original Message----- From: Keith Wiley [mailto:kwi###
@keithwiley.com] Sent: Tuesday, May 22, 2012 9:57 PM To: hdfs-us###
@hadoop.apache.org Subject: Re: Storing millions of small files In
addition to the responses already provided, there…
|
0 | May 23 2012 04:30 |
May 23 2012 04:30 |
|
|
namenode directory disappear after machines restart By: Brendan cheng Hi, I'm not sure if there is a setting to avoid the Namenode removed
after hosting machine of Namenode restart.I found that after
successfully installed single node pseudo distributed hadoop following
from your website, the name node dir…
|
5 | May 21 2012 22:22 |
May 22 2012 08:55 |
|
|
webhdfs is inaccessible By: Brendan cheng Hi, I followed single-node setup and successfully installed. HDFS
run on 50070 website. but I can't curl it curl -i -X PUT
"http://192.168.56.101:50070/webhdfs/v1/user/brendan/22m.png?op=CREATE
"HTTP/1.1 405 HTTP method PUT is not supported by…
|
1 | May 21 2012 23:25 |
May 21 2012 23:28 |
|
|
a question about controlling roles (read, write) of data node By: Kyungyong Lee Hello, I would like to ask if I can do the following. Assuming that
I have a datanode, i.e., dn1, which already contains some useful
blocks. Here, I do not want to save new data blocks to the datanode,
but I still want to use the blocks that…
|
2 | May 20 2012 14:08 |
May 21 2012 09:04 |
|
|
Change in behavior of public FileStatus[] globStatus(Path pathPattern, PathFilter filter) By: Subroto Hi, I was running a simple unit test for verifying the behavior of
a/m API. The UT is some thing like this: public void
testResolve_SimpleGlob() throws IOException { File folder =
_tempFolder.newFolder("folder"); File file1 =…
|
3 | May 18 2012 03:35 |
May 19 2012 12:32 |
|
|
libhdfs By: Devi Kumarappan I am currently using CDUH3 distibution and I could nto find libhdfs
in the distribution. Where could I get the libhdfs.so and the header
file ? Thanks, Devi
|
3 | May 16 2012 16:31 |
May 18 2012 15:24 |
|
|
Unable to start NN after rack assignment attempt By: Terry Healy Running Apache 1.0.2 ~12 datanodes Ran FSCK / -> OK, before,
everything running as expected. Started trying to use a script to
assign nodes to racks, which required several stop-dfs.sh /
start-dfs.sh cycles. (with some stop-all.sh /…
|
2 | May 18 2012 08:52 |
May 18 2012 11:35 |
|
|
Clarification about missing replicas calculation By: suja Hi , I need to know when the missing replicas in fsck is
displayed From Hadoop Definitive guide 3 we can see "Missing
Replicas Threse are blocks with no replicas anywhere in the
cluster." page number 346 Chap 10 Administrating…
|
0 | May 17 2012 00:13 |
May 17 2012 00:13 |
|
|
hdfsConnectAsUser vs hdfsConnectAsUserNewInstance By: Evgeny Turnaev Hello all, Is there any docs on libhdfs online? I googled but did
not found. Currently i am trying to figure out difference between
hdfsConnectAsUserNewInstance (*NewInstance) calls and
hdfsConnectAsUser It is said in hdfs.h: …
|
0 | May 16 2012 04:49 |
May 16 2012 04:49 |
|
|
FSCK / -move and -delete FAIL By: Terry Healy Running 1.0.2 on cluster with 10 datanodes. After running stop-all.sh
and start-all.sh following the addition of a new datanode, the NN
stays in SafeMode. hadoop fsck / reports several MISSING and CORRUPT
blocks, but I have not been able to…
|
1 | May 15 2012 15:19 |
May 15 2012 20:20 |
|
|
Hadoop hdfs / Hive backup solution, open-sourced by TripAdvisor By: Thomas Palka (TripAdvisor) At TripAdvisor we use Hadoop and Hive for our warehousing needs.
Processing the daily logs takes a long time, and re-processing them
would be prohibitive. As we couldn't find a backup solution, we put
one together. We open sourced it in hopes…
|
0 | May 15 2012 15:50 |
May 15 2012 15:50 |
|
|
append feature in 1.0.X - current stable version By: Ext-fabio.almeida Hello All, Does someone knows if all issues from append
functionality have been fixed on Hadoop latest stable version
(1.0.X)??? I mean, I had a lot of problems with append on hadoop
0.20.2. I noticed that one of the guarantees of the append…
|
1 | May 14 2012 17:26 |
May 14 2012 23:35 |
|
|
Unable to restart 1.0.2 NN, DFS By: Terry Healy Running Apache 1.0.2 Primary NN on Ubuntu 11.10, 8 datanodes. When I
came in today I ran a stop-all.sh since one of the datanodes was not
showing on the dfsnodelist.jsp?whatNodes=LIVE status page. I then ran
start-all.sh, and the NN dies on a Null…
|
1 | May 4 2012 08:56 |
May 14 2012 10:52 |
|
|
How to start up datanode with kerberos? By: shixing Hi?all? Now I want to setup the security with hbase by
kerberos. As I know, the hbase's ugi is based on the hadoop
UserGroupInformation without parameter "hadoop.job.ugi" after 0.20.2.
So when I use the cdh3u3, the ugi can be generated by…
|
2 | May 10 2012 09:59 |
May 13 2012 08:24 |