Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/mapreduce/TableInputFormat

problems compiling idmapreduce.java using pig
(34 lines)
pig and java mapreduce interop
(8 lines)
Jul 22, 2010
Preethi Vinayak Sunny
Preethi Vinayak Sunny
Hi All,

This is my first mail in the apache mailing list... please bear with me as
I
am absolutely new to Hadoop and its family.

This is my question... I have some data on my hdfs in the following form.

(number:int,word:chararray, word2:chararray,somethingelse:int)

I want to get this data into a neatly formed HBase Table. I chose the
simpler way instead of writing my own udf. I wanted to do this....

register ../hbase/hbase-0.20.4.jar;
register ../hbase/hbase-0.20.4-test.jar;
A = Load '/some_data';
B = STORE A into 'hbase://something' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage;
dump B;

but this is the error I get when I do that

2010-07-22 16:38:35,041 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting
to hadoop file system at: hdfs://MyMachine01:9000
2010-07-22 16:38:35,550 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting
to map-reduce job tracker at: MyMachine01:9001
2010-07-22 16:38:35,868 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 2998: Unhandled internal error.
org/apache/hadoop/hbase/mapreduce/TableInputFormat

I have checked my hbase-0.20.4.jar file and it does have a
TableInputFormat
class. I added the right path to hadoop-env.sh in the CLASSPATH field. I
added the conf folder to the classpath and also the test jar.

I don't know why it wouldn't work. My HBase installation went really
smooth.
I am able to check the status of the HBase in the hbase shell and still I
get this error. I am totally lost at this point. I would really appreciate
any help in this regard.

Thanks a bunch.
V.


Reply
Tags: mailformhdfs
Messages in this thread
ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/mapreduce/TableInputFormat
Similar Threads
DO NOT REPLY New: HTTP Error 500.0 - Internal Server Error
https://issues.apache.org/bugzilla/show_bug.cgi?id=49454

           Summary: HTTP Error 500.0 - Internal Server Error
           Product: Tomcat Connectors
           Version: 1.2.30
          Platform: Other
        OS/Version: Windows Server 2008 (Longhorn)
            Status: NEW
          Severity: critical
          Priority: P2
         Component: isapi
        AssignedTo: d### @tomcat.apache.org
        ReportedBy: vik### @gmail.com


Hi,

I completed setting up ISAPI filter on II7, Win2K8 but I am getting below
error:


HTTP Error 500.0 - Internal Server Error
Calling GetFilterVersion on ISAPI filter
"D:\Apps\Tomcat\6.0\bin\isapi_redirect.dll" failed Detailed Error
InformationModule IIS Web Core 
Notification Unknown 
Handler StaticFile 
Error Code 0x80070002 
Requested URL http://localhost:82/ 
Physical Path D:\Apps\XXX\WI_Multi\IISconfig 
Logon Method Not yet determined 
Logon User Not yet determined 

Can you please look into this and provide a solution to fix this.

Thanks,

Vikas




NoClassDefFoundError: org/apache/hadoop/hbase/rest/Main
I am trying to start and stop stargate rest server. I get
ClassNotFoundException intermittently.
I did perform these steps :
?  Place the Stargate jar in either the HBase installation root
directory or lib/ directories.
?  Copy the jars from contrib/stargate/lib/ into the lib/ directory of
the HBase installation.


:/usr/local/hbase-0.20.3 hadoop$./bin/hbase
org.apache.hadoop.hbase.stargate.Main -p 8080
2010-07-03 04:32:39.593::INFO:  Logging to STDERR via
org.mortbay.log.StdErrLog
2010-07-03 04:32:39.633::INFO:  jetty-6.1.14
2010-07-03 04:32:39.908::INFO:  Started SocketC### @0.0.0.0:8080


^Z
[1]+  Stopped                 ./bin/hbase
org.apache.hadoop.hbase.stargate.Main -p 8080
:/usr/local/hbase-0.20.3 hadoop$bg
[1]+ ./bin/hbase org.apache.hadoop.hbase.stargate.Main -p 8080 &
:/usr/local/hbase-0.20.3 hadoop$./bin/hbase-daemon.sh start
org.apache.hadoop.hbase.rest.Main -p 8080
starting org.apache.hadoop.hbase.rest.Main, logging to
/var/hbase/logs/hbase--org.apache.hadoop.hbase.rest.Main-phxradar03.out
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/hbase/rest/Main
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.rest.Main
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
Could not find the main class: org.apache.hadoop.hbase.rest.Main.  Program
will exit.


DO NOT REPLY Segfault and Internal Server Error on loading module
https://issues.apache.org/bugzilla/show_bug.cgi?id=45681

Nick Kew <nic### @webthing.com> changed:

           What    |Removed                     |Added

Re: Hadoop error
Hi,

I am trying to set up a development cluster for hadoop 0.20.1 in eclipse.
I used this url
http://svn.apache.org/repos/asf/hadoo...s/release-0.20.2/ to
check out the build. I compiled "compile , compile-core-test , and
eclipse-files" using ant. Then when I build the project , I am getting
errors in bin/benchmarks directory. I have followed the screencast from
cloudera
http://www.cloudera.com/blog/2009/04/...nt-a-screencast/.


The error log is :
Description	Resource	Path	Location	Type
FileInputFormat cannot be
resolved	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
84	Java Problem
FileOutputFormat cannot be
resolved	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
86	Java Problem
JobConf cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
64	Java Problem
JobConf cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
65	Java Problem
JobConf cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
65	Java Problem
Mapper cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
33	Java Problem
MapReduceBase cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
32	Java Problem
MapReduceBase cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
50	Java Problem
OutputCollector cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
39	Java Problem
OutputCollector cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
54	Java Problem
Reducer cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
51	Java Problem
Reporter cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
40	Java Problem
Reporter cannot be resolved to a
type	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
55	Java Problem
The declared package "org.apache.hadoop.mapred" does not match the
expected package
"gridmix2.src.java.org.apache.hadoop.mapred"	CombinerJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
19	Java Problem
FileInputFormat cannot be
resolved	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
52	Java Problem
FileInputFormat cannot be
resolved	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
69	Java Problem
FileOutputFormat cannot be
resolved	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
47	Java Problem
JobClient cannot be resolved to a
type	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
58	Java Problem
JobClient cannot be resolved to a
type	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
58	Java Problem
The declared package "org.apache.hadoop.mapred" does not match the
expected package
"gridmix2.src.java.org.apache.hadoop.mapred"	GenericMRLoadJobCreator.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
19	Java Problem
Counters cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
496	Java Problem
Counters cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
501	Java Problem
Counters cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
503	Java Problem
FileInputFormat cannot be
resolved	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
160	Java Problem
FileOutputFormat cannot be
resolved	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
161	Java Problem
JobClient cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
486	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
123	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
145	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
145	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
192	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
220	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
263	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
300	Java Problem
JobConf cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
487	Java Problem
JobID cannot be
resolved	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
495	Java Problem
JobID cannot be
resolved	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
509	Java Problem
JobID cannot be
resolved	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
511	Java Problem
TaskReport cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
509	Java Problem
TaskReport cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
510	Java Problem
TaskReport cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
522	Java Problem
TaskReport cannot be resolved to a
type	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
544	Java Problem
The declared package "org.apache.hadoop.mapred" does not match the
expected package
"gridmix2.src.java.org.apache.hadoop.mapred"	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
19	Java Problem
The method createJob(String[]) from the type CombinerJobCreator refers to
the missing type
JobConf	GridMixRunner.java	/hadoop-0.20.3/src/benchmarks/gridmix2/src/java/org/apache/hadoop/mapred	line
220	Java Problem


I am using eclipse galileo.

Thanks,
Vidur






error when executing mapreduce program
Hello :)

I developped my first mapreduce program with eclipse.

when i want to execute it i have this error i tried to solve it but i
failed :



Jul 19, 2010 5:06:37 PM org.apache.hadoop.mapred.JobClient
monitorAndPrintJob
INFO: Task Id : attempt_201007191410_0002_m_000001_1, Status : FAILED
java.lang.NullPointerException
	at  
org.apache.hadoop.io.serializer.SerializationFactory.getSerializer(SerializationFactory.java:73)
	at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:797)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:350)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)




thanks for any help

best regards



error:Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzopCodec
Hello?
    I got source code from
http://github.com/kevinweil/hadoop-lzo?compiled 
them successfully,and then
1?copy hadoop-lzo-0.4.4.jar to directory:$HADOOP_HOME/lib of each master
and 
slave
2?Copy all files under directory:../Linux-amd64-64/lib to directory:
$HADDOOP_HOME/lib/native/Linux-amd64-64 of each master and slave
3,and upload a file:test.lzo to HDFS
4?then run?hadoop jar $HADOOP_HOME/lib/hadoop-lzo-0.4.4.jar 
com.hadoop.compression.lzo.DistributedLzoIndexer test.lzo to test

got errors?

Created: (FELIX-2448) PermissionAdmin plugin causes internal server error if PermissionAdmin service
PermissionAdmin plugin causes internal server error if PermissionAdmin
service API not bound

Re: Does this error eman it is an error at your client machine side orthe error at the server side?
Try running a distributed test to verify that the client machine is not
choking. 

If the error still comes, try reducing the number of threads. 


------Original Message------
From: nathasha
To: JMeter Users List
ReplyTo: JMeter Users List
Subject: Does this error eman it is an error at your client machine side
orthe error at the server side?
Sent: Jul 16, 2010 4:39 AM


hello all,

I did some searchign for the cause of this problem, but couldn't find
anything useful yet.
I am runnign a load test on an image file and I am using 1000 threads
each
will run 60 times per minute.
I need to do it for an hour.
but, I am trying to do it for 10 minutes at first and I see some errors
like
the following.
Does it mean that the machine I am running jmeter encountered some
problems?
or does it mean that the server couldn't handle that many requests?

"Non HTTP response code: java.net.NoRouteToHostException,Non HTTP
response
message: Cannot assign requested address,"

thanks a lot,
Nathasha



Re: Does this error eman it is an error at your client machine side orthe error at the server side?
thank you.
yes. I am trying to do that and looks like it is fine now when I reduce
the
number of threads.

Nathasha



Does this error eman it is an error at your client machine side or the error at the server side?
hello all,

I did some searchign for the cause of this problem, but couldn't find
anything useful yet.
I am runnign a load test on an image file and I am using 1000 threads each
will run 60 times per minute.
I need to do it for an hour.
but, I am trying to do it for 10 minutes at first and I see some errors
like
the following.
Does it mean that the machine I am running jmeter encountered some
problems?
or does it mean that the server couldn't handle that many requests?

"Non HTTP response code: java.net.NoRouteToHostException,Non HTTP response
message: Cannot assign requested address,"

thanks a lot,
Nathasha



HBase on Hadoop 0.21
Hi,

I've checked the Release Notes of HDFS 0.21 and saw two fixes from hadoop-
append included, other two not, but still some more that have to do with
sync 
stuff.
Is Hadoop-append for HBase made obsolete with HDFS 0.21?

Thank you,

Thomas Koch, http://www.koch.ro


Created: (FELIX-2424) Internal Server Error requesting /system/console or /system/console/
Internal Server Error requesting /system/console or /system/console/

HBASE/HADOOP Examples
I've found examples using the older mapred interface but not the newer
mapreduce interface. I want to write a mapper that is configured to only
pull out specific rows(which are the mapper's keys) and a specific column's
value(which is the mapper's value).


Is there any examples of something like this available?

James Kilbride