Old Hive users archive Recent threads

Threads	Replies	First post	Last post
Hive 0.6.0 Release Update By: Carl Steinbach Hi, We are planning to cut the first release candidate for Hive 0.6.0 on Friday. At this point all of the tickets that were marked as blockers for the the 0.6.0 release have been committed and closed. If you believe that there are remaining…	1	Oct 7 2010 00:12	Oct 7 2010 04:09
hive query doesn't seem to limit itself to partitions based on the WHERE clause By: Marc Limotte Hi, From looking at the hive log output, it seems that my job is accessing many more partitions than it needs to? For example, my query is something like: INSERT OVERWRITE TABLE daily_fact PARTITION (dt='2010-09-29') SELECT 20100929 as stamp, …	6	Oct 1 2010 16:11	Oct 6 2010 21:56
Problems using UDFs By: phil young I'm getting errors while running contributed UDFs in Hive. The environment is Hadoop 0.20.2 with Hive from the trunk on 9/30/10 I've tried a few UDFs, and get the same results: 1) The reduce oscillates between 0 and 30% before failing 2) I get…	0	Oct 6 2010 17:50	Oct 6 2010 17:50
FileFormat By: gaurav jain Hi, insert overwrite directory "$dir" select * from xxx; creates files of type attempt_201008201925_165088_r_000000_0.gz insert overwrite table "$table" select * from xxx; creates file of type attempt_201008201925_165088_r_000000_0 How…	6	Oct 5 2010 22:44	Oct 6 2010 15:52
Is it possible to speed up select ... limit query? By: Leo Alekseyev Suppose I have a large-ish table (over a billion rows) and want to grab the first 5 million or so. When I run the query "create table foo_subset as select col1, col2, col3 from foo limit 5000000", the job launches one reducer, which runs for a…	0	Oct 6 2010 12:58	Oct 6 2010 12:58
hive-jdbc maven repo? By: Tommy Chheng I can't seen to find the hive-jdbc package in a maven repo. I tried the maven search site as well: http://mvnrepository.com/ Is there a maven repo that has all the hadoop-related jars? Thanks, Tommy	0	Oct 5 2010 22:48	Oct 5 2010 22:48
Runtime exception while running Hive By: hdev ml Hi all, I installed hadoop-0.21.0 and hive-0.5.0-bin and it is giving me following error when trying to run hive CLI Is there anything wrong that I am doing? [us### @machine bin]$ ./hive Exception in thread "main" java.lang.RuntimeException: Could…	4	Oct 5 2010 14:01	Oct 5 2010 16:00
Re: Hive table export? By: Arvind Prabhakar This is a multi-part message in MIME format. Sqoop 1.0.0+3 is supported against CDH3 B3 vesion of Hadoop (0.20.2+320). Please upgrade your Hadoop installation and try again. Arvind On 10/01/2010 04:09 PM, Tianqiang Li wrote: > Hi, Carl, >…	0	Oct 4 2010 12:07	Oct 4 2010 12:07
Re: wrong number of records loaded to a table is returned by Hive By: gaurav jain Hi Ning, I also see the same behavior. Below is some data for your reference. This behavior is observed for large values. I believe HIVE is recording non-final values at the end of insert query: Since hive reads the HIVE History file counters,…	2	Oct 1 2010 14:07	Oct 2 2010 00:45
dynamic partition query dies with LeaseExpiredException By: Dave Brondsema We're trying to insert into a table, using a dynamic partition, but the query runs for a while and then dies with a LeaseExpiredException. The hadoop details & some discussion is at https://issues.apache.org/jira/browse/HDFS-198 Is there a…	2	Oct 1 2010 10:35	Oct 1 2010 14:25
Select * from table fails : Killed : java.lang.NullPointerException By: vaibhav negi Hi, I am running Select * from table fails . But reduce task fails giving error :- Ended Job = job_201010011018_0001 with errors FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask 2010-10-01 10:01:38,915 FATAL…	1	Oct 1 2010 05:38	Oct 1 2010 13:27
sampling conditionality from a large table By: Tommy Chheng I have two tables: pages( title, domain, url ) top_domains(domain) top_domains was created from a group by domain operation on the pages table. Because the pages table is very large, I only want to be able to sample 5 rows for each domain in…	2	Sep 27 2010 19:51	Oct 1 2010 13:21
java.lang.RuntimeException: java.lang.Double cannot be cast to java.lang.String By: Hock Zoltán Hello, I got the following exception when I made a simple query in my table. I made the table to store email header data with the following command: CREATE TABLE mytable (xfrom STRING, xto STRING, subject STRING, cc STRING, xgeoip STRING,…	3	Sep 30 2010 10:47	Oct 1 2010 13:15
Re: wrong number of records loaded to a table is returned by Hive By: Ping Zhu I had such issues on different versions of hadoop/hive: The version of hadoop/hive I am using now is hadoop 0.20.2/hive 0.7. The version of hadoop/hive I once used is hadoop 0.20.0/hive 0.5 Ping On Fri, Oct 1, 2010 at 10:23 AM, Ping Zhu…	0	Oct 1 2010 12:30	Oct 1 2010 12:30
Tables using custom SerDe doesn't return any data when queried By: Jamie Cockrill Dear hive-user's, I've written my own custom SerDe to handle some log files in a custom format and as I'd quite like to (eventually) use the JDBC driver down the line, I'd quite like to retain the column types for the output. Part of the reason…	1	Sep 30 2010 04:21	Oct 1 2010 08:57
Create table as select fails with error "Error in metadata: org.apache.thrift.TApplicationExcep By: Amareshwari Sri Ramadasu Hi, Create table as select queries fail with org.apache.thrift.TApplicationException in our clusters for some queries. Following is the stack trace for the exception : Error in metadata: org.apache.thrift.TApplicationException: Internal error…	12	Sep 30 2010 23:26	Oct 1 2010 04:17
Read/write into HDFS By: Adarsh Sharma Dear all, I have set up a Hadoop cluster of 10 nodes. I want to know that how we can read/write file from HDFS (simple). Yes I know there are commands, i read the whole HDFS commands. bin/hadoop -copyFromLocal tells that the file should be in…	2	Sep 30 2010 06:59	Sep 30 2010 16:53
Json serde path issue By: Damien Allison Hi, I have noticed an issue with the JSON serde path when reviewing some code. The Json Serde include was from: add jar s3://elasticmapreduce/samples/hive-ads/libs/jsonserde.jar; and used a statement like WITH SERDEPROPERTIES ('paths'=' …	2	Sep 30 2010 08:44	Sep 30 2010 14:57
Need a faster way to load files into Hive! By: Ken.Barclay Hi, We have Python code currently to load log data into Hive. The steps it follows are: 1) Copy log files (.gz files) to a staging directory in HDFS. We're mounting HDFS using fuse-dfs (as per http://wiki.apache.org/hadoop/MountableHDFS) 2) …	4	Sep 24 2010 17:07	Sep 30 2010 14:48
compiling hive trunk By: Ted Yu Hi, I see the following when I compile hive trunk: model-enhance: [datanucleusenhancer] log4j:WARN No appenders could be found for logger (DataNucleus.Enhancer). [datanucleusenhancer] log4j:WARN Please initialize the log4j system properly.…	1	Sep 30 2010 11:44	Sep 30 2010 12:08