Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

Hive users Recent threads

Threads Replies First post Last post
Multi-group-by select always scans entire table
By: Jan Dolinár
Hello, I've encountered a weird issue with hive and I'm not sure if I'm doing something wrong or if it is a bug. I'm trying to do a multi-group-by select statement on a partitioned table. I wan't only data from one partition, therefore all the…
0 May 25 2012
05:04
May 25 2012
05:04
What is hive doing wrong?
By: Edward Capriolo
Over the past few months I have seen Spark through around a couple times. https://github.com/mesos/spark You know what strikes me as odd. Not once has spark EVER been mentioned on this mailing list! (To my knowledge). This is something similar to…
0 May 24 2012
21:09
May 24 2012
21:09
SQL help
By: Mohit Anchlia
I am new to Hive. I have several SQL from RDBMS database that I need to convert to hive. What's the best reference for HIVEQL? For now I am trying to figure out how to do this in hive: Select distinct A_ID, First_Value(path IGNORE NULLS)…
8 May 24 2012
15:02
May 24 2012
17:23
Map side aggregations
By: Raghunath, Ranjith
I have the parameter hive.map.aggr set to true. However, when I look at the counters associated with the map tasks I notice the following "Combine input records 0". I am interpreting this as a failure to perform the map side aggregation. Is that…
4 May 22 2012
19:43
May 23 2012
19:52
Local hadoop
By: Mohit Anchlia
When I launch simple SQL I see "local hadoop". And when I do hadoop job fs -list in my hadoop cluster I don't see any jobs. Am I doing something wrong here? # hive Hive history file=/tmp/root/hive_job_log_root_201205231 Execution log at:…
4 May 23 2012
18:49
May 23 2012
19:46
Is there a way to create user account and grant read only permissions?
By: Patrick Luo
My use case requires individual accounts for business users groups. Is there a way to mimic MySQL (or other database) to create users with read-only permissions? This avoid business user accidental table drop. Metastore has table ROLES but don’t…
7 May 18 2012
13:48
May 23 2012
18:59
Want to give a short talk at the next Hive User Group meetup?
By: Carl Steinbach
Hi, I just wanted to remind everyone that the next Hive User Group meetup is happening on June 12th (the day before the Hadoop Summit) in San Jose. More details about the meetup can be found on the Hive User Group page located here: …
2 May 22 2012
20:29
May 23 2012
12:15
How to Write a Simple SerDe?
By: Rubin, Bradley S.
My Hadoop MR job emits a value with three primitives via a custom Writable (see below). How do I write a corresponding custom SerDe so that Hive can read the output from HDFS? I can find complex SerDe examples (RegEx, JSON), but I can't find…
1 May 21 2012
14:45
May 23 2012
11:55
Re:
By: Debarshi Basak
But what i am doing is i am creating index then setting the path of the index and running a select <columns> from table_name where <condition> How can i resolve this issue? Debarshi Basak Tata Consultancy Services Mailto: debarsh### @tcs.c
5 May 23 2012
04:13
May 23 2012
05:04
Re:
By: alo alt
Hi, http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#Memo ry+management This message means that for some reason the garbage collector is taking an excessive amount of time (by default 98% of all CPU time of the process) and…
0 May 23 2012
03:38
May 23 2012
03:38
Re: Re: start hive cli error
By: dianbo.zhu
This is a multi-part message in MIME format. Hi Nitin, i reinstalled and did not modify anything, but it also can not work. It worked well when i first ran it months ago. the output of locale command is below: LANG=zh_CN LC_CTYPE="zh_CN" …
2 May 22 2012
05:48
May 22 2012
21:36
protobuf 2.4.1 and ObjectInspector
By: Kulkarni.swarnim
I am trying to use the ReflectionStructObjectInspector to extract fields from a protobuf generated from 2.4.1 compiler. I am seeing that reflections fails to extract fields out of the generated protobuf class. Specifically, this code snippet: …
1 May 22 2012
17:10
May 22 2012
21:01
RCFile and UDF
By: Mohit Anchlia
I am new to Hive. Currently I am trying out one of the use cases where we write xml files into a sequence file. We then read the sequence file and convert it into more structured row, col format using pig udf. This is currently being stored as…
0 May 22 2012
16:59
May 22 2012
16:59
Condition for doing a sort merge bucket map join
By: Bruce Bian
Hi , I've got 7 large tables to join(each ~10G in size) into one table, all with the same* 2 *join keys, I've read some documents on sort merge bucket map join, but failed to fire that. I've bucketed all the 7 tables into 20 buckets and sorted by…
2 May 22 2012
10:08
May 22 2012
13:26
Virtual Columns in Local Tasks
By: Tucker, Matt
Can anyone verify that virtual columns (INPUT__FILE__NAME, in particular) are not able to be used when map-side joins are enabled? I'm currently working with Hive 0.7.1 and CDH3u3. Example: SELECT COUNT(*) FROM table_a --small table that will…
0 May 22 2012
12:16
May 22 2012
12:16
user define data format
By: Richard
Hi, I want to use Hive on some data in the following format: <doc>\0x01 field1=val1\0x01 field2=val2\0x01 ... </doc>\0x01 the lines between <doc> and </doc> are a record. How should I define the table? thanks. Richard
3 May 21 2012
04:45
May 22 2012
11:52
Hive + Cassandra
By: Szymon D?browski
I've been trying to see if that's possible to combine Hive with Cassandra. I've noticed some issues about "integration" but it seems to me there's some mix-up about who is to patch things up. There are two issues: in Hive project [1] and in…
1 May 22 2012
03:20
May 22 2012
08:51
from-insert-select trouble
By: Avdeev V. M.
Hello! I'm very new to the world Hadoop and Hive so I cannot solve a problem that I encountered. Hadoop has been deployed on a single-node in a pseudo-distributed mode. I'm trying to copy data from one table to another. Source table created by…
3 May 22 2012
05:21
May 22 2012
08:08
AbstractMethodError while using serde
By: Sumit Kumar
Hi all, I'm using csv-serde code ( https://github.com/ogrodnek/csv-serde ) with hadoop 0.20.205 and hive 0.7.1 and running into the following issue 2012-05-22 15:51:44,354 WARN org.apache.hadoop.mapred.Child: Error running child…
0 May 22 2012
06:33
May 22 2012
06:33
start hive cli error
By: Dimboo Zhu
hi there, I got the following trace stack when startuping hive cli. It worked=20 well last week when i just installed it. Anybody can help? thanks, Dianbau [dzh### @bbdw-194 bin]$ ./hive Logging initialized using configuration in j=…
1 May 22 2012
04:47
May 22 2012
05:12