Best unofficial Apache Server developers community

Answers

Establishing a connection between R and a Hive (Hadoop) database

⇧

⇩

51 views

Does anyone know how to achieve that?

I am assuming that RJDBC would help; but from my (likely naive) understanding, a bit of tweaking is necessary to write or adapt a Hive driver for this.

Relevant documentation:

Any help or suggestion is welcome! If no one did this before, I would be happy to code a bit towards a solution but I know next to no Java.

r jdbc hadoop hive

asked May 19, 2011 6:24 am CDT

crayola

posted via StackOverflow

1 Answer

⇧

⇩

I haven't tested these, but try the RHIPE and hive packages.

See this quora question (particularly Jeff Hammerbacher's answer) for a discussion of other options.

answered May 19, 2011 7:23 am CDT

Richie Cotton

Your answer

Similar discussion threads

Updated: (HIVE-1840) Support ALTER DATABASE to change database properties
December 7, 2010 03:33:39 PM
[ https://issues.apache.org/jira/browse/HIVE-1840?page=com.atlassian.jir a.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1840:

Created: (HIVE-1840) Support ALTER DATABASE to change database properties
December 7, 2010 03:33:35 PM
Support ALTER DATABASE to change database properties

Re: Re: Database connection
January 13, 2011 12:36:33 AM
"Having a background in PHP myself I'd say that Java is heavily geared towards enterprise and you will find it "heavier" than the scripting environment of PHP." Having a background in Borland Delphi 1..2005 myself and many frinds of my with…

Re: Database connection
January 13, 2011 12:25:26 AM
Hello! You can use no ORM approach, as I do ;-) 1. All my db queries are in DAO class 2. for actual DB work I use Spring JDBC Templates http://static.springsource.org/spring/docs/3.0.x/reference/jdbc.html 3. for JDBC connection pooling I use The…

Database connection
January 12, 2011 05:40:40 PM
I'm starting work on an application. Normally I would use PHP, but I accidently found Apache Click. Looking at the documentation and examples, it appears easy to use. Maybe I missed it in the documentation, but how do you get data stored in a…

Any way to get the database ID, selected for connection?
April 3, 2011 02:35:31 PM
Hi, all! Redis 2.0.5 For debugging, I need to know the current DB ID, which is SELECTed for current connection. Any way to determine this besides pre-setting some key (like "db_id") in each DB, and then reading it back as needed? (I know that…

MyBatis and Spring: database connection
November 16, 2010 06:14:10 AM
Hi, I use Mybatis and Spring framework. I defined beans according to Mybatis wiki page, like this: <bean id="dataSource" class="org.apache.ibatis.datasource.pooled.PooledDataSource" destroy-method="close"> <property…

MyBatis connection pooling for H2 database
November 5, 2010 06:41:43 AM
Hi, I have web application which uses H2 database in embedded (data are saved in clan-ui.db file) mode and MyBatis. I define data source like this: <environments default="development"> <environment id="development"> …

Registering a custom tokenizer per database rather than per connection
October 8, 2010 03:37:39 PM
Is it possible to register a custom FTS3 tokenizer to be persistent in the database so that it is available every time a connection is opened? Or do I need to reregister the tokenizer every time I open a new connection to the database? Thanks …

Questions to jackrabbit database connection handling
May 18, 2011 01:49:53 AM
Hi, these questions are related to jackrabbit 1.6.1: How works the connection pool? Will be unused sessions closed or is there something like an keepalive operation? How often this (if any) keep-alive will be executed? thanks in advance, tf

How to retry database connection with Tomcat 7 jdbc pool ?
April 9, 2011 10:57:21 AM
How to configure Tomcat 7 jdbc pool to retry database connection if the DB goes restarted ? With default configurations on alternatives like apache dbcp or bonecp, the connection gets automatically re-connected when DB back in life. But not with…

pymssql Connection to the database failed for an unknown reason
January 29, 2011 10:48:05 AM
Hello I am using pymssql to connect to MSSQL2008 database. But an error occurs:

pymongo] enable safe mode on the database or connection level?
November 4, 2010 06:28:44 AM
This is a multi-part message in MIME format.-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Right now we can specify safe=True only on individual operations like insert() or update(). There is some global option to ensure safe mode in general for…

database in a an inconsistent stat, after a communications error has been detected: Connection rese
June 13, 2010 04:35:38 AM
Hi, We have a service in our company that works with derby embedded db in a server mode. I have an ongoing task which uses the db, and in one of the times I got the following exception: :52:44.961 WARN - JDBCExceptionReporter.java:77…

Created: (JCR-2767) Database connection leak with DBCP, MySQL, and Observers
October 4, 2010 05:27:59 PM
Database connection leak with DBCP, MySQL, and Observers

Created: (DERBY-5096) DisconnectException: "Connection was refused because the database DB was
March 7, 2011 09:07:25 AM
DisconnectException: "Connection was refused because the database DB was not found" on OS/400

After colse the JDBC connection, the hive don't delete hive exec scratch dir
January 24, 2011 08:24:38 PM
I use hive 0.6 version, I use JDBC to execute one search sql, for example below code: public static void query() { Connection hiveConnection = null; Statement statement = null; try { …

When I close the connection, hive don't clean hive.exec.scratchdir directory
October 14, 2010 09:26:59 PM
I use JDBC to connection hive server, I find when I close connection, hive don't clean hive.exec.scratchdir directory, so after hive run long time, the hive.exec.scratchdir directory include a lot of files. Now we use timer to clean the…

Commented: (HIVE-1583) Hive should not override Hadoop specific system properties
November 11, 2010 11:59:59 AM
[ https://issues.apache.org/jira/browse/HIVE-1583?page=com.atlassian.jir a.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1 2931107#action_12931107 ] Namit Jain commented on HIVE-1583:

Created: (HIVE-1583) Hive should not override Hadoop specific system properties
August 22, 2010 11:21:03 PM
Hive should not override Hadoop specific system properties

Questions and Answers are licensed under cc-wiki license.

Establishing a connection between R and a Hive (Hadoop) database

1 Answer

Your answer

Join with account you already have