Best unofficial Apache Server developers community

Answers

Hadoop/hive metastore

⇧

⇩

136 views

where do people place their multi user meta store? I'm going to use mysql but I don't know were I should stick it. on the name node or on its own server?

hadoop

asked August 7, 2009 6:38 pm CDT

posted via ServerFault

2 Answers

Newest Most Voted

⇧

⇩

It can be on any machine really.

We installed hive on a node that is not a cluster member (but is only used for staging data to load into hive) and setup the metastore mysql instance there.

answered December 21, 2010 7:54 am CST

¹ord">Nathan *****¹ord

⇧

⇩

Hadoop can really trash the page buffers on a datanode so you probably will do well to keep mySQL off of any of them.

The recommendation to run Hive outside the cluster is a very good one, if only because you will have serious balance problems if you run it inside the cluster.

answered December 21, 2010 7:54 am CST

Ted Dunning

Your answer

Similar discussion threads

Updated: (HIVE-232) metastore.warehouse configuration should use inherited hadoop configuration
July 23, 2010 01:06:51 PM
[ https://issues.apache.org/jira/browse/HIVE-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-232:

Created: (HIVE-1571) hive.metastore.uris is missing its definition in hive-default.xml
August 19, 2010 06:31:58 PM
hive.metastore.uris is missing its definition in hive-default.xml

Updated: (HIVE-17) conf/hive-default.xml has a repeated property: hive.metastore.uris
July 23, 2010 01:13:56 PM
[ https://issues.apache.org/jira/browse/HIVE-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-17:

Created: (HIVE-1554) Hive Unable to start due to metastore exception
August 18, 2010 10:09:41 AM
Hive Unable to start due to metastore exception

Created: (HIVE-1461) Clean up references to 'hive.metastore.local'
July 13, 2010 04:16:52 PM
Clean up references to 'hive.metastore.local'

Lost old tables in hive metastore after installing a new version of hive
August 10, 2010 05:52:12 PM
I built hive from SVN, and am running into the following issue: I can't seem to access any of my old tables, that is, SHOW TABLES doesn't return any entries. I can create new tables, and they show up in HDFS in /user/hive/warehouse alongside the…

Created: (HIVE-1465) hive-site.xml ${user.name} not replaced for local-file derby metastore connecti
July 14, 2010 12:57:51 PM
hive-site.xml ${user.name} not replaced for local-file derby metastore connection URL

hive-0.6 don't connection mysql in metastore
August 30, 2010 12:31:37 AM
I use hive-0.6 an use mysql as metasore, but hive don't connection the mysql. 2010-08-30 13:28:24,982 ERROR [main] util.Log4JLogger(125): Failed initialising database. Invalid URL: jdbc:mysql://127.0.0.1:3306/hive6?createDatabaseIfNotExist=true…

Updated: (HIVE-604) remove Schema from metastore
July 26, 2010 01:34:51 AM
[ https://issues.apache.org/jira/browse/HIVE-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-604:

Updated: (HIVE-142) Create a metastore check command
July 23, 2010 05:12:52 AM
[ https://issues.apache.org/jira/browse/HIVE-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-142:

hwo to connection metastore server with hive JDBC client
September 18, 2010 12:01:42 PM
I use ./hive --service metastore command to start metastore server, how to connection metastore server with hive JDBC client?

Updated: (HIVE-84) MetaStore Client is not thread safe
July 23, 2010 11:50:52 AM
[ https://issues.apache.org/jira/browse/HIVE-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-84:

Updated: (HIVE-884) Metastore Server should exit if error happens
July 26, 2010 01:00:51 AM
[ https://issues.apache.org/jira/browse/HIVE-884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-884:

Created: (HIVE-1696) Add delegation token support to metastore
October 6, 2010 01:12:56 PM
Add delegation token support to metastore

Created: (HIVE-1539) Concurrent metastore threading problem
August 13, 2010 10:38:46 AM
Concurrent metastore threading problem

Commented: (HIVE-1609) Support partition filtering in metastore
September 15, 2010 05:55:20 PM
[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jir a.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1 2909930#action_12909930 ] Paul Yang commented on HIVE-1609:

Updated: (HIVE-1609) Support partition filtering in metastore
September 15, 2010 11:56:01 PM
[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jir a.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kidave updated HIVE-1609:

Updated: (HIVE-1609) Support partition filtering in metastore
September 15, 2010 11:56:02 PM
[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jir a.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kidave updated HIVE-1609:

Created: (HIVE-1609) Support partition filtering in metastore
August 31, 2010 11:59:44 PM
Support partition filtering in metastore

Updated: (HIVE-126) Don't fetch information on Partitions from HDFS instead of MetaStore
July 23, 2010 04:55:53 AM
[ https://issues.apache.org/jira/browse/HIVE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-126:

Questions and Answers are licensed under cc-wiki license.

Hadoop/hive metastore

2 Answers

Your answer

Join with account you already have