PlanetJava
Custom Search

java-hadoop-hive-user
[Top] [All Lists]

How to configure level2 datanucleus cache with hive metastore

Subject: How to configure level2 datanucleus cache with hive metastore
Date: Wed, 18 Jul 2012 11:57:28 +0530
Hi There,
I am new to hive and struggling to get level2 cache enabled for my
metastore. I have added following in my hive-site.xml -
 <property>
   <name>datanucleus.cache.level2</name>
   <value>true</value>
   <description>Use a level 2 cache. Turn this off if metadata is changed
independently of hive metastore server</description>
 </property>
 <property>
   <name>datanucleus.cache.level2.type</name>
   <value>SOFT</value>
   <description>SOFT=soft reference based cache, WEAK=weak reference based
cache.</description>
 </property>
<property>
  <name>hive.metastore.cache.pinobjtypes</name>
  <value>Table,Database,Type,FieldSchema,Order</value>
  <description>List of comma separated metastore object types that should
be pinned in the cache</description>
</property>
I am very sure that my client is picking up this hive-site.xml.
Still when I run my client with logging on, I see
12/07/17 23:03:14 INFO metastore.HiveMetaStore: 0: Opening raw store with
implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
12/07/17 23:03:14 INFO metastore.ObjectStore: ObjectStore, initialize called
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.core.expressions" but it
cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.debug.core" but it
cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.core.runtime" but it
cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.jdt.launching" but it
cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.jdt.junit.runtime" but
it cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.core.variables" but it
cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires
"org.eclipse.equinox.simpleconfigurator.manipulator" but it cannot be
resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle
"org.eclipse.jdt.junit.core" requires "org.eclipse.equinox.frameworkadmin"
but it cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core"
requires "org.eclipse.core.resources" but it cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core"
requires "org.eclipse.core.runtime" but it cannot be resolved.
12/07/17 23:03:14 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core"
requires "org.eclipse.text" but it cannot be resolved.
12/07/17 23:03:14 INFO DataNucleus.Persistence: Property
javax.jdo.option.NonTransactionalRead unknown - will be ignored
*12/07/17 23:03:14 INFO DataNucleus.Persistence: Property
datanucleus.cache.level2 unknown - will be ignored*
12/07/17 23:03:14 INFO DataNucleus.Persistence: =================
Persistence Configuration ===============
12/07/17 23:03:14 INFO DataNucleus.Persistence: DataNucleus Persistence
Factory - Vendor: "DataNucleus"  Version: "2.0.3"
12/07/17 23:03:14 INFO DataNucleus.Persistence: DataNucleus Persistence
Factory initialised for datastore
URL="jdbc:derby://localhost:1527/default;create=true"
driver="org.apache.derby.jdbc.ClientDriver" userName="HIVE"
12/07/17 23:03:14 INFO DataNucleus.Persistence:
===========================================================
I assume that I miss something and hence level2 cache is still not enabled.
Can someone please help me out to fix this problem.
Thanks in advance!
--
Ravi.
*''We do not inherit the earth from our ancestors, we borrow it from our
children.'' PROTECT IT !*
msgmiddle
<Prev in Thread] Current Thread [Next in Thread>
  • How to configure level2 datanucleus cache with hive metastore,
Current Sitemap | © 2012 planetjava | Contact | Privacy Policy