[FINESCE] COSMOS : Shark error

Massimiliano Nigrelli massimiliano.nigrelli at eng.it
Mon Sep 21 10:28:03 CEST 2015


To whom it may concern,
from yesterday our applications have been getting the following error 
when trying to connect to Hive/Shark:

> INFO: Getting Historical Load Data by Sector
>
> Sep 21, 2015 10:16:31 AM eu.finesce.emarketplace.client.HiveClient 
> getHiveConnection
>
> SEVERE: HIVE Connection Error
>
> java.sql.SQLException: Could not establish connection to 
> 130.206.80.46:9999/default?user=FINESCE-WP4&password=******************: 
> java.net.ConnectException: Connection refused
>
>         at 
> org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:117)
>
>         at 
> org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:106)
>
>         at java.sql.DriverManager.getConnection(DriverManager.java:571)
>
>         at java.sql.DriverManager.getConnection(DriverManager.java:233)

Just to give you more details, when we try to launch hive from CLI, we 
get (although the CLI starts in the end):
>
> login as: FINESCE-WP4
>
> FINESCE-WP4 at 130.206.80.46's password:
>
> Last login: Mon Sep 21 10:15:40 2015 from 89-97-237-254.ip19.fastwebnet.it
>
> -bash-4.1$ hive
>
> log4j:ERROR Could not instantiate class 
> [org.apache.hadoop.hive.shims.HiveEventCounter].
>
> java.lang.RuntimeException: Could not load shims in class 
> org.apache.hadoop.log.metrics.EventCounter
>
>         at 
> org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:123)
>
>         at 
> org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:115)
>
>         at 
> org.apache.hadoop.hive.shims.ShimLoader.getEventCounter(ShimLoader.java:98)
>
>         at 
> org.apache.hadoop.hive.shims.HiveEventCounter.<init>(HiveEventCounter.java:34)
>
>         at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>
>         at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>
>         at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>
>         at java.lang.Class.newInstance0(Class.java:357)
>
>         at java.lang.Class.newInstance(Class.java:310)
>
>         at 
> org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:330)
>
>         at 
> org.apache.log4j.helpers.OptionConverter.instantiateByKey(OptionConverter.java:121)
>
>         at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:664)
>
>         at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647)
>
>         at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544)
>
>         at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440)
>
>         at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476)
>
>         at 
> org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:354)
>
>         at 
> org.apache.hadoop.hive.common.LogUtils.initHiveLog4jDefault(LogUtils.java:127)
>
>         at 
> org.apache.hadoop.hive.common.LogUtils.initHiveLog4jCommon(LogUtils.java:77)
>
>         at 
> org.apache.hadoop.hive.common.LogUtils.initHiveLog4j(LogUtils.java:58)
>
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:641)
>
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
>
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.log.metrics.EventCounter
>
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>         at java.lang.Class.forName0(Native Method)
>
>         at java.lang.Class.forName(Class.java:171)
>
>         at 
> org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:120)
>
>         ... 27 more
>
> log4j:ERROR Could not instantiate appender named "EventCounter".
>
> Logging initialized using configuration in 
> jar:file:/usr/local/apache-hive-0.13.0-bin/lib/hive-common-0.13.0.jar!/hive-log4j.properties


Could someone from COSMOS team help us sorting the issue out, please?

Regards,

Massimiliano

-- 
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli at eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-lab-help/attachments/20150921/d79ca3b7/attachment.html>


More information about the Fiware-lab-help mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy