[Fiware-lab-help] R: [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2

Pellegrino Dario dario.pellegrino at eng.it
Wed Aug 26 12:09:41 CEST 2015
Previous message: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2
Next message: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Hi Aristi,
I have done other tests. Please, could you send the information below to a second level support .

1) TOMCAT Log
Aug 26, 2015 11:29:43 AM eu.finesce.emarketplace.client.HiveClient getHiveConnection
SEVERE: HIVE Connection Error
java.sql.SQLException: Could not open connection to jdbc:hive2://130.206.80.46:10000: java.net.SocketException: Connection reset
	at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:206)
	at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:178)
	at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
	at java.sql.DriverManager.getConnection(DriverManager.java:571)
	at java.sql.DriverManager.getConnection(DriverManager.java:215)
	at eu.finesce.emarketplace.client.HiveClient.getHiveConnection(HiveClient.java:102)
	at eu.finesce.emarketplace.client.HiveClient.getloadpredictionBySector(HiveClient.java:1017)
	at eu.finesce.emarketplace.RestHive2Cosmos.getLoadPredictionbySector(RestHive2Cosmos.java:251)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:402)
	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:349)
	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:106)
	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:259)
	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:236)
	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1010)
	at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:373)
	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
	at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
	at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
	at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
	at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset
	at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
	at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
	at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
	at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288)
	at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
	at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:203)
	... 48 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:196)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
	at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
	... 53 more

2) BEELINE TEST
I tried to use the Jdbc Hive2 connection in "Beeline Hive Client" on COSMOS

 -bash-4.1$ beeline
Beeline version 0.13.0 by Apache Hive
beeline> !connect jdbc:hive2://130.206.80.46:10000", "FINESCE-WP4", "password"
scan complete in 24ms
Connecting to jdbc:hive2://130.206.80.46:10000",
Error: Invalid URL: jdbc:hive2://130.206.80.46:10000", (state=08S01,code=0)


Best regards,
Dario



Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino at eng.it

Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it 

-----Messaggio originale-----
Da: Aristi Galani [mailto:agalani at unipi.gr] 
Inviato: martedì 25 agosto 2015 18:29
A: Pellegrino Dario
Cc: fiware-lab-help at lists.fi-ware.org; Leandro Lombardo; FRANCISCO ROMERO BUENO (francisco.romerobueno at telefonica.com); Massimiliano Nigrelli; Luigi Briguglio; SERGIO GARCIA GOMEZ (sergio.garciagomez at telefonica.com); Pasquale Andriani
Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2

Dear Dario,

We forwarded your request to second level support.

Kind regards
IWAVE team, on behalf of helpdesk team


> Dear all,
> a few days ago we have received your mail about the Hive Server 
> upgrade
> (HiveServer2 instead of Shark) and we have modified our Java code as 
> you recommended.
> In particular we have load the new driver 
> "org.apache.hive.jdbc.HiveDriver" , we have modified the JDBC connection
> "return DriverManager.getConnection("jdbc:hive2://" + hiveServer      +
> ":" + hivePort + "/default", hdfsUser, hdfsPwd);" and we have changed 
> the file POM.xml (dependencies Hive 0.13.0).
> Unfortunately, after changes our application doesn't work.
> You can find our error message below:
>
> 25-ago-2015 15.34.01 org.apache.catalina.core.StandardWrapperValve 
> invoke
> GRAVE: Servlet.service() for servlet
> [eu.finesce.emarketplace.RestHiveInputApplication] in context with 
> path [/rest2cosmos] threw exception 
> [java.lang.IllegalMonitorStateException]
> with root cause
> java.lang.IllegalMonitorStateException
>        at 
> java.util.concurrent.locks.ReentrantLock$Sync.tryRelease(Unknown
> Source)
>        at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.release(Unknown
> Source)
>        at java.util.concurrent.locks.ReentrantLock.unlock(Unknown Source)
>        at
> org.apache.hive.jdbc.HiveStatement.closeClientOperation(HiveStatement.java:175)
>        at
> org.apache.hive.jdbc.HiveQueryResultSet.close(HiveQueryResultSet.java:293)
>        at
> eu.finesce.emarketplace.client.HiveClient.getmeterDetails(HiveClient.java:1386)
>        at
> eu.finesce.emarketplace.RestHive2Cosmos.getMeterDetails(RestHive2Cosmos.java:299)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
>        at java.lang.reflect.Method.invoke(Unknown Source)
>        at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
>        at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
>        at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
>        at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
>        at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
>        at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:402)
>        at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:349)
>        at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:106)
>        at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:259)
>        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
>        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
>        at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
>        at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
>        at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
>        at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
>        at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:236)
>        at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1010)
>        at
> org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:373)
>        at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
>        at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
>        at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
>        at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
>        at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
>        at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
>        at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
>        at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)
>        at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
>        at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
>        at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
>        at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
>        at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>        at
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
>        at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
>        at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)
>        at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown
> Source)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>        at java.lang.Thread.run(Unknown Source)
>
> Waiting for your feedback, thank you in advance.
> Best regards,
> Dario Pellegrino
>
> Dario Pellegrino
> Direzione Ricerca e Innovazione - R&D Lab 
> dario.pellegrino at eng.it<mailto:dario.pellegrino at eng.it>
>
> Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 
> 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 
> www.eng.it<http://www.eng.it/>
>
> _______________________________________________
> Fiware-lab-help mailing list
> Fiware-lab-help at lists.fi-ware.org
> https://lists.fi-ware.org/listinfo/fiware-lab-help
>
Previous message: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2
Next message: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Error after upgrading to HiveServer2
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Fiware-lab-help mailing list
You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy Cookies policy