apache/kyuubi
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
94 Commits 23 Branches 0 Tags 65 MiB
e4e682f1fc
Commit Graph

94 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kent Yao
e4e682f1fc column based set support 2018-03-26 15:55:55 +08:00
Kent Yao
8d05c989ec java.lang.NullPointerException 
at org.apache.spark.sql.execution.SparkPlan.org581decodeUnsafeRows(SparkPlan.scala:250)
        at org.apache.spark.sql.execution.SparkPlan581anonfun.apply(SparkPlan.scala:287)
        at org.apache.spark.sql.execution.SparkPlan581anonfun.apply(SparkPlan.scala:287)
        at scala.collection.Iterator581anon.nextCur(Iterator.scala:434)
        at scala.collection.Iterator581anon.hasNext(Iterator.scala:440)
        at scala.collection.Iterator581anon.hasNext(Iterator.scala:408)
        at scala.collection.Iterator581anon.hasNext(Iterator.scala:389)
        at scala.collection.Iterator581anon.hasNext(Iterator.scala:408)
        at scala.collection.Iterator.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at scala.collection.generic.Growable.(Growable.scala:59)
        at scala.collection.mutable.ListBuffer.(ListBuffer.scala:183)
        at scala.collection.mutable.ListBuffer.(ListBuffer.scala:45)
        at scala.collection.TraversableOnce.to(TraversableOnce.scala:310)
        at scala.collection.AbstractIterator.to(Iterator.scala:1336)
        at scala.collection.TraversableOnce.toList(TraversableOnce.scala:294)
        at scala.collection.AbstractIterator.toList(Iterator.scala:1336)
        at yaooqinn.kyuubi.schema.RowSet.toTRows(RowSet.scala:35)
        at yaooqinn.kyuubi.schema.RowSet.toTRowSet(RowSet.scala:32)
        at yaooqinn.kyuubi.server.FrontendService.FetchResults(FrontendService.scala:507)
        at org.apache.hive.service.cli.thrift.TCLIService.getResult(TCLIService.java:1553)
        at org.apache.hive.service.cli.thrift.TCLIService.getResult(TCLIService.java:1538)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge.process(HadoopThriftAuthBridge.java:692)
        at org.apache.thrift.server.TThreadPoolServer.run(TThreadPoolServer.java:286)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
 2018-03-23 17:25:40 +08:00
Kent Yao
857f60b3b3 typo 2018-03-23 16:59:46 +08:00
Kent Yao
135b39d1ce org.apache.thrift.protocol.TProtocolException: Required field 'columns' is unset! Struct:TTableSchema(columns:null) 
at org.apache.hive.service.cli.thrift.TTableSchema.validate(TTableSchema.java:310)
	at org.apache.hive.service.cli.thrift.TGetResultSetMetadataResp.validate(TGetResultSetMetadataResp.java:380)
	at org.apache.hive.service.cli.thrift.TCLIService.validate(TCLIService.java:12404)
	at org.apache.hive.service.cli.thrift.TCLIService.write(TCLIService.java:12461)
	at org.apache.hive.service.cli.thrift.TCLIService.write(TCLIService.java:12430)
	at org.apache.hive.service.cli.thrift.TCLIService.write(TCLIService.java:12381)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:53)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge.process(HadoopThriftAuthBridge.java:692)
	at org.apache.thrift.server.TThreadPoolServer.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
 2018-03-23 15:53:28 +08:00
Kent Yao
9c8dfda8e2 add ut RowSetSuite 2018-03-23 15:06:22 +08:00
Kent Yao
e4a74b7989 add ut ColumnDescriptorSuite 2018-03-23 11:24:37 +08:00
Kent Yao
e855d0f666 add ut TypeDescriptorSuite 2018-03-22 21:33:17 +08:00
Kent Yao
2970a88f03 add ut TypeQualifiersSuite 2018-03-22 21:00:24 +08:00
Kent Yao
78bc5345f3 add ut SchemaMapperSuite 2018-03-22 17:56:48 +08:00
Kent Yao
9dbee98d2c fixes #29 support spark struct directly to thrift type 2018-03-22 11:18:40 +08:00
Kent Yao
5e5359a8d3
Merge pull request #28 from yaooqinn/i26 
toLocalIterator fixes #26
 2018-03-20 17:03:27 +08:00
Kent Yao
9ddabe0acf toLocalIterator 2018-03-20 16:56:12 +08:00
Kent Yao
ce7a18a64d
Merge pull request #25 from yaooqinn/i23-f 
codecov reports not found
 2018-03-20 15:40:30 +08:00
Kent Yao
be05e30737 add badge 2018-03-20 15:31:31 +08:00
Kent Yao
754da7489a fixes #23 codecov reports not found 2018-03-20 15:21:24 +08:00
Kent Yao
1a788e28eb
Merge pull request #24 from yaooqinn/i23 
support codecov close #23
 2018-03-20 14:58:12 +08:00
Kent Yao
2dc31248ae travis codecov 2018-03-20 14:51:45 +08:00
Kent Yao
feedf971a3 jvm err 2018-03-20 14:17:03 +08:00
Kent Yao
9338b60a76 support codecov 2018-03-20 11:27:58 +08:00
Kent Yao
839bd24fdf
Merge pull request #22 from yaooqinn/i21 
named thread factory
 2018-03-19 22:40:46 +08:00
Kent Yao
2a030c63e0 fixed #21 named thread factory 2018-03-19 22:34:18 +08:00
Kent Yao
246c014b83
Merge pull request #20 from yaooqinn/i19 
bring in fetch orientation
 2018-03-19 20:43:14 +08:00
Kent Yao
aba6ce822b fixes #19 bring in fetch orientation 2018-03-19 20:39:10 +08:00
Kent Yao
7a95123130
Merge pull request #18 from yaooqinn/i17 
fetch type inline to kyuubi
 2018-03-19 17:33:28 +08:00
Kent Yao
6159b3125e fetch type inline to kyuubi fixes #17 2018-03-19 17:24:06 +08:00
Kent Yao
603913f0ac
Merge pull request #16 from yaooqinn/i15 
inline info type/value close #15
 2018-03-19 16:50:41 +08:00
Kent Yao
5af2cac98a fixes i15 inline info type/value 2018-03-19 16:25:40 +08:00
Kent Yao
4a6ecf04a5
Merge pull request #13 from yaooqinn/i12 
bring operation state to kyuubi close #12
 2018-03-19 14:17:24 +08:00
Kent Yao
4901d7d9bf test fix 2018-03-19 11:09:05 +08:00
Kent Yao
f387fcd7ee org.apache.hive.service.cli.HiveSQLException: Illegal Operation state transition FINISHED -> CLOSED 
at yaooqinn.kyuubi.operation.OperationState.ex(OperationState.scala:30)
	at yaooqinn.kyuubi.operation.FINISHED$.ex(OperationState.scala:50)
	at yaooqinn.kyuubi.operation.OperationState.validateTransition(OperationState.scala:28)
	at yaooqinn.kyuubi.operation.FINISHED$.validateTransition(OperationState.scala:50)
	at yaooqinn.kyuubi.operation.KyuubiOperation.setState(KyuubiOperation.scala:101)
	at yaooqinn.kyuubi.operation.KyuubiOperation.cleanup(KyuubiOperation.scala:439)
	at yaooqinn.kyuubi.operation.KyuubiOperation.close(KyuubiOperation.scala:215)
	at yaooqinn.kyuubi.operation.OperationManager.closeOperation(OperationManager.scala:137)
	at yaooqinn.kyuubi.session.KyuubiSession.closeOperation(KyuubiSession.scala:389)
	at yaooqinn.kyuubi.server.BackendService.closeOperation(BackendService.scala:149)
	at yaooqinn.kyuubi.server.FrontendService.CloseOperation(FrontendService.scala:474)
	at org.apache.hive.service.cli.thrift.TCLIService.getResult(TCLIService.java:1513)
	at org.apache.hive.service.cli.thrift.TCLIService.getResult(TCLIService.java:1498)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge.process(HadoopThriftAuthBridge.java:692)
	at org.apache.thrift.server.TThreadPoolServer.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
 2018-03-19 10:46:47 +08:00
Kent Yao
359a80bd57 do as wrap initial db connection 2018-03-18 23:10:37 +08:00
Kent Yao
787f4eb1de fixes #12 bring operation state to kyuubi 2018-03-18 22:58:23 +08:00
Kent Yao
6751203790
Merge pull request #11 from yaooqinn/i10 
kyuubi session handle and operation handle
close #10
 2018-03-18 21:19:49 +08:00
Kent Yao
f4ad3352ea session id key not found in ui 2018-03-18 21:14:04 +08:00
Kent Yao
039618fbcb fixes #10 kyuubi session handle and operation handle 2018-03-18 16:14:21 +08:00
Kent Yao
3a1fb0089c
Merge pull request #9 from yaooqinn/i8 
implementation of timeout sql operations cleaning up
fixed #8
 2018-03-16 22:39:30 +08:00
Kent Yao
7c2d8c7b82 java.lang.NumberFormatException: For input string: "21600000ms" 
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Long.parseLong(Long.java:589)
	at java.lang.Long.parseLong(Long.java:631)
	at scala.collection.immutable.StringLike$class.toLong(StringLike.scala:276)
	at scala.collection.immutable.StringOps.toLong(StringOps.scala:29)
	at yaooqinn.kyuubi.operation.KyuubiOperation.<init>(KyuubiOperation.scala:53)
	at yaooqinn.kyuubi.operation.OperationManager.newExecuteStatementOperation(OperationManager.scala:88)
	at yaooqinn.kyuubi.session.KyuubiSession.executeStatementInternal(KyuubiSession.scala:220)
	at yaooqinn.kyuubi.session.KyuubiSession.executeStatement(KyuubiSession.scala:334)
	at yaooqinn.kyuubi.session.KyuubiSession$$anonfun$open$1.apply(KyuubiSession.scala:297)
	at yaooqinn.kyuubi.session.KyuubiSession$$anonfun$open$1.apply(KyuubiSession.scala:297)
	at scala.Option.foreach(Option.scala:257)
	at yaooqinn.kyuubi.session.KyuubiSession.open(KyuubiSession.scala:297)
	at yaooqinn.kyuubi.session.SessionManager.openSession(SessionManager.scala:234)
	at yaooqinn.kyuubi.server.BackendService.openSessionWithImpersonation(BackendService.scala:72)
	at yaooqinn.kyuubi.server.FrontendService.getSessionHandle(FrontendService.scala:244)
	at yaooqinn.kyuubi.server.FrontendService.OpenSession(FrontendService.scala:258)
	at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
	at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:692)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
 2018-03-16 22:26:14 +08:00
Kent Yao
786dd58dcc fixed #8 implementation of timeout sql operations cleaning up 2018-03-16 18:07:04 +08:00
Kent Yao
0e360904d8
Merge pull request #6 from yaooqinn/i5 
invoke stop method if an error occurred in initializing spark context
fixed #5
 2018-03-16 16:03:24 +08:00
Kent Yao
a9fb262c94 logs 2018-03-16 15:51:09 +08:00
Kent Yao
91d8138b75 sc stop after exception 2018-03-16 15:18:18 +08:00
Kent Yao
7c62321df0 new context thread 2018-03-16 14:59:52 +08:00
Kent Yao
ce21b42493 ui swallow all exceptions 2018-03-16 14:36:34 +08:00
Kent Yao
29ff3b6fe6 import ExecutionContext.Implicits.global 2018-03-16 11:45:28 +08:00
Kent Yao
15d1f7fc18 stop sc in future 2018-03-16 11:24:45 +08:00
Kent Yao
346b5ba5cb add interrupt 2018-03-16 10:45:25 +08:00
Kent Yao
28156ca26d fixes #5 SparkContext promise in kyuubi session time out do not stop its instantiating 2018-03-16 10:25:21 +08:00
Kent Yao
abab544d49
Merge pull request #4 from yaooqinn/i2 
fixed #3 initial db switch fails with privileges check
close #3
 2018-03-15 22:02:30 +08:00
Kent Yao
125f7f5b84 fixes #3 handle hive conttol exception 2018-03-15 21:48:38 +08:00
Kent Yao
1d9dc0d642 fixes #3 format err log 2018-03-15 20:49:48 +08:00