[KYUUBI #703][FOLLOWUP][DEPS][TEST] Reduce hudi spark extraJars deps
### _Why are the changes needed?_ Reduce hudi spark extraJars deps , it is unnecessary to submit all jars. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request Closes #1072 from simon824/master. Closes #703 2bb4af06 [simon] 1 e2164fa6 [simon] 1 dfc79ba6 [simon] && -> || 6791f95b [simon] reduce hudi spark extraJars deps ed4dc4b5 [Simon] Merge branch 'apache:master' into master ea5db291 [simon] remove space 3d002afd [simon] fix "File line length exceeds 100 characters" 1939038e [simon] roll back d25d3721 [simon] roll back 41232e55 [simon] remove dataLakeSuiteMixin tableOptions 68d6e891 [simon] fix error commit b802603c [simon] add getTableOption f6d37426 [Simon] Merge branch 'apache:master' into master 8b3b4b85 [simon] add tableOptions Lead-authored-by: simon <zhangshiming@cvte.com> Co-authored-by: Simon <3656562@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org>
This commit is contained in:
parent
1b89272749
commit
1f403ec618
@ -28,12 +28,10 @@ trait HudiSuiteMixin extends DataLakeSuiteMixin {
|
||||
override protected def warehouse: Path = Utils.createTempDir()
|
||||
|
||||
override protected def extraJars: String = {
|
||||
var extraJars = ""
|
||||
System.getProperty("java.class.path")
|
||||
.split(":")
|
||||
.filter(_.contains("jar"))
|
||||
.foreach(i => extraJars += i + ",")
|
||||
extraJars.substring(0, extraJars.length - 1)
|
||||
.filter(i => i.contains("hudi") || i.contains("spark-avro"))
|
||||
.mkString(",")
|
||||
}
|
||||
|
||||
override protected def extraConfigs = Map(
|
||||
|
||||
Loading…
Reference in New Issue
Block a user