9d3347e949
- Scripts for running the benchmark either while working on spark-sql-perf (bin/run) or while working on Spark (bin/spark-perf). The latter uses Spark's sbt build to compile spark and downloads the most recent published version of spark-sql-perf. - Adds a `--compare` that can be used to compare the results with a baseline run Author: Michael Armbrust <michael@databricks.com> Closes #49 from marmbrus/runner.
9 lines
373 B
Bash
Executable File
9 lines
373 B
Bash
Executable File
#!/bin/bash
|
|
|
|
# runs the most recent published version of spark-sql-perf, from within the spark directory
|
|
# spark is compiled using SBT
|
|
|
|
DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
|
|
VERSION=`git -C $DIR/../ tag | tail -n 1 | cut -c 2-`
|
|
ARGS="sparkPackage com.databricks:spark-sql-perf_2.10:$VERSION com.databricks.spark.sql.perf.RunBenchmark $@"
|
|
build/sbt "$ARGS" |