How to run in Spark on YARN?

報告された spark-submit コマンド、その「Missing application resource」エラー、および記載されている YARN クラスターと Virtualenv の設定から始めます。必要なアプリケーションリソースと、Tensorframes および TensorFlow をワーカーノードで利用可能にする必要があるかどうかを確認します。完了条件は、動作する YARN 送信コマンドとデプロイ要件を文書化することです。

Hi, Everyone. Tensorframe is interesting to me. So I want to test Tensorframe in my Spark's cluster. But I have wonder.

1. I wondering that Tensorframe just needs to install to master node and don't needs to install any worker.
2. This command is okay that "pyspark --packages databricks:tensorframes:0.2.9-s_2.11"
   But I want to use Spark's cluster. So, I want to use this command "spark-submit --packages databricks:tensorframes:0.2.9-s_2.11". But this command has the error like this:

Exception in thread "main" java.lang.IllegalArgumentException: Missing application resource.
       at org.apache.spark.launcher.CommandBuilderUtils.checkArgument(CommandBuilderUtils.java:241)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitArgs(SparkSubmitCommandBuilder.java:160)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitCommand(SparkSubmitCommandBuilder.java:274)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:151)
       at org.apache.spark.launcher.Main.main(Main.java:86)

Someone have this error?

• I have Spark's cluster that has 3 nodes (YARN on a Hadoop cluster, 1 master, 2 worker)
• I used Virtualenv for Tensorflow(CPU version)
• I install panda-0.20.3

I would be grateful if you could please answer my question.