How to run in Spark on YARN?

从报告的 spark-submit 命令、其“Missing application resource”错误以及所述的 YARN 集群和 Virtualenv 设置开始。确定所需的应用程序资源，以及是否必须在工作节点上提供 Tensorframes 和 TensorFlow；完成的标准是记录一个可正常工作的 YARN 提交命令和部署要求。

Hi, Everyone. Tensorframe is interesting to me. So I want to test Tensorframe in my Spark's cluster. But I have wonder.

1. I wondering that Tensorframe just needs to install to master node and don't needs to install any worker.
2. This command is okay that "pyspark --packages databricks:tensorframes:0.2.9-s_2.11"
   But I want to use Spark's cluster. So, I want to use this command "spark-submit --packages databricks:tensorframes:0.2.9-s_2.11". But this command has the error like this:

Exception in thread "main" java.lang.IllegalArgumentException: Missing application resource.
       at org.apache.spark.launcher.CommandBuilderUtils.checkArgument(CommandBuilderUtils.java:241)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitArgs(SparkSubmitCommandBuilder.java:160)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitCommand(SparkSubmitCommandBuilder.java:274)
       at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:151)
       at org.apache.spark.launcher.Main.main(Main.java:86)

Someone have this error?

• I have Spark's cluster that has 3 nodes (YARN on a Hadoop cluster, 1 master, 2 worker)
• I used Virtualenv for Tensorflow(CPU version)
• I install panda-0.20.3

I would be grateful if you could please answer my question.