报错Could not find Flink job
Job has been submitted with JobID 52e00d8f89544a7df6de38b45e33686e
------------------------------------------------------------
The program finished with the following exception:
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error:
org.apache.flink.runtime.rest.util.RestClientException: [org.apache.flink.runtime.rest.handler.RestHandlerException:
org.apache.flink.runtime.messages.FlinkJobNotFoundException: Could not find Flink job
(52e00d8f89544a7df6de38b45e33686e)
at org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.propagateException
(JobExecutionResultHandler.java:94)
在运行最简单的样例的时候bin/flink run -m yarn-cluster examples/batch/WordCount.jar，出现了这种报错。当时的情况是第一次成功了，后来执行的就一直报这种错误，就算重启集群也不行。如果不kill掉的话，继续开启一个新的样例时，日志会打印Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster这种日志，最后才发现是因为配置文件里面配置了cluster.id。在使用cluster模式时，如果使用per job模式，不能手动设置cluster.id，每次提交任务时，会自动生成。检查配置参数，不要配置cluster.id就会解决。当时我看官网里有这些配置就配上去了，结果导致了这种错误，搞了好多天才搞定。
|