Hi Alessandro,

Yes, please include the properties file.

To be clear, you see in the spark web UI:
spark.master=yarn
spark.executor.instances=12

and only two executors for 700+ tasks show up, while other jobs using the same EMR account spawn tens of executors? Is their any yarn queue you have to specify to get more resources from yarn? It sounds like some limit in yarn RM.

Best wishes,   Marc