Hi All,
I am running SparkGraphComputer using tinker-pop library on Yarn. I am able to run vertex program successfully and write final output to a mount location. But I a want to make program to write to HDFS.
We are using Hadoop 3 and TinkerPop 3.6
On giving output path as hdfs location. I see Hadoop libraries tries to get host details from HDFS server DNS name and fails with unknown host exception.
To fix that I had put a condition in hadoop library saying if host is HDFS DNS name then looks for a specific host and then its started connecting to HDFS FS.
With that connection happening to HDFS, output folder gets created in HDFS but it fails while trying to write with below exception
java.io.IOException: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS];
Could you please share thoughts/pointers to debug it?
Thanks,
Anjani
