Re: Janusgraph + Spark standalone without hadoop

Debasish Kanhar <d.k...@...>


JanusGraph doesn't need Hadoop Cluster to run OLAP yes, but doesn't JanusGraph needs to point to a live Hadoop Cluster by setting HADOOP_CONF_DIR in CLASSPATH? I guess that was my understanding, and that was missing piece in docs for which it took me really long time to crack OLAP using Spark cluster.

On Friday, 24 August 2018 06:53:20 UTC+5:30, Jerry He wrote:
That being said, to be clear, you don't need a Hadoop cluster or any kind if that is what you mean. JanusGraph packages the Hadoop jars it needs. That is all you need to run SparkComputer on JansGraph.



On Thu, Aug 23, 2018 at 5:56 PM Jerry He <je...@...> wrote:
I don't think it will work. Spark needs input (to read graph data) and output (to write graph data).  JanusGraph currently only provides Hadoop InputFormat based reading from JanusGraph for OLAP.
In Tinkerpop, there are InputRDD and OutputRDD interfaces, which are by Spark (SpackGraphComputer).  (Search for Tinkerpop InputRDD.)
Unfortunately, JanusGraph provides no implementations other than the InputFormat based at the moment.



On Wed, Aug 22, 2018 at 8:46 AM, Wei Ding <dw...@...> wrote:
Hi All,
   I am pretty new to Janusgraph and want to get some suggestions from you. Previously I posted a question about using ES as backend storage, and got some good feedback from Jason (Thanks!).  Now here comes another question: If I want to use janusgraph spark standalone without Hadoop for OLAP,  can some one point me a direction? Basically I have spark standalone deployed on kubernetes, how could that be used for OLAP? 

Thanks a lot!


You received this message because you are subscribed to the Google Groups "JanusGraph developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
To view this discussion on the web visit
For more options, visit

Join { to automatically receive all group messages.