1. Messages
  2. Janusgraph + Spark standalone without hadoop

Re: Janusgraph + Spark standalone without hadoop

Jerry He <jerr...@...>
 

I don't think it will work. Spark needs input (to read graph data) and output (to write graph data).  JanusGraph currently only provides Hadoop InputFormat based reading from JanusGraph for OLAP.
In Tinkerpop, there are InputRDD and OutputRDD interfaces, which are by Spark (SpackGraphComputer).  (Search for Tinkerpop InputRDD.)
Unfortunately, JanusGraph provides no implementations other than the InputFormat based at the moment.

Thanks,

Jerry
 


On Wed, Aug 22, 2018 at 8:46 AM, Wei Ding <dw84...@...> wrote:
Hi All,
   I am pretty new to Janusgraph and want to get some suggestions from you. Previously I posted a question about using ES as backend storage, and got some good feedback from Jason (Thanks!).  Now here comes another question: If I want to use janusgraph spark standalone without Hadoop for OLAP,  can some one point me a direction? Basically I have spark standalone deployed on kubernetes, how could that be used for OLAP? 

Thanks a lot!

Wei

--
You received this message because you are subscribed to the Google Groups "JanusGraph developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-dev+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-dev/512224e3-5b20-4e31-afa5-e2fd74591182%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Join {janusgraph-dev@lists.lfaidata.foundation to automatically receive all group messages.