Hello, while debugging some Apache Spark jobs that process data from a Janusgraph graph. i noticed some issues with self-loop edges (edges that connect a vertex to itself). The data is read

Hi Zach, 1. For building an API service you do not need Gremlin Server. Gremlin Server has all kinds of features though that might (slightly) relieve the complexity of your service (with the

I've seen a lot of discussion about the benefits and such of both implementations but I was wondering if there was a big difference in terms of resource usage? I'm building an API service that will be

Hi, There does not seem to be much that helps in finding a root cause (no similar questions or issues in history). The most helpful thing I found is the following

Hi I am getting the below exception while ingesting data to an existing graph Job aborted due to stage failure: Task 349 in stage 2.0 failed 10 times, most recent failure: Lost task 349.9 in stage

Awesome thank you all for the great info and recent presentations! We are prototyping bulk export + deserialize from Cloud Bigtable over approx. the next week and will try to report back if we can

Hi Anjani, One thing that does not feel good is that you create and commit a transaction for every row of your dataframe. Although I do not see how this would interfere with ID allocation, best

Thanks Marc, i will try that option.

Sharing detail on how i am creating node/edges to make sure nothing wrong with that which is resulting in ID allocation failures. I am creating one static instance JanusGraph object on each spark

Thanks for response Marc. Yes i also think for some reason changes are not getting picked up but not able to figure out why so. ids.block-size is updated in config file of all janus nodes and after

Hi Anjani, It is still most likely that the modified value of "ids.block-size" somehow does not come through. So, are you sure that all JanusGraph instances are closed before using the new value

Hi Marc, I tried setting ids.num-partitions = number of executors through code not directly in janus global config files but no luck. Added below properties but it didn't

Hi Marc, That is an interesting solution. I was not aware of the mapreduce.application.classpath property. It is not well documented, but from what I understand, this option is used primarily to

Hi Boxuan, Yes, you are right, I mixed things up by wrongly interpreting GENERIC_OPTIONS as an env variable. I did some additional experiments. though, bringing in new information. 1. It is possible

Hi Anjani, To see what exactly happens with local configurations, I did the following: from the binary janusgraph distribution I started janusgraph with "bin/janusgraph.sh start" (this implicitly

Hi Elliot At zeotap we ve taken the same route to enable olap consumers via apache spark. We presented it in the recent janusgraph meet-up at

Hi Elliot, I am not aware of existing utilities for deserialization, but as Marc has suggested, you might want to see if there are old Titan resources regarding it, since the data model hasn’t been

Hi Elliot, There should be some old Titan resources that describe how the data model is binary coded into the row keys and row values. Of course, it is also implicit from the JanusGraph source

Hi Marc, Thanks for your explanation. Just to avoid confusion, GENERIC_OPTIONS itself is not an env variable, but a set of configuration options

Hello, Is there any supported way (e.g. a class/API) for deserializing raw data model rows, i.e. to get from raw Bigtable bytes to Vertex/edge list objects (in