Hi Anjani, The following section of the TinkerPop ref docs gives an example of how to reuse the output RDD of one job in a follow-up gremlin OLAP

Hi Boxuan, Yes, I did not finish my argument. What I tried to suggest: if the hadoop CLI command checks the GENERIC_OPTIONS env variable, then maybe also the mapreduce java client called by JanusGraph

Hello, We will be hosting a community meetup next week on Tuesday, May 18th at 9:30 central/10:30 eastern. We have a great set of speakers who will be discussing all things JanusGraph OLAP: * Hadoop

Hi Marc, you are right, we are indeed using this -files option :)

Hi Boxuan, Using existing mechanisms for configuring mapreduce would be nicer, indeed. Upon reading this hadoop command, I see a GENERIC_OPTIONS env variable read by the mapreduce client, that can

We have been using a yarn cluster to run MapReduce reindexing (Cassandra + Elasticsearch) for a long time. Recently, we introduced Kerberos-based authentication to the Elasticsearch cluster, meaning

Hello, I encounter the error describe in the issue #1916 (https://github.com/JanusGraph/janusgraph/issues/1916) on a mixed index (lucene). When I list property keys of the index, they are all

On Thu, May 6, 2021 at 11:36 PM, <hadoopmarc@...> wrote: MarcHi Marc, Thanks for the reply. Yeah, it's true that a multi-node setup uses the same storage backend. However, I am referring to here is

Hi All, I am using connected component vertex program to find all the connected nodes in graph and then using that RDD for further processing in graph. I want to store that RDD at some output location

On Tue, May 11, 2021 at 04:56 PM, <hadoopmarc@...> wrote: ids.num-partitionsThanks for help Marc, i will try updating value of ids.num-partitions = number of executors.

Hi Anjani, It is a while ago I did this myself. I interpret ids.num-partitions as a stock of reserved id blocks that can be delegated to a janugraph instance. It does not have a large value to not

We have 250 parallel spark task running for creating node/edges. I didn't get parallel tasks - (for setting ids.num-partitions)? Could you please help me on it?

What is the number of parallel tasks? (for setting ids.num-partitions) You have the ids.authority.wait-time still on its default value of 300 ms, so that seems worthwhile experimenting with. Best

On Tue, May 11, 2021 at 11:54 AM, <hadoopmarc@...> wrote: https://docs.janusgraph.org/advanced-topics/bulk-loading/#optimizing-id-allocation Thanks for response Marc. Below is the method i am using

Hi Anjani, Please show the properties file you use to open janusgraph. I assume you also saw the other recommendations in

Hi All, I am creating vertex and edges in bulk and getting below error while creating edge. Below is the exception log:I tired increasing value of "ids.block-size" but still no luck, even set to 1B

Hi Vinayak, Actually, query 4 was easier to rework. It could read somewhat like: g.V().has('property1', 'vertex1').as('v1').outE().has('property1', 'edge1').limit(100).as('e').inV().has('property1',

Hi Marc, Thank you for your reply. I will try to report this issue on janusgraph repository. Regarding the work around you suggested, if possible please share the updated query with work around for

Hi Vinayak, If you would bother to demonstrate this behavior with a reproducible, generated graph, you can report it as an issue on github. For now, you can only look for workarounds: - combine the

Hi Marc, This query takes 18 sec to run by changing as to aggregate and select to project. But still, 99% of the time is taken to compute union. There is no memory issue, it already set to