janusgraph-users@lists.lfaidata.foundation

Home Messages Hashtags Subgroups Calendar

Messages

Between

and

Hi All, I have a multi-level graph with total 800 vertices. When I run g.V(<id of parent>).repeat(out()).emit() for first time, it takes 300ms. In profile(), I could see RepeatStep takes most of the

By faizez@... · #5534 ·

Re: JanusGraph and future versions of ES

Please also read the stance of Elasticsearch itself (because the AWS article did not link to it ): https://www.elastic.co/blog/license-change-clarification

By hadoopmarc@... · #5533 ·

JanusGraph and future versions of ES

Hi all, Since ES seems to have changed their licensing, what does this entail about the future usage of ES as a JanusGraph index

By Assaf Schwartz · #5532 ·

Re: Janusgraph query execution performance

Analytical queries require a full table scan. Some people succeed in speeding up analytical queries on JanusGraph using OLAP, check the older questions on OLAP and SparkGraphComputer

By hadoopmarc@... · #5531 ·

Janusgraph query execution performance

Hi, I have used https://github.com/IBM/expressive-reasoning-graph-store project to import the turtle file having around 4 Lakhs of concepts ad this project is using Janusgraph 0.4.0. Now after

By lalwani.ritu2609@... · #5530 ·

Re: OLAP Spark

Hi Vinayak, JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/ However, these InputFormats have several

By hadoopmarc@... · #5529 ·

Re: Janusgraph spark on yarn error

The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but

By hadoopmarc@... · #5528 ·

Re: reindex job is very slow on ElasticSearch and BigTable

I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the

By hadoopmarc@... · #5527 ·

OLAP Spark

Hi All, I am working on OLAP using Spark and Hadoop. I have a couple of questions. 1. How to execute a filter step on the driver and create an RDD of internal ids? 2. Distributing the collected Ids to

By Vinayak Bali · #5526 ·

Re: Database Level Caching

Thanks Nicolas, I am able to reproduce it using your configs & script. Created an issue at https://github.com/JanusGraph/janusgraph/issues/2369 Looks like a bug with calculating cache entries' size.

By Boxuan Li · #5525 ·

Re: Janusgraph spark on yarn error

Thank you for response! I am using BulkLoaderVertexProgram from console. Sometimes it works correctly. This error still exist when i am running read from hbase spark job. my

By j2kupper@... · #5524 · Edited

Re: reindex job is very slow on ElasticSearch and BigTable

Thanks a lot for your reply. I don't get any error message. The REINDEX step is very slow (2000/s) for the mixed index and fails after running for a few days. Everytime indexing fails or the cluster

By vamsi.lingala@... · #5523 ·

Re: Janusgraph spark on yarn error

#Private reply from OP: Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase. Yes, i have graphson part files from spark job with a structure like grateful-dead.json example. But if

By hadoopmarc@... · #5522 ·

Re: reindex job is very slow on ElasticSearch and BigTable

Thanks for reposting your issue on the janusgraph-users list! Can you please show the entire stack trace leading to your error message? Note that your issue might be related

By hadoopmarc@... · #5521 ·

reindex job is very slow on ElasticSearch and BigTable

we have imported around 4 billion vertices in janus graph. We are using big table and elastic search reindexing speed is very slow..around 2000 records per second is there any way to speed it

By vamsi.lingala@... · #5520 ·

Re: Janusgraph spark on yarn error

Hi OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way! Is your input

By hadoopmarc@... · #5 ·

Janusgraph spark on yarn error

Hi! I have this configuration janusgraph: 0.5.2 spark 2.4.0 hbase 2.1.5 hadoop 2.7.7 I have 3 nodes hadoop on my cluster. I am set up janusgraph with hadoop infrastructure and run load data and read

By j2kupper@... · #4 ·

Re: Database Level Caching

Hi Boxuan, Issue seems to occurs when edge properties are retrieved: cache has expected size with g.V().outE().id() an not when I do g.V().outE().valueMap(); I am able to reproduce with following

By nicolas.trangosi@... · #3 ·

Re: Hadoop and Spark not working with Janusgraph

Hi Vinayak, JanusGraph itself has spark as a dependency and the spark versions of the spark jars in the janusgraph/lib folder and of your spark cluster must match. Best wishes, Marc

By hadoopmarc@... · #2 ·

Hadoop and Spark not working with Janusgraph

---------- Forwarded message --------- From: Vinayak Bali <vinayakbali16@...> Date: Wed, 13 Jan 2021, 7:42 pm Subject: Hadoop and Spark not working with Janusgraph To:

By Vinayak Bali <vinayakbali16@...> · #1 ·

1201 - 1220 of 6734

Home Hashtags Subgroups Calendar Terms