|
Re: JanusGraph and future versions of ES
It would only affect the use of JanusGraph+Elastic if you were offering it in an -as-a-Service (-aaS) offering, like a commercial DBaaS. In which case the SSPL would require you to commit back to the
It would only affect the use of JanusGraph+Elastic if you were offering it in an -as-a-Service (-aaS) offering, like a commercial DBaaS. In which case the SSPL would require you to commit back to the
|
By
Peter Corless
·
#5537
·
|
|
Re: Janusgraph traversal time
Sounds normal to me. Note that setting query.batch=true might help a bit. Also note that the graph structure, in particular the number of repeat steps, is important. Finally, note that caching in the
Sounds normal to me. Note that setting query.batch=true might help a bit. Also note that the graph structure, in particular the number of repeat steps, is important. Finally, note that caching in the
|
By
hadoopmarc@...
·
#5536
·
|
|
Re: JanusGraph and future versions of ES
If I am understanding correctly, this does not affect the usage of Elasticsearch in JanusGraph. Regarding AWS's decision, seems no additional configs/code changes are needed if someone wants to use
If I am understanding correctly, this does not affect the usage of Elasticsearch in JanusGraph. Regarding AWS's decision, seems no additional configs/code changes are needed if someone wants to use
|
By
Boxuan Li
·
#5535
·
|
|
Janusgraph traversal time
Hi All,
I have a multi-level graph with total 800 vertices. When I run g.V(<id of parent>).repeat(out()).emit() for first time, it takes 300ms. In profile(), I could see RepeatStep takes most of the
Hi All,
I have a multi-level graph with total 800 vertices. When I run g.V(<id of parent>).repeat(out()).emit() for first time, it takes 300ms. In profile(), I could see RepeatStep takes most of the
|
By
faizez@...
·
#5534
·
|
|
Re: JanusGraph and future versions of ES
Please also read the stance of Elasticsearch itself (because the AWS article did not link to it ):
https://www.elastic.co/blog/license-change-clarification
Please also read the stance of Elasticsearch itself (because the AWS article did not link to it ):
https://www.elastic.co/blog/license-change-clarification
|
By
hadoopmarc@...
·
#5533
·
|
|
JanusGraph and future versions of ES
Hi all,
Since ES seems to have changed their licensing, what does this entail about the future usage of ES as a JanusGraph index
Hi all,
Since ES seems to have changed their licensing, what does this entail about the future usage of ES as a JanusGraph index
|
By
Assaf Schwartz
·
#5532
·
|
|
Re: Janusgraph query execution performance
Analytical queries require a full table scan. Some people succeed in speeding up analytical queries on JanusGraph using OLAP, check the older questions on OLAP and SparkGraphComputer
Analytical queries require a full table scan. Some people succeed in speeding up analytical queries on JanusGraph using OLAP, check the older questions on OLAP and SparkGraphComputer
|
By
hadoopmarc@...
·
#5531
·
|
|
Janusgraph query execution performance
Hi,
I have used https://github.com/IBM/expressive-reasoning-graph-store project to import the turtle file having around 4 Lakhs of concepts ad this project is using Janusgraph 0.4.0.
Now after
Hi,
I have used https://github.com/IBM/expressive-reasoning-graph-store project to import the turtle file having around 4 Lakhs of concepts ad this project is using Janusgraph 0.4.0.
Now after
|
By
lalwani.ritu2609@...
·
#5530
·
|
|
Re: OLAP Spark
Hi Vinayak,
JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/
However, these InputFormats have several
Hi Vinayak,
JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/
However, these InputFormats have several
|
By
hadoopmarc@...
·
#5529
·
|
|
Re: Janusgraph spark on yarn error
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
|
By
hadoopmarc@...
·
#5528
·
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
|
By
hadoopmarc@...
·
#5527
·
|
|
OLAP Spark
Hi All,
I am working on OLAP using Spark and Hadoop. I have a couple of questions.
1. How to execute a filter step on the driver and create an RDD of internal ids?
2. Distributing the collected Ids to
Hi All,
I am working on OLAP using Spark and Hadoop. I have a couple of questions.
1. How to execute a filter step on the driver and create an RDD of internal ids?
2. Distributing the collected Ids to
|
By
Vinayak Bali
·
#5526
·
|
|
Re: Database Level Caching
Thanks Nicolas, I am able to reproduce it using your configs & script. Created an issue at https://github.com/JanusGraph/janusgraph/issues/2369
Looks like a bug with calculating cache entries' size.
Thanks Nicolas, I am able to reproduce it using your configs & script. Created an issue at https://github.com/JanusGraph/janusgraph/issues/2369
Looks like a bug with calculating cache entries' size.
|
By
Boxuan Li
·
#5525
·
|
|
Re: Janusgraph spark on yarn error
Thank you for response!
I am using BulkLoaderVertexProgram from console. Sometimes it works correctly.
This error still exist when i am running read from hbase spark job.
my
Thank you for response!
I am using BulkLoaderVertexProgram from console. Sometimes it works correctly.
This error still exist when i am running read from hbase spark job.
my
|
By
j2kupper@...
·
#5524
·
Edited
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
Thanks a lot for your reply.
I don't get any error message.
The REINDEX step is very slow (2000/s) for the mixed index and fails after running for a few days.
Everytime indexing fails or the cluster
Thanks a lot for your reply.
I don't get any error message.
The REINDEX step is very slow (2000/s) for the mixed index and fails after running for a few days.
Everytime indexing fails or the cluster
|
By
vamsi.lingala@...
·
#5523
·
|
|
Re: Janusgraph spark on yarn error
#Private reply from OP:
Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase.
Yes, i have graphson part files from spark job with a structure like grateful-dead.json example.
But if
#Private reply from OP:
Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase.
Yes, i have graphson part files from spark job with a structure like grateful-dead.json example.
But if
|
By
hadoopmarc@...
·
#5522
·
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
Thanks for reposting your issue on the janusgraph-users list!
Can you please show the entire stack trace leading to your error message?
Note that your issue might be related
Thanks for reposting your issue on the janusgraph-users list!
Can you please show the entire stack trace leading to your error message?
Note that your issue might be related
|
By
hadoopmarc@...
·
#5521
·
|
|
reindex job is very slow on ElasticSearch and BigTable
we have imported around 4 billion vertices in janus graph.
We are using big table and elastic search
reindexing speed is very slow..around 2000 records per second
is there any way to speed it
we have imported around 4 billion vertices in janus graph.
We are using big table and elastic search
reindexing speed is very slow..around 2000 records per second
is there any way to speed it
|
By
vamsi.lingala@...
·
#5520
·
|
|
Re: Janusgraph spark on yarn error
Hi
OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way!
Is your input
Hi
OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way!
Is your input
|
By
hadoopmarc@...
·
#5
·
|
|
Janusgraph spark on yarn error
Hi!
I have this configuration
janusgraph: 0.5.2
spark 2.4.0
hbase 2.1.5
hadoop 2.7.7
I have 3 nodes hadoop on my cluster.
I am set up janusgraph with hadoop infrastructure and run load data and read
Hi!
I have this configuration
janusgraph: 0.5.2
spark 2.4.0
hbase 2.1.5
hadoop 2.7.7
I have 3 nodes hadoop on my cluster.
I am set up janusgraph with hadoop infrastructure and run load data and read
|
By
j2kupper@...
·
#4
·
|