|
Janusgraph query execution performance
Hi,
I have used https://github.com/IBM/expressive-reasoning-graph-store project to import the turtle file having around 4 Lakhs of concepts ad this project is using Janusgraph 0.4.0.
Now after
Hi,
I have used https://github.com/IBM/expressive-reasoning-graph-store project to import the turtle file having around 4 Lakhs of concepts ad this project is using Janusgraph 0.4.0.
Now after
|
By
lalwani.ritu2609@...
·
#5530
·
|
|
Re: OLAP Spark
Hi Vinayak,
JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/
However, these InputFormats have several
Hi Vinayak,
JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/
However, these InputFormats have several
|
By
hadoopmarc@...
·
#5529
·
|
|
Re: Janusgraph spark on yarn error
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
|
By
hadoopmarc@...
·
#5528
·
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
|
By
hadoopmarc@...
·
#5527
·
|
|
OLAP Spark
Hi All,
I am working on OLAP using Spark and Hadoop. I have a couple of questions.
1. How to execute a filter step on the driver and create an RDD of internal ids?
2. Distributing the collected Ids to
Hi All,
I am working on OLAP using Spark and Hadoop. I have a couple of questions.
1. How to execute a filter step on the driver and create an RDD of internal ids?
2. Distributing the collected Ids to
|
By
Vinayak Bali
·
#5526
·
|
|
Re: Database Level Caching
Thanks Nicolas, I am able to reproduce it using your configs & script. Created an issue at https://github.com/JanusGraph/janusgraph/issues/2369
Looks like a bug with calculating cache entries' size.
Thanks Nicolas, I am able to reproduce it using your configs & script. Created an issue at https://github.com/JanusGraph/janusgraph/issues/2369
Looks like a bug with calculating cache entries' size.
|
By
Boxuan Li
·
#5525
·
|
|
Re: Janusgraph spark on yarn error
Thank you for response!
I am using BulkLoaderVertexProgram from console. Sometimes it works correctly.
This error still exist when i am running read from hbase spark job.
my
Thank you for response!
I am using BulkLoaderVertexProgram from console. Sometimes it works correctly.
This error still exist when i am running read from hbase spark job.
my
|
By
j2kupper@...
·
#5524
·
Edited
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
Thanks a lot for your reply.
I don't get any error message.
The REINDEX step is very slow (2000/s) for the mixed index and fails after running for a few days.
Everytime indexing fails or the cluster
Thanks a lot for your reply.
I don't get any error message.
The REINDEX step is very slow (2000/s) for the mixed index and fails after running for a few days.
Everytime indexing fails or the cluster
|
By
vamsi.lingala@...
·
#5523
·
|
|
Re: Janusgraph spark on yarn error
#Private reply from OP:
Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase.
Yes, i have graphson part files from spark job with a structure like grateful-dead.json example.
But if
#Private reply from OP:
Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase.
Yes, i have graphson part files from spark job with a structure like grateful-dead.json example.
But if
|
By
hadoopmarc@...
·
#5522
·
|
|
Re: reindex job is very slow on ElasticSearch and BigTable
Thanks for reposting your issue on the janusgraph-users list!
Can you please show the entire stack trace leading to your error message?
Note that your issue might be related
Thanks for reposting your issue on the janusgraph-users list!
Can you please show the entire stack trace leading to your error message?
Note that your issue might be related
|
By
hadoopmarc@...
·
#5521
·
|
|
reindex job is very slow on ElasticSearch and BigTable
we have imported around 4 billion vertices in janus graph.
We are using big table and elastic search
reindexing speed is very slow..around 2000 records per second
is there any way to speed it
we have imported around 4 billion vertices in janus graph.
We are using big table and elastic search
reindexing speed is very slow..around 2000 records per second
is there any way to speed it
|
By
vamsi.lingala@...
·
#5520
·
|
|
Re: Janusgraph spark on yarn error
Hi
OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way!
Is your input
Hi
OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way!
Is your input
|
By
hadoopmarc@...
·
#5
·
|
|
Janusgraph spark on yarn error
Hi!
I have this configuration
janusgraph: 0.5.2
spark 2.4.0
hbase 2.1.5
hadoop 2.7.7
I have 3 nodes hadoop on my cluster.
I am set up janusgraph with hadoop infrastructure and run load data and read
Hi!
I have this configuration
janusgraph: 0.5.2
spark 2.4.0
hbase 2.1.5
hadoop 2.7.7
I have 3 nodes hadoop on my cluster.
I am set up janusgraph with hadoop infrastructure and run load data and read
|
By
j2kupper@...
·
#4
·
|
|
Re: Database Level Caching
Hi Boxuan,
Issue seems to occurs when edge properties are retrieved: cache has expected size with g.V().outE().id() an not when I do g.V().outE().valueMap();
I am able to reproduce with following
Hi Boxuan,
Issue seems to occurs when edge properties are retrieved: cache has expected size with g.V().outE().id() an not when I do g.V().outE().valueMap();
I am able to reproduce with following
|
By
nicolas.trangosi@...
·
#3
·
|
|
Re: Hadoop and Spark not working with Janusgraph
Hi Vinayak,
JanusGraph itself has spark as a dependency and the spark versions of the spark jars in the janusgraph/lib folder and of your spark cluster must match.
Best wishes, Marc
Hi Vinayak,
JanusGraph itself has spark as a dependency and the spark versions of the spark jars in the janusgraph/lib folder and of your spark cluster must match.
Best wishes, Marc
|
By
hadoopmarc@...
·
#2
·
|
|
Hadoop and Spark not working with Janusgraph
---------- Forwarded message ---------
From: Vinayak Bali <vinayakbali16@...>
Date: Wed, 13 Jan 2021, 7:42 pm
Subject: Hadoop and Spark not working with Janusgraph
To:
---------- Forwarded message ---------
From: Vinayak Bali <vinayakbali16@...>
Date: Wed, 13 Jan 2021, 7:42 pm
Subject: Hadoop and Spark not working with Janusgraph
To:
|
By
Vinayak Bali <vinayakbali16@...>
·
#1
·
|
|
[ANNOUNCEMENT] JanusGraph joins LF AI & Data umbrella
On behalf of the JanusGraph Technical Steering Committee, we are excited to join LF AI & Data Foundation!
We are now moving mailing lists to a new home under LF AI & Data. Mailing lists hosted on
On behalf of the JanusGraph Technical Steering Committee, we are excited to join LF AI & Data Foundation!
We are now moving mailing lists to a new home under LF AI & Data. Mailing lists hosted on
|
By
"alex...@gmail.com" <alexand...@...>
·
#5519
·
|
|
Re: Could not alias [g] to [g] as [g]
Hi,
Unfortunately, the janusgraph ref docs do not have full documentation for using scylladb, but in order to use scylladb you have to make sure the janusgraph configs are similar to the
Hi,
Unfortunately, the janusgraph ref docs do not have full documentation for using scylladb, but in order to use scylladb you have to make sure the janusgraph configs are similar to the
|
By
HadoopMarc <bi...@...>
·
#5518
·
|
|
Re: docker base tests for scylladb stopped working
Raised it in
https://github.com/JanusGraph/janusgraph/issues/2351
Raised it in
https://github.com/JanusGraph/janusgraph/issues/2351
|
By
Israel Fruchter <fr...@...>
·
#5517
·
|
|
Re: Could not alias [g] to [g] as [g]
When I replaced Cassandra with ScyllaDB it stopped working. Could it be that ScyllaDB is not compatible with either JanusGraph or Elasticsearch?
When I replaced Cassandra with ScyllaDB it stopped working. Could it be that ScyllaDB is not compatible with either JanusGraph or Elasticsearch?
|
By
Yamiteru XYZ <yamit...@...>
·
#5516
·
|