|
Hadoop and Spark not working with Janusgraph
Hi Vinayak, JanusGraph itself has spark as a dependency and the spark versions of the spark jars in the janusgraph/lib folder and of your spark cluster must match. Best wishes, Marc
Hi Vinayak, JanusGraph itself has spark as a dependency and the spark versions of the spark jars in the janusgraph/lib folder and of your spark cluster must match. Best wishes, Marc
|
By
hadoopmarc@...
· #2
·
|
|
Janusgraph spark on yarn error
Hi OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way! Is your input d
Hi OK, do I understand right that you want to bulk load data from hdfs into janusgraph-hbase? Nothing wrong with that requirement, I do not know how to ask this in a more friendly way! Is your input d
|
By
hadoopmarc@...
· #5
·
|
|
reindex job is very slow on ElasticSearch and BigTable
Thanks for reposting your issue on the janusgraph-users list! Can you please show the entire stack trace leading to your error message? Note that your issue might be related to: https://github.com/Jan
Thanks for reposting your issue on the janusgraph-users list! Can you please show the entire stack trace leading to your error message? Note that your issue might be related to: https://github.com/Jan
|
By
hadoopmarc@...
· #5521
·
|
|
Janusgraph spark on yarn error
#Private reply from OP: Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase. Yes, i have graphson part files from spark job with a structure like grateful-dead.json example. But if app
#Private reply from OP: Yes, i am running bulk load from hdfs(graphson) in janusgraph-hbase. Yes, i have graphson part files from spark job with a structure like grateful-dead.json example. But if app
|
By
hadoopmarc@...
· #5522
·
|
|
reindex job is very slow on ElasticSearch and BigTable
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
I mean, what happens if you try to run MapReduceIndexManagement on BigTable. Apparently, you get this error message "MapReduceIndexManagement is not supported for BigTable" but I would like to see the
|
By
hadoopmarc@...
· #5527
·
|
|
Janusgraph spark on yarn error
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
The path of the BulkLoaderVertexProgram might be doable, but I cannot help you on that one. In the stack trace above, the yarn appmaster from spark-yarn apparently tries to communicate with HBase but
|
By
hadoopmarc@...
· #5528
·
|
|
OLAP Spark
Hi Vinayak, JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/ However, these InputFormats have several pro
Hi Vinayak, JanusGraph has defined hadoop InputFormats for its storage backends to do OLAP queries, see https://docs.janusgraph.org/advanced-topics/hadoop/ However, these InputFormats have several pro
|
By
hadoopmarc@...
· #5529
·
|
|
Janusgraph query execution performance
Analytical queries require a full table scan. Some people succeed in speeding up analytical queries on JanusGraph using OLAP, check the older questions on OLAP and SparkGraphComputer and https://docs.
Analytical queries require a full table scan. Some people succeed in speeding up analytical queries on JanusGraph using OLAP, check the older questions on OLAP and SparkGraphComputer and https://docs.
|
By
hadoopmarc@...
· #5531
·
|
|
JanusGraph and future versions of ES
Please also read the stance of Elasticsearch itself (because the AWS article did not link to it ): https://www.elastic.co/blog/license-change-clarification
Please also read the stance of Elasticsearch itself (because the AWS article did not link to it ): https://www.elastic.co/blog/license-change-clarification
|
By
hadoopmarc@...
· #5533
·
|
|
Janusgraph traversal time
Sounds normal to me. Note that setting query.batch=true might help a bit. Also note that the graph structure, in particular the number of repeat steps, is important. Finally, note that caching in the
Sounds normal to me. Note that setting query.batch=true might help a bit. Also note that the graph structure, in particular the number of repeat steps, is important. Finally, note that caching in the
|
By
hadoopmarc@...
· #5536
·
|
|
Issues with controlling partitions when using Apache Spark
Hi Mladen, Having answered several questions about the JanusGraph InputFormats, I can confirm that many users encounter problems with the size of the input splits. This is the case in particular for t
Hi Mladen, Having answered several questions about the JanusGraph InputFormats, I can confirm that many users encounter problems with the size of the input splits. This is the case in particular for t
|
By
hadoopmarc@...
· #5546
·
|
|
Connecting to Multiple Schemas using Java
Hi Vinayak, The TinkerPop ref docs gives the following code fragment for connecting with the cluster method: Cluster cluster = Cluster.open(); GraphTraversalSource g1 = traversal().withRemote(DriverRe
Hi Vinayak, The TinkerPop ref docs gives the following code fragment for connecting with the cluster method: Cluster cluster = Cluster.open(); GraphTraversalSource g1 = traversal().withRemote(DriverRe
|
By
hadoopmarc@...
· #5560
·
|
|
reindex job is very slow on ElasticSearch and BigTable
OK, thanks for confirming the stacktrace. You can report this behavior as an issue on https://github.com/JanusGraph/janusgraph/issues, referring to this thread. It is still not clear to me how this ex
OK, thanks for confirming the stacktrace. You can report this behavior as an issue on https://github.com/JanusGraph/janusgraph/issues, referring to this thread. It is still not clear to me how this ex
|
By
hadoopmarc@...
· #5561
·
|
|
Recommended way to perform Schema / Data migration
Hi Nick, What do you want to migrate? Vertex labels? Property keys? Did you take a look at: https://docs.janusgraph.org/basics/schema/#changing-schema-elements Best wishes, Marc
Hi Nick, What do you want to migrate? Vertex labels? Property keys? Did you take a look at: https://docs.janusgraph.org/basics/schema/#changing-schema-elements Best wishes, Marc
|
By
hadoopmarc@...
· #5562
·
|
|
Create new node for each group of connected nodes
Hi Anjani, Your use case obviously comes down to an OLAP query. While JanusGraph provides InputFormat classes to use TInkerPop's SparkGraphComputer and HadoopGraph, many users have experienced problem
Hi Anjani, Your use case obviously comes down to an OLAP query. While JanusGraph provides InputFormat classes to use TInkerPop's SparkGraphComputer and HadoopGraph, many users have experienced problem
|
By
hadoopmarc@...
· #5564
·
|
|
reindex job is very slow on ElasticSearch and BigTable
This trace says that your elasticsearch cluster becomes unresponsive. Check your elasticsearch cluster with requests like: https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-healt
This trace says that your elasticsearch cluster becomes unresponsive. Check your elasticsearch cluster with requests like: https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-healt
|
By
hadoopmarc@...
· #5569
·
|
|
reindex job is very slow on ElasticSearch and BigTable
Is this again for 4 billion vertices? Do the gremlin server logs show whether the problem is with the index or with the backend? Does this occur for any vertex? Try to retrieve the first few vertices
Is this again for 4 billion vertices? Do the gremlin server logs show whether the problem is with the index or with the backend? Does this occur for any vertex? Try to retrieve the first few vertices
|
By
hadoopmarc@...
· #5571
·
|
|
Open instances
Hi, Good that you noticed this! Some explanation and the cure can be found at: https://docs.janusgraph.org/advanced-topics/recovery/#janusgraph-instance-failure Best wishes, Marc
Hi, Good that you noticed this! Some explanation and the cure can be found at: https://docs.janusgraph.org/advanced-topics/recovery/#janusgraph-instance-failure Best wishes, Marc
|
By
hadoopmarc@...
· #5578
·
|
|
reindex job is very slow on ElasticSearch and BigTable
Hi, No, MixedIndex should be fine. Can you show the code lines that define the index for the maid property key? Possibly, the index is restricted to a specific label so you have to query: g.V().has('p
Hi, No, MixedIndex should be fine. Can you show the code lines that define the index for the maid property key? Possibly, the index is restricted to a specific label so you have to query: g.V().has('p
|
By
hadoopmarc@...
· #5579
·
|
|
Authentication All the Schema's
Hi Vinayak, No, this is not possible. TinkerPop/JanusGraph currently only support authentication to the graph system as a whole and do not support authorization. Later this year, the Apache TinkerPop
Hi Vinayak, No, this is not possible. TinkerPop/JanusGraph currently only support authentication to the graph system as a whole and do not support authorization. Later this year, the Apache TinkerPop
|
By
hadoopmarc@...
· #5583
·
|