|
Managed memory leak detected in Spark Olap query
Hi everyone,
I am using Janusgraph version 5.2 with cassandra backend.
When using
graph = GraphFactory.open(Resources.getResource("read-cql.properties").getFile());
g =
Hi everyone,
I am using Janusgraph version 5.2 with cassandra backend.
When using
graph = GraphFactory.open(Resources.getResource("read-cql.properties").getFile());
g =
|
By
Lilly <lfie...@...>
·
#5153
·
|
|
Re: Write to gryo
Hi Nicolas,
Thank you so much this works like a charm!
Lilly
Nicolas Trangosi schrieb am Sonntag, 6. September 2020 um 21:15:12 UTC+2:
Hi Nicolas,
Thank you so much this works like a charm!
Lilly
Nicolas Trangosi schrieb am Sonntag, 6. September 2020 um 21:15:12 UTC+2:
|
By
Lilly <lfie...@...>
·
#5152
·
|
|
Re: Encounter error when run OLAP with Spark Yarn
Hello Marc! Thank you again!
Sorry for my silly mistake......I forgot add hadoop conf dir into /etc/profile(I used to manually export this in console
But I still encounter a lot of ERROR caused by
Hello Marc! Thank you again!
Sorry for my silly mistake......I forgot add hadoop conf dir into /etc/profile(I used to manually export this in console
But I still encounter a lot of ERROR caused by
|
By
"sa...@gmail.com" <santh...@...>
·
#5151
·
|
|
Re: Write to gryo
Hi Lilly,
Have yuo tried to register JanusGraphIoRegistry ?
g.io(out)
.with(IO.writer, IO.gryo)
.with(IO.registry, JanusGraphIoRegistry.class.getName())
.write()
Regards,
NicolasCe message
Hi Lilly,
Have yuo tried to register JanusGraphIoRegistry ?
g.io(out)
.with(IO.writer, IO.gryo)
.with(IO.registry, JanusGraphIoRegistry.class.getName())
.write()
Regards,
NicolasCe message
|
By
Nicolas Trangosi <nicolas...@...>
·
#5150
·
|
|
Re: Use of ModifierType fails if TypeDefinitionCategory is not loaded before
Hello Marc,
The method setConsistency uses ModifierType.CONSISTENCY (cf.
Hello Marc,
The method setConsistency uses ModifierType.CONSISTENCY (cf.
|
By
toom <to...@...>
·
#5149
·
|
|
Re: Write to gryo
Thank you for your answer.
The problem is, I was actually meaning a Tinkergraph which is constructed by "subgraphing" a janusgraph.
I also tried it in the console like so:
gremlin> subG =
Thank you for your answer.
The problem is, I was actually meaning a Tinkergraph which is constructed by "subgraphing" a janusgraph.
I also tried it in the console like so:
gremlin> subG =
|
By
Lilly <lfie...@...>
·
#5148
·
|
|
Re: Encounter error when run OLAP with Spark Yarn
OK, some steps made!
The stacktrace says that the yarn client cannot connect to the yarn Resource Manager. So, check how you replaced the [hadoop_conf_dir] placeholder, which directory should contain
OK, some steps made!
The stacktrace says that the yarn client cannot connect to the yarn Resource Manager. So, check how you replaced the [hadoop_conf_dir] placeholder, which directory should contain
|
By
HadoopMarc <bi...@...>
·
#5147
·
|
|
Re: Write to gryo
Seems you mean Janusgraph instead Tinkergraph
This snippet works as expected:
graph = JanusGraphFactory.build().
set("storage.backend","inmemory").
open()
g =
Seems you mean Janusgraph instead Tinkergraph
This snippet works as expected:
graph = JanusGraphFactory.build().
set("storage.backend","inmemory").
open()
g =
|
By
"ow...@gmail.com" <owner...@...>
·
#5146
·
|
|
Write to gryo
Hi everyone,
I am using Java and trying to write a Tinkergraph to Gryo format. To do so I tried:
g.io("file.kryo").write().iterate()
As suggested in the tinkerpop documentation.
However, this results
Hi everyone,
I am using Java and trying to write a Tinkergraph to Gryo format. To do so I tried:
g.io("file.kryo").write().iterate()
As suggested in the tinkerpop documentation.
However, this results
|
By
Lilly <lfie...@...>
·
#5145
·
|
|
Re: Encounter error when run OLAP with Spark Yarn
Hello Marc!
Thanks for reply! I have seen you in a lot of post, appreciate your help!
I have checked the all jars in my CDH libs and replace them when certain errors occur.
So, followed post I
Hello Marc!
Thanks for reply! I have seen you in a lot of post, appreciate your help!
I have checked the all jars in my CDH libs and replace them when certain errors occur.
So, followed post I
|
By
"sa...@gmail.com" <santh...@...>
·
#5144
·
|
|
Re: Use of ModifierType fails if TypeDefinitionCategory is not loaded before
Hi Toom,
You are right, my bad. I can confirm this behaviour. Can you also document how this affects the use of JanusGraphManagement.setConsistency?
void setConsistency(JanusGraphSchemaElement
Hi Toom,
You are right, my bad. I can confirm this behaviour. Can you also document how this affects the use of JanusGraphManagement.setConsistency?
void setConsistency(JanusGraphSchemaElement
|
By
HadoopMarc <bi...@...>
·
#5143
·
|
|
Re: Encounter error when run OLAP with Spark Yarn
The stacktrace seems only related to the fact that the sparkcontext remained alive after a failed attempt at finding the right configs. So restart the gremlin console to get rid of this particular
The stacktrace seems only related to the fact that the sparkcontext remained alive after a failed attempt at finding the right configs. So restart the gremlin console to get rid of this particular
|
By
HadoopMarc <bi...@...>
·
#5142
·
|
|
Encounter error when run OLAP with Spark Yarn
Hello everyone!
I am trying to use spark yarn mode on janusgraph but I encounter several errors and I thought it may cause by inappropriate jar configuration.
Error:”java.lang.IllegalAccessError:
Hello everyone!
I am trying to use spark yarn mode on janusgraph but I encounter several errors and I thought it may cause by inappropriate jar configuration.
Error:”java.lang.IllegalAccessError:
|
By
"sa...@gmail.com" <santh...@...>
·
#5141
·
|
|
Re: JanusGraph Spark read edges
Thanks Marc,
You were right, I was not passing the right config options.
Thanks Marc,
You were right, I was not passing the right config options.
|
By
"ra...@gmail.com" <rafi1...@...>
·
#5140
·
|
|
Re: JanusGraph Spark read edges
HI Rafi,
It seems that you start spark-shell and spark-submit with different configs or command-line parameters. Be sure to use the same --master local[8] parameter, assuming you use spark as
HI Rafi,
It seems that you start spark-shell and spark-submit with different configs or command-line parameters. Be sure to use the same --master local[8] parameter, assuming you use spark as
|
By
HadoopMarc <bi...@...>
·
#5139
·
|
|
Re: EdgeId and RelationId using VertexWritable
Hi Marc,
I tried to cast the tinkerpop edge to JanusGraph edge but no luck. Is there any way by which I can derive the typeId part of the edgeId myself?
Hi Marc,
I tried to cast the tinkerpop edge to JanusGraph edge but no luck. Is there any way by which I can derive the typeId part of the edgeId myself?
|
By
"ra...@gmail.com" <rafi1...@...>
·
#5138
·
|
|
Re: Use of ModifierType fails if TypeDefinitionCategory is not loaded before
Cyclical dependency is not the right term. Static part of both class refers static member of the other.
Anyway, I use your pom.xml and I reproduce the problem with Oracle java 8 (maybe it depends on
Cyclical dependency is not the right term. Static part of both class refers static member of the other.
Anyway, I use your pom.xml and I reproduce the problem with Oracle java 8 (maybe it depends on
|
By
toom <to...@...>
·
#5137
·
|
|
Re: JanusGraph Spark read edges
Hi Marc,
I tried the spark persist() method to avoid fetching of data from Cassandra again and again but no difference on the number of partitions and the tasks. I have attached two images of the
Hi Marc,
I tried the spark persist() method to avoid fetching of data from Cassandra again and again but no difference on the number of partitions and the tasks. I have attached two images of the
|
By
"ra...@gmail.com" <rafi1...@...>
·
#5136
·
|
|
Re: Use of ModifierType fails if TypeDefinitionCategory is not loaded before
Hi Thomas,
Thanks for asking on the user group first. I cannot reproduce the issue (works fine on my system using java8).
I ran:
mvn exec:java -Dexec.mainClass="JGModifierTypeIssue"
and get
Hi Thomas,
Thanks for asking on the user group first. I cannot reproduce the issue (works fine on my system using java8).
I ran:
mvn exec:java -Dexec.mainClass="JGModifierTypeIssue"
and get
|
By
HadoopMarc <bi...@...>
·
#5135
·
|
|
Use of ModifierType fails if TypeDefinitionCategory is not loaded before
Hi,
When I try to set consistency of a property key (using JanusGraphManagement.setConsistency in a java project) I get a NPE if I don't refer the class TypeDefinitionCategory before.
The method
Hi,
When I try to set consistency of a property key (using JanusGraphManagement.setConsistency in a java project) I get a NPE if I don't refer the class TypeDefinitionCategory before.
The method
|
By
Thomas Franco <to...@...>
·
#5134
·
|