|
Hbase read after write not working with janusgraph-0.6.1 but was working with janusgraph-0.6.1
So basically g.addV() is adding vertices in hbase server. But retrieval after restart of gremlin is not happening.
Step1. In gremlin console, g2.addV() and g2.V().count() returns 124
Step2: Restart
So basically g.addV() is adding vertices in hbase server. But retrieval after restart of gremlin is not happening.
Step1. In gremlin console, g2.addV() and g2.V().count() returns 124
Step2: Restart
|
By
Nikita Pande
·
#6511
·
|
|
Re: Bulk Loading with Spark
Thank you Marc - something isn't right with my code - debugging. Right now the graph is 4,339,690 vertices and 15,707,179 edges, but that took days to build, and is probably 5% of the
Thank you Marc - something isn't right with my code - debugging. Right now the graph is 4,339,690 vertices and 15,707,179 edges, but that took days to build, and is probably 5% of the
|
By
Joe Obernberger
·
#6510
·
|
|
Re: Bulk Loading with Spark
Hi Joe,
What is slow? Can you please check the Expero blog series and compare to their reference numbers (per parallel spark
Hi Joe,
What is slow? Can you please check the Expero blog series and compare to their reference numbers (per parallel spark
|
By
hadoopmarc@...
·
#6509
·
|
|
Re: Bulk Loading with Spark
Should have added - I'm connecting with:
JanusGraph graph = JanusGraphFactory.build()
.set("storage.backend", "cql")
Should have added - I'm connecting with:
JanusGraph graph = JanusGraphFactory.build()
.set("storage.backend", "cql")
|
By
Joe Obernberger
·
#6508
·
|
|
Bulk Loading with Spark
Hi All - I'm trying to use spark to do a bulk load, but it's very slow.
The cassandra cluster I'm connecting to is a bare-metal, 15 node cluster.
I'm using java code to do the loading
Hi All - I'm trying to use spark to do a bulk load, but it's very slow.
The cassandra cluster I'm connecting to is a bare-metal, 15 node cluster.
I'm using java code to do the loading
|
By
Joe Obernberger
·
#6507
·
|
|
Re: NoSuchMethodError
Thanks for reporting back! Unfortunately, java still has big problems using multiple versions of the same library, so your current approach is not a guarantee for success for future version updates
Thanks for reporting back! Unfortunately, java still has big problems using multiple versions of the same library, so your current approach is not a guarantee for success for future version updates
|
By
hadoopmarc@...
·
#6506
·
|
|
Re: NoSuchMethodError
Oh - my apologies. I'm using 0.6, and Cassandra 4.04.
What I eventually did was get the source from github and compile with Cassandra 4. I'm using spark 3.2.1.
-Joe
On
Oh - my apologies. I'm using 0.6, and Cassandra 4.04.
What I eventually did was get the source from github and compile with Cassandra 4. I'm using spark 3.2.1.
-Joe
On
|
By
Joe Obernberger
·
#6505
·
|
|
Re: NoSuchMethodError
The answer to my problem was telling spark-submit to use the user classes first with:
--conf spark.executor.userClassPathFirst = true
--conf spark.driver.userClassPathFirst = true
-Joe
--
This
The answer to my problem was telling spark-submit to use the user classes first with:
--conf spark.executor.userClassPathFirst = true
--conf spark.driver.userClassPathFirst = true
-Joe
--
This
|
By
Joe Obernberger
·
#6504
·
|
|
Re: NoSuchMethodError
Hi Joe,
Your issue description is not complete. To start:
what version of JanusGraph do you use?
what spark master do you use?
The easiest way to find the guava version of JanusGraph is to download
Hi Joe,
Your issue description is not complete. To start:
what version of JanusGraph do you use?
what spark master do you use?
The easiest way to find the guava version of JanusGraph is to download
|
By
hadoopmarc@...
·
#6503
·
|
|
NoSuchMethodError
Hi All - I'm trying to write a spark job to load data from Cassandra in to a graph, but I'm getting this:
Exception in thread "main" java.lang.NoSuchMethodError: 'void
Hi All - I'm trying to write a spark job to load data from Cassandra in to a graph, but I'm getting this:
Exception in thread "main" java.lang.NoSuchMethodError: 'void
|
By
Joe Obernberger
·
#6502
·
|
|
Re: [DISCUSS] Moving from Gitter to Discord
I agree. Moving to discord will be much better.
I agree. Moving to discord will be much better.
|
By
nidhi.vinaykiya27@...
·
#6501
·
|
|
[DISCUSS] Moving from Gitter to Discord
Hi,
JanusGraph currently uses Gitter as its chat platform. We noticed however that Discord is becoming more and more popular for OSS communities. TinkerPop has also recently started a Discord server
Hi,
JanusGraph currently uses Gitter as its chat platform. We noticed however that Discord is becoming more and more popular for OSS communities. TinkerPop has also recently started a Discord server
|
By
Florian Hockmann
·
#6500
·
|
|
Re: Rapid deletion of vertices
Thanks Boxuan, Marc, and Eric.
I implemented Boxuan's get-vertex-ids-and-delete-in-parallel suggestion with 8 gremlinpython workers, and it saves an order of magnitude of time. I imagine it could
Thanks Boxuan, Marc, and Eric.
I implemented Boxuan's get-vertex-ids-and-delete-in-parallel suggestion with 8 gremlinpython workers, and it saves an order of magnitude of time. I imagine it could
|
By
Scott Friedman
·
#6499
·
|
|
Re: Rapid deletion of vertices
Hello Scott,
i had the same situation but with much more data. Fastest way was stopping the server, then clear all, start it again and create the schema again.
bin/janusgraph.sh stop
bin/janusgraph.sh
Hello Scott,
i had the same situation but with much more data. Fastest way was stopping the server, then clear all, start it again and create the schema again.
bin/janusgraph.sh stop
bin/janusgraph.sh
|
By
eric.neufeld@...
·
#6498
·
|
|
Re: Rapid deletion of vertices
Hi Scott,
Another approach is to take snapshots of the Cassandra tables and Elasticsearch indices after creating the schema and indices.
Note that there are some subtleties when taking snapshots of
Hi Scott,
Another approach is to take snapshots of the Cassandra tables and Elasticsearch indices after creating the schema and indices.
Note that there are some subtleties when taking snapshots of
|
By
hadoopmarc@...
·
#6497
·
|
|
Re: Rapid deletion of vertices
Hi Scott,
One idea that first came into my mind is to first collect all vertex ids, and then delete them in batch & in parallel using multi-threading.
Best regards,
Boxuan
Hi Scott,
One idea that first came into my mind is to first collect all vertex ids, and then delete them in batch & in parallel using multi-threading.
Best regards,
Boxuan
|
By
Boxuan Li
·
#6496
·
|
|
Rapid deletion of vertices
Good afternoon,
We're running a docker-compose janusgraph:0.6.1 with cassandra:3 and elasticsearch:6.6.0. We're primarily utilizing JanusGraph within Python 3.8 via gremlinpython.
We frequently reset
Good afternoon,
We're running a docker-compose janusgraph:0.6.1 with cassandra:3 and elasticsearch:6.6.0. We're primarily utilizing JanusGraph within Python 3.8 via gremlinpython.
We frequently reset
|
By
Scott Friedman
·
#6495
·
|
|
Re: Log4j Vulnerability for janusgraph
Hi,
Try updating the jar file, I mean deleting the earlier one and placing the new one in lib folder. There might be some other changes required not sure. I was working with janusgraph before not
Hi,
Try updating the jar file, I mean deleting the earlier one and placing the new one in lib folder. There might be some other changes required not sure. I was working with janusgraph before not
|
By
Vinayak Bali
·
#6494
·
|
|
Re: Log4j Vulnerability for janusgraph
@ronnie i agree. Patch release would help. But we are not sure when that’s going to come. Do we have any other alternative?
@ronnie i agree. Patch release would help. But we are not sure when that’s going to come. Do we have any other alternative?
|
By
nidhi.vinaykiya27@...
·
#6493
·
|
|
Re: Log4j Vulnerability for janusgraph
Even the latest release janusgraph 0.6.1 used log4j 1.2.x . How were you able to fix it?
Even the latest release janusgraph 0.6.1 used log4j 1.2.x . How were you able to fix it?
|
By
nidhi.vinaykiya27@...
·
#6492
·
|