|
Performance Improvement
Hi All,
I am using janusgraph for a while. The use case which I am working on consists of 1.5 million nodes and 3 million edges. Prepared a batch loading groovy script. The performance of the data
Hi All,
I am using janusgraph for a while. The use case which I am working on consists of 1.5 million nodes and 3 million edges. Prepared a batch loading groovy script. The performance of the data
|
By
Vinayak Bali
·
#6051
·
|
|
Re: How to split graph in multiple graphml files and load them separately
I've also noticed that graphml files can specify an "id" for the <graph> node, but I guess this has no effect on Janus at all? Like, it's completely ignored? Am I right?
I've also noticed that graphml files can specify an "id" for the <graph> node, but I guess this has no effect on Janus at all? Like, it's completely ignored? Am I right?
|
By
Laura Morales <lauretas@...>
·
#6050
·
|
|
Re: How to split graph in multiple graphml files and load them separately
The convention is simply to use custom IDs in graphml, like this
<node id="data_source1:id0"/>
<node id="data_source1:id1"/>
...
<node id="data_source2:id0"/>
<node
The convention is simply to use custom IDs in graphml, like this
<node id="data_source1:id0"/>
<node id="data_source1:id1"/>
...
<node id="data_source2:id0"/>
<node
|
By
Laura Morales <lauretas@...>
·
#6049
·
|
|
Re: janusgraph and deeplearning
Hi marc,
Thanks for your reply.
I have some knowledge data from multiple source, so firstly (i) I had to loaId those data to janusgraph, (ii) I need to apply a reconciliation algorithm which generate
Hi marc,
Thanks for your reply.
I have some knowledge data from multiple source, so firstly (i) I had to loaId those data to janusgraph, (ii) I need to apply a reconciliation algorithm which generate
|
By
jonathan.mercier.fr@...
·
#6048
·
|
|
Re: How to split graph in multiple graphml files and load them separately
Hi Laura,
I do not see an easy solution. Although JanusGraph supports custom vertex id's, I do not belief this is compatible with the gremlin io readers (at least, not out of the box, I tried...).
An
Hi Laura,
I do not see an easy solution. Although JanusGraph supports custom vertex id's, I do not belief this is compatible with the gremlin io readers (at least, not out of the box, I tried...).
An
|
By
hadoopmarc@...
·
#6047
·
|
|
Re: janusgraph and deeplearning
Hi Jonathan,
Can you elaborate on why you make the connection between janusgraph and deep learning? I can only imagine the wish to apply graph data stored in Janusgraph to train a GNN. I do not think
Hi Jonathan,
Can you elaborate on why you make the connection between janusgraph and deep learning? I can only imagine the wish to apply graph data stored in Janusgraph to train a GNN. I do not think
|
By
hadoopmarc@...
·
#6046
·
|
|
janusgraph and deeplearning
Dear,
I am looking to use both janusgraph with a deeplearning frameworks such as pytorch.
Does anyone have some experience/example on this subject ?
Actually I use parquet -> dataframe ->
Dear,
I am looking to use both janusgraph with a deeplearning frameworks such as pytorch.
Does anyone have some experience/example on this subject ?
Actually I use parquet -> dataframe ->
|
By
jonathan.mercier.fr@...
·
#6045
·
|
|
Fw: How to split graph in multiple graphml files and load them separately
ERRATA
it creates the edge but instead of linking to the vertex with "id" from the other file, it will create a new empty node (with no property) and assign it a new ID.
ERRATA
it creates the edge but instead of linking to the vertex with "id" from the other file, it will create a new empty node (with no property) and assign it a new ID.
|
By
Laura Morales <lauretas@...>
·
#6044
·
|
|
How to split graph in multiple graphml files and load them separately
Assuming that my colleagues and I are working on different "parts" of the same graph, everyone of us creates one GraphML file and then we'd like to load our files into the graph (we're using
Assuming that my colleagues and I are working on different "parts" of the same graph, everyone of us creates one GraphML file and then we'd like to load our files into the graph (we're using
|
By
Laura Morales <lauretas@...>
·
#6043
·
|
|
Re: Tinkerpop 3.4.1 with Hadoop3
Hi Anjani,
JanusGraph receives the hadoop dependency from Apache TinkerPop, so Apache TinkerPop will be in the driver seat regarding the upgrade of hadoop. Making a custom build of janusgraph with
Hi Anjani,
JanusGraph receives the hadoop dependency from Apache TinkerPop, so Apache TinkerPop will be in the driver seat regarding the upgrade of hadoop. Making a custom build of janusgraph with
|
By
hadoopmarc@...
·
#6042
·
Edited
|
|
Re: Query requires iterating over all vertices
The difference between “text” and “string” is explained here: https://docs.janusgraph.org/index-backend/text-search/
In short, “text” is for full-text search (tokenized search)
The difference between “text” and “string” is explained here: https://docs.janusgraph.org/index-backend/text-search/
In short, “text” is for full-text search (tokenized search)
|
By
Boxuan Li
·
#6041
·
Edited
|
|
New TSC member: Boxuan Li
On behalf of the JanusGraph Technical Steering Committee (TSC), I'm pleased to welcome a new Technical Steering Committee member on the project!
Boxuan Li has provided major contributions and has
On behalf of the JanusGraph Technical Steering Committee (TSC), I'm pleased to welcome a new Technical Steering Committee member on the project!
Boxuan Li has provided major contributions and has
|
By
Oleksandr Porunov
·
#6040
·
|
|
Re: Query requires iterating over all vertices
Thank you so much! I was using the newest release, but compiling the lastest source (from main branch) did indeed fix the problem. Or at least I think it has, since I don't get any more warnings.
On
Thank you so much! I was using the newest release, but compiling the lastest source (from main branch) did indeed fix the problem. Or at least I think it has, since I don't get any more warnings.
On
|
By
Laura Morales <lauretas@...>
·
#6039
·
|
|
Re: Query requires iterating over all vertices
Looks like this is because you are indexing your property as text. See https://docs.janusgraph.org/index-backend/text-search/#full-text-search_1
I believe the query has(“country", P.neq(null)) would
Looks like this is because you are indexing your property as text. See https://docs.janusgraph.org/index-backend/text-search/#full-text-search_1
I believe the query has(“country", P.neq(null)) would
|
By
Boxuan Li
·
#6038
·
|
|
Re: Query requires iterating over all vertices
I've tried with the graph of the gods (steps shown below), and the indexes seems to be persisted and working fine (don't see any warning when querying by name or age). So I guess I have some issue
I've tried with the graph of the gods (steps shown below), and the indexes seems to be persisted and working fine (don't see any warning when querying by name or age). So I guess I have some issue
|
By
Laura Morales <lauretas@...>
·
#6037
·
|
|
Re: Query requires iterating over all vertices
$ ./bin/gremlin.sh
gremlin> graph = JanusGraphFactory.open("/graph/graph.properties")
gremlin> g = graph.traversal()
gremlin> g.V().has("country",
$ ./bin/gremlin.sh
gremlin> graph = JanusGraphFactory.open("/graph/graph.properties")
gremlin> g = graph.traversal()
gremlin> g.V().has("country",
|
By
Laura Morales <lauretas@...>
·
#6036
·
|
|
Re: Query requires iterating over all vertices
Can you show the profile output? Just add .profile() to the end of your query.
「Laura Morales <lauretas@...>」在 2021年7月23日 週五,下午4:13 寫道:
Can you show the profile output? Just add .profile() to the end of your query.
「Laura Morales <lauretas@...>」在 2021年7月23日 週五,下午4:13 寫道:
|
By
Boxuan Li
·
#6035
·
|
|
Re: Query requires iterating over all vertices
I was able to open my lucene folder with a tool called "luke" for peeking at the data, and all the "country" values seems to be in there. I assume by looking at this that the index was created and
I was able to open my lucene folder with a tool called "luke" for peeking at the data, and all the "country" values seems to be in there. I assume by looking at this that the index was created and
|
By
Laura Morales <lauretas@...>
·
#6034
·
|
|
Re: Query requires iterating over all vertices
Unfortunately this does not seem to remove the warning.
WARN org.janusgraph.graphdb.transaction.StandardJanusGraphTx - Query requires iterating over all vertices [(country <> null)]. For better
Unfortunately this does not seem to remove the warning.
WARN org.janusgraph.graphdb.transaction.StandardJanusGraphTx - Query requires iterating over all vertices [(country <> null)]. For better
|
By
Laura Morales <lauretas@...>
·
#6033
·
|
|
Re: Query requires iterating over all vertices
Try rewriting your query as:
` g.V().has("country", P.neq(null)).values("country").dedup().order().limit(10)`
FYI starting from the upcoming 0.6.0 release, has("country") will leverage the mixed
Try rewriting your query as:
` g.V().has("country", P.neq(null)).values("country").dedup().order().limit(10)`
FYI starting from the upcoming 0.6.0 release, has("country") will leverage the mixed
|
By
Boxuan Li
·
#6032
·
|