Bulk loading


Laura Morales <lauretas@...>
 

If I setup an empty graph with persistent storage, for example berkeley (thus not an in-memory graph), can I load a graphml/graphson file and have it all added to the graph?
 
 
 

Sent: Tuesday, July 20, 2021 at 2:52 PM
From: hadoopmarc@...
To: janusgraph-users@...
Subject: Re: [janusgraph-users] Bulk loading
Hi Laura,

JanusGraph support for loading data does not go further than the Traversal API (used in https://tinkerpop.apache.org/docs/current/reference/#addvertex-step ) and the JanusGraphManagement API (used in https://docs.janusgraph.org/basics/schema/[https://docs.janusgraph.org/basics/schema/] ).

A better resource than the reference docs to get you started is:
http://www.kelvinlawrence.net/book/PracticalGremlin.html[http://www.kelvinlawrence.net/book/PracticalGremlin.html]

The bulk loading tips will be useful for graphs with millions of vertices and edges.

Best wishes,     Marc


hadoopmarc@...
 

Hi Laura,

JanusGraph support for loading data does not go further than the Traversal API (used in https://tinkerpop.apache.org/docs/current/reference/#addvertex-step ) and the JanusGraphManagement API (used in https://docs.janusgraph.org/basics/schema/ ).

A better resource than the reference docs to get you started is:
http://www.kelvinlawrence.net/book/PracticalGremlin.html

The bulk loading tips will be useful for graphs with millions of vertices and edges.

Best wishes,     Marc


Laura Morales <lauretas@...>
 

I've read the "Bulk Loading" chapter of the documentation several times but I still don't understand how to create a graph. Everything that I can find online is some Java or Groovy code.
Given:
1. a graph schema (say, in JSON)
2. a bunch of data (say, in CSV)
does Janus have any tool to load this stuff into a database, or to create a new one? Without using any Java/Groovy programming, or 3rd party tools? Or am I expected to write my own Groovy scripts for parsing the CSV and creating the graph?