Re: HBase ScannerTimeoutException
HadoopMarc <m.c.d...@...>
Hi Joseph, Sounds like OLAP is not going to help you here (you would need a gremlin database query step or a customer vertexprogram), You need a JanusGraph index on a unique property of your vertices. Then, a query g.V().has('yourprop', 'yourpropvalue').next() will return the vertex using the index, rather than doing an HBase table scan like you did before. This approach also allows you to make your code multi-threaded as long as you add vertices and edges in the right order. The Janusgraph and Tinkerpop docs on batch loading might provide further insights: http://docs.janusgraph.org/latest/bulk-loading.html http://tinkerpop.apache.org/docs/current/reference/#_loading_with_bulkloadervertexprogram The BulkLoaderVertexProgram is in effect an OLAP approach, but it assumes that you have all data organized before you start the graph loading. Cheers, Marc Op vrijdag 12 mei 2017 21:34:01 UTC+2 schreef Joseph Obernberger:
|
|