janusgraph-users@lists.lfaidata.foundation | org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block

Home Messages Hashtags Subgroups Calendar

Date Date 1 - 3 of 3

org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block

Ankur Goel <ankur...@...>

#876

Hi,

i have connected Janus to cassandra cluster:

storage.hostname=x.x.x.1,x.x.x.2,x.x.x.3

ids.block-size=10000

storage.batch-loading=true

storage.lock.wait-time=9000

storage.cassandra.read-consistency-level=ONE

storage.cassandra.write-consistency-level=ALL

query.force-index=false

storage.connection-timeout=60000

storage.lock.retries=10

i am inserting vertex in large no through java code: getting below exception:

2017-09-26 10:55:05,577 WARN [JanusGraphID(4)(3)[0]] org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority: Temporary storage exception while acquiring id block - retrying in PT0.6S: {}

org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block [1, 80001) in PT0.324S => too slow, threshold is: PT0.3S

at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:276)

at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288)

at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

~AnkurG

Jason Plurad <plu...@...>

#880

http://docs.janusgraph.org/latest/config-ref.html#_ids

I'd suggest trying to increase the ids.block-size, and perhaps adjusting the ids.renew-percentage.

No idea what your graph loading code looks like, but you might want to commit() transactions in smaller batches.

Also check out http://tinkerpop.apache.org/docs/current/tutorials/getting-started/#_loading_data

Show quoted text

On Tuesday, September 26, 2017 at 1:35:28 AM UTC-4, Ankur Goel wrote:

Hi,

i have connected Janus to cassandra cluster:

storage.hostname=x.x.x.1,x.x.x.2,x.x.x.3

ids.block-size=10000
storage.batch-loading=true
storage.lock.wait-time=9000
storage.cassandra.read-consistency-level=ONE
storage.cassandra.write-consistency-level=ALL
query.force-index=false
storage.connection-timeout=60000

storage.lock.retries=10

i am inserting vertex in large no through java code: getting below exception:

2017-09-26 10:55:05,577 WARN [JanusGraphID(4)(3)[0]] org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority: Temporary storage exception while acquiring id block - retrying in PT0.6S: {}
org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block [1, 80001) in PT0.324S => too slow, threshold is: PT0.3S
at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:276)
at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288)
at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

~AnkurG

Ankur Goel <ankur...@...>

#885

java code that i am using for data uploading:

{

int loopCounter = getTotalNoofRecorsdCountFromDB();

List<Data> data = getData fromDB();

JanusGraphTransaction tx = graph.newTransaction();

for (int i = 0; i < loopCounter; i++) {

VerticesDTO vertex = data.get(i);

Vertex v = tx.addVertex(T.label, "data", dataid, vertex.getDataId());

v.property("vlabel", "taglead");

v.property("prop1", vertex.getProp1());

v.property("prop2", vertex.getProp2());

v.property("prop3", vertex.getProp3());

v.property("prop4", vertex.getProp4());

v.property("prop5", vertex.getProp5());

v.property("prop6", vertex.getProp6());

v.property("prop7", vertex.getProp7());

List<String> prop8 = getProp8();

prop8.forEach(p -> v.property("prop8", p));

List<String> prop9 = getProp9();

prop9.forEach(p -> v.property("prop9", p));

List<String> prop10 = getProp10();

prop10.forEach(p -> v.property("prop10", p));

if(i%1000 ==0){

tx.commit();

}

tx.commit();

}

Please suggest.

~AnkurG

Show quoted text

On Tuesday, September 26, 2017 at 11:05:28 AM UTC+5:30, Ankur Goel wrote:

Hi,

i have connected Janus to cassandra cluster:

storage.hostname=x.x.x.1,x.x.x.2,x.x.x.3

ids.block-size=10000
storage.batch-loading=true
storage.lock.wait-time=9000
storage.cassandra.read-consistency-level=ONE
storage.cassandra.write-consistency-level=ALL
query.force-index=false
storage.connection-timeout=60000

storage.lock.retries=10

i am inserting vertex in large no through java code: getting below exception:

2017-09-26 10:55:05,577 WARN [JanusGraphID(4)(3)[0]] org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority: Temporary storage exception while acquiring id block - retrying in PT0.6S: {}
org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block [1, 80001) in PT0.324S => too slow, threshold is: PT0.3S
at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:276)
at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288)
at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

~AnkurG

1 - 3 of 3

Previous Topic Next Topic

Home Hashtags Subgroups Calendar Terms