Date   

Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Robert Dale <rob...@...>
 

Titan/JanusGraph has been using 2.11 and TinkerPop has been using 2.12 for the last 2 years or so.  JanusGraph overrides TinkerPop's version. There is only one copy of jline in either TinkerPop or JanusGraph distributions.

In jline, the interface change was from 1.x to 2.x.  I would suspect that jline 1.x  is somewhrere in your classpath.  A quick search leads to some stackoverflow answers that point to the HADOOP classpath.

However, if you believe that this is a bug in either JanusGraph, TinkerPop, please provide the steps to reproduce with a clean distribution and without manipulating the classpath.  In the meantime, I have created an issue to update JanusGraph to the TinkerPop version - https://github.com/JanusGraph/janusgraph/pull/491




Robert Dale

On Sat, Sep 2, 2017 at 7:23 AM, Rohit Jain <rohit.j...@...> wrote:
Here is what one of our developers found:
It looks like there are some incompatibilities in the interface for the class jline.Terminal between jline 2.11 and jline 2.12.

If the jline 2.12, part of Cloudera CDH Hive, is loaded, Gremlin will fail with the following error:



[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

If the jline 2.11 version is loaded, Gremlin does not have a problem.

To work around the issue at this moment, here is what was done:
We changed gremlin.sh around line 43, to add the janusgraph/lib at the beginning of the current class path. It is likely, that the only library needed to be in front was jline. But we added them all to the front, so they get preference over any of the current jars and classes.

#WORKAROUND....PUT LIB in front of classpath
#export CLASSPATH="${CLASSPATH:-}:$CP"
export CLASSPATH="$CP:${CLASSPATH:-}"

This indicates that perhaps Gremlin / Tinkerpop, as included with JanusGraph, may not be compatible with jline 2.12 after all.

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/0600fd72-7410-41ae-b1f3-d621d137a490%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Rohit Jain <rohit.j...@...>
 

Here is what one of our developers found:
It looks like there are some incompatibilities in the interface for the class jline.Terminal between jline 2.11 and jline 2.12.

If the jline 2.12, part of Cloudera CDH Hive, is loaded, Gremlin will fail with the following error:



[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

If the jline 2.11 version is loaded, Gremlin does not have a problem.

To work around the issue at this moment, here is what was done:
We changed gremlin.sh around line 43, to add the janusgraph/lib at the beginning of the current class path. It is likely, that the only library needed to be in front was jline. But we added them all to the front, so they get preference over any of the current jars and classes.

#WORKAROUND....PUT LIB in front of classpath
#export CLASSPATH="${CLASSPATH:-}:$CP"
export CLASSPATH="$CP:${CLASSPATH:-}"

This indicates that perhaps Gremlin / Tinkerpop, as included with JanusGraph, may not be compatible with jline 2.12 after all.


Re: Backup and restore when using Janus via Gremlin server and a Berkley DB backend

Jason Plurad <plu...@...>
 

Yeah, I'd think that would work. Here's the doc:

http://docs.oracle.com/cd/E17277_02/html/GettingStartedGuide/backuprestore.html


On Friday, September 1, 2017 at 4:03:06 PM UTC-4, Mark Henderson wrote:
Is backup as simple as copying the storage.directory path and all of its files? And is a restore replacing that directory with a previously copied backup? 

Or better yet, how should I handle backups and restorations?

Thanks,
Mark


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Rohit Jain <rohit.j...@...>
 

Based on that, it looks like it finds the following in my CLASSPATH:
 
... /opt/cloudera/parcels/CDH/lib/hive/lib/jline-2.12.jar .../disk1/rohit/janusgraph-0.1.1-hadoop2/lib/jline-2.11.jar ...

Rohit


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Robert Dale <rob...@...>
 


SCRIPT_DEBUG=y ./bin/gremlin.sh



Robert Dale

On Fri, Sep 1, 2017 at 4:39 PM, Rohit Jain <rohit.j...@...> wrote:
Robert,

I am not a Linux expert either :-(  Do you know how I can find out what version of jline in my CLASSPATH I am picking up?

Rohit

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/0273a5e2-853f-4a84-97ef-14f25419e0ab%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Rohit Jain <rohit.j...@...>
 

Robert,

I am not a Linux expert either :-(  Do you know how I can find out what version of jline in my CLASSPATH I am picking up?

Rohit


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Robert Dale <rob...@...>
 

You clearly have too many versions of jline.  JanusGraph uses 2.11, TinkerPop uses 2.12. Either should work fine but use just one.

Robert Dale

On Fri, Sep 1, 2017 at 4:27 PM, Rohit Jain <rohit.j...@...> wrote:
Robert,

You are just so fast!

We are on Linux centos I think.  I tried setting it to none as you suggested, but I still got the same error. Here are the versions of jline installed on the system.

$ find . -name jline*

./crunch/lib/jline-2.10.4.jar

./hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/jline-2.11.jar

./llama/lib/jline-2.11.jar

./sentry/lib/jline-2.11.jar

./hadoop-kms/webapps/kms/WEB-INF/lib/jline-2.11.jar

./hadoop-0.20-mapreduce/lib/jline-2.11.jar

./whirr/lib/jline-2.11.jar

./impala/lib/jline-2.12.jar

./zookeeper/lib/jline-2.11.jar

./hadoop-yarn/lib/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hive2/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/sqoop/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hcatalog/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/pig/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hive/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/spark/jline-2.10.5.jar

./oozie/oozie-sharelib-yarn/lib/spark/jline-2.11.jar

./oozie/lib/jline-2.11.jar

./oozie/libserver/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hive2/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/sqoop/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hcatalog/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/pig/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hive/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/spark/jline-2.10.5.jar

./oozie/oozie-sharelib-mr1/lib/spark/jline-2.11.jar

./oozie/libtools/jline-2.11.jar

./hive/lib/jline-2.12.jar


--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/1b28c085-12f3-4840-b763-e953c90893de%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Rohit Jain <rohit.j...@...>
 

Robert,

You are just so fast!

We are on Linux centos I think.  I tried setting it to none as you suggested, but I still got the same error. Here are the versions of jline installed on the system.

$ find . -name jline*

./crunch/lib/jline-2.10.4.jar

./hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/jline-2.11.jar

./llama/lib/jline-2.11.jar

./sentry/lib/jline-2.11.jar

./hadoop-kms/webapps/kms/WEB-INF/lib/jline-2.11.jar

./hadoop-0.20-mapreduce/lib/jline-2.11.jar

./whirr/lib/jline-2.11.jar

./impala/lib/jline-2.12.jar

./zookeeper/lib/jline-2.11.jar

./hadoop-yarn/lib/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hive2/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/sqoop/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hcatalog/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/pig/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/hive/jline-2.11.jar

./oozie/oozie-sharelib-yarn/lib/spark/jline-2.10.5.jar

./oozie/oozie-sharelib-yarn/lib/spark/jline-2.11.jar

./oozie/lib/jline-2.11.jar

./oozie/libserver/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hive2/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/sqoop/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hcatalog/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/pig/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/hive/jline-2.11.jar

./oozie/oozie-sharelib-mr1/lib/spark/jline-2.10.5.jar

./oozie/oozie-sharelib-mr1/lib/spark/jline-2.11.jar

./oozie/libtools/jline-2.11.jar

./hive/lib/jline-2.12.jar



Re: Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Robert Dale <rob...@...>
 

What OS, terminal are you using?  Are there other versions of jline in the classpath?

You can try setting `-Djline.terminal=none`

e.g. `export JAVA_OPTIONS="-Djline.terminal=none" ; ./bin/gremlin.sh`

Robert Dale

On Fri, Sep 1, 2017 at 4:02 PM, Rohit Jain <rohit.j...@...> wrote:
Hi folks,

I keep running into this problem.  I don't know how I got around it the last time but it has cropped up again.  Any ideas?

bin/gremlin.sh

         \,,,/
         (o o)
-----oOOo-(3)-oOOo-----
[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

Rohit

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/5a4cc0f9-a09a-4930-99cd-284e5c9c2e75%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Terminal initialization failed ... Found class jline.Terminal, but interface was expected

Rohit Jain <rohit.j...@...>
 

Hi folks,

I keep running into this problem.  I don't know how I got around it the last time but it has cropped up again.  Any ideas?

bin/gremlin.sh

         \,,,/
         (o o)
-----oOOo-(3)-oOOo-----
[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

Rohit


Backup and restore when using Janus via Gremlin server and a Berkley DB backend

emeh...@...
 

Is backup as simple as copying the storage.directory path and all of its files? And is a restore replacing that directory with a previously copied backup? 

Or better yet, how should I handle backups and restorations?

Thanks,
Mark


Re: Getting TemporaryLockingException: No lock columns found for KeyColumn for mgmt.commit()

Jason Plurad <plu...@...>
 

Did you drop the keyspace before retrying with the corrected properties file?
If not, you might be picking up the old values which were stored in the graph because both have GLOBAL_OFFLINE mutability.


On Friday, September 1, 2017 at 1:49:24 AM UTC-4, padmasrinijana wrote:
Hi Jason,
Thank You..I have changed the values as you said..still getting same exception..
cassandra keyspace:
CREATE KEYSPACE keyspaceName WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1': '2', 'dc2': '1', 'dc3': '1'}  AND durable_writes = true;
also checked that cassandra nodes are sync and running properly..


On Thursday, 31 August 2017 18:48:40 UTC+5:30, padmasrinijana wrote:
Using janusgraph-0.1.0-hadoop2 with backend cassandra-3.0.14:

This is the configuration file:
storage.backend=cassandrathrift
storage.hostname=hostName1
storage.cassandra.keyspace=keyspaceName
storage.batch-loading=false
cache.db-cache=true
cache.db-cache-time = 180000
cache.db-cache-size = 0.25
storage.lock.wait-time=300000
storage.lock.retries=10
storage.lock.clean-expired=true
storage.buffer-size=512
ids.block-size=300000
storage.cassandra.compression=false
storage.lock.expiry-time=100
index.search.backend=elasticsearch
index.search.hostname=es-hostName
index.search.elasticsearch.client-only=true
storage.connection-timeout=300000


Tried to create a new label with new cassandra keyspace(empty keyspace)..but getting below exception:

graph = JanusGraphFactory.open('janus.properties')
mgmt= graph.openManagement()
labelName = mgmt.makeVertexLabel('labelName').make()
mgmt.commit()
Could not commit transaction due to exception during persistence
Type ':help' or ':h' for help.
Display stack trace? [yN]y
org.janusgraph.core.JanusGraphException: Could not commit transaction due to exception during persistence
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.database.management.ManagementSystem.commit(ManagementSystem.java:235)
at org.janusgraph.core.schema.JanusGraphManagement$commit.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
at groovysh_evaluate.run(groovysh_evaluate:3)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70)
at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72)
at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455)
Caused by: org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:143)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commit(BackendTransaction.java:150)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:703)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363)
... 47 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT3M20S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 53 more
Caused by: org.janusgraph.diskstorage.locking.TemporaryLockingException: No lock columns found for KeyColumn [k=0x 16-165-160-118-108- 30-114-101-113-117-101-115-116- 95-106-111-226, c=0x  0]
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSeniority(ConsistentKeyLocker.java:519)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:454)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:123)
at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:178)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:157)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
...54 more


Re: Getting TemporaryLockingException: No lock columns found for KeyColumn for mgmt.commit()

padmasr...@...
 

Hi Jason,
Thank You..I have changed the values as you said..still getting same exception..
cassandra keyspace:
CREATE KEYSPACE keyspaceName WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1': '2', 'dc2': '1', 'dc3': '1'}  AND durable_writes = true;
also checked that cassandra nodes are sync and running properly..


On Thursday, 31 August 2017 18:48:40 UTC+5:30, pad...@... wrote:
Using janusgraph-0.1.0-hadoop2 with backend cassandra-3.0.14:

This is the configuration file:
storage.backend=cassandrathrift
storage.hostname=hostName1
storage.cassandra.keyspace=keyspaceName
storage.batch-loading=false
cache.db-cache=true
cache.db-cache-time = 180000
cache.db-cache-size = 0.25
storage.lock.wait-time=300000
storage.lock.retries=10
storage.lock.clean-expired=true
storage.buffer-size=512
ids.block-size=300000
storage.cassandra.compression=false
storage.lock.expiry-time=100
index.search.backend=elasticsearch
index.search.hostname=es-hostName
index.search.elasticsearch.client-only=true
storage.connection-timeout=300000


Tried to create a new label with new cassandra keyspace(empty keyspace)..but getting below exception:

graph = JanusGraphFactory.open('janus.properties')
mgmt= graph.openManagement()
labelName = mgmt.makeVertexLabel('labelName').make()
mgmt.commit()
Could not commit transaction due to exception during persistence
Type ':help' or ':h' for help.
Display stack trace? [yN]y
org.janusgraph.core.JanusGraphException: Could not commit transaction due to exception during persistence
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.database.management.ManagementSystem.commit(ManagementSystem.java:235)
at org.janusgraph.core.schema.JanusGraphManagement$commit.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
at groovysh_evaluate.run(groovysh_evaluate:3)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70)
at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72)
at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455)
Caused by: org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:143)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commit(BackendTransaction.java:150)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:703)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363)
... 47 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT3M20S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 53 more
Caused by: org.janusgraph.diskstorage.locking.TemporaryLockingException: No lock columns found for KeyColumn [k=0x 16-165-160-118-108- 30-114-101-113-117-101-115-116- 95-106-111-226, c=0x  0]
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSeniority(ConsistentKeyLocker.java:519)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:454)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:123)
at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:178)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:157)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
...54 more


Re: com.datastax.driver.core.exceptions.BusyPoolException with CQL backend

Robert Dale <rob...@...>
 

To be honest, I'm not sure how the backend handles open iterators and other open resources. `next()` and `hasNext()` may not necessarily know that nothing follows and should clean itself up. I'm not even sure what requires closing in an embedded graph traversal at this point since I typically work with the remote client.  However, looking at the code in the stacktrace, it's creating the batches for adds/deletes and submitting them in parallel. Looking at the FAQ that Jason linked, it agree it would point to batch size.  Thus, if you are committing every 10k mutations, then batch size should probably be (10000/256) around 40. Or, your transaction size should be (256*20) about 5k.  Let us know if these changes make sense and work for you.

Robert Dale

On Wed, Aug 30, 2017 at 2:35 PM, Scott P <scott_p...@...> wrote:
A single thread is doing all CRUD operations, it commits after roughly every 10,000 element touches. Could the number of deltas in the transaction be too large?


On Wednesday, August 30, 2017 at 12:52:52 PM UTC-4, Jason Plurad wrote:
Looks like you can set a batch size, and the default is 20. Let us know if it helps.

storage.cql.batch-statement-size=20

Related reading on the Cassandra Java Driver FAQ.


On Wednesday, August 30, 2017 at 12:29:36 PM UTC-4, scott_patterson wrote:
I'm trying out the new storage.backend=CQL with cassandra from the master branch (0.2.0) and I'm consistently hitting this error after a few hours of CRUD operations, which could previously be handled (0.1.0) with no problems using the storage.backend=cassandra driver.

Is this a known issue that will be addressed in the final 0.2.0 release? Any recommendations on configuration options to adjust the pool or connection sizes?

org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:137)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:133)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:729)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:272)
at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:105)
... 13 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT1M40S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 21 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:123)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore$$Lambda$184.00000000BC05D670.apply(Unknown Source)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:120)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore$$Lambda$65.00000000C02B77E0.apply(Unknown Source)
at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:415)
at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:346)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:79)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 22 more
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /x.x.x.x:9042 (com.datastax.driver.core.exceptions.BusyPoolException: [/x.x.x.x] Pool is busy (no available connection and the queue has reached its max size 256)))
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at io.vavr.concurrent.Future$$Lambda$71.00000000C00F2990.apply(Unknown Source)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at io.vavr.concurrent.FutureImpl$$Lambda$72.00000000C00F3670.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522)
... 4 more
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /x.x.x.x:9042 (com.datastax.driver.core.exceptions.BusyPoolException: [/x.x.x.x] Pool is busy (no available connection and the queue has reached its max size 256)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:211)
at com.datastax.driver.core.RequestHandler.access$1000(RequestHandler.java:46)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:275)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution$1.onFailure(RequestHandler.java:338)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1310)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:457)
at com.google.common.util.concurrent.Futures$ImmediateFuture.addListener(Futures.java:106)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1322)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1258)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.query(RequestHandler.java:297)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:272)
at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:115)
at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:95)
at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:132)
at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$24(CQLStoreManager.java:406)
at org.janusgraph.diskstorage.cql.CQLStoreManager$$Lambda$106.00000000C0938C00.apply(Unknown Source)
at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632)
at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34)
at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510)
at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34)
at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510)
at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34)
at io.vavr.collection.Traversable.foldLeft(Traversable.java:471)
at io.vavr.concurrent.Future.sequence(Future.java:549)
at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:388)
at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:346)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:79)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:137)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:133)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:729)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:272)
at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:105)
... 13 more

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/ab139ab4-79b0-4d0b-a8f4-2340339ee22f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.


Re: Getting TemporaryLockingException: No lock columns found for KeyColumn for mgmt.commit()

Jason Plurad <plu...@...>
 

Your values for storage.lock.expiry-time and storage.lock.wait-time seem to be reversed.
The storage lock docs say the default values for storage.lock.expiry-time is 300000 ms and storage.lock.wait-time is 100 ms.

On Thursday, August 31, 2017 at 9:18:40 AM UTC-4, padmasrinijana wrote:
Using janusgraph-0.1.0-hadoop2 with backend cassandra-3.0.14:

This is the configuration file:
storage.backend=cassandrathrift
storage.hostname=hostName1
storage.cassandra.keyspace=keyspaceName
storage.batch-loading=false
cache.db-cache=true
cache.db-cache-time = 180000
cache.db-cache-size = 0.25
storage.lock.wait-time=300000
storage.lock.retries=10
storage.lock.clean-expired=true
storage.buffer-size=512
ids.block-size=300000
storage.cassandra.compression=false
storage.lock.expiry-time=100
index.search.backend=elasticsearch
index.search.hostname=es-hostName
index.search.elasticsearch.client-only=true
storage.connection-timeout=300000


Tried to create a new label with new cassandra keyspace(empty keyspace)..but getting below exception:

graph = JanusGraphFactory.open('janus.properties')
mgmt= graph.openManagement()
labelName = mgmt.makeVertexLabel('labelName').make()
mgmt.commit()
Could not commit transaction due to exception during persistence
Type ':help' or ':h' for help.
Display stack trace? [yN]y
org.janusgraph.core.JanusGraphException: Could not commit transaction due to exception during persistence
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.database.management.ManagementSystem.commit(ManagementSystem.java:235)
at org.janusgraph.core.schema.JanusGraphManagement$commit.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
at groovysh_evaluate.run(groovysh_evaluate:3)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70)
at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72)
at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455)
Caused by: org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:143)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commit(BackendTransaction.java:150)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:703)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363)
... 47 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT3M20S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 53 more
Caused by: org.janusgraph.diskstorage.locking.TemporaryLockingException: No lock columns found for KeyColumn [k=0x 16-165-160-118-108- 30-114-101-113-117-101-115-116- 95-106-111-226, c=0x  0]
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSeniority(ConsistentKeyLocker.java:519)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:454)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:123)
at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:178)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:157)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
...54 more


Getting TemporaryLockingException: No lock columns found for KeyColumn for mgmt.commit()

padmasr...@...
 

Using janusgraph-0.1.0-hadoop2 with backend cassandra-3.0.14:

This is the configuration file:
storage.backend=cassandrathrift
storage.hostname=hostName1
storage.cassandra.keyspace=keyspaceName
storage.batch-loading=false
cache.db-cache=true
cache.db-cache-time = 180000
cache.db-cache-size = 0.25
storage.lock.wait-time=300000
storage.lock.retries=10
storage.lock.clean-expired=true
storage.buffer-size=512
ids.block-size=300000
storage.cassandra.compression=false
storage.lock.expiry-time=100
index.search.backend=elasticsearch
index.search.hostname=es-hostName
index.search.elasticsearch.client-only=true
storage.connection-timeout=300000


Tried to create a new label with new cassandra keyspace(empty keyspace)..but getting below exception:

graph = JanusGraphFactory.open('janus.properties')
mgmt= graph.openManagement()
labelName = mgmt.makeVertexLabel('labelName').make()
mgmt.commit()
Could not commit transaction due to exception during persistence
Type ':help' or ':h' for help.
Display stack trace? [yN]y
org.janusgraph.core.JanusGraphException: Could not commit transaction due to exception during persistence
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at org.janusgraph.graphdb.database.management.ManagementSystem.commit(ManagementSystem.java:235)
at org.janusgraph.core.schema.JanusGraphManagement$commit.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
at groovysh_evaluate.run(groovysh_evaluate:3)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70)
at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72)
at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122)
at org.codehaus.groovy.tools.shell.ShellRunner.work(ShellRunner.groovy:95)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.work(InteractiveShellRunner.groovy:124)
at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152)
at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152)
at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232)
at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455)
Caused by: org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:95)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:143)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:200)
at org.janusgraph.diskstorage.BackendTransaction.commit(BackendTransaction.java:150)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:703)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363)
... 47 more
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT3M20S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 53 more
Caused by: org.janusgraph.diskstorage.locking.TemporaryLockingException: No lock columns found for KeyColumn [k=0x 16-165-160-118-108- 30-114-101-113-117-101-115-116- 95-106-111-226, c=0x  0]
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSeniority(ConsistentKeyLocker.java:519)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:454)
at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:123)
at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:178)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:157)
at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:98)
at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:95)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
...54 more


Re: Where are my edges?

Yair Ogen <yair...@...>
 

I did comm at the end:

graph.tx().commit()

graph.close

On Thu, Aug 31, 2017 at 10:59 AM, HadoopMarc <marc.d...@...> wrote:
All graph mutations are realized within a (hidden) transaction. You have to commit() the transaction before the changes are visible to other clients. So, look for .commit methods in the gremlin-scala API .

Cheers,    Marc

Op donderdag 31 augustus 2017 09:33:33 UTC+2 schreef ya...@...:
I am using gremlin-scala.

I connect to remote janus server that forked cassandra using:


val conf = new BaseConfiguration()
conf.setProperty("storage.backend", "cassandra")
conf.setProperty("storage.hostname", "my-ip")
conf.setProperty("index.search.hostname", "my-ip")
val graph = JanusGraphFactory.open(conf).asScala

I create vertexes and edges:

val cityA = graph + (location, name -> "City-A", population -> 400000)
val cityB= graph + (location, name -> "CityB", population -> 300000)


cityB<-- ("Road", distance -> 92) --> cityA 

and If I query these - everything is ok.

however, if I look up the vertexes in another client:

val telAviv = graph.V().has(name,"TelAviv").head()

my queries (for example find all paths from V1 to V2) don't work.

It's as it they are not stored in the DB and are only available during the same run that created them.

What am I doing wrong?

--
You received this message because you are subscribed to a topic in the Google Groups "JanusGraph users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/janusgraph-users/fONPVU9xkHE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to janusgraph-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/38fbaf0f-e670-409e-b6a2-81e0ecab7b6d%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.


Re: Where are my edges?

HadoopMarc <marc.d...@...>
 

All graph mutations are realized within a (hidden) transaction. You have to commit() the transaction before the changes are visible to other clients. So, look for .commit methods in the gremlin-scala API .

Cheers,    Marc

Op donderdag 31 augustus 2017 09:33:33 UTC+2 schreef ya...@...:

I am using gremlin-scala.

I connect to remote janus server that forked cassandra using:


val conf = new BaseConfiguration()
conf.setProperty("storage.backend", "cassandra")
conf.setProperty("storage.hostname", "my-ip")
conf.setProperty("index.search.hostname", "my-ip")
val graph = JanusGraphFactory.open(conf).asScala

I create vertexes and edges:

val cityA = graph + (location, name -> "City-A", population -> 400000)
val cityB= graph + (location, name -> "CityB", population -> 300000)


cityB<-- ("Road", distance -> 92) --> cityA 

and If I query these - everything is ok.

however, if I look up the vertexes in another client:

val telAviv = graph.V().has(name,"TelAviv").head()

my queries (for example find all paths from V1 to V2) don't work.

It's as it they are not stored in the DB and are only available during the same run that created them.

What am I doing wrong?


Where are my edges?

yair...@...
 

I am using gremlin-scala.

I connect to remote janus server that forked cassandra using:


val conf = new BaseConfiguration()
conf.setProperty("storage.backend", "cassandra")
conf.setProperty("storage.hostname", "my-ip")
conf.setProperty("index.search.hostname", "my-ip")
val graph = JanusGraphFactory.open(conf).asScala

I create vertexes and edges:

val cityA = graph + (location, name -> "City-A", population -> 400000)
val cityB= graph + (location, name -> "CityB", population -> 300000)


cityB<-- ("Road", distance -> 92) --> cityA 

and If I query these - everything is ok.

however, if I look up the vertexes in another client:

val telAviv = graph.V().has(name,"TelAviv").head()

my queries (for example find all paths from V1 to V2) don't work.

It's as it they are not stored in the DB and are only available during the same run that created them.

What am I doing wrong?


Re: Scala client

HadoopMarc <bi...@...>
 

Hi ...

The gremlin-scala client looks great and uses scala 2_12, indeed. Apart from using gremlin-scala you can import the tinkerpop java libs directly from scala, but this will give you an occasional headache regarding conversions between java and scala types. On the other hand, I expect that gremlin-scala does not support Tinkerpop´ s SparkGraphComputer which uses scala 2_10   @mpollmeier ???

Cheers,    Marc

Op woensdag 30 augustus 2017 15:02:35 UTC+2 schreef ya...@...:

Does anyone know of a good scala client?

Shold I use 'gremlin-scala_2.12'?

5981 - 6000 of 6678