Re: Getting TemporaryLockingException: No lock columns found for KeyColumn for mgmt.commit()
Suny <sahithiy...@...>
Were you able to resolve this issue ? On Thursday, August 31, 2017 at 9:18:40 AM UTC-4, pad...@... wrote:
|
|
Limit on size of strings in Janusgraph
Suny <sahithiy...@...>
Is there any limit on size of strings in Janusgraph ? (Using String datatype) |
|
Re: unique index per label
stan...@...
Hi,Robert. I want to index all my vertex.But it seems to slow. Is there any resolvent? 在 2017年9月12日星期二 UTC+8上午12:35:10,Robert Dale写道:
|
|
Re: Elastic search 5.5.1 with Janusgraph
guan wang <gyw...@...>
Thank you Jerry. Yes, it was classpath problem. After fixed it. Now I have different error. solr/zookeeper connection is fine, the collections are automatically created after, but the index is empty. 22:36:37.548 [main] DEBUG o.j.d.hbase.HBaseKeyColumnValueStore - Generated HBase Filter ColumnRangeFilter [\x00, \xFF) Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedTime(Ljava/util/concurrent/TimeUnit;)J at com.google.common.cache.LocalCache$LoadingValueReference.elapsedNanos(LocalCache.java:3600) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2407) at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2373) at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2335) at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2250) at com.google.common.cache.LocalCache.get(LocalCache.java:3985) at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4788) at org.janusgraph.graphdb.transaction.vertexcache.GuavaVertexCache.get(GuavaVertexCache.java:83) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.getInternalVertex(StandardJanusGraphTx.java:446) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$7.apply(StandardJanusGraphTx.java:1329) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$7.apply(StandardJanusGraphTx.java:1324) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) at java.util.stream.SliceOps$1$1.accept(SliceOps.java:204) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) at java.util.ArrayList$ArrayListSpliterator.tryAdvance(ArrayList.java:1351) at java.util.stream.StreamSpliterators$WrappingSpliterator.lambda$initPartialTraversalState$0(StreamSpliterators.java:294) at java.util.stream.StreamSpliterators$AbstractWrappingSpliterator.fillBuffer(StreamSpliterators.java:206) at java.util.stream.StreamSpliterators$AbstractWrappingSpliterator.doAdvance(StreamSpliterators.java:161) at java.util.stream.StreamSpliterators$WrappingSpliterator.tryAdvance(StreamSpliterators.java:300) at java.util.Spliterators$1Adapter.hasNext(Spliterators.java:681) at org.janusgraph.graphdb.util.SubqueryIterator.hasNext(SubqueryIterator.java:79) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:70) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.<init>(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:68) at com.google.common.collect.Iterables$7.iterator(Iterables.java:613) at com.google.common.collect.Iterables.getOnlyElement(Iterables.java:284) at org.janusgraph.graphdb.database.StandardJanusGraph$1.retrieveSchemaByName(StandardJanusGraph.java:361) at org.janusgraph.graphdb.database.cache.StandardSchemaCache.getSchemaId(StandardSchemaCache.java:112) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.getSchemaVertex(StandardJanusGraphTx.java:878) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.getVertexLabel(StandardJanusGraphTx.java:1005) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.getOrCreateVertexLabel(StandardJanusGraphTx.java:1010) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsTransaction.addVertex(JanusGraphBlueprintsTransaction.java:119) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:117) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:66) at com.sysomos.labs.janusgraph.JavaExample.main(JavaExample.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147) 22:36:38.264 [main-SendThread(alzk01.lab.dev.yyz.corp.pvt:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x15790982d05010f after 82ms 22:36:41.391 [pool-6-thread-1] DEBUG o.j.d.hbase.HBaseKeyColumnValueStore - Generated HBase Filter FilterList AND (2/2): [ColumnRangeFilter [\x00\x05Y\x84>\x17\x0F\x18, \x00\x05Y\x84>W\x0A\x00), ColumnPaginationFilter On Sun, 17 Sep 2017 at 15:02 Jerry He <jerr...@...> wrote: Looks like you are missing janusgraph-solr jar in your classpath. |
|
Re: Fetching TTL for individual graph vertices
Jerry He <jerr...@...>
Hi, Sankar You raised a good question. If you use the management API to get Edge Label (or any types) TTL, you will get the configured fixed TTL value. But if you try to retrieve the individual TTLs on the individual edges, you MAY get the 'remaining time' as you would want it. JanusGraph simply returns what it gets from the Cassandra backend. From the CQL documentation, it does seem that Cassandra returns the 'remaining time'. Please try it out with the driver you use. Thanks, Jerry On Sunday, September 17, 2017 at 11:20:06 PM UTC-7, Sankar Sangili wrote:
|
|
Re: Dynamic edge creation
Robert Dale <rob...@...>
On Monday, September 18, 2017 at 6:21:59 AM UTC-4, Robert Dale wrote:
|
|
Re: Dynamic edge creation
Robert Dale <rob...@...>
If `l1` is `p1` then yes, this will create an edge from every player p1 to every player p2. You're not filtering anything out so all players show up in both `V().hasLabel('player')`. If you want to filter out `self` and `has existing 'sameTeam' edge, try this: g.V().hasLabel('player').as('p1').V().hasLabel('player').where(neq('p1')).where(eq('p1')).by('teamName') Robert Dale On Mon, Sep 18, 2017 at 1:58 AM, Ankur Goel <ankur...@...> wrote:
|
|
Re: Lock write succeeded but took too long: duration PT0.146S exceeded limit PT0.1S in logs
Ankur Goel <ankur...@...>
My bad got resolved, correct property is : storage.lock.wait-time. On Monday, September 18, 2017 at 2:11:06 PM UTC+5:30, Ankur Goel wrote:
|
|
Lock write succeeded but took too long: duration PT0.146S exceeded limit PT0.1S in logs
Ankur Goel <ankur...@...>
Hi, i am having embedded (ES + Cassandra) server on remote server, that i connecting through java code. i am consistently getting following logs for schema creation commit: 2017-09-18 14:07:28,822 WARN [main] org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker: Lock write succeeded but took too long: duration PT0.146S exceeded limit PT0.1S 2017-09-18 14:07:28,956 WARN [main] org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker: Lock write succeeded but took too long: duration PT0.134S exceeded limit PT0.1S 2017-09-18 14:07:29,115 WARN [main] org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker: Lock write succeeded but took too long: duration PT0.159S exceeded limit PT0.1S 2017-09-18 14:07:29,250 ERROR [main] org.janusgraph.graphdb.database.StandardJanusGraph: Could not commit transaction [1] due to exception org.janusgraph.diskstorage.locking.TemporaryLockingException: Temporary locking failure at org.janusgraph.diskstorage.locking.AbstractLocker.writeLock(AbstractLocker.java:309) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStore.acquireLock(ExpectedValueCheckingStore.java:103) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.acquireLock(KCVSProxy.java:52) at org.janusgraph.diskstorage.BackendTransaction.acquireIndexLock(BackendTransaction.java:255) at org.janusgraph.graphdb.database.StandardJanusGraph.prepareCommit(StandardJanusGraph.java:565) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:694) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363) at org.janusgraph.graphdb.database.management.ManagementSystem.commit(ManagementSystem.java:235) at com.test.ankur.janusgraph.mains.JGMgmtService.createSchema(JGMgmtService.java:131) at com.test.ankur.janusgraph.mains.JanusGraphMain.schemaCreation(JanusGraphMain.java:107) at com.test.ankur.janusgraph.mains.JanusGraphMain.main(JanusGraphMain.java:136) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Lock write retry count exceeded at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.writeSingleLock(ConsistentKeyLocker.java:339) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.writeSingleLock(ConsistentKeyLocker.java:123) at org.janusgraph.diskstorage.locking.AbstractLocker.writeLock(AbstractLocker.java:304) ... 10 common frames omitted Although i have modified following properties seeing network overhead, still seeing Lock write succeeded but took too long: duration PT0.146S exceeded limit PT0.1S in logs. storage.lock-wait-time=900000
storage.wait-time=5000 What i am missing. ~AnkurG |
|
Re: Fetching TTL for individual graph vertices
sankar...@...
Hi Jerry Thanks for the reply. The Sample use case could be like . John wantsBike BikeA . Here the edge label could have a ttl of 3 days. if i am suppose to understand all the users whose wantsBike TTL is about to expire in next 9 hours , How can i get it. In the tescases of JanusGraphTest ,I was not able to find the cases for finding the remaining TTL for the edge/vertex . I think it provides the configured time. Please let me know if my understanding is not right. Regards Sankar S On Saturday, September 16, 2017 at 12:39:16 AM UTC+5:30, Jerry He wrote:
|
|
Re: Dynamic edge creation
Ankur Goel <ankur...@...>
Thnx Robert n Daniel, Its working like charm. But it got stuck in other use case: where i want to create relation based on team: g.V().hasLabel('player').as('p1').V().hasLabel('player').where(eq('l1')).by('teamName').addE('sameTeam').from('p1') in this i want to create edges between same teamName player. Above gremlin query is working but creating all combination of edges. For example for a 3 node of player label having same team name, its creating 9 edges, instead of 3 only. Double edges for between two vertex and one loop to same vertex. ~AnkurG On Fri, Sep 15, 2017 at 7:54 PM, Daniel Kuppitz <me@...> wrote:
|
|
Re: Elastic search 5.5.1 with Janusgraph
Jerry He <jerr...@...>
Looks like you are missing janusgraph-solr jar in your classpath.
toggle quoted message
Show quoted text
Thanks, Jerry On Sat, Sep 16, 2017 at 5:42 PM, <gyw...@...> wrote:
need help to use the master branch for janusgraph-hbase-solr setup |
|
Re: Intgrating JanusGraph to an existing hadoop cluster
HadoopMarc <bi...@...>
You can start here: http://yaaics.blogspot.nl/2017/07/configuring-janusgraph-for-spark-yarn.html Cheers, Marc Op zondag 17 september 2017 07:15:43 UTC+2 schreef Dilan Ranasinghe:
|
|
Intgrating JanusGraph to an existing hadoop cluster
Dilan Ranasinghe <dila...@...>
Hello, I'm new to big data including JanusGraph. I'm assigned with a task of integrating JanusGraph to an existing Hadoop cluster. Can you please provide me the steps to be followed for this or a reference to be used? Thanks and regards, Dilan. |
|
Re: Elastic search 5.5.1 with Janusgraph
gyw...@...
need help to use the master branch for janusgraph-hbase-solr setup I got code compiled. When I run the example in the core directory, hbase connection is fine and the table been created. But I got the following solr index error ..... 17:23:48.039 [main] DEBUG o.j.d.hbase.HBaseStoreManager - [HBaseConfig] s3.bytes-per-checksum=512 17:23:48.039 [main] DEBUG o.j.d.hbase.HBaseStoreManager - [HBaseConfig] hfile.index.block.max.size=131072 17:23:48.039 [main] DEBUG o.j.d.hbase.HBaseStoreManager - [HBaseConfig] yarn.resourcemanager.webapp.https.address=${yarn.resourcemanager.hostname}:8090 17:23:48.039 [main] DEBUG o.j.d.hbase.HBaseStoreManager - [HBaseConfig] hbase.regionserver.info.bindAddress=0.0.0.0 17:23:48.039 [main] DEBUG o.j.d.hbase.HBaseStoreManager - End of HBase config key=value pairs 17:23:48.040 [main] INFO org.janusgraph.diskstorage.Backend - Configuring index [search] Exception in thread "main" java.lang.IllegalArgumentException: Could not find implementation class: org.janusgraph.diskstorage.solr.SolrIndex at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:61) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getIndexes(Backend.java:464) at org.janusgraph.diskstorage.Backend.<init>(Backend.java:149) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.getBackend(GraphDatabaseConfiguration.java:1872) at org.janusgraph.graphdb.database.StandardJanusGraph.<init>(StandardJanusGraph.java:134) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:107) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:75) at com.sysomos.labs.janusgraph.MyTestFactory.main(MyTestFactory.java:165) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147) Caused by: java.lang.ClassNotFoundException: org.janusgraph.diskstorage.solr.SolrIndex at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:56) storage.backend=hbase storage.hostname=alghzk01:2181,alghzk02:2181,alghzk03:2181 cache.db-cache = false index.search.backend=solr (solr6.6 is used) index.search.solr.mode=cloud index.search.solr.zookeeper-url=alzk01.lab.dev.yyz.corp.pvt:2181/solr,alzk02.lab.dev.yyz.corp.pvt:2181/solr,alzk03.lab.dev.yyz.corp.pvt:2181/solr index.search.solr.configset=janusGraphConf #index.vertics.solr.num-shards=10 #index.edges.solr.num-shards=10 I do have solr collections (edges and vertices) created. Thanks, Guan On Friday, 15 September 2017 08:53:34 UTC-7, Jason Plurad wrote:
|
|
Re: Fetching TTL for individual graph vertices
Jerry He <jerr...@...>
What is the use case that you want to fetch individual TTLs. The TTLs are defined on VertexLable, EdgeLable and PropertyKey via the management API. After that anytime you can retrieve the generic TTL for a particular type, which is the pre-set fixed number. There are ways to get individual TTL. You can look at the TTL test cases in JanusGraphTest. Thanks, Jerry On Friday, September 15, 2017 at 6:21:39 AM UTC-7, Sankar Sangili wrote:
|
|
Re: Elastic search 5.5.1 with Janusgraph
Jason Plurad <plu...@...>
JanusGraph 0.2.0 will be out before next year, definitely. If you want to try out the ES 5.5 functionality, it is available now on the master branch. Build a distribution from source code, and you can help test it out now. On Friday, September 15, 2017 at 10:42:08 AM UTC-4, Suny wrote:
|
|
Elastic search 5.5.1 with Janusgraph
Suny <sahithiy...@...>
I see JG 0.1.1 is compatible with 1.5.1 version of Elastic Search. I read somewhere JG 0.2.0 is going to support ES 5.x, but it is going to be released early next year may be. Is it possible to customize JG 0.1.1 it to work with ES 5.5.1 version ? Is this a good idea ? Did anybody tried doing this ? |
|
Re: Dynamic edge creation
Daniel Kuppitz <me@...>
Oops, Gmail didn't notify me about your response, sorry for the double-post. On Fri, Sep 15, 2017 at 6:57 AM, Robert Dale <rob...@...> wrote:
|
|
Re: Dynamic edge creation
Daniel Kuppitz <me@...>
This should do the trick:
However, note that this query will do 2 full table scans under the hood (unless Janus already has some runtime optimization that I'm not aware of). In any case it will be at least one full table scan. Cheers, Daniel On Fri, Sep 15, 2017 at 6:44 AM, Ankur Goel <ankur...@...> wrote:
|
|