janusgraph-users@lists.lfaidata.foundation

Janusgraph SDK support

Juan Pablo Gomez Espinosa <jpgo...@...>

#27

Does Janusgraph support OpenJDK instead of Oracle?

Thansk.

Thanks
JP

Janusgraph SDK support

Ted Wilmes <twi...@...>

#26

Hi JP,
OpenJDK will work fine.

--Ted

subscribe

Phil Young <phil.wi...@...>

#28

Scalability issue with current titan(0.5.4) version and upgrade version to (1.0.0)

ankit tyagi <ankitty...@...>

#29

Hi,

Currently, I am using titan graph0.5.4 for making the social graph out of user activities like (user1-->follows-->user2, user1-->likes-->object2 etc.).

Earlier when I started using it, a number of activities, users etc. were quite small and since then it is growing daily. So to give approximate numbers I have around 20 million user nodes and 50 million objects nodes and obviously billions of edges :).

I have exposed APIs on this social graph using tinker pop library in java eg. get followers, following of user1 etc. I am using Cassandra(version2.0.14) as the underlying database.

Throughput is around 50K rpm.

So, overall loads of deletion, insertion, update, reads are happening on daily basis.

Problems I am facing

If read increases, load gets quite high on my machines (machine config RAID-1 , 1 TB DISK ,32 core, 64GB RAM, 4 similar machines, replication fact 3, Levelled compaction)

Response time/SLA of APIs also degraded over a period of time.

My Queries

Can I use titan for serving this type of real-time queries, or should I keep it only for analytics purpose to explore/recommend user data?

Do I need to change my Cassandra configurations or machines configuration to improve performance?

Any suggestions for scaling/serving this type of data?

For more explanation or any other thing, please do ping. I am quite stuck over this problem.

For using Janus graph, we need to migrate our version to 1.0.0. Is this upgrade requires data migration also because I am below exception when I am trying to load data with 1.0.0 version,

Display stack trace? [yN] y

java.lang.ArrayIndexOutOfBoundsException: Required size [1] exceeds actual remaining size [0]

at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.require(StaticArrayBuffer.java:80)

at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.getByte(StaticArrayBuffer.java:156)

at com.thinkaurelius.titan.di skstorage.util.ReadArrayBuffer.getByte(ReadArrayBuffer.java:67)

at com.thinkaurelius.titan.graphdb.database.idhandling.VariableLong.readUnsigned(VariableLong.java:34)

at com.thinkaurelius.titan.graphdb.database.idhandling.VariableLong.readPositive(VariableLong.java:80)

I am using below configuration to load the graph.

ids.block-size=100000

storage.cassandra.keyspace=lgpgels

storage.backend=cassandra

storage.hostname=lgp1,lgp2,lgp3,lgp4

index.gelssearch.hostname=lgp1,lgp2,lgp3,lgp4

index.gelssearch.backend=elasticsearch

index.gelssearch.index-name=lgpgels

index.gelssearch.elasticsearch.cluster-name=lgp

Scalability issue with titan (0.5.4) and upgrade version from 0.5.4 to 1.0.0

ankit tyagi <ankitty...@...>

#30

Hi,

Currently, I am using titan graph0.5.4 for making the social graph out of user activities like (user1-->follows-->user2, user1-->likes-->object2 etc.).

Earlier when I started using it, a number of activities, users etc. were quite small and since then it is growing daily. So to give approximate numbers I have around 20 million user nodes and 50 million objects nodes and obviously billions of edges :).

I have exposed APIs on this social graph using tinker pop library in java eg. get followers, following of user1 etc. I am using Cassandra(version2.0.14) as the underlying database.

Throughput is around 50K rpm.

So, overall loads of deletion, insertion, update, reads are happening on daily basis.

Problems I am facing

If read increases, load gets quite high on my machines (machine config RAID-1 , 1 TB DISK ,32 core, 64GB RAM, 4 similar machines, replication fact 3, Levelled compaction)

Response time/SLA of APIs also degraded over a period of time.

My Queries

Can I use titan for serving this type of real time queries, or should I keep it only for analytics purpose to explore/recommend user data?

Do I need to change my Cassandra configurations or machines configuration to improve performance?

Any suggestions for scaling/serving this type of data?

For more explanation or any other thing, please do ping. I am quite stuck over this problem :/

For using JanusGraph, we need to migrate our current version to 1.0.0. Do we need data migration also because I am getting below exception while loading graph with 1.0.0.

Required size [1] exceeds actual remaining size [0]

Display stack trace? [yN] y

java.lang.ArrayIndexOutOfBoundsException: Required size [1] exceeds actual remaining size [0]

at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.require(StaticArrayBuffer.java:80)

at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.getByte(StaticArrayBuffer.java:156)

at com.thinkaurelius.titan.diskstorage.util.ReadArrayBuffer.getByte(ReadArrayBuffer.java:67)

I am using below configuration to load the graph.

ids.block-size=100000

storage.cassandra.keyspace=lgpgels

storage.backend=cassandra

storage.hostname=lgp1,lgp2,lgp3,lgp4

index.gelssearch.hostname=lgp1,lgp2,lgp3,lgp4

index.gelssearch.backend=elasticsearch

index.gelssearch.index-name=lgpgels

index.gelssearch.elasticsearch.cluster-name=lgp

Re: Scalability issue with titan (0.5.4) and upgrade version from 0.5.4 to 1.0.0

Ted Wilmes <twi...@...>

#31

Hi Ankit,

You will need to perform a data migration from 0.5.4 to Titan 1.0 or JanusGraph. Daniel Kuppitz and Stephen Mallette put together an example migration from 0.5.4 to 1.0.0 here: https://github.com/dkuppitz/openflights. You'll need to carefully think through how you'd do this in production and I'd recommend many practice runs on test systems to get it right first! As far as if OLTP, I'd suggest profiling your system to see where the slowdown is. Maybe there are particular queries that need to be optimized or possibly you can tune your Cassandra configuration. First thing first though, you'll need to figure out where the bottlenecks are.

--Ted

Show quoted text

On Monday, January 30, 2017 at 9:14:58 AM UTC-6, ankit tyagi wrote:

Hi,

Currently, I am using titan graph0.5.4 for making the social graph out of user activities like (user1-->follows-->user2, user1-->likes-->object2 etc.).

Earlier when I started using it, a number of activities, users etc. were quite small and since then it is growing daily. So to give approximate numbers I have around 20 million user nodes and 50 million objects nodes and obviously billions of edges :).

I have exposed APIs on this social graph using tinker pop library in java eg. get followers, following of user1 etc. I am using Cassandra(version2.0.14) as the underlying database.

Throughput is around 50K rpm.

So, overall loads of deletion, insertion, update, reads are happening on daily basis.

Problems I am facing
If read increases, load gets quite high on my machines (machine config RAID-1 , 1 TB DISK ,32 core, 64GB RAM, 4 similar machines, replication fact 3, Levelled compaction)
Response time/SLA of APIs also degraded over a period of time.
My Queries
Can I use titan for serving this type of real time queries, or should I keep it only for analytics purpose to explore/recommend user data?
Do I need to change my Cassandra configurations or machines configuration to improve performance?
Any suggestions for scaling/serving this type of data?
For more explanation or any other thing, please do ping. I am quite stuck over this problem :/

For using JanusGraph, we need to migrate our current version to 1.0.0. Do we need data migration also because I am getting below exception while loading graph with 1.0.0.

Required size [1] exceeds actual remaining size [0]
Display stack trace? [yN] y
java.lang.ArrayIndexOutOfBoundsException: Required size [1] exceeds actual remaining size [0]
at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.require(StaticArrayBuffer.java:80)
at com.thinkaurelius.titan.diskstorage.util.StaticArrayBuffer.getByte(StaticArrayBuffer.java:156)
at com.thinkaurelius.titan.diskstorage.util.ReadArrayBuffer.getByte(ReadArrayBuffer.java:67)

I am using below configuration to load the graph.
ids.block-size=100000
storage.cassandra.keyspace=lgpgels
storage.backend=cassandra
storage.hostname=lgp1,lgp2,lgp3,lgp4
index.gelssearch.hostname=lgp1,lgp2,lgp3,lgp4
index.gelssearch.backend=elasticsearch
index.gelssearch.index-name=lgpgels
index.gelssearch.elasticsearch.cluster-name=lgp

Re: subscribe

Jason Plurad <plu...@...>

#32

Anybody interested in subscribing to the list, what you need to do is first sign in with your Google account.

Click on the Join group button at the top near the Google Group name.

Under the My settings dropdown, select Membership and email settings if you want messages sent directly to your email address.

For Email delivery preference, you can decide how you want the messages delivered to you.

Show quoted text

On Monday, January 30, 2017 at 10:15:36 AM UTC-5, Phil Young wrote:

Re: subscribe

Misha Brukman <mbru...@...>

#33

To subscribe to either the users or the dev list, visit the archive page for the list:

and follow the instructions that Jason posted below.

We'll update the instructions on https://github.com/JanusGraph/janusgraph/blob/master/README.md to clarify this.

Show quoted text

On Mon, Jan 30, 2017 at 10:34 AM, Jason Plurad <plu...@...> wrote:

Anybody interested in subscribing to the list, what you need to do is first sign in with your Google account.

Click on the Join group button at the top near the Google Group name.

Under the My settings dropdown, select Membership and email settings if you want messages sent directly to your email address.

For Email delivery preference, you can decide how you want the messages delivered to you.

On Monday, January 30, 2017 at 10:15:36 AM UTC-5, Phil Young wrote:

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: subscribe

Misha Brukman <mbru...@...>

#34

This has been updated, please see

https://github.com/JanusGraph/janusgraph/blob/master/README.md#contact

for a single-click subscription process.

Show quoted text

On Mon, Jan 30, 2017 at 11:13 AM, Misha Brukman <mbru...@...> wrote:

To subscribe to either the users or the dev list, visit the archive page for the list:
https://groups.google.com/group/janusgraph-users
https://groups.google.com/group/janusgraph-dev
and follow the instructions that Jason posted below.

We'll update the instructions on https://github.com/JanusGraph/janusgraph/blob/master/README.md to clarify this.

On Mon, Jan 30, 2017 at 10:34 AM, Jason Plurad <plu...@...> wrote:
Anybody interested in subscribing to the list, what you need to do is first sign in with your Google account.

Click on the Join group button at the top near the Google Group name.

Under the My settings dropdown, select Membership and email settings if you want messages sent directly to your email address.

For Email delivery preference, you can decide how you want the messages delivered to you.

On Monday, January 30, 2017 at 10:15:36 AM UTC-5, Phil Young wrote:

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Installation of JanusGraph

e2t2 <ghaffa...@...>

#35

Hi All,

I am new to graph world and have done basic Titan tutorials, etc. Happy to hear that JanusGraph will continue where titan guys left.

Just a quick question, in the Getting started guide for JanusGraph it says to download zip file and unzip it to get started. However, in download link there is no release available.

Do I need to clone the repository and build it myself or I am missing something here?

Thanks

Re: Installation of JanusGraph

Misha Brukman <mbru...@...>

#36

Yes, that's correct. For now, please clone and build locally.

https://github.com/JanusGraph/janusgraph/issues/40 is tracking the work of building a release snapshot to simplify the getting started process.

Show quoted text

On Wed, Feb 8, 2017 at 2:15 PM, e2t2 <ghaffa...@...> wrote:

Hi All,

I am new to graph world and have done basic Titan tutorials, etc. Happy to hear that JanusGraph will continue where titan guys left.

Just a quick question, in the Getting started guide for JanusGraph it says to download zip file and unzip it to get started. However, in download link there is no release available.

Do I need to clone the repository and build it myself or I am missing something here?

Thanks

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Wrapper Class Support

Barry Hill <barry...@...>

#37

Is it possible to add support for Arrays of wrapper classes such as Integer in JanusGraph?

Exception in thread "main" java.lang.IllegalArgumentException: Property value [[Ljava.lang.Integer;@1583741e] is of type class [Ljava.lang.Integer; is not supported

at org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:163)

at org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:159)

at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.verifyAttribute(StandardJanusGraphTx.java:578)

at org.janusgraph.graphdb.query.QueryUtil.addConstraint(QueryUtil.java:233)

at org.janusgraph.graphdb.query.QueryUtil.constraints2QNF(QueryUtil.java:223)

at org.janusgraph.graphdb.query.graph.GraphCentricQueryBuilder.constructQueryWithoutProfile(GraphCentricQueryBuilder.java:213)

at org.janusgraph.graphdb.query.graph.GraphCentricQueryBuilder.constructQuery(GraphCentricQueryBuilder.java:202)

at org.janusgraph.graphdb.query.graph.GraphCentricQueryBuilder.vertices(GraphCentricQueryBuilder.java:165)

at org.janusgraph.graphdb.tinkerpop.optimize.JanusGraphStep.lambda$new$0(JanusGraphStep.java:62)

at org.apache.tinkerpop.gremlin.process.traversal.step.map.GraphStep.processNextStart(GraphStep.java:123)

at org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.next(AbstractStep.java:126)

at org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.next(AbstractStep.java:37)

at org.apache.tinkerpop.gremlin.process.traversal.util.DefaultTraversal.next(DefaultTraversal.java:157)

I'm using Kotlin for my project and kotlin uses wrapper classes for types such as Int (Integer)

https://kotlinlang.org/docs/reference/basic-types.html

I'm new to TinkerPop/JanusGraph so pardon my ignorance.

Wrapper Class Support

Barry Hill <barry...@...>

#38

It's only for Arrays oops

Work around for me is to use Kotlin IntArray which compiles to Javas int[]

JanusGraph release roadmap

Manas Bajaj <manas...@...>

#39

Hello JanusGraph committers

We are all very excited to see JanusGraph kickoff in 2017. Is there a release roadmap for this project? What will be the first release and tentatively when?

Thanks

Manas

Re: JanusGraph release roadmap

吴冉波 <wur...@...>

#40

Want too ~~~~
And hope to make ElasticSearch to be the new storage backend.

Show quoted text

On Monday, February 20, 2017 at 10:22:54 AM UTC+8, Manas Bajaj wrote:

Hello JanusGraph committers

We are all very excited to see JanusGraph kickoff in 2017. Is there a release roadmap for this project? What will be the first release and tentatively when?

Thanks
Manas

Build and first use.

Manoj Waikar <mmwa...@...>

#41

Hi,

I was able to build JanusGraph after cloning the Git repo.

I included the janusgraph-core and janusgraph-cassandra jar files in my project. Additionally, I had to specify the following dependencies in my pom file -

<dependency>
 <groupId>org.apache.tinkerpop</groupId>
 <artifactId>gremlin-core</artifactId>
 <version>3.2.4</version>
</dependency>

<dependency>
 <groupId>com.google.guava</groupId>
 <artifactId>guava</artifactId>
 <version>21.0</version>
</dependency>

<dependency>
 <groupId>org.apache.commons</groupId>
 <artifactId>commons-lang3</artifactId>
 <version>3.4</version>
</dependency>

<dependency>
 <groupId>com.netflix.astyanax</groupId>
 <artifactId>astyanax-core</artifactId>
 <version>3.9.0</version>
</dependency>

<dependency>
 <groupId>com.netflix.astyanax</groupId>
 <artifactId>astyanax-cassandra</artifactId>
 <version>3.9.0</version>
</dependency>

<dependency>
 <groupId>com.netflix.astyanax</groupId>
 <artifactId>astyanax-thrift</artifactId>
 <version>3.9.0</version>
</dependency>

<dependency>
 <groupId>com.codahale.metrics</groupId>
 <artifactId>metrics-core</artifactId>
 <version>3.0.2</version>
</dependency>

<dependency>
 <groupId>com.spatial4j</groupId>
 <artifactId>spatial4j</artifactId>
 <version>0.5</version>
</dependency>

Is this expected, or am I missing something?

Thanks,

Manoj.

Re: JanusGraph release roadmap

Ted Wilmes <twi...@...>

#42

Hello,

A tentative date has not been set yet. There has been some discussion on the dev list.

There are a number of prerequisites that we're working through. For now, I'd recommend

watching the dev list as discussions continue. You can also track progress of the issues that

are slated to be included by looking at https://github.com/JanusGraph/janusgraph/milestone/1.

That's not necessarily a complete or final list but it should give you some insight along with

the dev chatter.

Thanks,

Ted

Show quoted text

On Monday, February 20, 2017 at 8:16:29 PM UTC-6, 吴冉波 wrote:

Want too ~~~~
And hope to make ElasticSearch to be the new storage backend.

On Monday, February 20, 2017 at 10:22:54 AM UTC+8, Manas Bajaj wrote:
Hello JanusGraph committers

We are all very excited to see JanusGraph kickoff in 2017. Is there a release roadmap for this project? What will be the first release and tentatively when?

Thanks
Manas

Re: Installation of JanusGraph

loui...@...

#43

Hi Misha,

What exactly is involved in building locally? I can't seem to find any documentation.

Thanks

Show quoted text

On Wednesday, February 8, 2017 at 10:07:39 PM UTC+1, Misha Brukman wrote:

Yes, that's correct. For now, please clone and build locally.

https://github.com/JanusGraph/janusgraph/issues/40 is tracking the work of building a release snapshot to simplify the getting started process.

On Wed, Feb 8, 2017 at 2:15 PM, e2t2 <gha...@...> wrote:
Hi All,

I am new to graph world and have done basic Titan tutorials, etc. Happy to hear that JanusGraph will continue where titan guys left.

Just a quick question, in the Getting started guide for JanusGraph it says to download zip file and unzip it to get started. However, in download link there is no release available.

Do I need to clone the repository and build it myself or I am missing something here?

Thanks

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Installation of JanusGraph

Misha Brukman <mbru...@...>

#44

There's a doc in the repo:

https://github.com/JanusGraph/janusgraph/blob/master/BUILDING.md

Show quoted text

On Tue, Feb 21, 2017 at 4:41 PM, <loui...@...> wrote:

Hi Misha,

What exactly is involved in building locally? I can't seem to find any documentation.

Thanks

On Wednesday, February 8, 2017 at 10:07:39 PM UTC+1, Misha Brukman wrote:
Yes, that's correct. For now, please clone and build locally.

https://github.com/JanusGraph/janusgraph/issues/40 is tracking the work of building a release snapshot to simplify the getting started process.

On Wed, Feb 8, 2017 at 2:15 PM, e2t2 <gha...@...> wrote:
Hi All,

I am new to graph world and have done basic Titan tutorials, etc. Happy to hear that JanusGraph will continue where titan guys left.

Just a quick question, in the Getting started guide for JanusGraph it says to download zip file and unzip it to get started. However, in download link there is no release available.

Do I need to clone the repository and build it myself or I am missing something here?

Thanks

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "JanusGraph users list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: JanusGraph release roadmap

Manas Bajaj <manas...@...>

#45

Ted - Thanks for the response and the link. It would be best if the team starts posting snapshot zips that can be used.

Show quoted text

On Tuesday, February 21, 2017 at 8:46:52 AM UTC-5, Ted Wilmes wrote:

Hello,
A tentative date has not been set yet. There has been some discussion on the dev list.
There are a number of prerequisites that we're working through. For now, I'd recommend
watching the dev list as discussions continue. You can also track progress of the issues that
are slated to be included by looking at https://github.com/JanusGraph/janusgraph/milestone/1.
That's not necessarily a complete or final list but it should give you some insight along with
the dev chatter.

Thanks,
Ted

On Monday, February 20, 2017 at 8:16:29 PM UTC-6, 吴冉波 wrote:
Want too ~~~~
And hope to make ElasticSearch to be the new storage backend.

On Monday, February 20, 2017 at 10:22:54 AM UTC+8, Manas Bajaj wrote:
Hello JanusGraph committers

We are all very excited to see JanusGraph kickoff in 2017. Is there a release roadmap for this project? What will be the first release and tentatively when?

Thanks
Manas