Re: [VOTE] JanusGraph 0.3.0 release


Jerry He <jerr...@...>
 

 Downloaded the binary zip. Checked the signature.  Loos good.
 Unzip it.  Looked at the directories and files.  Looks good.
 Ran some simple transactions and queries against HBase 1.2.6 and Solr 6.3.0.  Good.
 Started gremlin-server against the HBase and Solr backend configuration . Ran remote queries.  Good.

Ran SparkComputer with my modified version of read-hbase.properties (pointing to the above HBase instance).

gremlin> graph = GraphFactory.open('conf/hadoop-graph/read-hbase.properties')
==>hadoopgraph[hbaseinputformat->gryooutputformat]
gremlin> g = graph.traversal().withComputer(SparkGraphComputer)
==>graphtraversalsource[hadoopgraph[hbaseinputformat->gryooutputformat], sparkgraphcomputer]
gremlin> g.V().count()
==>12

But I was not able to get the pagerank to work. 
I tried to set  spark.kryo.registrator to different values, but neither worked for me.

spark.serializer=org.apache.spark.serializer.KryoSerializer
#spark.kryo.registrator=org.janusgraph.hadoop.serialize.JanusGraphKryoRegistrator
spark.kryo.registrator=org.apache.tinkerpop.gremlin.spark.structure.io.gryo.GryoRegistrator

gremlin> g.V().pageRank().valueMap()
22:42:32 WARN  org.apache.spark.storage.BlockManager  - Putting block rdd_2_0 failed due to an exception
22:42:32 WARN  org.apache.spark.storage.BlockManager  - Block rdd_2_0 could not be removed as it was not found on disk or in memory
22:42:32 ERROR org.apache.spark.executor.Executor  - Exception in task 0.0 in stage 1.0 (TID 1)
com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException
Serialization trace:
readers (org.locationtech.spatial4j.io.SupportedFormats)
formats (org.locationtech.spatial4j.context.jts.JtsSpatialContext)
ctx (org.locationtech.spatial4j.shape.impl.PointImpl)
shape (org.janusgraph.core.attribute.Geoshape)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:144)
...

When I have 
spark.kryo.registrator=org.janusgraph.hadoop.serialize.JanusGraphKryoRegistrator

I got:
gremlin> g.V().pageRank().valueMap()
22:48:18 ERROR org.apache.spark.util.Utils  - Aborting task
java.lang.IllegalArgumentException: Class is not registered: org.janusgraph.core.attribute.Geoshape
Note: To register this class use: kryo.register(org.janusgraph.core.attribute.Geoshape.class);
        at org.apache.tinkerpop.shaded.kryo.Kryo.getRegistration(Kryo.java:484)
        at org.apache.tinkerpop.gremlin.structure.io.gryo.AbstractGryoClassResolver.writeClass(AbstractGryoClassResolver.java:110)
        at org.apache.tinkerpop.shaded.kryo.Kryo.writeClass(Kryo.java:514)
        at org.apache.tinkerpop.shaded.kryo.Kryo.writeClassAndObject(Kryo.java:619)

It worked in JanusGraph 0.2.1 with spark.kryo.registrator=org.janusgraph.hadoop.serialize.JanusGraphKryoRegistrator 

I need to look into it more.

Thanks,

Jerry


On Thu, Aug 2, 2018 at 4:52 PM, Jason Plurad <plu...@...> wrote:
1 day to go to get your review/votes in. Thanks to everybody that has participated so far.

I'll make note here that Alex Patrikalakis identified an issue (and also submitted a PR) during his review of the 0.3.0 release. Thank you for both! I don't believe it qualifies as a stop-ship issue. The fix is simple and only involves configuration file updates, so I don't think we need to respin the 0.3.0 release artifacts and restart the vote. We'll target the fix for the 0.2 stream, which has the same problem, then merge it upstream.

Please let us know if there are any concerns with this approach.


On Wednesday, August 1, 2018 at 4:53:45 PM UTC-4, Misha Brukman wrote:
+1, LGTM!

On Tue, Jul 31, 2018 at 3:40 PM, Jason Plurad wrote:
Hello,

We are happy to announce that JanusGraph 0.3.0 is ready for release.

The release artifacts can be found at this location:
        https://github.com/JanusGraph/janusgraph/releases/tag/v0.3.0

A binary distribution is provided for user convenience:
        https://github.com/JanusGraph/janusgraph/releases/download/v0.3.0/janusgraph-0.3.0-hadoop2.zip

The GPG key used to sign the release artifacts is available at:
        https://github.com/JanusGraph/janusgraph/releases/download/v0.3.0/KEYS

The docs can be found here:
        https://github.com/JanusGraph/janusgraph/releases/download/v0.3.0/janusgraph-0.3.0-hadoop2-doc.zip
        (See also documentation preview site)

The release tag in Git can be found here:
        https://github.com/JanusGraph/janusgraph/tree/v0.3.0

The release notes are available here:
        https://github.com/JanusGraph/janusgraph/blob/v0.3.0/docs/changelog.adoc

This [VOTE] will open for the next 3 days --- closing Friday, August 3, 2018 at 3:40 PM EDT.
All are welcome to review and vote on the release, but only votes from TSC members are binding.
My vote is +1.


Thank you,
Jason Plurad

--
You received this message because you are subscribed to the Google Groups "JanusGraph developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-dev+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-dev/9540182f-122b-4f5a-9ac6-1c7fcd7b6dff%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "JanusGraph developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-dev+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-dev/bdb5c994-7fa4-4a8d-a0d6-94f6f5358a65%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Join janusgraph-dev@lists.lfaidata.foundation to automatically receive all group messages.