janusgraph solr cassandra GraphOfTheGodsFactory
mahi...@...
Error trying to load GraphOfTheGodsFactory into janusgraph-cassandra-solr Steps: 1) download cassandra, copy cassandra.yaml from janusgraph/cassandra/cassandra.yaml -> cassandra_installationdir/conf/cassandra.yaml 2) download solr 5.2.1, copy all conf files from janusgraph/conf/solr/* -> solr_installation/server/solr/config_sets/basic_configs/* 3) Started cassandra and solr 4)janusgraph/bin/gremlin.sh graph = JanusGraphFactory.open('conf/janusgraph-cassandra-solr.properties') ==>standardjanusgraph[cassandrathrift:[127.0.0.1]] gremlin> GraphOfTheGodsFactory.load(graph) causes this stack trace 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - Unable to save documents to Solr as one of the shape objects stored were not compatible with Solr. org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/> <title>Error 404 Not Found</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/edges/update. Reason: <pre> Not Found</pre></p><hr><i><small>Powered by Jetty://</small></i><hr/> </body> </html> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:526) at org.janusgraph.diskstorage.solr.SolrIndex.commitDocumentChanges(SolrIndex.java:407) at org.janusgraph.diskstorage.solr.SolrIndex.mutate(SolrIndex.java:318) at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:137) at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:134) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.indexing.IndexTransaction.flushInternal(IndexTransaction.java:134) at org.janusgraph.diskstorage.indexing.IndexTransaction.commit(IndexTransaction.java:115) at org.janusgraph.diskstorage.BackendTransaction.commitIndexes(BackendTransaction.java:140) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:743) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:144) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:63) at org.janusgraph.example.GraphOfTheGodsFactory$load.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125) at groovysh_evaluate.run(groovysh_evaluate:3) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70) at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190) at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy) at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72) at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122) at org.codehaus.groovy.tools.shell.ShellRunner.work(ShellRunner.groovy:95) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.work(InteractiveShellRunner.groovy:124) at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455) 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - Details in failed document batch: 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:5y1-6h4-9hx-38w 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(23.7 38.1) 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:2s2-39s-b2t-cqw 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:no fear of death 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:5xt-39k-b2t-6fs 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:loves waves 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:6qh-6h4-9hx-6eo 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(22.0 39.0) 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:3yx-3bc-b2t-3cg 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:loves fresh breezes 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:6c9-6h4-9hx-9l4 15:07:39 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(23.9 37.7) 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - Unable to save documents to Solr as one of the shape objects stored were not compatible with Solr. org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/> <title>Error 404 Not Found</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/edges/update. Reason: <pre> Not Found</pre></p><hr><i><small>Powered by Jetty://</small></i><hr/> </body> </html> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:526) at org.janusgraph.diskstorage.solr.SolrIndex.commitDocumentChanges(SolrIndex.java:407) at org.janusgraph.diskstorage.solr.SolrIndex.mutate(SolrIndex.java:318) at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:137) at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:134) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.indexing.IndexTransaction.flushInternal(IndexTransaction.java:134) at org.janusgraph.diskstorage.indexing.IndexTransaction.commit(IndexTransaction.java:115) at org.janusgraph.diskstorage.BackendTransaction.commitIndexes(BackendTransaction.java:140) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:743) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1363) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:144) at org.janusgraph.example.GraphOfTheGodsFactory.load(GraphOfTheGodsFactory.java:63) at org.janusgraph.example.GraphOfTheGodsFactory$load.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125) at groovysh_evaluate.run(groovysh_evaluate:3) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:70) at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:190) at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.super$3$execute(GremlinGroovysh.groovy) at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.apache.tinkerpop.gremlin.console.GremlinGroovysh.execute(GremlinGroovysh.groovy:72) at org.codehaus.groovy.tools.shell.Shell.leftShift(Shell.groovy:122) at org.codehaus.groovy.tools.shell.ShellRunner.work(ShellRunner.groovy:95) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$work(InteractiveShellRunner.groovy) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.work(InteractiveShellRunner.groovy:124) at org.codehaus.groovy.tools.shell.ShellRunner.run(ShellRunner.groovy:59) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.super$2$run(InteractiveShellRunner.groovy) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1215) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuperN(ScriptBytecodeAdapter.java:132) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnSuper0(ScriptBytecodeAdapter.java:152) at org.codehaus.groovy.tools.shell.InteractiveShellRunner.run(InteractiveShellRunner.groovy:83) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.apache.tinkerpop.gremlin.console.Console.<init>(Console.groovy:152) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at org.apache.tinkerpop.gremlin.console.Console.main(Console.groovy:455) 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - Details in failed document batch: 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:5y1-6h4-9hx-38w 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(23.7 38.1) 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:2s2-39s-b2t-cqw 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:no fear of death 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:5xt-39k-b2t-6fs 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:loves waves 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:6qh-6h4-9hx-6eo 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(22.0 39.0) 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:3yx-3bc-b2t-3cg 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - reason_t:loves fresh breezes 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - id:6c9-6h4-9hx-9l4 15:07:52 ERROR org.janusgraph.diskstorage.solr.SolrIndex - place_g:POINT(23.9 37.7) |
|
sju...@...
When I've done this test before I've needed to create a core for both edges and vertices. http://localhost:8983/solr/admin/cores?action=CREATE&name=edges&instanceDir=/opt/solr/server/solr/configsets/janusgraph&config=solrconfig.xml&dataDir=/tmp/edges_data http://localhost:8983/solr/admin/cores?action=CREATE&name=vertices&instanceDir=/opt/solr/server/solr/configsets/janusgraph&config=solrconfig.xml&dataDir=/tmp/vertices_data To load GraphOfTheGods you probably will also need to add the JTS jar to your Solr server. There's an open PR now that will remove this requirement in the future. http://docs.janusgraph.org/0.1.1/solr.html#_jts_classnotfoundexception_with_geo_data On Friday, July 7, 2017 at 10:11:04 PM UTC-5, mahendiran chandrasekar wrote:
|
|
mahi...@...
Thanks for the reply, that worked for GraphOfTheGods On Friday, 7 July 2017 20:11:04 UTC-7, mahendiran chandrasekar wrote:
|
|
mahi...@...
I am still running into same kind of trouble with solr, when i try to build a search index. I am following this http://docs.janusgraph.org/0.1.0-SNAPSHOT/solr.html Does section 24.1.2.3 means, i need to create a solr core for every index i create ? Like, if i create an index on a property key of a vertex called "foo" i need to create a core for that index ? On Saturday, 8 July 2017 05:41:17 UTC-7, s...@... wrote:
|
|
sju...@...
It looks like that is the case. I'm not a regular Solr user so maybe others can chime in here if they know otherwise. The docs reference a "index.search.solr.configset" configuration property that would allow configset/core reuse but it looks like that's only used in SolrCloud configurations not HTTP. On Wednesday, July 12, 2017 at 2:52:04 PM UTC-5, mahendiran chandrasekar wrote:
|
|
Adam Holley <holl...@...>
I deleted my previous post as it was not correct. You do not need to create a core for each mixedIndex. Assuming you are using Solr cloud mode, and following the instructions for Option 1 (http://docs.janusgraph.org/latest/solr.html#_solr_collections) you just need to manually copy the configset, and then add the initial core. Here's the relevant section from my janusgraph-cassandra-solr.properties file index.search.backend=solr index.search.solr.mode=cloud index.search.solr.zookeeper-url=localhost:2181 index.search.solr.configset=janusgraph On Thursday, July 13, 2017 at 10:35:47 PM UTC-5, s...@... wrote:
|
|
Ankur Goel <ankur...@...>
what about if you are not using solr cloud. On Saturday, July 8, 2017 at 8:41:04 AM UTC+5:30, mahendiran chandrasekar wrote:
|
|
Jason Plurad <plu...@...>
With Solr HTTP, there's no Zookeeper involved that can keep track of a shared configuration. You need to create each core manually.
where "vertices" and "edges" match the names of the mixed indexes in the schema definition On Friday, September 22, 2017 at 8:14:30 AM UTC-4, Ankur Goel wrote:
|
|
Ankur Goel <ankur...@...>
Hi I am using the same configuration and have created core with name janusSolr for mixed index, when adding a vertex, getting below error: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/> <title>Error 404 Not Found</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/janusSolr/update. Reason: <pre> Not Found</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/> i checked following URL are working: http://localhost:8983/solr/janusSolr/select http://localhost:8983/solr/janusSolr/query but http://localhost:8983/solr/janusSolr/update is throwing 404. I am no solr expert, any advise? ~AnkurG
On Saturday, July 8, 2017 at 8:41:04 AM UTC+5:30, mahendiran chandrasekar wrote:
|
|
Jason Plurad <plu...@...>
That error indicates the core isn't available. Did you create it with
Are you able to see the core in the Solr UI? http://localhost:8983/solr/#/~cores/janusSolr Were you able to get Graph of the Gods example working with mixed indexes? On Friday, September 22, 2017 at 9:26:35 AM UTC-4, Ankur Goel wrote:
|
|
Ankur Goel <ankur...@...>
Yes i am able to see core using Solr UI. i have created core by adding directory in core folder and updating solr.xml. Just to update i am using solr 4.3. ~AnkurG On Fri, Sep 22, 2017 at 7:39 PM, Jason Plurad <plu...@...> wrote:
|
|
Jason Plurad <plu...@...>
Solr 4.3 is not a supported indexing backend. http://docs.janusgraph.org/latest/version-compat.html On Friday, September 22, 2017 at 10:17:48 AM UTC-4, Ankur Goel wrote:
|
|
Ankur Goel <ankur...@...>
Yeah i realized and done solr cloud setup on solr-5.5.3. After connecting i am getting following error when creating schema and mixed-index (name: mixed-index-1, mixed-index-2): org.janusgraph.core.JanusGraphException: Could not register new index field with index backend My directory structure in config-set: itadmins-MacBook-Pro-4:configsets ankur.goel$ pwd /Users/ankur/solr/solr-5.5.3/server/solr/configsets itadmins-MacBook-Pro-4:configsets ankurl$ ls basic_configs data_driven_schema_configs janus_configs sample_techproducts_configs i create one collection with name janussolr using above janus_configs configset with 2 shard and replication factor 2. SolrCould installation is on a single machine. solr configuration:
index.search.backend=solr
index.search.solr.mode=cloud index.search.solr.zookeeper-url=localhost:9983
index.search.solr.configset=janussolr what i am missing? ~AnkurG On Saturday, July 8, 2017 at 8:41:04 AM UTC+5:30, mahendiran chandrasekar wrote:
|
|
Robert Dale <rob...@...>
Can you try again with only alphanumeric characters? Only the elasticsearch section states that 'index names contain only alphanumeric lowercase characters and hyphens'. From experience, I know lucene accepts only alphanumeric characters, not hyphens. I don't know what solr accepts. Robert Dale On Mon, Sep 25, 2017 at 5:49 AM, Ankur Goel <ankur...@...> wrote:
|
|
Ankur Goel <ankur...@...>
correct, working now. On Saturday, July 8, 2017 at 8:41:04 AM UTC+5:30, mahendiran chandrasekar wrote:
|
|
Jason Plurad <plu...@...>
Opened up https://github.com/JanusGraph/janusgraph/issues/544 to address index name restrictions. On Monday, September 25, 2017 at 10:00:50 AM UTC-4, Ankur Goel wrote:
|
|