Re: a problem about elasticsearch


Ted Wilmes <twi...@...>
 

Hi jcbms,
This sort of thing usually means you're overloading your Elasticsearch server(s). Perhaps you're committing too much in a single transaction or you do not have enough resources to support the load you're placing on the ES server? I'd suggest watching the ES metrics and turning down the concurrency of your load and/or batch sizes, or perhaps expanding your ES resources.

--Ted


On Wednesday, July 25, 2018 at 1:37:00 AM UTC-5, jcbms wrote:
I want to know if this problem will lost data? and how to prevent it  

在 2018年7月25日星期三 UTC+8下午2:30:27,jcbms写道:
janusgraph : 0.2.0
elasticsearch: 6.1.1

can you tell me why this happen?
06:21:01,169 ERROR ElasticSearchIndex:604 - Failed to execute bulk Elasticsearch mutation
java.lang.RuntimeException: error while performing request
at org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:681)
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:219)
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:191)
at org.janusgraph.diskstorage.es.rest.RestElasticSearchClient.performRequest(RestElasticSearchClient.java:320)
at org.janusgraph.diskstorage.es.rest.RestElasticSearchClient.bulkRequest(RestElasticSearchClient.java:249)
at org.janusgraph.diskstorage.es.ElasticSearchIndex.mutate(ElasticSearchIndex.java:601)
at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:160)
at org.janusgraph.diskstorage.indexing.IndexTransaction$1.call(IndexTransaction.java:157)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
at org.janusgraph.diskstorage.indexing.IndexTransaction.flushInternal(IndexTransaction.java:157)
at org.janusgraph.diskstorage.indexing.IndexTransaction.commit(IndexTransaction.java:138)
at org.janusgraph.diskstorage.BackendTransaction.commitIndexes(BackendTransaction.java:141)
at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:751)
at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1374)
at DNSSubmit.submit(DNSSubmit.java:104)
at LoadData$4.run(LoadData.java:160)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Join janusgraph-users@lists.lfaidata.foundation to automatically receive all group messages.