Date
1 - 4 of 4
Too low Performance when running PageRank and WCC on Graph500
shepherdkingqsp@...
Hi there,
Recently I am trying to measure Janusgraph performance. When I was trying to run benchmark using Janusgraph 0.5.3, I found too low performance when testing pagerank and wcc. The code I used that you can refer to: https://github.com/gaolk/graph-database-benchmark/tree/master/benchmark/janusgraph Data: Graph500 The environment: Janusgraph Version: 0.5.3 (download the full release zip from janugraph github) The config of Janusgraph (default conf/janusgraph-cql.properties)
To be more specific, I ran Khop with it and got reasonable result.
But when I ran wcc and pagerank, I got 3 hours timeout either. Could you somebody help find the reason that I got low performance? Regards, Shipeng |
||||||||||||||
|
||||||||||||||
hadoopmarc@...
Hi Shipeng,
Did you use their machine specs: 32 vCPU and 244 GB memory? The graph is pretty big for in-memory use during OLAP: marc@antecmarc:~$ curl http://service.tigergraph.com/download/benchmark/dataset/graph500-22/graph500-22_unique_node | wc -lBest wishes, Marc |
||||||||||||||
|
||||||||||||||
shepherdkingqsp@...
Well, the spec I am using is 32vCPU and 128GB memory. But I am testing Janusgraph with Cassandra as storage backend.
I think this is not a thing with memory spec. I think maybe it is a thing with configuration. (Cause you can see the result of Khop is reasonable.) Best regards, Shipeng |
||||||||||||||
|
||||||||||||||
Hi Shipeng,
I didn't check the graph which you refereed but 0.5.3 JanusGraph has some hard limits with Cassandra backend. I would recommend trying 0.6.0 version. You might want to add some configurations related to your throughput. Something like: ``` storage.cql.read-consistency-level: ONE query.batch: true query.smart-limit: false # query.fast-property: false or true depending on queries ids.block-size: 1000000 storage.batch-loading: true storage.cql.local-max-connections-per-host: 5 storage.cql.max-requests-per-connection: 1024 storage.cql.executor-service.enabled: false storage.parallel-backend-executor-service.core-pool-size: 100 ``` Best regards, Oleksandr |
||||||||||||||
|