JanusGraph Hbase MapReduceIndexmanagement Configuration


Shubhram Mohanty <mohanty...@...>
 

Hi ,

Can someone share the exact configuration for JanusGraph  MapReduceIndexmanagement with hbase as storage backend?

I am currently facing an issue where the hbase rootdir is not getting picked and it is pointing to default value as "/hbase".

I tried to use the following propertykeys :

storage.hbase.ext.hbase.rootdir=/data/hbase

janusgraphmr.ioformat.conf.storage.hbase.ext.hbase.rootdir=/data/hbase

None of them is actually picked by MapReduceIndexmanagement class.

Am I doing anything wrong here? 

Rest all of my configs are picked as I can see in the logs.

Please revert on this thread if you have a solution for this?

Regards,
Shubhram



Pushkar Nagpal <nagpal...@...>
 

Hi Shubhram, I'm trying something similar for reindex and deletion of index with Hbase as backend, were you able to resolve your issue? I'm getting the following error for my function call on
```
MapReduceIndexJobs.hbaseRepair()
```


Error:
```
java.io.IOException: Can't get Master Kerberos principal for use as renewer
    at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:116)
    at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
    at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:166)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(AccessController.java:770)
    at javax.security.auth.Subject.doAs(Subject.java:570)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
    at org.janusgraph.hadoop.scan.HadoopScanRunner.runJob(HadoopScanRunner.java:139)
    at org.janusgraph.hadoop.scan.HadoopScanRunner.runJob(HadoopScanRunner.java:115)
    at org.janusgraph.hadoop.scan.HadoopScanRunner.runVertexScanJob(HadoopScanRunner.java:189)
    at org.janusgraph.hadoop.scan.HBaseHadoopScanRunner.run(HBaseHadoopScanRunner.java:64)
    at org.janusgraph.hadoop.MapReduceIndexJobs.hbaseRepair(MapReduceIndexJobs.java:207)
    at org.janusgraph.hadoop.MapReduceIndexJobs.hbaseRepair(MapReduceIndexJobs.java:194)
    at org.janusgraph.hadoop.MapReduceIndexJobs.hbaseRepair(MapReduceIndexJobs.java:186)
```

On Monday, 30 March, 2020 at 8:26:12 pm UTC+5:30 moh...@... wrote:
Hi ,

Can someone share the exact configuration for JanusGraph  MapReduceIndexmanagement with hbase as storage backend?

I am currently facing an issue where the hbase rootdir is not getting picked and it is pointing to default value as "/hbase".

I tried to use the following propertykeys :

storage.hbase.ext.hbase.rootdir=/data/hbase

janusgraphmr.ioformat.conf.storage.hbase.ext.hbase.rootdir=/data/hbase

None of them is actually picked by MapReduceIndexmanagement class.

Am I doing anything wrong here? 

Rest all of my configs are picked as I can see in the logs.

Please revert on this thread if you have a solution for this?

Regards,
Shubhram