refresh_hfiles not working

Question

Hi
I have a EMR with Hbase on S3 storage mode.I have a read replica cluster pointing to same S3 bucket.
Now when I add record in primary cluster and flush table on primary, and then run refresh_hfiles on secondary cluster, I am getting error.

hbase:008:0> refresh_hfiles
Traceback (most recent call last):
NameError (undefined local variable or method `refresh_hfiles' for #)
Did you mean?  refresh_meta

is refresh_hfiles not supported? If not whats the way to reflect updates hfiles on read replica cluster?

Answer

Hi,

Seems the command is unsupported in your EMR version where the hbase deployed could be deprecated in the later release.

You can run the below command outside the hbase shell to refresh hfiles flushed for a table in primary.

Sync storefile table in an online region:

hbase org.apache.hadoop.hbase.client.example.RefreshHFilesClient <table>

Reference

[1] - https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html#emr-hbase-s3-hfile-tracking

refresh_hfiles not working

Conteúdo relevante