By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

refresh_hfiles not working

0

Hi I have a EMR with Hbase on S3 storage mode.I have a read replica cluster pointing to same S3 bucket. Now when I add record in primary cluster and flush table on primary, and then run refresh_hfiles on secondary cluster, I am getting error.

hbase:008:0> refresh_hfiles Traceback (most recent call last): NameError (undefined local variable or method `refresh_hfiles' for #HBaseReceiver:0x4ede8888) Did you mean? refresh_meta

is refresh_hfiles not supported? If not whats the way to reflect updates hfiles on read replica cluster?

Topics
AnalyticsDatabaseSecurity, Identity, & ComplianceStorage
Tags
Amazon EMRDatabaseAWS IAM Identity CenterAmazon S3 Access Grants
Language
English
shushant
asked a month ago327 views
1 Answer
3

Hi,

Seems the command is unsupported in your EMR version where the hbase deployed could be deprecated in the later release.

You can run the below command outside the hbase shell to refresh hfiles flushed for a table in primary.

Sync storefile table in an online region:

hbase org.apache.hadoop.hbase.client.example.RefreshHFilesClient <table>

Reference

[1] - https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html#emr-hbase-s3-hfile-tracking

AWS
SUPPORT ENGINEER
Yokesh NK
answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content