[FEATURE REQUEST] Archival support for metadata table of Record level indexing #11195
Labels
feature-enquiry
issue contains feature enquiries/requests or great improvement ideas
metadata
metadata table
Hi Community,
I am seeking guidance on implementing archival policies for the Metadata table in Hudi's record-level indexing (RLI). We are not concerned with retaining data older than three years, as we move that data from standard S3 storage to Glacier. Additionally, we would like to archive the metadata record keys provided by Hudi's record-level indexing to keep storage costs under control. I wanted to inquire if there are any plans to introduce TTL or Archival support for the Hudi metadata table's record keys. Is there any plan to bring this feature.
Thanks
cc - @codope
The text was updated successfully, but these errors were encountered: