Hive Metastore Canary Fails After Enabling HDFS Encryption

0 votes
3 views
asked Aug 28, 2017 in Hadoop by admin (4,410 points)
SummaryAfter enabling HDFS Transparent Encryption, Hive Metastore Canary Health Test from Cloudera Manager fails with the following error: MetaException(message:Unable to drop table because it is in an encryption zone and trash is enabled. Use PURGE option to skip trash

Symptoms

Hive Metastore Canary Health Test fails with the following message:

MetaException(message:Unable to drop cloudera_manager_metastore_canary_test_db_hive_HIVEMETASTORE_4ae078640c22ed6efebd02f20ddd2536.CM_TEST_TABLE because it is in an encryption zone and trash is enabled. Use PURGE option to skip trash
Applies To
  • CDH 5.7
  • CDH 5.8
  • CDH 5.9
  • CDH 5.10
  • CDH 5.11
Cause

When HDFS Transparent Encryption is enabled, Hive will not move files into the HDFS trashcan to prevent cases where doing so would move data between different encryption zones.

Instructions

After enabling HDFS Transparent Encryption, Hive Metastore Canary Health Test from Cloudera Manager will no longer work correctly and should be disabled.  While this health test will be disabled, all other Hive Metastore Server Health Tests will still continue to monitor the Hive Metastore for potential issues.

Workaround: Turn off the Hive Metastore canary by disabling the Hive Metastore Canary Health Test:

  1. Go to the Hive service.
  2. Click the Configuration tab.
  3. Select SCOPE > Hive Metastore Server.
  4. Select CATEGORY > Monitoring.
  5. Deselect the Hive Metastore Canary Health Test checkbox for the Hive Metastore Server Default Group.
  6. Click Save Changes to commit the changes.

Please log in or register to answer this question.

...