Hive Query Failed with Token Renewer Error | Hive on Spark

0 votes
asked Aug 20, 2017 in Hadoop by admin (4,410 points)
When running Hive on Spark query, it fails with below error:
2017-06-27 17:04:08,836 INFO org.apache.hive.spark.client.SparkClientImpl: [stderr-redir-1]: 17/06/27 17:04:08 
WARN security.UserGroupInformation: PriviledgedActionException as:testuser (auth:PROXY) via 
hive/ (auth:KERBEROS) 
testuser tries to renew a token with renewer hive
Applies To
  • Hive on Spark in Kerberos secured clusters.

This issue was introduced by an attempt to fix the upstream JIRA HIVE-14383.

Spark needs the principal/keytab passed in via --principal and --keytab options, and does the renewal by copying the keytab to the cluster and handling login to kerberos inside the application.  But the option --principal and --keytab could not work with --proxy-userin, so at this moment we could support either the token renewal or the impersonation, but not both.

HIVE-14383 without the HIVE-15485 fix currently exists in following CDH releases:
CDH5.8.3, CDH5.8.4, CDH5.9.1, CDH5.10.0
HIVE-15485 has been fixed and is now available in the following CDH releases and above versions:
CDH5.10.1, CDH5.10.2
CDH5.11.0, CDH5.11.1
As there is no workaround for this failure, please upgrade or deploy to the latest maintenance version of the above mentioned releases to resolve this issue.

Please log in or register to answer this question.