YARN Job Logs Not Visible from HUE | Changes Made to the yarn.nodemanager.remote-app-log-dir

0 votes
2 views
asked Aug 28, 2017 in Hadoop by admin (4,410 points)
SummaryHow to workaround having a non-default setting in the Remote App Log Directory ( /tmp/logs)

Symptoms

You are not able to see the YARN job logs from HUE.

Applies To

Cloudera Manager version prior to 5.8

Cause

Known issue. 
Changes to the yarn.nodemanager.remote-app-log-dir are not picked up from gateway.
If a non-default Remote App Log Directory is used, then an advanced configuration is needed to point the YARN logs back to the tmp directory.

Instructions

Workarounds:
1. Change the Remote App Log Directory back to the default /tmp/logs
OR
2. If you need to use a non-default Remote App Log Directory, apply the following Advanced Configuration:
YARN Service Advanced Configuration Snippet (Safety Valve) for yarn-site.xml
From Cloudera Manager's home page navigate to YARN > Configuration > NodeManager Default Group > Remote App Log Directory

<property>
<name>yarn.nodemanager.remote-app-log-dir</name>
<value>/tmp/logs2</value>
</property>


3. Restart the YARN Service.

Please log in or register to answer this question.

...