After CDH upgrade, users may notice they can not see recent submitted jobs from Hue Job Browser
After an upgrade to one of the releases below, the Hue Job Browser may not displaying recent jobs. YARN ResourceManager and JobHistory Servers are displaying jobs as expected.
Hue Job Browser
CDH 5.7.4 and higher
CDH 5.8.2 and higher
CDH 5.9.0 and higher
CDH 5.10.0 and higher
An improvement to Hue performance was made to lower the number of jobs displayed on the main page to 1000 (HUE-4540). Because the Resource Manager returns the oldest rows first, as a result recently submitted jobs may not get displayed in Hue.
An improvement was made to HUE to allow filtering the jobs by start time (HUE-5602). With this improvement, users can filter jobs by start time (day, hour, minute) to find the jobs they need.
Upgrade to one of the following releases to obtain this improvement:
CDH 5.9.2 and higher
CDH 5.10.1 and higher
CDH 5.11.0 and higher
Apply a username filter to display the most recent jobs for a user.
Change the Resource Manager retention to be 1000 to match what Hue displays. Hue will get every job that the Resource Manager has in its own history. To make this change in the configuration, in Cloudera Manager:
Navigate to YARN > Configuration
Search for "Max Completed Applications"
Set this value to 1000
Save Changes and restart the Resource Manager.
WARNING: With this change if your cumulative jobs per day goes beyond 1000, only the latest 1000 jobs will be available in Hue. The jobs will still be visible in the JobHistory Server's UI.