Error: java.lang.OutOfMemoryError: unable to create new native thread | Cloudera Manager

0 votes
0 views
asked Aug 19, 2017 in Hadoop by admin (4,410 points)
SummaryCloudera Manager may encounter resource limits that prevent it from creating new threads. Adjusting the ulimits should allow more resources.
Symptoms

Cloudera Manager server log reports: java.lang.OutOfMemoryError: unable to create new native thread on startup

Applies To

Cloudera Manager

Cause

A resource such as open files or memory for data may be set too low.
 

Instructions
It may be necessary to adjust the ulimits to make more resources available.  Cloudera Manager Server uses a large number of file descriptors.
  1. Check limits for resources on the running Cloudera Manager Server process with the following command:
    sudo cat /proc/$(pgrep -f cmf.Main)/limits
     

    Sample output:

    Limit Soft Limit Hard Limit Units
    Max cpu time unlimited unlimited seconds
    Max file size unlimited unlimited bytes
    Max data size unlimited unlimited bytes
    Max stack size 10485760 unlimited bytes
    Max core file size 0 unlimited bytes
    Max resident set unlimited unlimited bytes
    Max processes 32768 65536 processes
    Max open files 32768 32768 files
    Max locked memory 65536 65536 bytes
    Max address space unlimited unlimited bytes
    Max file locks unlimited unlimited locks
    Max pending signals 385986 385986 signals
    Max msgqueue size 819200 819200 bytes
    Max nice priority 0 0
    Max realtime priority 0 0
    Max realtime timeout unlimited unlimited us
    
  2.  Identify any resources that may be too low
    1.  Max data size should be set to unlimited
    2.   Max open files should be set to 64k or higher
  3.  Increase the necessary resource limits for the Cloudera Manager Server.  This will vary by Linux Distribution and version.  One common way is through the /etc/security/limits.conf file, though this may not be available on all installations.   Please consult with your Linux Administrator on how to set the ulimits

Please log in or register to answer this question.

...