Hbase Audits Fail to Propagate to the Navigator Audit Server | Error: Data too long for column 'QUALIFIER'

0 votes
2 views
asked Aug 28, 2017 in Hadoop by admin (4,410 points)
SummaryHbase audits fail because the data was either too long or invalid for the column type that was set in the database.
Applies To
Symptoms

Hbase Audit files under /var/log/hbase/audit fill up on Hbase role hosts.

The following errors are seen in the Navigator Audit Server logs:

2016-04-02 03:04:20,783 ERROR org.hibernate.engine.jdbc.spi.SqlExceptionHelper: Data truncation: Data too long for column 'QUALIFIER' at row 1 
2016-04-02 03:04:20,808 WARN com.cloudera.navigator.NavigatorServer: Error persisting events for service hbase2 
org.hibernate.exception.DataException: error executing work 
at org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:135) 
at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:49) 
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:125) 
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:110) 
at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.coordinateWork(JdbcCoordinatorImpl.java:289) 
... 
Caused by: java.sql.BatchUpdateException: Data truncation: Data too long for column 'QUALIFIER' at row 1 
at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2056) 
at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1467) 
at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPreparedStatement.java:1723) 
at com.cloudera.navigator.NavigatorEntityManager$1.execute(NavigatorEntityManager.java:362) 
at org.hibernate.jdbc.WorkExecutor.executeWork(WorkExecutor.java:54) 
at org.hibernate.internal.SessionImpl$2.accept(SessionImpl.java:1982) 
at org.hibernate.internal.SessionImpl$2.accept(SessionImpl.java:1979) 
at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.coordinateWork(JdbcCoordinatorImpl.java:284) 


2016-04-02 03:04:20,746 WARN com.cloudera.navigator.NavigatorServer: Error persisting events for service hbase2 
org.hibernate.exception.GenericJDBCException: error executing work 
at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:54) 
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:125) 
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:110) 
at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.coordinateWork(JdbcCoordinatorImpl.java:289) 
at org.hibernate.internal.SessionImpl.doWork(SessionImpl.java:2000) 
at org.hibernate.internal.SessionImpl.doWork(SessionImpl.java:1986) 
at com.cloudera.navigator.NavigatorEntityManager.doWork(NavigatorEntityManager.java:288) 
at com.cloudera.navigator.NavigatorEntityManager.persistWithJdbc(NavigatorEntityManager.java:323) 
... 
Caused by: java.sql.BatchUpdateException: Incorrect string value: '\xF3\xA7\xA3\xA8\xEF\xBF...' for column 'QUALIFIER' at row 1 
at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2056) 
at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1467) 
at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPreparedStatement.java:1723) 
at com.cloudera.navigator.NavigatorEntityManager$1.execute(NavigatorEntityManager.java:362) 
at org.hibernate.jdbc.WorkExecutor.executeWork(WorkExecutor.java:54) 
at org.hibernate.internal.SessionImpl$2.accept(SessionImpl.java:1982) 
at org.hibernate.internal.SessionImpl$2.accept(SessionImpl.java:1979) 
at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.coordinateWork(JdbcCoordinatorImpl.java:284) 
... 29 more

Cause

Hbase audits fail because the data was either too long or invalid for the column type that was set in the database.
This is a bug.  The Column Type for Hbase Qualifier value in Navigator Audit DB should be LONGBLOB instead of varchar(1024)
 

Instructions

Upgrade to Cloudera Manager 5.7.4 or higher.

Please log in or register to answer this question.

...