Cannot access S3 from HUE S3 browser for region "ca-central-1"

0 votes
6 views
asked Aug 28, 2017 in Hadoop by admin (4,410 points)
Summary
Last Published Date5/10/2017 10:22 AM
Symptoms

Users can not access S3 from Hue S3 Browser. The error is:

Cannot access: S3A://.
[Errno 22] Unknown scheme s3a, available schemes: ['hdfs']

From Cloudera Manager, below snippet is already added in Hue configuration > Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini:

[aws]
[[aws_accounts]]
[[[default]]]
access_key_id=XXXXX
secret_access_key=XXXX+XXX+XXX
allow_environment_credentials=false
region=ca-central-1
Applies To
  • Hue
  • S3 Browser
Cause

The issue is caused by a product bug. Basically, the regions are hard-coded in boto which is the AWS lib we use in Hue. ca-central-1 is not a supported region in the boto shipped with CDH5.11.0 version.

Instructions

CDH needs to upgrade the boto version to support newer regions. This will be done in future CDH releases.

The only workaround before upgrade will be choosing a different region. 

Please log in or register to answer this question.

...