Apache spark container adding in hadoop-aws, aws-sdk, etc. so that s3a:// can be read using instance profiles.
The container is available at https://hub.docker.com/r/heartysoft/spark-aws/
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Apache spark container adding in hadoop-aws, aws-sdk, etc. so that s3a:// can be read using instance profiles.
The container is available at https://hub.docker.com/r/heartysoft/spark-aws/