Amazon S3 V2 Connector User Guide v1.0
Creating connection
Currently supported authentication typesversion: 1.0.0
Category: File System
Tier: 1
Type: Source, Target
Authentication:
Basic authentication. Enter the actual access key and secret key.
Temporary security credentials using assume role. Enter the secret access key and secret key of an IAM user with no permissions to access Amazon S3 bucket.
Credential profile file authentication Don't enter the access key and secret key.
Basic Authentication
Enter the ff:
Access Key
Secret Key
Folder Path
format can be bucket name e.g. mybucket
or bucket name/folder1/folder2... e.g. mybucket/myfolder or mybucket/myfolder/mynestedfolder
Region Name (of the s3 bucket)
Credential profile file authentication
Enter the ff:
Folder Path
Files Supported:
Csv files
Excel Files
Supported Save Mode as Target:
Append
Overwrite
New
See: Target Connector Save Modes
Connection Properties
Temporary security credentials using assume role
Use case for this is that if your user has no direct access to the s3 bucket but has access to sts:AssumeRole, using the role that has access to the s3 bucket
User that has no direct access to s3 bucket
...
Assumed Role that has access to s3
...
Name | Mandatory | Description |
---|---|---|
Connection Name | Yes | Name of the connection |
Description | No | Description of connection |
Folder Path | Yes |
|
Region Name (of the s3 bucket) |
...
Other Authentication Type – Set it to Credential Profile File Authentication
...
Credential Profile File Path – full path to the aws credentials file residing in the secure agent
...
Profile Name – Optional, name of the profile to be used in the file, uses default if blank
Connection Objects
The connection object displays as bucket/object or bucket/folder//anotherfolder//object to follow the IICS format. Currently filtered to display csv files only as other file formats are not yet supported for mapping as of this writing.
View in Eazydi
...
View in S3
Mapping and running of the pipeline follows the normal behavior of Eazydi
...
Yes | ||
Access Key | Yes | |
Secret Key |
...
Folder Path
format can be bucket name e.g. mybucket
or bucket name/folder1/folder2... e.g. mybucket/myfolder or mybucket/myfolder/mynestedfolder
...
Region Name (of the s3 bucket)
...
IAM Role ARN – arn for the role to be used that has access to the s3 bucket
...
External Id – optional, if the role requires an external id
Yes | ||
IAM Role ARN | No | The IAM Role ARN for temporary credentials for credentials that has no direct access to s3 bucket but can assume a role |
External Id | No | Indicates the External id used for the IAM Role ARN (If necessary) |
Reading Objects
For excel objects indicate and choose the sheet name from the drop down
For date string handling See Date and DateTime String Handling in EazyDI