Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Amazon S3 V2 Connector User Guide v1.0

Creating connection

Currently supported authentication typesversion: 1.0.0

Category: File System

Tier: 1

Type: Source, Target

Authentication:

  • Basic authentication. Enter the actual access key and secret key.

  • Temporary security credentials using assume role. Enter the secret access key and secret key of an IAM user with no permissions to access Amazon S3 bucket.

  • Credential profile file authentication Don't enter the access key and secret key.

Basic Authentication

Enter the ff:

  • Access Key

  • Secret Key

  • Folder Path

    • format can be bucket name e.g. mybucket

    • or bucket name/folder1/folder2... e.g. mybucket/myfolder or mybucket/myfolder/mynestedfolder

  • Region Name (of the s3 bucket)

Image Removed

Credential profile file authentication

Enter the ff:

  • Folder Path

Files Supported:

  • Csv files

  • Excel Files

Supported Save Mode as Target:

  • Append

  • Overwrite

  • New

See: Target Connector Save Modes

Connection Properties

image-20240331-025658.pngImage Added

Image Removed

Temporary security credentials using assume role

Use case for this is that if your user has no direct access to the s3 bucket but has access to sts:AssumeRole, using the role that has access to the s3 bucket

User that has no direct access to s3 bucket

...

Assumed Role that has access to s3

...

Name

Mandatory

Description

Connection Name

Yes

Name of the connection

Description

No

Description of connection

Folder Path

Yes

  • format can be bucket name e.g. mybucket

  • or bucket name/folder1/folder2... e.g. mybucket/myfolder or mybucket/myfolder/mynestedfolder

Region Name (of the s3 bucket)

...

Other Authentication Type – Set it to Credential Profile File Authentication

...

Credential Profile File Path – full path to the aws credentials file residing in the secure agent

...

Profile Name – Optional, name of the profile to be used in the file, uses default if blank

Image Removed

Connection Objects

The connection object displays as bucket/object or bucket/folder//anotherfolder//object to follow the IICS format. Currently filtered to display csv files only as other file formats are not yet supported for mapping as of this writing.

View in Eazydi

...

View in S3

Image RemovedImage RemovedImage Removed

Mapping and running of the pipeline follows the normal behavior of Eazydi

Image Removed

Image Removed

...

Yes

Access Key

Yes

Secret Key

...

Folder Path

  • format can be bucket name e.g. mybucket

  • or bucket name/folder1/folder2... e.g. mybucket/myfolder or mybucket/myfolder/mynestedfolder

...

Region Name (of the s3 bucket)

...

IAM Role ARN – arn for the role to be used that has access to the s3 bucket

...

External Id – optional, if the role requires an external id

Yes

IAM Role ARN

No

The IAM Role ARN for temporary credentials for credentials that has no direct access to s3 bucket but can assume a role

External Id

No

Indicates the External id used for the IAM Role ARN (If necessary)

Reading Objects

image-20240331-031206.pngImage Added

Image Added

For excel objects indicate and choose the sheet name from the drop down

image-20240331-031423.pngImage Added

For date string handling See Date and DateTime String Handling in EazyDI