Export data from Amazon Redshift

Redshift customers unload the agreed tables on a schedule to an Amazon S3 bucket they own, then give Scowtt read-only access to that bucket. Your data stays in your AWS account.

How it works: You unload the agreed tables from Redshift to an S3 bucket you own and create a read-only role for Scowtt. Scowtt checks the data with you.

Before you start

Someone who can manage IAM roles in your AWS account and run scheduled queries in Redshift.
An S3 bucket or folder for the export. See Share data through Amazon S3 for how Scowtt gets read access.

Steps

You: Let Redshift write to your bucket

Give your Redshift cluster an IAM role that can write to your S3 bucket.
You: Unload the tables

Use Redshift's UNLOAD command, selecting only rows updated since the last run:
```
UNLOAD ('SELECT ... WHERE updated_at > <last run>') TO 's3://<bucket>/scowtt/<table>/' IAM_ROLE '<role arn>' FORMAT PARQUET MANIFEST
```
Add REGION '<region>' if the bucket is in a different region from the cluster.
You: Schedule it

Run it as a scheduled query in Query Editor v2, ideally hourly and at least 4 times a day. Send the full history first.

AWS's step-by-step guide: Scheduled queries with query editor v2.
You: Give Scowtt read access

Create the read-only role for Scowtt described in Share data through Amazon S3, using the role ARN and External ID your Scowtt team sends. Then send your Scowtt team your role ARN, bucket path and AWS region. S3 access is granted to an AWS role, not an email address.
Scowtt: Check the data with you

Scowtt confirms it can read the files and validates the backfill with you before turning on recurring reads.

Good to know

Follow the data format standards.

Who does what

Step	Who	What changes hands
Let Redshift write to your bucket	You	—
Unload the tables	You	History files
Schedule it	You	Recurring files
Give Scowtt read access	You	Your role ARN, bucket path and region (after Scowtt sends its role ARN and External ID)
Check the data with you	Scowtt	Confirmation, or fixes needed