Use Database Blueprint

Create a workflow to bring data from your transactional relational database.

Check in your CloudWatch events Rules if you have started the c360-ScheduledIngestionPostgresql-, as it has been created later maybe you did not start this one yet.

Step 1: If this Rule is not “green”, please enable it now on Actions. bp 0

Step 2: Lake Formation Use blueprint to import data from a relational database Go to Lake Formation Workflows Blueprints, and Use a Blueprint.

bp 1

Step 3: Choose database snapshot

bp 1

  • Database connection: sourcemf
  • Source Path: sourcemf/% (it means sourcemf database, with (%) all tables)

bp 1

  • Do not choose any “Exclude patterns”
  • Target Database: c360view_raw
  • Target storage location: s3://c360view-us-west-2--raw
  • Data format: CSV

bp 1

  • Frequency: run on demand

  • Workflow name: sourcemf_full_workflow

  • IAM role: Glue-role-c360view

  • Table Prefix: sourcemf

bp 1

Click on Create.

Step 4: After created it Start it now

bp 1

It will take some minutes for you to see the workflow importing data.

bp 1

You will come back later to this workflow, while it starts let’s perform some data processing.