This repo gathers some snippets to move data around. In details:
- A bash script to push a file to an AWS S3 Bucket.
- A bash script to extract tables out of a PostgreSQL Database and export them as CSV on an AWS S3 Bucket. This script can be run in a CRON job.
- A bash script to extract tables out of a PostgreSQL Database and export them as Parquet on an AWS S3 Bucket. This script can be run in a CRON job.
- A Google Cloud Function to react on new file in GCS and export them to an AWS S3 Bucket.
- A Google Cloud Function to extract tables out of a Google Cloud SQL Instance and export them on a GCS Bucket.