Skip to content

Extract, Transform, and Load processes for Urban Development

License

Notifications You must be signed in to change notification settings

urbanyeti/urbandev-etl

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

71 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hack Oregon - Urban Development project

Hack Oregon's Urban Development Project consists of web services to retrieve data about activities in Portland neighborhoods, as well as a web site, PlotPDX, which is a Single-Page Application (SPA), implemented in JavaScript. This ETL repository holds the database design and scripts for the data that supports the other two components.

Extract, Transform, and Load (ETL)
processes for Urban Development project data

In this repository, you will find:

  • Entity relationship diagrams.
  • Scripts to create the database schema.
  • Scripts for preparing the data and loading it into the database:
    • Extract: Scripts and processes to obtain or update data sets from particular data sources.
    • Transform: Scripts and processes to clean particular data sources.
    • Load: Scripts and processes to load particular data sources into the defined tables.

The implementation is migrating from MySQL to PostgreSQL, so you will find material related to both implementations.

About

Extract, Transform, and Load processes for Urban Development

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 70.9%
  • Python 26.1%
  • PLpgSQL 3.0%