Create new documentation

[jpmckinney]

Tasks: Request boundaries

• Requesting boundaries (similar sections to Represent CSV Schema docs)
• Adding a boundary: define task, run all tasks with --base, run spreadsheet as normal
• Handling slug collisions, like 'Richmond, NS' and 'Paroisse de Plessisville'
• Making an MFIPPA request (sample text, upload past requests)
• Refer to Google Sheets Mail Merge

Tasks: Respond to emails

• Requests for new data (ask budget)
• Offers to supply data (spreadsheet option)
• Postal code errors (boilerplate response)
• Outdated/missing data (fix scrapers-ca)
• Creating app (ask for link when ready)
• Updating the users spreadsheets

[jpmckinney]

Overview

Data sources:

• boundaries
• web scrapers
• CSV scrapers
• CSV proxies

Repositories:

• represent-canada project and related apps
• represent-canada-data and represent-canada-private-data
• scrapers_ca_app and scrapers-ca
• represent-canada-csv-proxy
• ocd-division-ids
• govkit-ca gem, Drupal module and WordPress plugin

Deployment

Servers:

• Access to servers
• Server configuration
• AWS failover configuration
• Fabric commands

Heroku:

• Access to Heroku
• Heroku apps
• image-proxy and Cloudfront

Maintenance

• Flesh out maintenance tasks more, like using headers to sort dashboard
• Interpreting the different events that can occur when performing maintenance tasks
• The rare changes to make to represent-canada: data.js, demo.js order

CSV Schema

• Going through and updating the CVS Schema spreadsheet
• Sending "Elected Officials' Contact Information" emails with attachment
• Adding the logo to http://represent.opennorth.ca/government/
• Writing and configuring CSV scrapers
  • Add BC candidates

Maintaining boundaries

• Writing a definition.py file: writing name_func and id_func
• Document when a new license URL is discovered (constants.py)
• Discuss different sources: online, email, MFIPPA, purchase
• Add a docs sheet: data dictionary, making sense of other sheets, sort order
• Link to Federal, provincial, territorial boundary set name migration #102

Cleanup

• scrapers-ca: run invoke tidy and document expected output
• Delete this wiki page and finish redocumenting and cleaning up unnecessary shapefiles for ca_qc_districts, ca_qc_boroughs, ca_qc_wip
• Finish maintenance steps

Maintenance support

• represent-canada-data: Add a task to display all files without data_url, including notes
• represent-canada-data: Add a task to create a manifest file with number of (valid) geometries and sample values for name and id functions, to more quickly update shapes
• scrapers-ca: Describe the validations performed
• scrapers-ca: Describe any other modifications to Pupa (e.g. helper methods)