Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crawl historical inspection data (data before current year separate files) #72

Open
ccjoel opened this issue Feb 28, 2017 · 0 comments
Open

Comments

@ccjoel
Copy link
Contributor

ccjoel commented Feb 28, 2017

We currently only scan inspections for the current fiscal year. We'd like to add all CSV files from inspections from all years (earliest data on July 2012)

Things to consider:

  • Time, memory and CPU resources used when crawling data / csv files
  • We would probably require a bigger database and more expensive running instance

http://www.myfloridalicense.com/dbpr/sto/file_download/public-records-food-service.html

@ccjoel ccjoel changed the title Crawl historical Data Crawl historical inspection data Feb 28, 2017
@ccjoel ccjoel changed the title Crawl historical inspection data Crawl historical inspection data (data before current year separate files) Mar 5, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant