This is a texting service that provide basic statistics and basic question-answering functionality about COVID-19.
| _ | _ |
|---|---|
 |
 |
This project is a texting service initially built for those without Internet access to get information about the coronavirus (COVID-19) pandemic. The service provides the latest coronavirus statistics (confirmed, recovered, and deaths) at a global-level, country-level, US state-level, or US county-level (i.e. county, borough, or parish). It also answers basic coronavirus-related questions (for example, about protection, symptoms, quarantine, etc)
To test it out, text "HELLO" to the test number at +1781-524-3409.
The reason I created a texting service is to ensure that even those without Internet can access the latest stats on COVID in their region. There are currently a lot of numbers and resources on many different websites, but they are not accessible to those without Internet access.
According to a 2019 Pew Research survey, 10% of Americans (nearly 33 million people) do not use the Internet. In Louisiana, over 400,000 people do not have access to a wired connection capable of 25mbps download speeds, and 262,000 people do not have any wired Internet providers available where they live.
However, most people have texting, and a service like this would make it easier to access the most up-to-date COVID numbers for the areas that you care most about - at the state level as well as at the local (parish) level.
Note: Louisiana currently has a texting service (text LACOVID to 898211), but it focuses more on recent state-wide announcements, and often contains links, which may not be accessible to those without Internet connection. Further, it doesn't tell you the most up-to-date numbers on COVID in your region, which is very pertinent residents as you increasingly self-quarantine.
cases.py
I am getting my stats from a few sources.
World & Country Level:
- COVID19 Real-Time Data REST API v1.0 built by Chris Michael. You can reach the API endpoint here. More details here.
US State Level:
US Local level:
To ensure I do not get throttled, I am pulling every hour (3600 seconds).
bot.py
I am scraping my answers from the "Frequently Asked Questions" sections from the following sites:
- WHO
- CDC
- FDA
Then, I am doing some very preliminary question-answer matching. Eventually I'd like to build a model, but for now, I'm just using heuristics:
- string similarity (Levenshtein)
- cosine similarity
- keyword matching
Note This is a very preliminary version of Q&A. I realize there are a lot of messy manual matching and heuristic decisions being made.
| _ | _ |
|---|---|
 |
 |
To set up this service locally, you will need to set up the twilio service and the Flask framework.
- Clone the repo:
git clone https://github.com/yenniejun/covid-texting-service.git
- Install twilio
npm install twilio-cli -g
pip install twilio
-
Download and setup ngrok (For running locally)
-
Install and activate virtual environment
pip install virtualenv
python3 -m venv env
source venv/bin/activate
Once you have virtual environment set up, install the dependencies
venv/bin/pip install -r requirements.txt
Note: I would recommend following the set-up steps in the twilio tutorial. This will help you get a phone number, connect the number with the local backend, and to setup ngrok. In this process, you will install twilio, flask, and other required libraries.
To run locally, run the following twilio-cli command in the terminal. This will run ngrok and expose the service to the Internet.
twilio phone-numbers:update "+1xxxxxxxxxx" --sms-url="http://localhost:5000/sms"
If this doesn't work, you can also run the ngrok tunnel directly
ngrok http 5000
If you do this, make sure you note the forwarding URL (https://<something>.ngrok.io) and paste https://<something>.ngrok.io/sms into the Twilio Webhook console.
Open another terminal window and run the Flask application.
python3 run.py
| ngrok | flask |
|---|---|
 |
 |
Text "HELLO" from your phone to the phone number to get started.
Debug statements will show up on the Terminal window running the application.
To turn off debug statements, locate the following line in run.py and set debug=False
if __name__ == "__main__":
app.run(debug=True)
Make sure to log onto the Twilio console -> Phone numbers -> click your phone number -> Messaging. Make sure for "A Message Comes In", "Webhook" is selected in the dropdown.
- Investigate more accurate source of stats - currently am pulling from Bing API, which seems to be the most accurate one I've found so far.
- Allow a more robust search that supports typos or slight mispellings of regions
- Support state abbreviations (i.e. LA finds Louisiana)
- Provide useful (but concise) information about COVID (keeping in mind that the target of this service is for people without internet)
- Create an email service using the same scraping service for Live COVID updates. Users can sign up for how often they want updates (once a day? real-time?) and for the regions that affect them the most (i.e. local, state, country) as well as family or friends that reside in different regions.
- Worldometers
- Bing API
- COVID19 Real-Time Data REST API v1.0 built by Chris Michael. You can reach the API endpoint here. More details here.
- ProgrammableWeb lists various different APIs that are currently tracking COVID-19 numbers across the world
- Covid Tracking Project
- Corona Data Scraper
- Covid19api
- NYT
- Covid Tracking (The Atlantic)
- I was inspired by this blog post: How To Track Coronavirus In Your Country with Python
- Bing API