The ISB-CGC Web Application provides a GUI for browsing, curating, and analyzing TCGA, TARGET, and CCLE data. It is built in Django 1.11 (Python 3) with MySQL 5.7, and is deployed on Google AppEngine Flex.
The system uses Vagrant to setup a consistent, platform independent development environment. To setup your development environment to run locally, you will need to install the following:
- Vagrant
- Oracle VirtualBox
If you are on Windows 8 or above, you will need to make sure you have version 5.0.9 or above to support the network interface. This may involve downloading a test build - PyCharm Pro (Recommended)
From there perform the following steps...
- Once you've installed PyCharm and cloned the repositories, create a directory within the
PycharmProjects
directory (the parent directory of your repositories) calledsecure_files/
. - Copy the
sample.env
file to a file named.env
insecure_files/
- Fill out the
.env
file with the proper values
- For most development environments,
MYSQL_ROOT_PASSWORD
andDATABASE_PASSWORD
can be the same, andDATABASE_USER
can beroot
GCLOUD_PROJECT_ID
is available after creating a project in the Google Cloud DashboardGOOGLE_CLIENT_ID
andGOOGLE_CLIENT_SECRET
can also be obtained in the Google Cloud Dashboard by going to API & Auth > Credentials > Add New > OAuth 2.0 Client > Web Application- Be sure when developing locally that you have 127.0.0.1 in the list of allowed domains for the OAuth 2.0 key
PyCharm Pro can be used to run your server through Vagrant and the Google App Engine.
- Go to your PyCharm Settings (On Mac, Go to Preferences;
CMD+,
) - Select Project: ISB-CGC-Webapp > Project Interpreter
- Click the icon next to the Project Interpreter drop down at the top of the main area
- Click Add Remote
- Select Vagrant (if it asks to start the machine, say yes)
- Set the Python interpreter path to
/home/vagrant/www/shell/python-su.sh
and click Ok - Select Languages & Frameworks > Google App Engine
- Change the SDK directory to
/home/vagrant/google_appengine/
- Click Ok to save
- Go to Run > Edit Configurations
- If there is not a Django Configuration, add one
- Set the host to
0.0.0.0
- Set the Python Interpreter to the Vagrant Machine (if it is not set to that already)
- Set the working directory to
/home/vagrant/www
- Click
...
next to theEnvironment variables:
, box and add the following values:SECURE_LOCAL_PATH = ../parentDir/secure_files/
PYTHONPATH = /home/vagrant/www:/home/vagrant/www/lib:/home/vagrant/google_appengine
DJANGO_SETTINGS_MODULE = GenespotRE.settings
PYTHONUNBUFFERED = 1
- Click ok to save
You will also need to set the shell/python-su.sh file to be executable. You can do this in the vagrant machines command line with the command chmod +x /home/vagrant/www/shell/python-su.sh
To run your server in PyCharm:
- Make sure your Vagrant machine is running by going to Tools > Vagrant > Up
- If this is the first time you've built the VM, it can be time consuming.
- Our VMs are currently running Ubuntu 16 LTS, which is what the app deploys under as well.
- Once the VM has built, click on the Run or Debug icons in the toolbar (upper-right corner of the PyCharm GUI)
- Your server will start and the PyCharm console should show all the logs and output from the system.
- If you are running in debug, you can also use breakpoints to stop the execution and examine variables and code as it runs.
To add Python Libraries or Dependencies, you should add them to the requirements.txt file and they will automatically be pulled down when a new developer starts the system.
- Double-check any new libraries to make sure they don't introduce conflicts.
- Note that sometimes a library will function fine on a local build but fail on the deployment, so always test on the mvm deployment as soon as your PR has been merged into master.
To update your existing python dependencies because of a change, or to pull down additional libraries you need, SSH into the virtual machine and run pip3 install
. Through PyCharm, you can take the following steps:
- Click Tools > Start SSH session...
- Select the Vagrant VM Connection you set up
- Type
cd www; sudo pip3 install -r requirements.txt --upgrade -t lib/
Or from the command line, you can do this by doing the following:
- Open a terminal in the project directory
- Type
vagrant ssh
to login to the virtual machine - Change directory to the
www
directory (/home/vagrant/www/
is the full path) - Run
pip3 install -r requirements.txt --upgrade -t lib/