Imperial College London - Mathematics for Machine Learning Specialization/Imperial College London - Mathematics for Machine Learning Linear Algebra/PageRank.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# PageRank\n",
    "\n",
    "##### salimt\n",
    "\n",
    "In this notebook, you'll build on your knowledge of eigenvectors and eigenvalues by exploring the PageRank algorithm.\n",
    "The notebook is in two parts, the first is a worksheet to get you up to speed with how the algorithm works - here we will look at a micro-internet with fewer than 10 websites and see what it does and what can go wrong.\n",
    "The second is an assessment which will test your application of eigentheory to this problem by writing code and calculating the page rank of a large network representing a sub-section of the internet."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 1 - Worksheet\n",
    "### Introduction\n",
    "\n",
    "PageRank (developed by Larry Page and Sergey Brin) revolutionized web search by generating a\n",
    "ranked list of web pages based on the underlying connectivity of the web. The PageRank algorithm is\n",
    "based on an ideal random web surfer who, when reaching a page, goes to the next page by clicking on a\n",
    "link. The surfer has equal probability of clicking any link on the page and, when reaching a page with no\n",
    "links, has equal probability of moving to any other page by typing in its URL. In addition, the surfer may\n",
    "occasionally choose to type in a random URL instead of following the links on a page. The PageRank is\n",
    "the ranked order of the pages from the most to the least probable page the surfer will be viewing.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Populating the interactive namespace from numpy and matplotlib\n"
     ]
    }
   ],
   "source": [
    "# Before we begin, let's load the libraries.\n",
    "%pylab notebook\n",
    "import numpy as np\n",
    "import numpy.linalg as la\n",
    "from readonly.PageRankFunctions import *\n",
    "np.set_printoptions(suppress=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### PageRank as a linear algebra problem\n",
    "Let's imagine a micro-internet, with just 6 websites (**A**vocado, **B**ullseye, **C**atBabel, **D**romeda, **e**Tings, and **F**aceSpace).\n",
    "Each website links to some of the others, and this forms a network as shown,\n",
    "\n",
    "![A Micro-Internet](readonly/internet.png \"A Micro-Internet\")\n",
    "\n",
    "The design principle of PageRank is that important websites will be linked to by important websites.\n",
    "This somewhat recursive principle will form the basis of our thinking.\n",
    "\n",
    "Imagine we have 100 *Procrastinating Pat*s on our micro-internet, each viewing a single website at a time.\n",
    "Each minute the Pats follow a link on their website to another site on the micro-internet.\n",
    "After a while, the websites that are most linked to will have more Pats visiting them, and in the long run, each minute for every Pat that leaves a website, another will enter keeping the total numbers of Pats on each website constant.\n",
    "The PageRank is simply the ranking of websites by how many Pats they have on them at the end of this process.\n",
    "\n",
    "We represent the number of Pats on each website with the vector,\n",
    "$$\\mathbf{r} = \\begin{bmatrix} r_A \\\\ r_B \\\\ r_C \\\\ r_D \\\\ r_E \\\\ r_F \\end{bmatrix}$$\n",
    "And say that the number of Pats on each website in minute $i+1$ is related to those at minute $i$ by the matrix transformation\n",
    "\n",
    "$$ \\mathbf{r}^{(i+1)} = L \\,\\mathbf{r}^{(i)}$$\n",
    "with the matrix $L$ taking the form,\n",
    "$$ L = \\begin{bmatrix}\n",
    "L_{A→A} & L_{B→A} & L_{C→A} & L_{D→A} & L_{E→A} & L_{F→A} \\\\\n",
    "L_{A→B} & L_{B→B} & L_{C→B} & L_{D→B} & L_{E→B} & L_{F→B} \\\\\n",
    "L_{A→C} & L_{B→C} & L_{C→C} & L_{D→C} & L_{E→C} & L_{F→C} \\\\\n",
    "L_{A→D} & L_{B→D} & L_{C→D} & L_{D→D} & L_{E→D} & L_{F→D} \\\\\n",
    "L_{A→E} & L_{B→E} & L_{C→E} & L_{D→E} & L_{E→E} & L_{F→E} \\\\\n",
    "L_{A→F} & L_{B→F} & L_{C→F} & L_{D→F} & L_{E→F} & L_{F→F} \\\\\n",
    "\\end{bmatrix}\n",
    "$$\n",
    "where the columns represent the probability of leaving a website for any other website, and sum to one.\n",
    "The rows determine how likely you are to enter a website from any other, though these need not add to one.\n",
    "The long time behaviour of this system is when $ \\mathbf{r}^{(i+1)} = \\mathbf{r}^{(i)}$, so we'll drop the superscripts here, and that allows us to write,\n",
    "$$ L \\,\\mathbf{r} = \\mathbf{r}$$\n",
    "\n",
    "which is an eigenvalue equation for the matrix $L$, with eigenvalue 1 (this is guaranteed by the probabalistic structure of the matrix $L$).\n",
    "\n",
    "Complete the matrix $L$ below, we've left out the column for which websites the *FaceSpace* website (F) links to.\n",
    "Remember, this is the probability to click on another website from this one, so each column should add to one (by scaling by the number of links)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Replace the ??? here with the probability of clicking a link to each website when leaving Website F (FaceSpace).\n",
    "L = np.array([[0,   1/2, 1/3, 0, 0,   0 ],\n",
    "              [1/3, 0,   0,   0, 1/2, 0 ],\n",
    "              [1/3, 1/2, 0,   1, 0,   1/2 ],\n",
    "              [1/3, 0,   1/3, 0, 1/2, 1/2 ],\n",
    "              [0,   0,   0,   0, 0,   0 ],\n",
    "              [0,   0,   1/3, 0, 0,   0 ]])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In principle, we could use a linear algebra library, as below, to calculate the eigenvalues and vectors.\n",
    "And this would work for a small system. But this gets unmanagable for large systems.\n",
    "And since we only care about the principal eigenvector (the one with the largest eigenvalue, which will be 1 in this case), we can use the *power iteration method* which will scale better, and is faster for large systems.\n",
    "\n",
    "Use the code below to peek at the PageRank for this micro-internet."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 16.        ,   5.33333333,  40.        ,  25.33333333,\n",
       "         0.        ,  13.33333333])"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "eVals, eVecs = la.eig(L) # Gets the eigenvalues and vectors\n",
    "order = np.absolute(eVals).argsort()[::-1] # Orders them by their eigenvalues\n",
    "eVals = eVals[order]\n",
    "eVecs = eVecs[:,order]\n",
    "\n",
    "r = eVecs[:, 0] # Sets r to be the principal eigenvector\n",
    "100 * np.real(r / np.sum(r)) # Make this eigenvector sum to one, then multiply by 100 Procrastinating Pats"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see from this list, the number of Procrastinating Pats that we expect to find on each website after long times.\n",
    "Putting them in order of *popularity* (based on this metric), the PageRank of this micro-internet is:\n",
    "\n",
    "**C**atBabel, **D**romeda, **A**vocado, **F**aceSpace, **B**ullseye, **e**Tings\n",
    "\n",
    "Referring back to the micro-internet diagram, is this what you would have expected?\n",
    "Convince yourself that based on which pages seem important given which others link to them, that this is a sensible ranking.\n",
    "\n",
    "Let's now try to get the same result using the Power-Iteration method that was covered in the video.\n",
    "This method will be much better at dealing with large systems.\n",
    "\n",
    "First let's set up our initial vector, $\\mathbf{r}^{(0)}$, so that we have our 100 Procrastinating Pats equally distributed on each of our 6 websites."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 16.66666667,  16.66666667,  16.66666667,  16.66666667,\n",
       "        16.66666667,  16.66666667])"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = 100 * np.ones(6) / 6 # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "r # Shows it's value"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, let's update the vector to the next minute, with the matrix $L$.\n",
    "Run the following cell multiple times, until the answer stabilises."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 13.88888889,  13.88888889,  38.88888889,  27.77777778,\n",
       "         0.        ,   5.55555556])"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = L @ r # Apply matrix L to r\n",
    "r # Show it's value\n",
    "# Re-run this cell multiple times to converge to the correct answer."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can automate applying this matrix multiple times as follows,"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 16.        ,   5.33333333,  40.        ,  25.33333333,\n",
       "         0.        ,  13.33333333])"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = 100 * np.ones(6) / 6 # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "for i in np.arange(100) : # Repeat 100 times\n",
    "    r = L @ r\n",
    "r"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Or even better, we can keep running until we get to the required tolerance."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "18 iterations to convergence.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "array([ 16.00149917,   5.33252025,  39.99916911,  25.3324738 ,\n",
       "         0.        ,  13.33433767])"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = 100 * np.ones(6) / 6 # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "lastR = r\n",
    "r = L @ r\n",
    "i = 0\n",
    "while la.norm(lastR - r) > 0.01 :\n",
    "    lastR = r\n",
    "    r = L @ r\n",
    "    i += 1\n",
    "print(str(i) + \" iterations to convergence.\")\n",
    "r"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "See how the PageRank order is established fairly quickly, and the vector converges on the value we calculated earlier after a few tens of repeats.\n",
    "\n",
    "Congratulations! You've just calculated your first PageRank!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Damping Parameter\n",
    "The system we just studied converged fairly quickly to the correct answer.\n",
    "Let's consider an extension to our micro-internet where things start to go wrong.\n",
    "\n",
    "Say a new website is added to the micro-internet: *Geoff's* Website.\n",
    "This website is linked to by *FaceSpace* and only links to itself.\n",
    "![An Expanded Micro-Internet](readonly/internet2.png \"An Expanded Micro-Internet\")\n",
    "\n",
    "Intuitively, only *FaceSpace*, which is in the bottom half of the page rank, links to this website amongst the two others it links to,\n",
    "so we might expect *Geoff's* site to have a correspondingly low PageRank score.\n",
    "\n",
    "Build the new $L$ matrix for the expanded micro-internet, and use Power-Iteration on the Procrastinating Pat vector.\n",
    "See what happens…"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    " # We'll call this one L2, to distinguish it from the previous L.\n",
    "L2 = np.array([[0,   1/2, 1/3, 0, 0,   0,   0 ],\n",
    "               [1/3, 0,   0,   0, 1/2, 0,   0 ],\n",
    "               [1/3, 1/2, 0,   1, 0,   1/3, 0 ],\n",
    "               [1/3, 0,   1/3, 0, 1/2, 1/3, 0 ],\n",
    "               [0,   0,   0,   0, 0,   0,   0 ],\n",
    "               [0,   0,   1/3, 0, 0,   0,   0 ],\n",
    "               [0,   0,   0,   0, 0,   1/3, 1 ]])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "131 iterations to convergence.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "array([  0.03046998,   0.01064323,   0.07126612,   0.04423198,\n",
       "         0.        ,   0.02489342,  99.81849527])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = 100 * np.ones(7) / 7 # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "lastR = r\n",
    "r = L2 @ r\n",
    "i = 0\n",
    "while la.norm(lastR - r) > 0.01 :\n",
    "    lastR = r\n",
    "    r = L2 @ r\n",
    "    i += 1\n",
    "print(str(i) + \" iterations to convergence.\")\n",
    "r"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "That's no good! *Geoff* seems to be taking all the traffic on the micro-internet, and somehow coming at the top of the PageRank.\n",
    "This behaviour can be understood, because once a Pat get's to *Geoff's* Website, they can't leave, as all links head back to Geoff.\n",
    "\n",
    "To combat this, we can add a small probability that the Procrastinating Pats don't follow any link on a webpage, but instead visit a website on the micro-internet at random.\n",
    "We'll say the probability of them following a link is $d$ and the probability of choosing a random website is therefore $1-d$.\n",
    "We can use a new matrix to work out where the Pat's visit each minute.\n",
    "$$ M = d \\, L + \\frac{1-d}{n} \\, J $$\n",
    "where $J$ is an $n\\times n$ matrix where every element is one.\n",
    "\n",
    "If $d$ is one, we have the case we had previously, whereas if $d$ is zero, we will always visit a random webpage and therefore all webpages will be equally likely and equally ranked.\n",
    "For this extension to work best, $1-d$ should be somewhat small - though we won't go into a discussion about exactly how small.\n",
    "\n",
    "Let's retry this PageRank with this extension."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "d = 0.5 # Feel free to play with this parameter after running the code once.\n",
    "M = d * L2 + (1-d)/7 * np.ones([7, 7]) # np.ones() is the J matrix, with ones for each entry."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "8 iterations to convergence.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "array([ 13.68217054,  11.20902965,  22.41964343,  16.7593433 ,\n",
       "         7.14285714,  10.87976354,  17.90719239])"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = 100 * np.ones(7) / 7 # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "lastR = r\n",
    "r = M @ r\n",
    "i = 0\n",
    "while la.norm(lastR - r) > 0.01 :\n",
    "    lastR = r\n",
    "    r = M @ r\n",
    "    i += 1\n",
    "print(str(i) + \" iterations to convergence.\")\n",
    "r"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is certainly better, the PageRank gives sensible numbers for the Procrastinating Pats that end up on each webpage.\n",
    "This method still predicts Geoff has a high ranking webpage however.\n",
    "This could be seen as a consequence of using a small network. We could also get around the problem by not counting self-links when producing the L matrix (an if a website has no outgoing links, make it link to all websites equally).\n",
    "We won't look further down this route, as this is in the realm of improvements to PageRank, rather than eigenproblems.\n",
    "\n",
    "You are now in a good position, having gained an understanding of PageRank, to produce your own code to calculate the PageRank of a website with thousands of entries.\n",
    "\n",
    "Good Luck!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 2 - Assessment\n",
    "In this assessment, you will be asked to produce a function that can calculate the PageRank for an arbitrarily large probability matrix.\n",
    "This, the final assignment of the course, will give less guidance than previous assessments.\n",
    "You will be expected to utilise code from earlier in the worksheet and re-purpose it to your needs.\n",
    "\n",
    "### How to submit\n",
    "Edit the code in the cell below to complete the assignment.\n",
    "Once you are finished and happy with it, press the *Submit Assignment* button at the top of this notebook.\n",
    "\n",
    "Please don't change any of the function names, as these will be checked by the grading script.\n",
    "\n",
    "If you have further questions about submissions or programming assignments, here is a [list](https://www.coursera.org/learn/linear-algebra-machine-learning/discussions/weeks/1/threads/jB4klkn5EeibtBIQyzFmQg) of Q&A. You can also raise an issue on the discussion forum. Good luck!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# PACKAGE\n",
    "# Here are the imports again, just in case you need them.\n",
    "# There is no need to edit or submit this cell.\n",
    "import numpy as np\n",
    "import numpy.linalg as la\n",
    "from readonly.PageRankFunctions import *\n",
    "np.set_printoptions(suppress=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION\n",
    "# Complete this function to provide the PageRank for an arbitrarily sized internet.\n",
    "# I.e. the principal eigenvector of the damped system, using the power iteration method.\n",
    "# (Normalisation doesn't matter here)\n",
    "# The functions inputs are the linkMatrix, and d the damping parameter - as defined in this worksheet.\n",
    "# (The damping parameter, d, will be set by the function - no need to set this yourself.)\n",
    "def pageRank(linkMatrix, d) :\n",
    "    n = linkMatrix.shape[0]\n",
    "    M = d * linkMatrix + (1-d)/n * np.ones([n, n])\n",
    "    r = 100 * np.ones(n) / n # Sets up this vector (6 entries of 1/6 × 100 each)\n",
    "    lastR = r\n",
    "    r = M @ r\n",
    "    i = 0\n",
    "    while la.norm(lastR - r) > 0.01 :\n",
    "        lastR = r\n",
    "        r = M @ r\n",
    "        i += 1\n",
    "    print(str(i) + \" iterations to convergence.\")\n",
    "    return r\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Test your code before submission\n",
    "To test the code you've written above, run the cell (select the cell above, then press the play button [ ▶| ] or press shift-enter).\n",
    "You can then use the code below to test out your function.\n",
    "You don't need to submit this cell; you can edit and run it as much as you like."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.2,  0. ,  0.5,  0.2,  0. ],\n",
       "       [ 0.2,  1. ,  0.5,  0.2,  0. ],\n",
       "       [ 0.2,  0. ,  0. ,  0.2,  0. ],\n",
       "       [ 0.2,  0. ,  0. ,  0.2,  0. ],\n",
       "       [ 0.2,  0. ,  0. ,  0.2,  1. ]])"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Use the following function to generate internets of different sizes.\n",
    "generate_internet(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Test your PageRank method against the built in \"eig\" method.\n",
    "# You should see yours is a lot faster for large internets\n",
    "L = generate_internet(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "103 iterations to convergence.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "array([  0.00886344,   0.01829783,   0.00886344,   0.02833996,\n",
       "         0.00886344,   0.00886344,   0.00886344,   0.01829783,\n",
       "         0.02833996,  99.86240722])"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pageRank(L, 1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([  0.0000001,   0.0000002,   0.0000001,   0.0000003,   0.0000001,\n",
       "         0.0000001,   0.0000001,   0.0000002,   0.0000003,  99.9999985])"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Do note, this is calculating the eigenvalues of the link matrix, L,\n",
    "# without any damping. It may give different results that your pageRank function.\n",
    "# If you wish, you could modify this cell to include damping.\n",
    "# (There is no credit for this though)\n",
    "eVals, eVecs = la.eig(L) # Gets the eigenvalues and vectors\n",
    "order = np.absolute(eVals).argsort()[::-1] # Orders them by their eigenvalues\n",
    "eVals = eVals[order]\n",
    "eVecs = eVecs[:,order]\n",
    "\n",
    "r = eVecs[:, 0]\n",
    "100 * np.real(r / np.sum(r))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Populating the interactive namespace from numpy and matplotlib\n",
      "37 iterations to convergence.\n"
     ]
    },
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAgAElEQVR4Xu2dC9BtZ12fn4AQRslJrEMJgVSGBkkzQcFouUmIllFjYEgYrrYzCW1FLoI2NZJwMaE4NOUaIEVbtYTMVCLIQNGoKBREIEhqAkyUmyGH5BAEFP2CF2DAdP6H9YWdzbe//e73v771rbXeZ82cmeTs97/2ep/39671nHXbR+AiAQlIQAISkIAEJNAUgSOa6q2dlYAEJCABCUhAAhJAATQEEpCABCQgAQlIoDECCmBjA253JSABCUhAAhKQgAJoBiQgAQlIQAISkEBjBBTAxgbc7kpAAhKQgAQkIAEF0AxIQAISkIAEJCCBxggogI0NuN2VgAQkIAEJSEACCqAZkIAEJCABCUhAAo0RUAAbG3C7KwEJSEACEpCABBRAMyABCUhAAhKQgAQaI6AANjbgdlcCEpCABCQgAQkogGZAAhKQgAQkIAEJNEZAAWxswO2uBCQgAQlIQAISUADNgAQkIAEJSEACEmiMgALY2IDbXQlIQAISkIAEJKAAmgEJSEACEpCABCTQGAEFsLEBt7sSkIAEJCABCUhAATQDEpCABCQgAQlIoDECCmBjA253JSABCUhAAhKQgAJoBiQgAQlIQAISkEBjBBTAxgbc7kpAAhKQgAQkIAEF0AxIQAISkIAEJCCBxggogI0NuN2VgAQkIAEJSEACCqAZkIAEJCABCUhAAo0RUAAbG3C7KwEJSEACEpCABBRAMyABCUhAAhKQgAQaI6AANjbgdlcCEpCABCQgAQkogGZAAhKQgAQkIAEJNEZAAWxswO2uBCQgAQlIQAISUADNgAQkIAEJSEACEmiMgALY2IDbXQlIQAISkIAEJKAAmgEJSEACEpCABCTQGAEFsLEBt7sSkIAEJCABCUhAATQDEpCABCQgAQlIoDECCmBjA253JSABCUhAAhKQgAJoBiQgAQlIQAISkEBjBBTAxgbc7kpAAhKQgAQkIAEF0AxIQAISkIAEJCCBxggogI0NuN2VgAQkIAEJSEACCqAZkIAEJCABCUhAAo0RUAAbG3C7KwEJSEACEpCABBRAMyABCUhAAhKQgAQaI6AANjbgdlcCEpCABCQgAQkogGZAAhKQgAQkIAEJNEZAAWxswO2uBCQgAQlIQAISUADNgAQkIAEJSEACEmiMgALY2IDbXQlIQAISkIAEJKAAmgEJSEACEpCABCTQGAEFsLEBt7sSkIAEJCABCUhAATQDEpCABCQgAQlIoDECCmBjA253JSABCUhAAhKQgAJoBiQgAQlIQAISkEBjBBTAxgbc7kpAAhKQgAQkIAEF0AxIQAISkIAEJCCBxggogI0NuN2VgAQkIAEJSEACCqAZkIAEJCABCUhAAo0RUABzAx78jgO+lFuN1RKQgAQkIAEJDEzgKOBm4NaBv3cUX6cA5obhnsCh3CqsloAEJCABCUhgnwjcC/jMPn33vn6tApjDfwDYuummmzhwIP7TRQISkIAEJCCBsRO45ZZbOP7442MzjwZuGfv27sX2KYA5qocFcGtrSwHMcbRaAhKQgAQkMBiBEMCjjw73UwAHgz6zL1IAZzagdkcCEpCABOZPQAEEzwDmcq4A5vhZLQEJSEACEhicgAKoAGZDpwBmCVovAQlIQAISGJiAAqgAZiOnAGYJWi8BCUhAAhIYmIACqABmI6cAZglaLwEJSEACEhiYgAKoAGYjpwBmCVovAQlIQAISGJiAAqgAZiOnAGYJWi8BCUhAAhIYmIACqABmI6cAZglaLwEJSEACEhiYgAKoAGYjpwBmCVovAQlIQAISGJiAAjgdAbwAeCxwIvCPwPuB5wAfX8jMXYCXA08CjgTeDjwD+NwuuYr3IL4Q+CngGOB9wNOBTxZmUQEsBGUzCUhAAhKQwFgIKIDTEcDfB64Arga+DXgxcDJwEvD3XaB+GTgDOCd+ng24FPgn4GG7BC4kMuQyaj4FvAi4f7feLxcEVQEsgGQTCUhAAhKQwJgIKIDTEcDl3NwN+DzwCOA93W/5fQH4SeC3usZxtvCjwEOAD+wQvDj7d3N31vBl3efxw4BxxjCEMIRz3aIAriPk5xKQgAQkIIGREVAApyuAJ3SXaeNs3XXAjwDvBL4T+NuFnH0auAR45Q7Zuw9wPfBA4EMLn/9R9/8/u0NNXFqOP9vLUcChra0tDhwIF3SRgAQkIAEJSGDsBBTAaQrgHYC3dffs/VAXsjjz97olOYuPPgi8q7tfcDmPD+3u+TsO+OzCh28EbgWeuEOALwIuXP57BXDsU93tk4AEJCABCXyTgAI4TQGMe/1OB0L+Dq0RwLhnMM4Mnr9D8FcJ4JuAr3cPkyyXeQbQPYgEBiZw7/OvvO0bD14ct/m6SEACEsgRUACnJ4DxYMdjgFOBGxaGf6hLwMuJ8x7A3By0WgJrCSiAaxHZQAIS2JCAAjgdAYwHNl4DnAWctsNrWuLhjXgI5MnAm7scfE/3mph1D4HEAyDx+phYQuji4RIfAtlwMtlcAntFQAHcK7KuVwLtElAApyOAr+2e8I2zf4vv/ovXvcR7AWOJS8M/0cnbLZ0wxt/Hpd7t5WPda1/e0v1FvAYmLg+f3Z1RjNfAfK+vgWl3p2DPx0dAARzfmLhFEpg6AQVwOgIYD2XstDwFuKz7YPtF0HEWcPFF0H+5UBjrWazZfhH0U7uHSt7bvTz6E4Xh9hJwISibSaCWgAJYS846CUhgFQEFcDoCONYUK4BjHRm3azYEFMDZDKUdkcBoCCiACmA2jApglqD1ElhDQAE0IhKQQN8EFEAFMJspBTBL0HoJKIBmQAISGJiAAqgAZiOnAGYJWi8BBdAMSEACAxNQABXAbOQUwCxB6yWgAJoBCUhgYAIKoAKYjZwCmCVovQQUQDMgAQkMTEABVACzkVMAswStl4ACaAYkIIGBCSiACmA2cgpglqD1ElAAzYAEJDAwAQVQAcxGTgHMErReAgqgGZCABAYmoAAqgNnIKYBZgtZLQAE0AxKQwMAEFEAFMBs5BTBL0HoJKIBmQAISGJiAAqgAZiOnAGYJWi8BBdAMSEACAxNQABXAbOQUwCxB6yWgAJoBCUhgYAIKoAKYjZwCmCVovQQUQDMgAQkMTEABVACzkVMAswStl4ACaAYkIIGBCSiACmA2cgpglqD1ElAAzYAEJDAwAQVQAcxGTgHMErReAgqgGZCABAYmoAAqgNnIKYBZgtZLQAE0AxKQwMAEFEAFMBs5BTBL0HoJKIBmQAISGJiAAqgAZiOnAGYJWi8BBdAMSEACAxNQABXAbOQUwCxB6yWgAJoBCUhgYAIKoAKYjZwCmCVovQQUQDMgAQkMTEABVACzkVMAswStl4ACaAYkIIGBCSiACmA2cgpglqD1ElAAzYAEJDAwAQVQAcxGTgHMErReAgqgGZCABAYmoAAqgNnIKYBZgtZLQAE0AxKQwMAEFEAFMBs5BTBL0HoJKIBmQAISGJiAAqgAZiOnAGYJWi8BBdAMSEACAxNQABXAbOQUwCxB6yWgAJoBCUhgYAIKoAKYjZwCmCVovQQUQDMgAQkMTEABVACzkVMAswStl4ACaAYkIIGBCSiACmA2cgpglqD1ElAAzYAEJDAwAQVQAcxGTgHMErReAgqgGZCABAYmoAAqgNnIKYBZgtZLQAE0AxKQwMAEFMDpCOCpwHnAKcA9gLOAty7k5dYV2fkF4KUrPrsIuHDps48DJ26QQwVwA1g2lUANgXuff+VtZQcvPqNmFdZIQAISuB0BBXA6Ang68DDgGuDNOwjgsUvZjva/DpwAfGoXAXwc8MiFz78G/NUG80QB3ACWTSVQQ0ABrKFmjQQksBsBBXA6Arg4jnG2b/kM4PI4x9nBo4B/s0sA4gzgmcADEtNEAUzAs1QCJQQUwBJKtpGABDYhoADOUwDvDhwCzgZ+Y40AxmXlLeDLwFXABcCNu9QcCcSf7SUk89DW1hYHDoQLukhAAn0TUAD7Jur6JCABBXCeAhj3/Z0PHNeJ3aqkx2XiuwJx31/cVxj3A94TOBn40oqine4bRAF0ZyKBvSOgAO4dW9csgVYJKIDzFMCPAX8IPGvDYB8DfBo4t7t/cKdyzwBuCNXmEsgSUACzBK2XgASWCSiA8xPAhwPv6e7r+3BF5K8G3tFdCi4p9x7AEkq2kUCCgAKYgGepBCSwIwEFcH4CeFl3CfcHKjIfl4Pj/r+4zPvqwnoFsBCUzSRQS0ABrCVnnQQksIqAAjgdAQw5i1e6xHJtd5n2XcAXFx7aCBn7LPCfgV/ZYdDfCbwFuLT77GXAb3eXfeN+wRd2Zw5PAr5QOG0UwEJQNpNALQEFsJacdRKQgAK4OgNHTCQepwEhfMvL64Fzur98KnBJ90BHPNm7vBwE4gxhnOGL5QogXjD9XZ3wvRd4HnD9BkwUwA1g2VQCNQQUwBpq1khAArsR8AzgdM4AjjXJCuBYR8btmg0BBXA2Q2lHJDAaAgqgApgNowKYJWi9BNYQUACNiAQk0DcBBVABzGZKAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBXA6AngqcB5wCnAP4CzgrQt5uQw4eyk/bwd+fE2mntmt91jgw8CzgA9ukEMFcANYNpVADYF7n3/lbWUHLz6jZhXWSEACErgdAQVwOgJ4OvAw4BrgzSsE8O7AUxZG+CvA3+yS+ScClwNPA/4E+Dng8cD9gM8XzhUFsBCUzSRQS0ABrCVnnQQksIqAAjgdAVwcw1tXCOAxwJkbxD2k72rgZ7qaOwA3Aa8BLi5cjwJYCMpmEqgloADWkrNOAhJQAFdn4IgJxmOVAIb8fbU76/d/gecDf72if3cG/gF43NKl5NcDIZKPWVF3JBB/tpejgENbW1scOBAu6CIBCfRNQAHsm6jrk4AEPAM4nzOAT+qE7gbgXwIvBv4OeAjw9R2ifhzwGeChwFULn78EeATwoBXT4yLgwuXPFEB3JhLYOwIK4N6xdc0SaJWAAjgfAVzO8H2A64FHAu/cQABfCjwceLBnAFvdLdjvsRFQAMc2Im6PBKZPQAGcrwBGOr/QXQb+HztEtfYS8PKqvAdw+vsBezByAgrgyAfIzZPABAkogPMVwHsBN3YPhbxtRTbjIZB45Uu8+iWWeAgkai71IZAJzmY3ebYEFMDZDq0dk8C+EVAApyOAdwVO6JJyLXAu8C7gi92fuC8vXg/zl909gHEvXzygcX8gXgcTS1wKfksnePH/26+BeWongvEamCcAJwKfK0ylZwALQdlMArUEFMBactZJQAKrCCiA0xHA0zrhWx7LeGr36d2TvA/snuC9GfgD4AVLIncQiBdGx4Mc20u8AiZeMB0vgv4Q8OzunYCls0YBLCVlOwlUElAAK8FZJgEJrCSgAE5HAMcaYwVwrCPjds2GgAI4m6G0IxIYDQEFUAHMhlEBzBK0XgJrCCiARkQCEuibgAKoAGYzpQBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAI4HQE8FTgPOAW4B3AW8NYuL3cCfgn4CeA+wBbwDuB84OZdMnURcOHS5x8HTtwghwrgBrBsKoEaAvc+/8rbyg5efEbNKqyRgAQkcDsCCuB0BPB04GHANcCblwTwaOC3gF8FPgx8J/Aq4I7AD6wRwMcBj1xo8zXgrzaYJwrgBrBsKoEaAgpgDTVrJCCB3QgogNMRwMVxvHVJAHca4x8EPgh8N3DjihDEGcAzgQckpokCmIBnqQRKCCiAJZRsIwEJbEJAAZyvAMZZvT8AjgFu2UUA47JyXDL+MnAVcMEuwrjTahTATWacbSVQQUABrIBmiQQksCsBBXCeAngX4H3Ax4B/u0sC4rLyXYG47y/uK4z7Ae8JnAx8aUXdkUD82V6OAg5tbW1x4EC4oIsEJNA3AQWwb6KuTwISUADnJ4DxQEjcI3gv4LRdzv7tlP44W/hp4Fzg13c5a7j84AgKoDsTCewdAQVw79i6Zgm0SkABnJcAhvy9sXsS+EeAv64I9tXdE8RxKXinxTOAFVAtkUCGgAKYoWetBCSwEwEFcD4CuC1/9wV+GPhCReTjcnA8MBIPh7y6sN57AAtB2UwCtQQUwFpy1klAAqsIKIDTEcCQsxO6gby2u0z7LuCL3bv+4rLv9wOPAj63MODx+Ve7/38n8Bbg0u7/Xwb8dnfZ9zjghd0TwSdtIJAKoPsXCewxAQVwjwG7egk0SEABnI4Axv18IXzLy+u7M3Y3rMhvnA18d/fZQeCyrn381RVAvGD6uzrhey/wPOD6DeaCArgBLJtKoIaAAlhDzRoJSGA3AgrgdARwrElWAMc6Mm7XbAgogLMZSjsigdEQUAAVwGwYFcAsQeslsIaAAmhEJCCBvgkogApgNlMKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogApgNnIKYJag9RJQAM2ABCQwMAEFUAHMRk4BzBK0XgIKoBmQgAQGJqAAKoDZyCmAWYLWS0ABNAMSkMDABBRABTAbOQUwS9B6CSiAZkACEhiYgAKoAGYjpwBmCVovAQXQDEhAAgMTUAAVwGzkFMAsQesloACaAQlIYGACCqACmI2cApglaL0EFEAzIAEJDExAAVQAs5FTALMErZeAAmgGJCCBgQkogNMRwFOB84BTgHsAZwFvXcjLEcALgZ8CjgHeBzwd+OSaTD2zW++xwIeBZwEf3CCHCuAGsGwqgRoC9z7/ytvKDl58Rs0qrJGABCRwOwIK4HQE8HTgYcA1wJt3EMDnABcA5wCfAl4E3B84Cfjyitw/EbgceBrwJ8DPAY8H7gd8vnCuKICFoGwmgVoCCmAtOeskIIFVBBTA6Qjg4hjeuiSAcfbvZuDlwMu6hkcDn+uE8IoVAQjpuxr4me7zOwA3Aa8BLi6cNgpgISibSaCWgAJYS846CUhAAVydgZCnqS3LAngf4HrggcCHFjrzR93//+wOHbwz8A/A45YuJb++u4T8mEIoCmAhKJtJoJaAAlhLzjoJSEABnLcAPrS75+844LMLXX0jELIYl3qXl2j7GSBqr1r48CXAI4AHrUB2JBB/tpejgENbW1scOBAu6CIBCfRNQAHsm6jrk4AEvAQ8j0vAqwTwTcDXgSdtIIAvBR4OPHjF9LgIuHD5MwXQnYkE9o6AArh3bF2zBFoloADOQwCHvATsGcBW9xb2e98IKID7ht4vlsBsCSiA8xDA7YdA4gGQeBAklrgeG0/yxlPBuz0EEq98iVe/xBIPgdwIXOpDILOd83ZsggQUwAkOmpssgZETUACnI4B3BU7o8nQtcC7wLuCLnbTFa2DOB84GbuheA/O9S6+BeSfwlk7wYlXbr4F5avfuv3gNzBOAE7sniEvi60MgJZRsI4EEAQUwAc9SCUhgRwIK4HQE8LRO+JYHMp7ajbN82y+CDpmLF0G/F3gG8ImFgoPAZUDcx7e9xCtg4gXT8SLoeIL42d07AUunjAJYSsp2EqgkoABWgrNMAhJYSUABnI4AjjXGCuBYR8btmg0BBXA2Q2lHJDAaAgqgApgNowKYJWi9BNYQUACNiAQk0DcBBVABzGZKAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBVABzEZOAcwStF4CCqAZkIAEBiagACqA2cgpgFmC1ktAATQDEpDAwAQUQAUwGzkFMEvQegkogGZAAhIYmIACqABmI6cAZglaLwEF0AxIQAIDE1AAFcBs5BTALEHrJaAAmgEJSGBgAgqgApiNnAKYJWi9BBRAMyABCQxMQAFUALORUwCzBK2XgAJoBiQggYEJKIAKYDZyCmCWoPUSUADNgAQkMDABBXBeAngQ+O4dMvRa4Jk7/P05wOuW/v4rwF02yKECuAEsm/ZH4N7nX3m7lR28+Iz+Vj6yNS32dc79HBl2N0cCsyagAM5LAO8G3HEhsScDfwj8MPDuFQL4KuB+C5/dCnxug9QrgBvAsml/BBTA/li6JglIoD0CCuC8BHA5wZcAjwLuC4TYLS9xBjDaHJOIvgKYgGdpPQEFsJ6dlRKQgAQUwPkK4J2Bm4FXAC9eEfUQwF8DPgPcAZqQZZQAACAASURBVLgGeC7wZxtMDQVwA1g27Y+AAtgfS9ckAQm0R0ABnK8APgH4DeBfdCK4U7of0p0d/AhwNPDzwKlAXDq+acV0OBKIP9vLUcChra0tDhwIF3SRwDAEFMBhOPstEpDAPAkogPMVwLcDXwUevUF07wR8FHgD8IIVdRcBFy5/pgBuQNmmvRBQAHvB6EokIIFGCSiA8xTAeBL4U8Bjgf+zYbbfBHwNeLJnADckZ/NBCSiAg+L2yyQggZkRUADnKYBxlu6ngeM7mSuNbTxBfB3we8C5hUXeA1gIymb9ElAA++Xp2iQggbYIKIDzE8B4mOOG7jLu+Utxvrx74OOC7u9/EfgA8Bfdk8DnAWcCpwB/XjgVFMBCUDbrl4AC2C9P1yYBCbRFQAGcnwD+KBD3/8W7/T6xFOd4F2C8LDqe/o3lld1l4mOBvwH+FHg+cO0G00AB3ACWTfsjoAD2x9I1SUAC7RFQAOcngEOnWAEcmrjfd5iAAmgQJCABCdQTUAAVwPr0fKNSAcwStL6KgAJYhc0iCUhAAocJKIAKYHYqKIBZgtZXEVAAq7BZJAEJSEAB7DJwhFlIEVAAU/gsriWgANaSs04CEpCAZwAjAwpgbiYogDl+VlcSUAArwVkmAQlIwEvAhzOgAOamggKY42d1JQEFsBKcZRKQgAQUQAWwh1mgAPYA0VVsTkAB3JyZFRKQgAS2CfgQiGcAs7NBAcwStL6KgAJYhc0iCUhAAocJKIAKYHYqKIBZgtZXEVAAq7BZJAEJSEAB7DLgPYC5yaAA5vhZXUlAAawEZ5kEJCABzwAezoACmJsKCmCOn9WVBBTASnCWSUACElAAFcAeZoEC2ANEV7E5AQVwc2ZWSEACEtgm4D2AngHMzgYFMEvQ+ioCCmAVNoskIAEJHCagACqA2amgAGYJWl9FQAGswmaRBCQgAQWwy4D3AOYmgwKY42d1JQEFsBKcZRKQgAQ8A3g4AwpgbioogDl+VlcSUAArwVkmAQlIQAFUAHuYBQpgDxBdxeYEFMDNmVkhAQlIYJuA9wB6BjA7GxTALEHrqwgogFXYLJKABCRwmIACqABmp4ICmCVofRUBBbAKm0USkIAEFMAuA94DmJsMCmCOn9WVBBTASnCWSUACEvAM4OEMKIC5qaAA5vhZXUlAAawEZ5kEJCABBVAB7GEWKIA9QHQVmxNQADdnZoUEJCCBbQLeA+gZwOxsUACzBK2vIqAAVmGzSAISkMBhAgqgApidCgpglqD1VQQUwCpsFklAAhJQALsMeA9gbjIogDl+VlcSUAArwVkmAQlIwDOAhzOgAOamggKY42d1JQEFsBKcZRKQgAQUQAWwh1mgAPYA0VVsTkAB3JyZFRKQgAS2CXgPoGcAs7NBAcwStL6KgAJYhc0iCUhAAocJKIAKYHYqKIBZgtZXEVAAq7BZJAEJSEAB7DLgPYC5yaAA5vhZXUlAAawEZ5kEJCABzwAezoACmJsKCmCOn9WVBBTASnCWSUACElAAFcAeZoEC2ANEV7E5AQVwc2ZWSEACEtgm4D2AngHMzgYFMEvQ+ioCCmAVNoskIAEJHCagACqA2amgAGYJWl9FQAGswmaRBCQgAQWwy8Bc7gG8CLhwKdcfB07cJeuPB14E3Bv4JPAc4Hc3nBsK4IbAbN4PAQWwH46uRQISaJOAZwDncwYwBPBxwCMXovw14K9WRPshwB8DFwC/AzwZOB/4fuC6DaaDArgBLJv2R0AB7I+la5KABNojoADOSwDPBB5QGOPfBL4DeNRC+w8AHwKeVriOaKYAbgDLpv0RUAD7Y+maJCCB9ggogPMSwPOALeDLwFXd2b0bV8Q6/v4VwCULn78QCIn8vg2mggK4ASyb9kdAAeyPpWuSgATaI6AAzkcATwfuCsR9f/fo7ge8J3Ay8KUdov1V4GzgDQufPaOru/suU+FIIP5sL0cBh7a2tjhwIFzQRQLDEFAAh+Hst+wfgZYyvn+U2/1mBXA+Aric4mOATwPnAr9eKIDPBF4AHLvLlNjpYRMUwHZ3IvvV85YOjot9PXjxGfuF3O8dmEBLGR8YrV/na2AOZ2AuTwHvFOirgXd0l4KXP6+9BOwZQHcdoyDQ0sFRARxF5AbfiJYyPjhcv9D3AM5YAONycEhenLF79Q5Zj4dAvh149MJn7wc+4kMg7hmmQKClg6MCOIVE9r+NLWW8f3qucR0BLwHP5wzgy4Df7i77HgfEAx3xRPBJwBeAy4HPLJwNfCjwnu7df1cCTwKe62tg1k0ZPx8LgZYOjgrgWFI37Ha0lPFhyfptQUABnI8AXgGcCnxXJ3zvBZ4HXN9F/d3AQeCchejHi6B/aeFF0L/gi6DdMUyFQEsHRwVwKqnsdztbyni/5FxbCQEFcD4CWDLee9HG18DsBVXXuZZASwdHBXBtHGbZoKWMz3IAR94pBVABzEZUAcwStL6KQEsHRwWwKiKTL2op45MfrAl2QAFUALOxVQCzBK2vItDSwVEBrIrI5ItayvjkB2uCHVAAFcBsbBXALEHrqwi0dHBUAKsiMvmiljI++cGaYAcUQAUwG1sFMEvQ+ioCLR0cFcCqiEy+qKWMT36wJtgBBVABzMZWAcwStL6KQEsHRwWwKiKTL2op45MfrAl2QAFUALOxVQCzBK2vItDSwVEBrIrI5ItayvjkB2uCHVAAFcBsbJsSQA/E2bj0V9/SwdHc9ZebKa2ppYxPaVzmsq0KoAKYzbICmCVofRWBlg6OCmBVRCZf1FLGJz9YE+yAAqgAZmOrAGYJWl9FoKWDowJYFZHJF7WU8ckP1gQ7oAAqgNnYKoBZgtZXEWjp4KgAVkVk8kUtZXzygzXBDiiACmA2tgpglqD1VQRaOjgqgFURmXxRSxmf/GBNsAMKoAKYja0CmCVofRWBlg6OCmBVRCZf1FLGJz9YE+yAAqgAZmOrAGYJWl9FoKWDowJYFZHJF7WU8ckP1gQ7oAAqgNnYKoBZgtZXEWjp4KgAVkVk8kUtZXzygzXBDiiACmA2tgpglqD1VQRaOjgqgFURmXxRSxmf/GBNsAMKoAKYja0CmCVofRWBlg6OCmBVRCZf1FLGJz9YE+yAAqgAZmOrAGYJWl9FoKWDowJYFZHJF7WU8ckP1gQ7oAAqgNnYKoBZgtZXEWjp4KgAVkVk8kUtZXzygzXBDiiACmA2tgpglqD1VQRaOjgqgFURmXxRSxmf/GBNsAMKoAKYja0CmCVofRWBlg6OCmBVRCZf1FLGJz9YE+yAAqgAZmOrAGYJWl9FoKWDowJYFZHJF7WU8ckP1gQ7oAAqgNnYKoBZgtZXEWjp4KgAVkVk8kUtZXzygzXBDiiACmA2tgpglqD1VQRaOjgqgFURmXxRSxmf/GBNsAMKoAKYja0CmCVofRWBlg6OCmBVRCZf1FLGJz9YE+yAAqgAZmOrAGYJWl9FoKWDowJYFZHJF7WU8ckP1gQ7oAAqgNnYKoBZgtZXEWjp4KgAVkVk8kUtZXzygzXBDiiACmA2tgpglqD1VQRaOjgqgFURmXxRSxmf/GBt0IGxzGcFUAHcILY7NlUAswStryLQ0sFxLAeMqoGyqJpASxmvhjTBwrHMZwVQAcxOHwUwS9D6KgItHRzHcsCoGiiLqgm0lPFqSBMsHMt8VgAVwOz0UQCzBK2vItDSwXEsB4yqgbKomkBLGa+GNMHCscxnBVABzE4fBTBL0PoqAi0dHMdywKgaKIuqCbSU8WpIEywcy3xWABXA7PRRALMEra8i0NLBcSwHjKqBsqiaQEsZr4Y0wcKxzGcFUAHMTh8FMEvQ+ioCLR0cx3LAqBooi6oJtJTxakgTLBzLfFYAFcDs9FEAswStryLQ0sFxLAeMqoGyqJpASxmvhjTBwrHMZwVwPgJ4AfBY4ETgH4H3A88BPr7L/DgHeN3S518B7rLBnFIAN4Bl0/4ItHRwHMsBo7/Rc00lBFrKeAmPubQZy3xWAOcjgL8PXAFcDXwb8GLgZOAk4O9XTJwQwFcB91v4/FbgcxtMNAVwA1g27Y9ASwfHsRww+hs911RCoKWMl/CYS5uxzGcFcD4CuDw37gZ8HngE8J5dBPAS4JjExFIAE/AsrSfQ0sFxLAeM+tGysoZASxmv4TPVmrHMZwVwvgJ4AvBJ4P7AdbsI4K8BnwHuAFwDPBf4s10m1pFA/NlejgIObW1tceBAuOC8l7FM3HlTLutdSwdHc1eWibm1ainjcxu73fozlvmsAM5TAEPm3tad2fuhXYL4EOC+wEeAo4GfB07tLh3ftKLuIuDC5c8UwJZ2X+Poa0sHx7EcMMYx8u1sRUsZb2dUYSzzWQGcpwD+MnA6EPJ3aIOJdSfgo8AbgBesqPMMYAfm4MVnbIDWpn0TaOngOJYDRt9j6Pp2J9BSxlvKwljmswI4PwG8FHhMdybvhopJ9Sbga8CTC2u9B7AQlM36JdDSwXEsB4x+R9C1rSPQUsbXsZjT52OZzwrgfATwCOA1wFnAad39f5vOmTt29wv+HnBuYbECWAjKZv0SaOngOJYDRr8j6NrWEWgp4+tYzOnzscxnBXA+Avha4Ce7s3+L7/7b6t4LGPPn8u6Bj3hnYCy/CHwA+IvufsHzgDOBU4A/L5xwCmAhKJv1S6Clg+NYDhj9jmDbayvJb0mbtilOs/djmc8K4HwEMN7ft9PyFOCy7oN3AweBeP9fLK/sXh59LPA3wJ8Czweu3WBaKYAbwLJpfwRaOjiO5YDR3+i5ppL8lrSR5PQIjGU+K4DzEcD9mgUK4H6Rb/x7Wzo4juWA0Xjkeu1+SX5L2vS6Ua5sEAJjmc8KoAKYDbwCmCVofRWBlg6OYzlgVA2URTsSKMlvSRvxTo/AWOazAqgAZmePApglaH0VgSkcHPva0fe1nirQFu0JgZL8lrTZk41zpXtKYCzzWQFUALNBVwCzBK2vIjCFg2NfO/q+1lMF2qI9IVCS35I2e7JxrnRPCYxlPiuACmA26ApglqD1VQSmcHDsa0ff13qqQFu0JwRK8lvSZk82zpXuKYGxzGcFUAHMBl0BzBK0vorAFA6Ofe3o+1pPFWiL1hKoGZ+S/Ja0Wbtx3P6nx6L9Tr9i1Nd3lWxP621q8rIXzBRABTCbKwUwS9D6KgJTOGD1taPvaz1VoC26HYGdclczPiX5LWlTMjwl6ylps9N31daVbPdc29TkZS9YKIAKYDZXCmCWoPVVBKZw4OlrR9/XeqpAW6QA7pKBKczDsUV4LPNZAVQAs3NDAcwSLLxE08PXzGoVUzjw9LWj72s9swrAPnXGM4C3Bz+FebhPUVn5tWOZzwqgApidGwpglqACWEVwCgeevnb0fa2nCrRFngH0DGCvs2As81kBVACzwVYAswQVwCqCCmAVNouSBDwD6BnAZIRQALME+6s/or9VNbkmBbCHYZ+CzPTQzV5XMQVmfe3o+1pPrwPQ6MoUQAUwG/2xzGfPAHoGMJtlBTBL0DOAVQQVwCpsFiUJKIAKYDJCngHMAuyx3jOAOZgKYI7f4eqxyczYtmcnxFPbxp3evVYanbGcMSjd3jm3UwAVwGy+xzKfPQPoGcBslhXALEEFsIpgiQCWtKn68sKivnb0fa2ncLNttgsBBVABzE6QscxnBVABzGZZAcwSVACrCJbIXUmbqi8vLOprR9/Xego322YK4I6/FjLVM/FjC/RY5rMCqABm58aeCuBYJso2pL3anv0WleUQjG17ag88+92PvvLS13qyk73v+v0en5r+eAbQM4A1uVmsGct8VgAVwGyWFcAsQc8AVhEskYeSNlVfXljU146+r/UUbvbaZn1x7Ws9aze4xwYK4LgFcL8zVTJXS9r0GNmVq1IAFcBszhTALEEFsIpgyY6+pE3VlxcW9bWj72s9hZu9tllfXPtaz9oN7rGBAqgA7hankrla0qbHyCqAu8D0KeBc0iYpgLUHnr2auLXbkxu61dVj256dtrRkG0va7BXDWG9feelrPX31tS+ufa2nr36VrKdEAGvbLH9/X3xK1lPSpnYelnDtq01tP/bi+1c9+T+W+ewZQM8AZnOvAGYJegawimDJjr6kTdWXFxb1taPvaz2Fm722WV9c+1rP2g3usUGt3C2PYUnfS9qUdK1kPSVtFMD1tEvmakmb9d+Ub6EAKoDZFCmAWYIKYBXBkgNWSZuqLy8s6mtH39d6Cjd7bbO+uPa1nrUb3GMDBfD2MPd7DGvEusc4fMuqSuZqSZu93MbtdSuACmA2ZwpgBcGx7bSWu7DfO/USpCXbWNKm5Ltq2/S1o+9rPX2Nc19c+1pP7fjU1E1BAJe3cbmfO12arB2L2roa9uvOQEa/xrY9JdvcF4tN16MAKoCbZma5vQJYQVABrIC2VFKyoy9pk9+S1WvoS9z6Wo8CmB9tBdAzgLulqGSulrTJJ3X9GhRABXB9SnZvoQBWEBxSAEt2NjVnDCq6XVxSIm59tSneqIqGJexLVtvXehTAEtq7t1EA90YAS+Zzydm02vXkk/GNNZTM1ZI2fW3PbutRABXAbM4UwAqCCuDmB9kaeZnCwaAkPnt1wKjlU1tXMoZ71dcSziVtFEAF0DOAJTNlGm18DUxunGYjgCUHnpI2JTgVQAWwJCfbbUpyV9KmRMBKtmsKAljDo7bvJfO5rzY127hcM8Z7AGszVcK1hFlfbUpyV9Kmr+3xDODuJBXAXNJmK4Al/9LfCV3JDqmkTW5YvlldsrNZ7mvJAaOv7VvHMD6vPWDVHlRK+rYp11XvBNvP76rlU1tXIqAlXPtiVrKemm0u2XfUtinZ5pr5vG57MvOwZptL58uQ+9JN++F7AEuI7W8bBTDHv2kBXLfTXPVU2l7ttEq2p0S4FMD1k6JEVErarP+mvbuvqFbkautqZKqEz7pMl8pEyXeVzLEh26zr+06fl/6DqmScS9rUct20rvQp4L62eR17BbBkBPe3jQKY468ALvBb3gG1JoC1O9YaIS75rpI2tfEvkbuSNiXfX7KekjYlArbp9qw6M1S7npp+1B6IS7axhFlJfveqzbq+K4BnfAuCse0X9nJ7dsu4D4H4EEjNPnCxZnQCWDKZhvwXeu131QxMyXf1dcAoWU/pmZe+Do4lB+saruv62ue/9PsYwxrum4hcyRwr4Vzb103XXcpj0/VuM+srv3uxnjEIYEleStqUzMOS9ZS0KclCyfaUtNnL7VEAdx9JzwDWJv0bdQrgAr+9PANYspOoPaAu1y1Hos9LRrU7xJKD49gFcKgxLBWeku1ZN16biGPJ+Ax5BrDmu0rm2JjaKICeAVx1iPcMoGcAc/o3sACWHLBq25QIxpBtSg6WJW1KDnIK4ObTYFOumfuTar6rpEclc2W/BbCPbSw9Q1vyXWOSu5JbTFYJYMmc30seJfuuTTOcmWMl31WyzTVztYRzzfatq1EAFcB1GVn3+aBnAEsmytR20CU78T7blBzQ+zoDuNN69nJ8SnbQ6wIdn/e1Ey/5B0PJNtdsz6b93ORMXok81H7/XjGrzV3N+NR+V0nfN20zVgHctB9jkPiaLKzb35ZKa8l82rSNAjg/AXwmcB5wLPBh4FnAB3cJxuOBF8UxD/gk8BzgdzcIkgK4AKvPS8A1O8g+Djx9HjCGFsASZiXZrhGuPtiXin7JQWXTfq4SwHX9Ks3LVOdGzUF/HbPSce5jPaXjUzpX95NHSe77YNbn+NRuc8n8zbZRAOclgE8ELgeeBvwJ8HNACN79gM/vEJaHAH8MXAD8DvBk4Hzg+4HrCsO17wJYctC3zTdGs2TH1ucBo/Sg4viUj0/JGJa0cZzP+JYzvWOThz62x3GexzgXHo83aqYAzksAQ/quBn6mS8EdgJuA1wAX75CM3wS+A3jUwmcfAD7USWRJmBRAzwCulEsF8MrbEJRI2ZBtFIN5iME6SXSc5zHOJQfjTdsogPMRwDsD/wA8DnjrQhBeDxwDPGaHcNwIvAK4ZOGzFwJnAt+3IkxHAvFnezkKOHTTTTdx4EC4YL/LyRe+/bYVXvfCH2Px/+OD5b+zzTd51fLZaQR34rrcrraNY7g/GXecb78/meu+w3Gexzj3e2T9xtpCAI8//vj4z6Pjf/fiO8a+zrm8BuY44DPAQ4GrFqC/BHgE8KAdBuKrwNnAGxY+ewZwIXD3FQN3Uff52MfV7ZOABCQgAQlIYD2Be3X+sL7lzFrMXQBfCjwceHChAMZDJC/oHiLZaaiXzwBGm38GfHGPcnH4DCMQAf3SHn2Hq/0GAVkPkwQ5y3kYAsN9i5kehvVecI513gzcOkwXxvUtcxHAoS4BDz16h+8xbPkU9YDAZT0MbDnLeRgCw32LmR6GtZx75jwXAQws8RBIvPIlXv0SSzwEEvf5XbrLQyDfDjx6gen7gY9s8BBIz8PxLasz8HtN+Jvrl/UwrOUs52EIDPctZnoY1nLumfOcBHD7NTBP7UQwXgPzBOBE4HPdK2LiPsF47Usscb/ge7p3/8Xjik8Cnrvha2B6Hg4FcK+B7rJ+dy7DwJeznIchMNy3mOlhWMu5Z85zEsBAE6+A2X4RdLzO5dndmcH47N3xKjjgnAWG8Z7AX1p4EfQvbPgi6J6H41tWF/cchrD+V+Are/1lja9f1sMEQM5yHobAcN9ipodhLeeeOc9NAHvG4+okIAEJSEACEpDA/AgogPMbU3skAQlIQAISkIAEdiWgABoQCUhAAhKQgAQk0BgBBbCxAbe7EpCABCQgAQlIQAE0AxKQgAQkIAEJSKAxAgrguAc8fplk+6nmD3fvOIx3HbrUEYgnqh/bvRroH4F47+NzgI8vrO4uwMu71wLFU2fxY7XxE4HxKiGXOgLB/cXAq4B4PVMscq5juVPVPYH/BpwOxLtN/wJ4CvD/usaxn4/fOf+p7rfR3wc8Hfhkf5sw+zXdEYifAv133S9Fxa9HXNa9RWL7VyTkXBeDU7vj3CnAPYCzgLcurKqEa/wi12u69/r+E/Bm4GeBv6vbpDaqFMDxjvP2ew2f1r3KJg6c8dqa+wGfH+9mj3rLfh+4Arga+LZOSk4GTgL+vtvyXwbO6F4XFL/CEi8Sjx3Kw0bds/Fu3A8Cb+x+bP1dCwIo537G7DuBa4FgG0y/ANwXuL77E98S/8gJCY9XYH0KeBFw/y73X+5nM2a/lnhH7Lnd78f/GfADwOuA5wGv7nov57oYxD9cYv96TSduywJYwvX3Onn8aeBO3djEfv4n6zapjSoFcLzjHL9sEgGOdxvGEr9sclP3r5yLx7vZk9qyu3Uy/YjupeBHdwfQ2Gn8VteTeJH4R4GHAB+YVO/2f2Pv2u3U4wzq84F4N2f8Q0bO/Y1N7Avi4Bm/eb7TEvv4OFsVZ7Vf1jUI/nFGO4Qw/kHksp7A73TM/sNC0zjLFFcS4qygnNczLGkRZ1MXBbCE678C/hyIf2xun/X+8e6dvvfq8l/y3c21UQDHOeQ1v208zp6Me6tO6C6DxdmQ64AfAd4JxFmVv13Y9E8DlwCvHHd3Rrd1rwe+CPyn7kXs2wIo5/6GKg58cZtCHOjiHzLxa0evBX61+4r7dGcCH9gJ+PY3/1H3/3GZzGU9gTgDGL8y9aPAJ4DvA/6gOyv4vwE5r2dY0mJZAEu4/vvuHzix395e4gpPnN2Oq2ZvKfniFtsogOMc9eO6HXn8XN1VC5v4km4n/6BxbvaktirOqL6tuyfqh7otjzN/cVkn7v1bXOK+y7jEFpciXMoIxE8rxuWx+Fd57Ijjl3i2BVDOZQxLWm1fwn0F8CbgX3f/WIlLYZd3P3kZ9/zFPuWzCyuMy/JxsI1bTVzWE4j9RdzHGr8W9XUg7gmMfMevNMUS+2o5r+e4rsWyAJZwDTk/u7s9anH9cavUhd2tEeu+t8nPFcBxDvsqAXxpd6nnwePc7EltVdwvFfeehPwdWiOAcSk+zgyeP6ke7t/GHt9diomzJfHwUiwlAijnzcfsqx3rOFBuL3FPWoh33Law6gAashgiE6Lusp5AcIr9bzyUF/cAPqAT7bgvMM50y3k9w5IWpQK4mN9VAhj3w74A+JWSL26xjQI4zlH3EvDejks82PEYIJ4+u2Hhq7w02Q/3M7vLLiEY20ucMYmdezxQ82PAO7zU3gvsuD3hD4H/uLC2eMI37rmMp4NLLqH1siEzX0ncfx33W/73hX4G47j/L+4TlnM/AfAScD8ci9aiABZh2pdG8RBIXHp8VvftcQnixu6pVB8CqRuSyHu8KiBuMj5th9dgbD+c8OTuabT4lu/pXhPjQyDlzI8CvnupeVxa/1j3upI4mMa/zuVcznRVy98A4ozr4kMgca9q3CYSZ6W2b6KPB0DiQZBYDnQPP/kQSDn/v+6kOq4cbC/xZHW8bif2EXIuZ7lby1UPgeyW3+2HQOLJ7D/tVh5XH+KtDz4EsgttBbCf0O7FWrZfAxM3HocIxtOTT+j+tek76eqIx83xcf9ZnP1bfPdfvO4lnuaLJXbwP9E9IXlLJ4zx94uX2Oq+ve2qxUvAcu4vC3GpN95nGfc6xX19cQ9gPAAS+414OCGWuHc1bl+I+6TijHe8BuZ7fQ3MRoMQ7/x7JBD3VsYl4Hio5n8C/2vh3mA5b4T0tsbxtoB4IC+WeKVRXFaPe67jAbI46VHCNV4Dc3cgXpu2/RqYeCLY18AogHWpHEFVvAJm+0XQcQP9s7t3Ao5g0ya5CdsvbF3e+PhXfOzgY9l+QXGcnVp8EfRfTrLH49noZQGUc39j86juYYR4/18IXjwQsv0UcHzL9ot0QwqPAd7bvdw8nmZ1KSMQZ7VDnOPqwT/vXi3yBuC/AHEfppzLOO7UKq7GhPAtL3FvZZylLslvvAg6bu15dHebSbyiJ46XvghaAaxPppUSkIAEJCABCUhgbgS8BDy3EbU/EpCABCQgAQlIYA0BBdCISEACEpCABCQggcYIKICNDbjdlYAEJCABCUhAAgqgGZCABCQgvOdHOgAAAbJJREFUAQlIQAKNEVAAGxtwuysBCUhAAhKQgAQUQDMgAQlIQAISkIAEGiOgADY24HZXAhKQgAQkIAEJKIBmQAISkIAEJCABCTRGQAFsbMDtrgQkIAEJSEACElAAzYAEJCABCUhAAhJojIAC2NiA210JSEACEpCABCSgAJoBCUhAAhKQgAQk0BgBBbCxAbe7EpCABCQgAQlIQAE0AxKQgAQkIAEJSKAxAgpgYwNudyUgAQlIQAISkIACaAYkIAEJSEACEpBAYwQUwMYG3O5KQAISkIAEJCABBdAMSEACEpCABCQggcYIKICNDbjdlYAEJCABCUhAAgqgGZCABCQgAQlIQAKNEVAAGxtwuysBCUhAAhKQgAQUQDMgAQlIQAISkIAEGiOgADY24HZXAhKQgAQkIAEJKIBmQAISkIAEJCABCTRGQAFsbMDtrgQkIAEJSEACElAAzYAEJCABCUhAAhJojIAC2NiA210JSEACEpCABCSgAJoBCUhAAhKQgAQk0BgBBbCxAbe7EpCABCQgAQlIQAE0AxKQgAQkIAEJSKAxAgpgYwNudyUgAQlIQAISkMD/B14b1e4wbzYFAAAAAElFTkSuQmCC\" width=\"640\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# You may wish to view the PageRank graphically.\n",
    "# This code will draw a bar chart, for each (numbered) website on the generated internet,\n",
    "# The height of each bar will be the score in the PageRank.\n",
    "# Run this code to see the PageRank for each internet you generate.\n",
    "# Hopefully you should see what you might expect\n",
    "# - there are a few clusters of important websites, but most on the internet are rubbish!\n",
    "%pylab notebook\n",
    "r = pageRank(generate_internet(100), 0.9)\n",
    "plt.bar(arange(r.shape[0]), r);"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "coursera": {
   "course_slug": "linear-algebra-machine-learning",
   "graded_item_id": "Sfbnp",
   "launcher_item_id": "aPxf3"
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}