Restricted Boltzmann Machines/RBM-Recommendation-System.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Recommendation System with RBM"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Recommendation system is an algorithm that recommends items by trying to find users that are similar to each other based on their item ratings."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Table of contents\n",
    "\n",
    "<div class=\"alert alert-block alert-info\">\n",
    "<p><a href=\"#ref1\">- Acquiring the Data</a></p>\n",
    "<p><a href=\"#ref2\">- Loading in the Data</a></p>\n",
    "<p><a href=\"#ref3\">- The Restricted Boltzmann Machine model</a></p>\n",
    "<p><a href=\"#ref4\">- Setting the Model's Parameters</a></p>\n",
    "<p><a href=\"#ref5\">- Recommendation</a></p>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref1\"></a>\n",
    "# Acquiring the Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The datasets we're going to use were acquired by [GroupLens](http://grouplens.org/datasets/movielens/) and contain movies, users and movie ratings by these users."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "With the datasets in place, let's now import the necessary libraries. We will be using [Tensorflow](https://www.tensorflow.org/) and [Numpy](http://www.numpy.org/) to model and initialize our Restricted Boltzmann Machine and [Pandas](http://pandas.pydata.org/pandas-docs/stable/) to manipulate our datasets."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [],
   "source": [
    "import tensorflow as tf\n",
    "# Numpy contains helpful functions for efficient mathematical calculations.\n",
    "import numpy as np\n",
    "# Dataframe manipulation library.\n",
    "import pandas as pd\n",
    "# Graph plotting library.\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref2\"></a>\n",
    "# Loading in the Data\n",
    "\n",
    "Let's begin by loading in our data with Pandas. The `.dat` files containing our data are similar to CSV files, but instead of using the ',' (comma) character to separate entries, it uses '::' (two colons) characters instead. To let Pandas know that it should separate data points at every '::', we have to specify the `sep='::'` parameter when calling the function.\n",
    "\n",
    "Additionally, we also pass the `header=None` parameter due to the fact that our files don't contain any headers.\n",
    "Let's start with the `movies.dat` file and take a look at its structure:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Jumanji (1995)</td>\n",
       "      <td>Adventure|Children's|Fantasy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Grumpier Old Men (1995)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>Waiting to Exhale (1995)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Father of the Bride Part II (1995)</td>\n",
       "      <td>Comedy</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   0                                   1                             2\n",
       "0  1                    Toy Story (1995)   Animation|Children's|Comedy\n",
       "1  2                      Jumanji (1995)  Adventure|Children's|Fantasy\n",
       "2  3             Grumpier Old Men (1995)                Comedy|Romance\n",
       "3  4            Waiting to Exhale (1995)                  Comedy|Drama\n",
       "4  5  Father of the Bride Part II (1995)                        Comedy"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Loading in the movies dataset.\n",
    "movies_df = pd.read_csv('./resources/ml-1m/movies.dat', sep='::', header=None, engine='python')\n",
    "movies_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can do the same for the `ratings.dat` file:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1193</td>\n",
       "      <td>5</td>\n",
       "      <td>978300760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>661</td>\n",
       "      <td>3</td>\n",
       "      <td>978302109</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>914</td>\n",
       "      <td>3</td>\n",
       "      <td>978301968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>3408</td>\n",
       "      <td>4</td>\n",
       "      <td>978300275</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>2355</td>\n",
       "      <td>5</td>\n",
       "      <td>978824291</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   0     1  2          3\n",
       "0  1  1193  5  978300760\n",
       "1  1   661  3  978302109\n",
       "2  1   914  3  978301968\n",
       "3  1  3408  4  978300275\n",
       "4  1  2355  5  978824291"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Loading in the ratings dataset.\n",
    "ratings_df = pd.read_csv('./resources/ml-1m/ratings.dat', sep=\"::\", header=None, engine='python')\n",
    "ratings_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So our `movies_df` variable contains a dataframe that stores a movie's unique ID number, title and genres, while our `ratings_df` variable stores a unique User ID number, a movie ID that the user has watched, the user's rating and when the user rated that movie.\n",
    "\n",
    "Let's now rename the columns in these dataframes so we can better convey their data more intuitively:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "movies_df.columns = ['MovieID', 'Title', 'Genres']\n",
    "ratings_df.columns = ['UserID', 'MovieID', 'Rating', 'Timestamp']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here's our final `movies_df`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Jumanji (1995)</td>\n",
       "      <td>Adventure|Children's|Fantasy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Grumpier Old Men (1995)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>Waiting to Exhale (1995)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Father of the Bride Part II (1995)</td>\n",
       "      <td>Comedy</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MovieID                               Title                        Genres\n",
       "0        1                    Toy Story (1995)   Animation|Children's|Comedy\n",
       "1        2                      Jumanji (1995)  Adventure|Children's|Fantasy\n",
       "2        3             Grumpier Old Men (1995)                Comedy|Romance\n",
       "3        4            Waiting to Exhale (1995)                  Comedy|Drama\n",
       "4        5  Father of the Bride Part II (1995)                        Comedy"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And our final `ratings_df`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>UserID</th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Rating</th>\n",
       "      <th>Timestamp</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1193</td>\n",
       "      <td>5</td>\n",
       "      <td>978300760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>661</td>\n",
       "      <td>3</td>\n",
       "      <td>978302109</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>914</td>\n",
       "      <td>3</td>\n",
       "      <td>978301968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>3408</td>\n",
       "      <td>4</td>\n",
       "      <td>978300275</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>2355</td>\n",
       "      <td>5</td>\n",
       "      <td>978824291</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   UserID  MovieID  Rating  Timestamp\n",
       "0       1     1193       5  978300760\n",
       "1       1      661       3  978302109\n",
       "2       1      914       3  978301968\n",
       "3       1     3408       4  978300275\n",
       "4       1     2355       5  978824291"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ratings_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref3\"></a>\n",
    "# The Restricted Boltzmann Machine model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"https://ibm.box.com/shared/static/o049tx0dsllpbj3b546vuba25qqlzelq.png\" alt=\"RBM Model\"/>\n",
    "\n",
    "The Restricted Boltzmann Machine model has two layers of neurons, one of which is what we call a visible input layer and the other is called a hidden layer. The hidden layer is used to learn features from the information fed through the input layer. For our model, the input is going to contain X neurons, where X is the amount of movies in our dataset. Each of these neurons will possess a normalized rating value varying from 0 to 1 - 0 meaning that a user has not watched the movie and the closer the value is to 1, the more the user likes the movie that neuron's representing. These normalized values, of course, will be extracted and normalized from the ratings dataset.\n",
    "\n",
    "After passing in the input, we train the RBM on it and have the hidden layer learn its features. These features are what we use to reconstruct the input, which in our case, will predict the ratings for movies that the user hasn't watched, which is exactly what we can use to recommend movies!\n",
    "\n",
    "We will now begin to format our dataset to follow the model's expected input."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Formatting the Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First let's see how many movies we have and see if the movie ID's correspond with that value:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3883"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(movies_df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>3878</th>\n",
       "      <td>3948</td>\n",
       "      <td>Meet the Parents (2000)</td>\n",
       "      <td>Comedy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3879</th>\n",
       "      <td>3949</td>\n",
       "      <td>Requiem for a Dream (2000)</td>\n",
       "      <td>Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3880</th>\n",
       "      <td>3950</td>\n",
       "      <td>Tigerland (2000)</td>\n",
       "      <td>Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3881</th>\n",
       "      <td>3951</td>\n",
       "      <td>Two Family House (2000)</td>\n",
       "      <td>Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3882</th>\n",
       "      <td>3952</td>\n",
       "      <td>Contender, The (2000)</td>\n",
       "      <td>Drama|Thriller</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MovieID                       Title          Genres\n",
       "3878     3948     Meet the Parents (2000)          Comedy\n",
       "3879     3949  Requiem for a Dream (2000)           Drama\n",
       "3880     3950            Tigerland (2000)           Drama\n",
       "3881     3951     Two Family House (2000)           Drama\n",
       "3882     3952       Contender, The (2000)  Drama|Thriller"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df.tail()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As it is possible to notice, we have 3883 movies, while our ID's vary from 1 to 3952. Due to this, we won't be able to index movies through their ID since we would get memory indexing errors. To amend this, we can create a column that shows what spot in our list that particular movie is in:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "      <th>List Index</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Jumanji (1995)</td>\n",
       "      <td>Adventure|Children's|Fantasy</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Grumpier Old Men (1995)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>Waiting to Exhale (1995)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Father of the Bride Part II (1995)</td>\n",
       "      <td>Comedy</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MovieID                               Title                        Genres  \\\n",
       "0        1                    Toy Story (1995)   Animation|Children's|Comedy   \n",
       "1        2                      Jumanji (1995)  Adventure|Children's|Fantasy   \n",
       "2        3             Grumpier Old Men (1995)                Comedy|Romance   \n",
       "3        4            Waiting to Exhale (1995)                  Comedy|Drama   \n",
       "4        5  Father of the Bride Part II (1995)                        Comedy   \n",
       "\n",
       "   List Index  \n",
       "0           0  \n",
       "1           1  \n",
       "2           2  \n",
       "3           3  \n",
       "4           4  "
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df['List Index'] = movies_df.index\n",
    "movies_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "With that, let's merge the ratings dataframe into the movies one so we can have the List Index values in both dataframes. Additionally we're also going to drop the Timestamp, Title and Genres columns since we won't be needing it to make recommendations."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>List Index</th>\n",
       "      <th>UserID</th>\n",
       "      <th>Rating</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>9</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>10</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MovieID  List Index  UserID  Rating\n",
       "0        1           0       1       5\n",
       "1        1           0       6       4\n",
       "2        1           0       8       4\n",
       "3        1           0       9       5\n",
       "4        1           0      10       5"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Merging movies_df with ratings_df by MovieID.\n",
    "merged_df = movies_df.merge(ratings_df, on='MovieID')\n",
    "# Dropping unecessary columns.\n",
    "merged_df = merged_df.drop('Timestamp', axis=1).drop('Title', axis=1).drop('Genres', axis=1)\n",
    "# Displaying the result.\n",
    "merged_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's also group up the users by their user IDs and take a look at one of them."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>List Index</th>\n",
       "      <th>Rating</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>UserID</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>21</td>\n",
       "      <td>20</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>104</td>\n",
       "      <td>102</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>260</td>\n",
       "      <td>257</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>6</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "        MovieID  List Index  Rating\n",
       "UserID                             \n",
       "1             1           0       5\n",
       "2            21          20       1\n",
       "3           104         102       4\n",
       "4           260         257       5\n",
       "5             6           5       2"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Group up by UserID.\n",
    "user_group = merged_df.groupby('UserID')\n",
    "user_group.first().head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, we can start formatting the data into input for the RBM. We're going to store the normalized users ratings into a list of lists called `trX`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Amount of users used for training.\n",
    "amount_of_users = 1000\n",
    "# Creating the training list.\n",
    "trX = []\n",
    "# For each user in the group.\n",
    "for user_id, cur_user in user_group:\n",
    "    # Create a temp that stores every movie's rating.\n",
    "    temp = [0]*len(movies_df)\n",
    "    # For each movie in cur_user's movie list.\n",
    "    for num, movie in cur_user.iterrows():\n",
    "        # Divide the rating by 5 and store it.\n",
    "        temp[movie['List Index']] = movie['Rating'] / 5.0\n",
    "    # Now add the list of ratings into the training list.\n",
    "    trX.append(temp)\n",
    "    # Check to see if we finished adding in the amount of users for training.\n",
    "    if amount_of_users == 0:\n",
    "        break\n",
    "    amount_of_users -= 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref4\"></a>\n",
    "# Setting the Model's Parameters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, let's start building the RBM with Tensorflow. We'll begin by first determining the number of hidden layers and then creating placeholder variables for storing the visible layer biases, hidden layer biases and weights that connect the hidden layer with the visible one. We will be arbitrarily setting the amount of hidden layers to 20."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "hidden_units = 20\n",
    "visible_units = len(movies_df)\n",
    "vb = tf.placeholder(\"float\", [visible_units])  # Number of unique movies.\n",
    "hb = tf.placeholder(\"float\", [hidden_units])  # Number of features we're going to learn.\n",
    "W = tf.placeholder(\"float\", [visible_units, hidden_units])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We then move on to creating the visible and hidden layer units and setting their activation functions. In this case, we will be using the `tf.sigmoid` and `tf.relu` functions as nonlinear activations since it's what is usually used in RBM's."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Phase 1: Input Processing.\n",
    "v0 = tf.placeholder(\"float\", [None, visible_units])\n",
    "_h0 = tf.nn.sigmoid(tf.matmul(v0, W) + hb)\n",
    "h0 = tf.nn.relu(tf.sign(_h0 - tf.random_uniform(tf.shape(_h0))))\n",
    "# Phase 2: Reconstruction.\n",
    "_v1 = tf.nn.sigmoid(tf.matmul(h0, tf.transpose(W)) + vb) \n",
    "v1 = tf.nn.relu(tf.sign(_v1 - tf.random_uniform(tf.shape(_v1))))\n",
    "h1 = tf.nn.sigmoid(tf.matmul(v1, W) + hb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "Now we set the RBM training parameters and functions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Learning rate.\n",
    "alpha = 1.0\n",
    "# Create the gradients.\n",
    "w_pos_grad = tf.matmul(tf.transpose(v0), h0)\n",
    "w_neg_grad = tf.matmul(tf.transpose(v1), h1)\n",
    "# Calculate the Contrastive Divergence.\n",
    "CD = (w_pos_grad - w_neg_grad) / tf.to_float(tf.shape(v0)[0])\n",
    "# Create methods to update the weights and biases.\n",
    "update_w = W + alpha * CD\n",
    "update_vb = vb + alpha * tf.reduce_mean(v0 - v1, 0)\n",
    "update_hb = hb + alpha * tf.reduce_mean(h0 - h1, 0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Set the error function, which in this case will be the Mean Absolute Error Function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "err = v0 - v1\n",
    "err_sum = tf.reduce_mean(err * err)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We also have to initialize our variables. Thankfully, NumPy has a handy `zeros` function for this."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Current weight.\n",
    "cur_w = np.zeros([visible_units, hidden_units], np.float32)\n",
    "# Current visible unit biases.\n",
    "cur_vb = np.zeros([visible_units], np.float32)\n",
    "# Current hidden unit biases.\n",
    "cur_hb = np.zeros([hidden_units], np.float32)\n",
    "# Previous weight.\n",
    "prv_w = np.zeros([visible_units, hidden_units], np.float32)\n",
    "# Previous visible unit biases.\n",
    "prv_vb = np.zeros([visible_units], np.float32)\n",
    "# Previous hidden unit biases.\n",
    "prv_hb = np.zeros([hidden_units], np.float32)\n",
    "sess = tf.Session()\n",
    "sess.run(tf.global_variables_initializer())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we train the RBM with 15 epochs with each epoch using 10 batches with size 100. After training, we print out a graph with the error by epoch."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.12330387\n",
      "0.082664765\n",
      "0.06800283\n",
      "0.060190666\n",
      "0.050763827\n",
      "0.047311626\n",
      "0.045593128\n",
      "0.044372823\n",
      "0.043658838\n",
      "0.04265177\n",
      "0.04241857\n",
      "0.041740485\n",
      "0.041191548\n",
      "0.04077561\n",
      "0.040422566\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEKCAYAAADjDHn2AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3XucXHV9//HXZ2b2nuwl92ST3QQJl4QQshuCVMQqlkKrRNpQQK2oWGp/au2vtEr1h1Jara1WrZUHFUFBQalQhbSgiGBLWwGzCZCQhEAI5H5Pdjd739n9/P6Ys8tks7szm+zsmcv7+XjMY86cOWfnvbCb957zPRdzd0REREYTCTuAiIhkP5WFiIikpLIQEZGUVBYiIpKSykJERFJSWYiISEoqCxERSUllISIiKaksREQkpVjYAcbLtGnTfP78+WHHEBHJKWvXrj3k7tNTLZc3ZTF//nyamprCjiEiklPMbHs6y2k3lIiIpKSyEBGRlFQWIiKSkspCRERSUlmIiEhKKgsREUlJZSEiIikVfFk0d/TwT794hRd3t4QdRUQka+XNSXknKxoxvv7EywCcU1sVchoRkexU8FsWk0uLOHPmZNbtOBp2FBGRrFXwZQGwrK6GdTuO0t/vYUcREclKKgugsb6GY11xXj3YFnYUEZGslNGyMLPLzGyLmW01s5uGef9iM1tnZnEzW5U0/zwze9rMNprZejO7OpM5G+qqAVi7XbuiRESGk7GyMLMocBtwObAIuNbMFg1ZbAfwQeAHQ+Z3AB9w98XAZcDXzaw6U1kXTKugprxI4xYiIiPI5NFQK4Ct7r4NwMzuB1YCmwYWcPfXg/f6k1d095eTpveY2QFgOtCciaBmRkNdjbYsRERGkMndULXAzqTXu4J5Y2JmK4Bi4NVxyjWshvoaXj3YTnNHTyY/RkQkJ2X1ALeZzQa+D3zI3fuHef8GM2sys6aDBw+e0mc11NUA8NzOjGy8iIjktEyWxW5gXtLrucG8tJhZJfAI8Fl3f2a4Zdz9Dndf7u7Lp09PeVfAUS2dV0U0YqzTrigRkRNksizWAAvNbIGZFQPXAKvTWTFY/ifA99z9wQxmHFReHOPs2To5T0RkOBkrC3ePAx8HHgM2Az9y941mdquZXQFgZueb2S7gKuBbZrYxWP0PgIuBD5rZ88HjvExlHdBQV8PzO5rp08l5IiLHyei1odz9UeDRIfM+lzS9hsTuqaHr3Qvcm8lsw2msr+F7T29ny75jLJpTOdEfLyKStbJ6gHuiDQxyr9WuKBGR46gsksytKWPapBKe0yC3iMhxVBZJzIzG+moNcouIDKGyGKKhrobXD3dwqK077CgiIllDZTFEY31wct4OnZwnIjJAZTHEObVVFEVN14kSEUmishiitCjKojlVGrcQEUmishhGY10N63c109t3wuWoREQKkspiGA311XT19rN5b2vYUUREsoLKYhgDg9y6qKCISILKYhizq8qYXVXKWh0RJSICqCxG1FBfoy0LEZGAymIEDXU17G7uZH9rV9hRRERCp7IYQUNdNaBxCxERUFmMaPGcKopjEZ2cJyKCymJExbEI59bq5DwREVBZjKqxvoYXd7fSHe8LO4qISKhUFqNYVldDT18/L+7WyXkiUthUFqNoqE8Mcj+nXVEiUuBUFqOYMbmUeVPKNMgtIgVPZZFCQ10N63Ycxd3DjiIiEhqVRQqN9TXsb+1md3Nn2FFEREKjskihoS64qKCuEyUiBUxlkcJZsyZTVhTVmdwiUtBUFinEohGWztPJeSJS2FQWaWioq2HTnlY6e3RynogUJpVFGhrra4j3O+t3adxCRAqTyiINyzTILSIFTmWRhikVxZw2rUIn54lIwVJZpGlZXQ3P6eQ8ESlQKos0NdRXc7i9hx1HOsKOIiIy4VQWaWqsT4xbaFeUiBQilUWaFs6YzKSSmM63EJGCpLJIUzRiLKurZu12HRElIoVHZTEGy+pq2LKvlbbueNhRREQmlMpiDBrqqul3WL9TWxciUlhUFmMwcHKeBrlFpNCoLMagqqyIhTMmaZBbRAqOymKMGutrWLejmf5+nZwnIoUjo2VhZpeZ2RYz22pmNw3z/sVmts7M4ma2ash715nZK8HjukzmHIuGuhpaOnvZdqg97CgiIhMmY2VhZlHgNuByYBFwrZktGrLYDuCDwA+GrDsF+DxwAbAC+LyZ1WQq61g0BCfn6WZIIlJIMrllsQLY6u7b3L0HuB9YmbyAu7/u7uuB/iHr/jbwuLsfcfejwOPAZRnMmrbTplVQVVakcQsRKSiZLItaYGfS613BvEyvm1GR4OQ8lYWIFJKcHuA2sxvMrMnMmg4ePDhhn9tYV8PL+9to6eydsM8UEQlTJstiNzAv6fXcYN64revud7j7cndfPn369JMOOlYD4xbP6+Q8ESkQmSyLNcBCM1tgZsXANcDqNNd9DLjUzGqCge1Lg3lZYem8aiKmk/NEpHBkrCzcPQ58nMQ/8puBH7n7RjO71cyuADCz881sF3AV8C0z2xisewT4GxKFswa4NZiXFSaVxDhzViXPadxCRApELJNf3N0fBR4dMu9zSdNrSOxiGm7d7wDfyWS+U9FQV83Dz++hr9+JRizsOCIiGZXTA9xhaqyvoa07zisHjoUdRUQk41QWJ6mhbuDkPA1yi0j+U1mcpPqp5UytKNYgt4gUBJXFSTIzltXVaJBbRAqCyuIUNNbXsO1QO0fae8KOIiKSUSqLU9BQVw2grQsRyXsqi1Nw7txqYhHTuIWI5D2VxSkoK46yaE6lLiooInlPZXGKGupqeGFnC/G+oVdZFxHJHyqLU9RQX0Nnbx8v7dPJeSKSv1QWp2hgkFu7okQkn6ksTlFtdRkzJpdokFtE8prK4hSZGY31NdqyEJG8prIYBw11New80smBY11hRxERyQiVxTgYuHOeLiooIvlKZTEOzqmtpDga0ZncIpK3VBbjoCQW5ZzaSg1yi0jeUlmMk4a6GtbvbqEnrpPzRCT/qCzGSUN9DT3xfjbuaQk7iojIuFNZjJPGgUHuHRrkFpH8o7IYJzMrS6mtLmOdxi1EJA+pLMZRg07OE5E8pbIYRw111ext6WJPc2fYUURExpXKYhw11A2MW2jrQkTyi8piHC2aU0lpUURncotI3lFZjKOiaIRza6tZqy0LEckzKotx1lBfw6Y9LXT19oUdRURk3KgsxllDXTW9fc6G3To5T0TyR8qyMLOomX1lIsLkgzeuQKtdUSKSP1KWhbv3ARdNQJa8MG1SCfVTy3VElIjklViayz1nZquBB4D2gZnu/uOMpMpxDXU1/Pcrh3B3zCzsOCIipyzdMYtS4DDwDuDdweNdmQqV6xrqazjU1s2uozo5T0TyQ1pbFu7+oUwHyScNddUArN1+lHlTykNOIyJy6tLasjCzuWb2EzM7EDz+zczmZjpcrjpz5mQqiqMatxCRvJHubqjvAquBOcHj34N5MoxYNMLSedW6c56I5I10y2K6u3/X3ePB425gegZz5byGuhpe2neM9u542FFERE5ZumVx2MzeH5xzETWz95MY8JYRvP2s6fT1O3c8tS3sKCIipyzdsvgw8AfAPmAvsArQoPcoGuuncMXSOdz+n6/y6sG2sOOIiJyStM7gBn7P3a9w9+nuPsPd3+PuOyYgX077f+86m5KiCDc/9CLuHnYcEZGTlu4Z3NeezBc3s8vMbIuZbTWzm4Z5v8TM/jV4/1kzmx/MLzKze8xsg5ltNrO/OpnPD9uMyaXcdPlZ/OrVw/zkud1hxxEROWnp7ob6XzP7ppm91cwaBh6jrRBskdwGXA4sAq41s0VDFrseOOrupwNfA/4+mH8VUOLuS4BG4I8HiiTXXHt+HQ111Xzhkc00d/SEHUdE5KSkWxbnAYuBW4F/DB6pLi64Atjq7tvcvQe4H1g5ZJmVwD3B9IPAJZa4PoYDFWYWA8qAHqA1zaxZJRIxvnDlEpo7e/nST18KO46IyElJZ8wiAtzu7m8f8nhHilVrgZ1Jr3cF84Zdxt3jQAswlURxtJMYTN8BfMXdj6TzDWWjs2dX8pGLFnD/mp38+rWc/TZEpIClM2bRD3xqArIkWwH0kTgBcAFwo5mdNnQhM7vBzJrMrOngwYMTHHFsPvnOhdRWl/HZn2ygJ94fdhwRkTFJdzfUL8zsL8xsnplNGXikWGc3MC/p9dxg3rDLBLucqkicv/Fe4Gfu3uvuB4D/BZYP/QB3v8Pdl7v78unTs/scwfLiGLeuXMwrB9r49n/r3AsRyS3plsXVwMeAp4C1waMpxTprgIVmtsDMioFrSFwyJNlq4LpgehXwpCeOMd1B4gq3mFkF8GYg53f4X3L2TC5bPItvPPEKOw53hB1HRCRtaZWFuy8Y5nHCbqEh68SBjwOPAZuBH7n7RjO71cyuCBa7C5hqZluBPwcGDq+9DZhkZhtJlM533X392L+97HPLFYspika4+WGdeyEiuWPUsjCzTyVNXzXkvS+m+uLu/qi7n+Hub3L3LwTzPufuq4PpLne/yt1Pd/cV7r4tmN8WzF/s7ovc/csn881lo1lVpdx46Rn818sHeWTD3rDjiIikJdWWxTVJ00NPjLtsnLMUjA9cOJ8ltVX89b9vorWrN+w4IiIppSoLG2F6uNeSpmjE+OKVSzjc1s1XHtsSdhwRkZRSlYWPMD3caxmDJXOr+MCF8/n+M9t5fmdz2HFEREaVqiyWmlmrmR0Dzg2mB14vmYB8ee3GS89gxuQSPvPjDcT7dO6FiGSvUcvC3aPuXunuk909FkwPvC6aqJD5anJpEbe8ezGb9rZy969eDzuOiMiI0j3PQjLksnNmcclZM/jq4y+zu7kz7DgiIsNSWYTMzPjrlYtxh1tWbww7jojIsFQWWWBuTTl/9s6FPL5pPz/fuC/sOCIiJ1BZZIkPX7SAs2ZN5pbVG2nvjocdR0TkOCqLLFEUjfCFK5ewt7WLrz3+cthxRESOo7LIIo31NVy7oo7v/up1XtzdEnYcEZFBKoss8+nfPoua8iI++5MN9PXrvEcRyQ4qiyxTVV7Eze9axAu7Wrjv2e1hxxERAVQWWemKpXN468JpfPlnW9jf2hV2HBERlUU2MjP+ZuU5dPf1c+t/bAo7joiIyiJbzZ9WwSfefjqPrN/Lf245EHYcESlwKossdsPbTuNN0yu4+eEX6ezpCzuOiBQwlUUWK4lF+cKVS9h5pJN/fvKVsOOISAFTWWS5N582lVWNc7njqW28vP9Y2HFEpECpLHLAZ37nbCaXxvjMjzfQr3MvRCQEKoscMKWimM/8ztk0bT/Kj5p2hh1HRAqQyiJHrGqcywULpvB3P32JQ23dYccRkQKjssgRZsYXrlxCR0+cz6/eqEuBiMiEUlnkkNNnTOLP3nkGj6zfy5/cu5aOHl3KXEQmhsoix3zs7afz+Xcv4heb93P1t57hgC4HIiITQGWRgz70lgV8+wPLefVgG++57X95aV9r2JFEJM+pLHLUJWfP5Ed/fCF97qy6/WldEkREMkplkcPOqa3ioY+9hbop5Vx/TxPff0aXNBeRzFBZ5LjZVWU88NELedsZ07n5oRf52//YpCOlRGTcqSzyQEVJjG9/YDkf/I353Pk/r+lIKREZdyqLPBGNGLdcsVhHSolIRqgs8szQI6U279WRUiJy6lQWeSj5SKmr/kVHSonIqVNZ5CkdKSUi40llkcd0pJSIjBeVRZ4beqTUR3WklIicBJVFAUg+UuqJ4Eip/TpSSkTGQGVRQHSklIicLJVFgRk4UqrfnVW3/0pHSolIWjJaFmZ2mZltMbOtZnbTMO+XmNm/Bu8/a2bzk94718yeNrONZrbBzEozmbWQnFNbxcMfu4j6qRV8+O41OlJKRFLKWFmYWRS4DbgcWARca2aLhix2PXDU3U8Hvgb8fbBuDLgX+Ki7LwZ+E+jNVNZCNKuqlAc+eiG/eeYMbn7oRf5GR0qJyCgyuWWxAtjq7tvcvQe4H1g5ZJmVwD3B9IPAJWZmwKXAend/AcDdD7t7XwazFqTkI6Xu+p/X+NP7nyPe1x92LBHJQpksi1pgZ9LrXcG8YZdx9zjQAkwFzgDczB4zs3Vm9qnhPsDMbjCzJjNrOnjw4Lh/A4Vg4Eipmy4/i0fW7+UvH1yvLQwROUEs7AAjiAEXAecDHcATZrbW3Z9IXsjd7wDuAFi+fLn+hTsFH33bm+iN9/OPj79MSSzCF69cQiRiYccSkSyRybLYDcxLej03mDfcMruCcYoq4DCJrZCn3P0QgJk9CjQATyAZ84lLFtId7+ebv9xKSSzCLVcsJrFXUEQKXSZ3Q60BFprZAjMrBq4BVg9ZZjVwXTC9CnjS3R14DFhiZuVBibwN2JTBrBK48dIz+MhFC7jn6e383U9fIvG/Q0QKXca2LNw9bmYfJ/EPfxT4jrtvNLNbgSZ3Xw3cBXzfzLYCR0gUCu5+1My+SqJwHHjU3R/JVFZ5g5nx2d89m+54P3c8tY3SWIQ/v/TMsGOJSMgyOmbh7o8Cjw6Z97mk6S7gqhHWvZfE4bMywcyMv75iMT3xfr7x5FZKiqJ87O2nhx1LREKUrQPcErJIxPji7y2hO97Hlx/bQkkswkfeelrYsUQkJCoLGVE0YnzlqqX09PXzt49spiQW4Q8vnB92LBEJgcpCRhWLRvj61cvoia/l5oc3UhKL8gfnz0u9oojkFV1IUFIqjkW47X0NXHzGdD794/U89NzQI6BFJN+pLCQtJbEo33p/IxcsmMKND7zAoxv2hh1JRCaQykLSVlYc5a7rzue8edX86Q+f4xeb9ocdSUQmiMpCxqSiJMZ3P3Q+i+ZU8n/uW8dTL+uaXCKFQGUhY1ZZWsT3PryCN82YxB99r4mnXz0cdiQRyTCVhZyU6vJi7r1+BXVTyrn+njWs3X4k7EgikkEqCzlpUyeVcN9HLmBmZSkf/M4a1u9qDjuSiGSIykJOyYzKUu77yAVUlRfxh3f9mk17WsOOJCIZoLKQUzanuowf/tGbKS+O8v67nuWV/cfCjiQi40xlIeNi3pRyfvBHbyYaMd5757O8dqg97EgiMo5UFjJuFkyr4AcfuYC+fue9336GnUc6wo4kIuNEZSHjauHMydx7/QV09PTx3jufYU9zZ9iRRGQcqCxk3C2aU8n3r19Bc3sv77vzWdZuP6o77onkOJWFZMS5c6u5+8Pnc6itm9+//Vdc8tX/4vb/fJX9rV1hRxORk2D58hff8uXLvampKewYMkRbd5xH1+/lgbU7WfP6USIGbztjOlctn8clZ8+gJBYNO6JIQTOzte6+POVyKguZKK8daufBtTv5t7W72dfaRXV5Ee85r5ZVjXM5p7Yq7HgiBUllIVmrr9/5n62HeKBpJz/ftJ+eeD9nz65kVeNc3nPeHKZOKgk7okjBUFlITmjp6GX1C7t5YO0u1u9qoShqvOOsGVzVOI/fPHM6saiG1UQySWUhOWfLvmM80LSTh57fzaG2HqZNKuH3Gmq5qnEuC2dODjueSF5SWUjO6u3r55cvHeCBtbv45UsHiPc7S+dVc1XjXN69dA5VZUVhRxTJGyoLyQuH2rp56LndPNC0iy37j1ESi/Dbi2dxZUMty+ZVU11eHHZEkZymspC84u68uLuVB9bu5OHn99DS2QtAbXUZi+ZUsmh25eDz3JoyzCzkxCK5QWUheaurt49fv3aETXtb2bSnlY17Wth2qJ2BH+XK0lhQHFUsmlPJ4jmVnD5jEkUaLBc5QbplEZuIMCLjqbQoysVnTOfiM6YPzuvoibNl37GkAmnlB7/eTldvPwDF0QgLZ05i0exEeSyaU8XZsyczuVTjHyLpUFlIXigvjrGsroZldTWD8/r6ndcOtbNpb2LrY9OeVp4MBs4H1E0pT5RHsBvrjJmTmVNdRjSi3VgiyVQWkreiEeP0GZM4fcYkrlg6B0iMfRw81s3GPa2DWyGb9rby0xf3Da5XFDVqq8uom1pB3ZQy6qaUB48K6qaWM6lEvzZSePRTLwXFzJhRWcqMylLeftaMwflt3XE2723l1QNt7DjSwfYjHew80sH6Xc00d/Qe9zWmVBQzb0o59YMlUk7d1MTzrMpSItoqkTykshABJpXEOH/+FM6fP+WE91o6e9l5pCNRIocTzzuPdPD8zmYe2bCXvv43DhIpjkaYe9zWSOIxs7KUKRXF1FQUU1Ec1dFaknNUFiIpVJUVUVVbNezFDnv7+tnb3BVsjbQPFsn2wx2sff0ox7rjJ6xTHI1QU1FETXnxYIFMKR94Lko8VxQPvj+lopjSIl2dV8KlshA5BUXRSGIX1NRyLmLace+5Oy2dvWw/3MGhtm6OtPdwtKOHI+29HG3v4UhHD0fbe9i8p5UjHT20dPYy0pHsZUXRoFiSSqa8mFlVpcyuKmV2VRmzq0qZUVmiy75LRqgsRDLEzKguL077LPN4Xz8tnb2DhfJGufQcVy5HOhIFdLitm/aevhO+zrRJJcyuKmVWVSlzqkqZFRTJQKnMrFKhyNipLESyRCwaYeqkkjFdov1YVy/7WrrY29I1+Ly3pZO9LV3sONzBM9sOc6zrxF1h0yYltkpmVQZFUp0ok1mVZcHWSYTiaITiWISi4DkWMY21FDCVhUgOm1xaxOTSolGvytvWHWdfUCZ7WjqTyqWTXUc7WPP6kcHLp4zGLLHb7Y0SsTfKJBqhJKlYBp6Tly0vjlFdXsSUisTWVk15YpdadfBcroH/rKayEMlzk0pig+ebjKSjJz5YIofauumO99Pb109PPPEYnO7zIa+DR9K83r5+2rvjb3yNvn564057d3zYAf8BxdHIYHEMPNdUFA0WS+I5ebqIqrIi3fNkgqgsRITy4hinTZ/EadNHLpTx0NvXT3NHL80dPRztSIzPHDfdPjCvl1cPtnF0e2LZeP/I17CbXBJjcmmMyrKixHNp0XGvJ5cWnTCvsrSIyuC90qKItmjSkNGyMLPLgH8CosCd7v6lIe+XAN8DGoHDwNXu/nrS+3XAJuAWd/9KJrOKSOYVRSNMn1zC9Mnpj8u4O23dcZqDQjk6UDbtienWrl5aO+Mc60pM72vt4pUDcVq7ejnWFT/uPJjhM1lQKLFgt16ifCpKYlQUxygvjlJeHKOiJEpZcfS4eeUlya+jVJTEKInlZ/lkrCzMLArcBvwWsAtYY2ar3X1T0mLXA0fd/XQzuwb4e+DqpPe/Cvw0UxlFJPuZ2eDYzLwp5WNa193p6OnjWNdAeSSKZaBIBp87j3998GA7HT19dPTEae/poyfen/ZnRiyxpTZQHmVFUSpKooPzyoqilAbPZUWJAiodnI5QGjvx/bKiYJniKKWxSCi73jK5ZbEC2Oru2wDM7H5gJYkthQErgVuC6QeBb5qZubub2XuA14D2DGYUkTxmZokthJIYs6pKT/rrxPv66ejto6M7USAdPX20d8cH57X3xOnsSTwnlnmjaDp74rR399Hc0cPu5j66ehOPzp4+Onv7SLHhM6ziaITSoshg0Zw7t5p/vnbZSX9/6chkWdQCO5Ne7wIuGGkZd4+bWQsw1cy6gE+T2Cr5iwxmFBFJKRaNUBmNUDnOl7R3d3r6+unq7T+uQDp7++hKmu7sCQqmt4+u3v4T5tVWl41rruFk6wD3LcDX3L1ttH1/ZnYDcANAXV3dxCQTERknZkZJLEpJLJr195bPZFnsBuYlvZ4bzBtumV1mFgOqSAx0XwCsMrN/AKqBfjPrcvdvJq/s7ncAd0DiTnkZ+S5ERCSjZbEGWGhmC0iUwjXAe4cssxq4DngaWAU86Yn7vL51YAEzuwVoG1oUIiIycTJWFsEYxMeBx0gcOvsdd99oZrcCTe6+GrgL+L6ZbQWOkCgUERHJMuYjXeYyxyxfvtybmprCjiEiklPMbK27L0+1nM6TFxGRlFQWIiKSkspCRERSUlmIiEhKeTPAbWYHge2n8CWmAYfGKU6m5VJWyK28uZQVcitvLmWF3Mp7Klnr3X16qoXypixOlZk1pXNEQDbIpayQW3lzKSvkVt5cygq5lXcismo3lIiIpKSyEBGRlFQWb7gj7ABjkEtZIbfy5lJWyK28uZQVcitvxrNqzEJERFLSloWIiKRU8GVhZpeZ2RYz22pmN4WdZzRmNs/Mfmlmm8xso5l9MuxMqZhZ1MyeM7P/CDtLKmZWbWYPmtlLZrbZzC4MO9NIzOz/Bj8DL5rZD83s5G8DlwFm9h0zO2BmLybNm2Jmj5vZK8FzTZgZB4yQ9cvBz8F6M/uJmVWHmTHZcHmT3rvRzNzMpo335xZ0WSTdJ/xyYBFwrZktCjfVqOLAje6+CHgz8LEszwvwSWBz2CHS9E/Az9z9LGApWZrbzGqBPwWWu/s5JK7qnG1XbL4buGzIvJuAJ9x9IfBE8Dob3M2JWR8HznH3c4GXgb+a6FCjuJsT82Jm84BLgR2Z+NCCLguS7hPu7j3AwH3Cs5K773X3dcH0MRL/mNWGm2pkZjYX+F3gzrCzpGJmVcDFJC6bj7v3uHtzuKlGFQPKgpuGlQN7Qs5zHHd/isRtB5KtBO4Jpu8B3jOhoUYwXFZ3/7m7x4OXz5C4eVtWGOG/LcDXgE8BGRmILvSyGO4+4Vn7j28yM5sPLAOeDTfJqL5O4oe3P+wgaVgAHAS+G+w2u9PMKsIONRx33w18hcRfkHuBFnf/ebip0jLT3fcG0/uAmWGGGYMPAz8NO8RozGwlsNvdX8jUZxR6WeQkM5sE/BvwZ+7eGnae4ZjZu4AD7r427CxpigENwO3uvgxoJ3t2kxwn2Ne/kkTBzQEqzOz94aYam+COmFl/KKaZfZbE7t/7ws4yEjMrBz4DfC6Tn1PoZZHOfcKzipkVkSiK+9z9x2HnGcVbgCvM7HUSu/feYWb3hhtpVLuAXe4+sKX2IInyyEbvBF5z94Pu3gv8GPiNkDOlY7+ZzQYIng+EnGdUZvZB4F3A+zy7zzF4E4k/HF4Ift/mAuvMbNZ4fkihl8XgfcLNrJjEIOHqkDONyMyMxD71ze7+1bDzjMbd/8rd57r7fBL/XZ9096z969fd9wE7zezMYNYlwKYQI41mB/BmMysPfiYuIUsH44dYDVwXTF8HPBxillGZ2WWmBkpxAAACRUlEQVQkdqFe4e4dYecZjbtvcPcZ7j4/+H3bBTQEP9PjpqDLIhjAGrhP+GbgR+6+MdxUo3oL8Ick/kp/Pnj8Ttih8sgngPvMbD1wHvDFkPMMK9j6eRBYB2wg8XucVWcbm9kPgaeBM81sl5ldD3wJ+C0ze4XE1tGXwsw4YISs3wQmA48Hv2f/EmrIJCPkzfznZvfWlYiIZIOC3rIQEZH0qCxERCQllYWIiKSkshARkZRUFiIikpLKQmQMzKwv6bDl58fzSsVmNn+4K4mKZINY2AFEckynu58XdgiRiaYtC5FxYGavm9k/mNkGM/u1mZ0ezJ9vZk8G90V4wszqgvkzg/skvBA8Bi7XETWzbwf3qvi5mZWF9k2JJFFZiIxN2ZDdUFcnvdfi7ktInP379WDePwP3BPdFuA/4RjD/G8B/uftSEtegGrhywELgNndfDDQDv5/h70ckLTqDW2QMzKzN3ScNM/914B3uvi242OM+d59qZoeA2e7eG8zf6+7TzOwgMNfdu5O+xnzg8eDmQJjZp4Eid//bzH9nIqPTloXI+PERpseiO2m6D40rSpZQWYiMn6uTnp8Opn/FG7c8fR/w38H0E8CfwOB9yqsmKqTIydBfLSJjU2Zmzye9/pm7Dxw+WxNcsbYbuDaY9wkSd9/7SxJ34vtQMP+TwB3BFUP7SBTHXkSylMYsRMZBMGax3N0PhZ1FJBO0G0pERFLSloWIiKSkLQsREUlJZSEiIimpLEREJCWVhYiIpKSyEBGRlFQWIiKS0v8H0CYrh3el1NAAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "epochs = 15\n",
    "batch_size = 100\n",
    "errors = []\n",
    "for i in range(epochs):\n",
    "    for start, end in zip(range(0, len(trX), batch_size), range(batch_size, len(trX), batch_size)):\n",
    "        batch = trX[start:end]\n",
    "        cur_w = sess.run(update_w, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        cur_vb = sess.run(update_vb, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        cur_hb = sess.run(update_hb, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        prv_w = cur_w\n",
    "        prv_vb = cur_vb\n",
    "        prv_hb = cur_hb\n",
    "    errors.append(sess.run(err_sum, feed_dict={v0: trX, W: cur_w, vb: cur_vb, hb: cur_hb}))\n",
    "    print(errors[-1])\n",
    "plt.plot(errors)\n",
    "plt.ylabel('Error')\n",
    "plt.xlabel('Epoch')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref5\"></a>\n",
    "## Recommendation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can now predict movies that an arbitrarily selected user might like. This can be accomplished by feeding in the user's watched movie preferences into the RBM and then reconstructing the input. The values that the RBM gives us will attempt to estimate the user's preferences for movies that he or she hasn't watched based on the preferences of the users that the RBM was trained on."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Selecting the input user.\n",
    "input_user = [trX[75]]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Feeding in the user and reconstructing the input.\n",
    "hh0 = tf.nn.sigmoid(tf.matmul(v0, W) + hb)\n",
    "vv1 = tf.nn.sigmoid(tf.matmul(hh0, tf.transpose(W)) + vb)\n",
    "feed = sess.run(hh0, feed_dict={v0: input_user, W: prv_w, hb: prv_hb})\n",
    "rec = sess.run(vv1, feed_dict={hh0: feed, W: prv_w, vb: prv_vb})"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we can list the 20 most recommended movies for our mock user by sorting it by their scores given by our model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "      <th>List Index</th>\n",
       "      <th>Recommendation Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>589</th>\n",
       "      <td>593</td>\n",
       "      <td>Silence of the Lambs, The (1991)</td>\n",
       "      <td>Drama|Thriller</td>\n",
       "      <td>589</td>\n",
       "      <td>0.838450</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>604</th>\n",
       "      <td>608</td>\n",
       "      <td>Fargo (1996)</td>\n",
       "      <td>Crime|Drama|Thriller</td>\n",
       "      <td>604</td>\n",
       "      <td>0.806462</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>315</th>\n",
       "      <td>318</td>\n",
       "      <td>Shawshank Redemption, The (1994)</td>\n",
       "      <td>Drama</td>\n",
       "      <td>315</td>\n",
       "      <td>0.788866</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2789</th>\n",
       "      <td>2858</td>\n",
       "      <td>American Beauty (1999)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>2789</td>\n",
       "      <td>0.787612</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>523</th>\n",
       "      <td>527</td>\n",
       "      <td>Schindler's List (1993)</td>\n",
       "      <td>Drama|War</td>\n",
       "      <td>523</td>\n",
       "      <td>0.770072</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2327</th>\n",
       "      <td>2396</td>\n",
       "      <td>Shakespeare in Love (1998)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "      <td>2327</td>\n",
       "      <td>0.724269</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>296</td>\n",
       "      <td>Pulp Fiction (1994)</td>\n",
       "      <td>Crime|Drama</td>\n",
       "      <td>293</td>\n",
       "      <td>0.680893</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1959</th>\n",
       "      <td>2028</td>\n",
       "      <td>Saving Private Ryan (1998)</td>\n",
       "      <td>Action|Drama|War</td>\n",
       "      <td>1959</td>\n",
       "      <td>0.648980</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1575</th>\n",
       "      <td>1617</td>\n",
       "      <td>L.A. Confidential (1997)</td>\n",
       "      <td>Crime|Film-Noir|Mystery|Thriller</td>\n",
       "      <td>1575</td>\n",
       "      <td>0.645957</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "      <td>0</td>\n",
       "      <td>0.615498</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1245</th>\n",
       "      <td>1265</td>\n",
       "      <td>Groundhog Day (1993)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "      <td>1245</td>\n",
       "      <td>0.601301</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1656</th>\n",
       "      <td>1704</td>\n",
       "      <td>Good Will Hunting (1997)</td>\n",
       "      <td>Drama</td>\n",
       "      <td>1656</td>\n",
       "      <td>0.592880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2693</th>\n",
       "      <td>2762</td>\n",
       "      <td>Sixth Sense, The (1999)</td>\n",
       "      <td>Thriller</td>\n",
       "      <td>2693</td>\n",
       "      <td>0.586704</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2928</th>\n",
       "      <td>2997</td>\n",
       "      <td>Being John Malkovich (1999)</td>\n",
       "      <td>Comedy</td>\n",
       "      <td>2928</td>\n",
       "      <td>0.520358</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>108</th>\n",
       "      <td>110</td>\n",
       "      <td>Braveheart (1995)</td>\n",
       "      <td>Action|Drama|War</td>\n",
       "      <td>108</td>\n",
       "      <td>0.513054</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1195</th>\n",
       "      <td>1213</td>\n",
       "      <td>GoodFellas (1990)</td>\n",
       "      <td>Crime|Drama</td>\n",
       "      <td>1195</td>\n",
       "      <td>0.511359</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1337</th>\n",
       "      <td>1358</td>\n",
       "      <td>Sling Blade (1996)</td>\n",
       "      <td>Drama|Thriller</td>\n",
       "      <td>1337</td>\n",
       "      <td>0.491497</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>352</th>\n",
       "      <td>356</td>\n",
       "      <td>Forrest Gump (1994)</td>\n",
       "      <td>Comedy|Romance|War</td>\n",
       "      <td>352</td>\n",
       "      <td>0.486228</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2255</th>\n",
       "      <td>2324</td>\n",
       "      <td>Life Is Beautiful (La Vita � bella) (1997)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>2255</td>\n",
       "      <td>0.468796</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1372</th>\n",
       "      <td>1393</td>\n",
       "      <td>Jerry Maguire (1996)</td>\n",
       "      <td>Drama|Romance</td>\n",
       "      <td>1372</td>\n",
       "      <td>0.464281</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MovieID                                       Title  \\\n",
       "589       593            Silence of the Lambs, The (1991)   \n",
       "604       608                                Fargo (1996)   \n",
       "315       318            Shawshank Redemption, The (1994)   \n",
       "2789     2858                      American Beauty (1999)   \n",
       "523       527                     Schindler's List (1993)   \n",
       "2327     2396                  Shakespeare in Love (1998)   \n",
       "293       296                         Pulp Fiction (1994)   \n",
       "1959     2028                  Saving Private Ryan (1998)   \n",
       "1575     1617                    L.A. Confidential (1997)   \n",
       "0           1                            Toy Story (1995)   \n",
       "1245     1265                        Groundhog Day (1993)   \n",
       "1656     1704                    Good Will Hunting (1997)   \n",
       "2693     2762                     Sixth Sense, The (1999)   \n",
       "2928     2997                 Being John Malkovich (1999)   \n",
       "108       110                           Braveheart (1995)   \n",
       "1195     1213                           GoodFellas (1990)   \n",
       "1337     1358                          Sling Blade (1996)   \n",
       "352       356                         Forrest Gump (1994)   \n",
       "2255     2324  Life Is Beautiful (La Vita � bella) (1997)   \n",
       "1372     1393                        Jerry Maguire (1996)   \n",
       "\n",
       "                                Genres  List Index  Recommendation Score  \n",
       "589                     Drama|Thriller         589              0.838450  \n",
       "604               Crime|Drama|Thriller         604              0.806462  \n",
       "315                              Drama         315              0.788866  \n",
       "2789                      Comedy|Drama        2789              0.787612  \n",
       "523                          Drama|War         523              0.770072  \n",
       "2327                    Comedy|Romance        2327              0.724269  \n",
       "293                        Crime|Drama         293              0.680893  \n",
       "1959                  Action|Drama|War        1959              0.648980  \n",
       "1575  Crime|Film-Noir|Mystery|Thriller        1575              0.645957  \n",
       "0          Animation|Children's|Comedy           0              0.615498  \n",
       "1245                    Comedy|Romance        1245              0.601301  \n",
       "1656                             Drama        1656              0.592880  \n",
       "2693                          Thriller        2693              0.586704  \n",
       "2928                            Comedy        2928              0.520358  \n",
       "108                   Action|Drama|War         108              0.513054  \n",
       "1195                       Crime|Drama        1195              0.511359  \n",
       "1337                    Drama|Thriller        1337              0.491497  \n",
       "352                 Comedy|Romance|War         352              0.486228  \n",
       "2255                      Comedy|Drama        2255              0.468796  \n",
       "1372                     Drama|Romance        1372              0.464281  "
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scored_movies_df_75 = movies_df\n",
    "scored_movies_df_75[\"Recommendation Score\"] = rec[0]\n",
    "scored_movies_df_75.sort_values([\"Recommendation Score\"], ascending=False).head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, how to recommend the movies that the user has not watched yet? \n",
    "\n",
    "Lets first find the __User ID__ of our mock user:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "MovieID         1\n",
       "List Index      0\n",
       "UserID        215\n",
       "Rating          4\n",
       "Name: 75, dtype: int64"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "merged_df.iloc[75]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, we can find all the movies that our mock user has watched before:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>List Index</th>\n",
       "      <th>UserID</th>\n",
       "      <th>Rating</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>75</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>215</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11873</th>\n",
       "      <td>24</td>\n",
       "      <td>23</td>\n",
       "      <td>215</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>67543</th>\n",
       "      <td>260</td>\n",
       "      <td>257</td>\n",
       "      <td>215</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>82782</th>\n",
       "      <td>316</td>\n",
       "      <td>313</td>\n",
       "      <td>215</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97063</th>\n",
       "      <td>356</td>\n",
       "      <td>352</td>\n",
       "      <td>215</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       MovieID  List Index  UserID  Rating\n",
       "75           1           0     215       4\n",
       "11873       24          23     215       5\n",
       "67543      260         257     215       5\n",
       "82782      316         313     215       4\n",
       "97063      356         352     215       5"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df_75 = merged_df[merged_df['UserID']==215]\n",
    "movies_df_75.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the next cell, we merge all the movies that our mock user has watched with the predicted scores based on his historical data:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Merging movies_df with ratings_df by MovieID.\n",
    "merged_df_75 = scored_movies_df_75.merge(movies_df_75, on='MovieID', how='outer')\n",
    "# Dropping unecessary columns.\n",
    "merged_df_75 = merged_df_75.drop('List Index_y', axis=1).drop('UserID', axis=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets sort it and take a look at the firt 20 rows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "      <th>List Index_x</th>\n",
       "      <th>Recommendation Score</th>\n",
       "      <th>Rating</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>589</th>\n",
       "      <td>593</td>\n",
       "      <td>Silence of the Lambs, The (1991)</td>\n",
       "      <td>Drama|Thriller</td>\n",
       "      <td>589</td>\n",
       "      <td>0.838450</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>604</th>\n",
       "      <td>608</td>\n",
       "      <td>Fargo (1996)</td>\n",
       "      <td>Crime|Drama|Thriller</td>\n",
       "      <td>604</td>\n",
       "      <td>0.806462</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>315</th>\n",
       "      <td>318</td>\n",
       "      <td>Shawshank Redemption, The (1994)</td>\n",
       "      <td>Drama</td>\n",
       "      <td>315</td>\n",
       "      <td>0.788866</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2789</th>\n",
       "      <td>2858</td>\n",
       "      <td>American Beauty (1999)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>2789</td>\n",
       "      <td>0.787612</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>523</th>\n",
       "      <td>527</td>\n",
       "      <td>Schindler's List (1993)</td>\n",
       "      <td>Drama|War</td>\n",
       "      <td>523</td>\n",
       "      <td>0.770072</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2327</th>\n",
       "      <td>2396</td>\n",
       "      <td>Shakespeare in Love (1998)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "      <td>2327</td>\n",
       "      <td>0.724269</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>296</td>\n",
       "      <td>Pulp Fiction (1994)</td>\n",
       "      <td>Crime|Drama</td>\n",
       "      <td>293</td>\n",
       "      <td>0.680893</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1959</th>\n",
       "      <td>2028</td>\n",
       "      <td>Saving Private Ryan (1998)</td>\n",
       "      <td>Action|Drama|War</td>\n",
       "      <td>1959</td>\n",
       "      <td>0.648980</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1575</th>\n",
       "      <td>1617</td>\n",
       "      <td>L.A. Confidential (1997)</td>\n",
       "      <td>Crime|Film-Noir|Mystery|Thriller</td>\n",
       "      <td>1575</td>\n",
       "      <td>0.645957</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "      <td>0</td>\n",
       "      <td>0.615498</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1245</th>\n",
       "      <td>1265</td>\n",
       "      <td>Groundhog Day (1993)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "      <td>1245</td>\n",
       "      <td>0.601301</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1656</th>\n",
       "      <td>1704</td>\n",
       "      <td>Good Will Hunting (1997)</td>\n",
       "      <td>Drama</td>\n",
       "      <td>1656</td>\n",
       "      <td>0.592880</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2693</th>\n",
       "      <td>2762</td>\n",
       "      <td>Sixth Sense, The (1999)</td>\n",
       "      <td>Thriller</td>\n",
       "      <td>2693</td>\n",
       "      <td>0.586704</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2928</th>\n",
       "      <td>2997</td>\n",
       "      <td>Being John Malkovich (1999)</td>\n",
       "      <td>Comedy</td>\n",
       "      <td>2928</td>\n",
       "      <td>0.520358</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>108</th>\n",
       "      <td>110</td>\n",
       "      <td>Braveheart (1995)</td>\n",
       "      <td>Action|Drama|War</td>\n",
       "      <td>108</td>\n",
       "      <td>0.513054</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1195</th>\n",
       "      <td>1213</td>\n",
       "      <td>GoodFellas (1990)</td>\n",
       "      <td>Crime|Drama</td>\n",
       "      <td>1195</td>\n",
       "      <td>0.511359</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1337</th>\n",
       "      <td>1358</td>\n",
       "      <td>Sling Blade (1996)</td>\n",
       "      <td>Drama|Thriller</td>\n",
       "      <td>1337</td>\n",
       "      <td>0.491497</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>352</th>\n",
       "      <td>356</td>\n",
       "      <td>Forrest Gump (1994)</td>\n",
       "      <td>Comedy|Romance|War</td>\n",
       "      <td>352</td>\n",
       "      <td>0.486228</td>\n",
       "      <td>5.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2255</th>\n",
       "      <td>2324</td>\n",
       "      <td>Life Is Beautiful (La Vita � bella) (1997)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>2255</td>\n",
       "      <td>0.468796</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1372</th>\n",
       "      <td>1393</td>\n",
       "      <td>Jerry Maguire (1996)</td>\n",
       "      <td>Drama|Romance</td>\n",
       "      <td>1372</td>\n",
       "      <td>0.464281</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MovieID                                       Title  \\\n",
       "589       593            Silence of the Lambs, The (1991)   \n",
       "604       608                                Fargo (1996)   \n",
       "315       318            Shawshank Redemption, The (1994)   \n",
       "2789     2858                      American Beauty (1999)   \n",
       "523       527                     Schindler's List (1993)   \n",
       "2327     2396                  Shakespeare in Love (1998)   \n",
       "293       296                         Pulp Fiction (1994)   \n",
       "1959     2028                  Saving Private Ryan (1998)   \n",
       "1575     1617                    L.A. Confidential (1997)   \n",
       "0           1                            Toy Story (1995)   \n",
       "1245     1265                        Groundhog Day (1993)   \n",
       "1656     1704                    Good Will Hunting (1997)   \n",
       "2693     2762                     Sixth Sense, The (1999)   \n",
       "2928     2997                 Being John Malkovich (1999)   \n",
       "108       110                           Braveheart (1995)   \n",
       "1195     1213                           GoodFellas (1990)   \n",
       "1337     1358                          Sling Blade (1996)   \n",
       "352       356                         Forrest Gump (1994)   \n",
       "2255     2324  Life Is Beautiful (La Vita � bella) (1997)   \n",
       "1372     1393                        Jerry Maguire (1996)   \n",
       "\n",
       "                                Genres  List Index_x  Recommendation Score  \\\n",
       "589                     Drama|Thriller           589              0.838450   \n",
       "604               Crime|Drama|Thriller           604              0.806462   \n",
       "315                              Drama           315              0.788866   \n",
       "2789                      Comedy|Drama          2789              0.787612   \n",
       "523                          Drama|War           523              0.770072   \n",
       "2327                    Comedy|Romance          2327              0.724269   \n",
       "293                        Crime|Drama           293              0.680893   \n",
       "1959                  Action|Drama|War          1959              0.648980   \n",
       "1575  Crime|Film-Noir|Mystery|Thriller          1575              0.645957   \n",
       "0          Animation|Children's|Comedy             0              0.615498   \n",
       "1245                    Comedy|Romance          1245              0.601301   \n",
       "1656                             Drama          1656              0.592880   \n",
       "2693                          Thriller          2693              0.586704   \n",
       "2928                            Comedy          2928              0.520358   \n",
       "108                   Action|Drama|War           108              0.513054   \n",
       "1195                       Crime|Drama          1195              0.511359   \n",
       "1337                    Drama|Thriller          1337              0.491497   \n",
       "352                 Comedy|Romance|War           352              0.486228   \n",
       "2255                      Comedy|Drama          2255              0.468796   \n",
       "1372                     Drama|Romance          1372              0.464281   \n",
       "\n",
       "      Rating  \n",
       "589      NaN  \n",
       "604      NaN  \n",
       "315      NaN  \n",
       "2789     NaN  \n",
       "523      NaN  \n",
       "2327     NaN  \n",
       "293      NaN  \n",
       "1959     NaN  \n",
       "1575     4.0  \n",
       "0        4.0  \n",
       "1245     NaN  \n",
       "1656     NaN  \n",
       "2693     NaN  \n",
       "2928     NaN  \n",
       "108      NaN  \n",
       "1195     NaN  \n",
       "1337     NaN  \n",
       "352      5.0  \n",
       "2255     NaN  \n",
       "1372     NaN  "
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "merged_df_75.sort_values([\"Recommendation Score\"], ascending=False).head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, there are some movies that the user has not watched yet and have high score based on our model. So, we can recommend them to the user."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## References\n",
    "* [Restricted Boltzmann Machines for Collaborative Filtering](http://www.cs.utoronto.ca/~hinton/absps/netflixICML.pdf)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.5"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}