Lesson3_5_recommendations.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Lesson3.5-recommendations.ipynb",
      "version": "0.3.2",
      "provenance": [],
      "collapsed_sections": [
        "NhT7rabY0fp4",
        "6cAYslM7Ype9",
        "ulEBTojcapEH",
        "-wocOTgtcEX2",
        "dAyWCIaNfFBB",
        "5s7H0qT3iEj4",
        "LOrWDYMolR7b",
        "4huGqSbPtyo1",
        "EvTT7BrWxAPP",
        "kJ6xu_58xP-H",
        "UU_xwRmh9Acw",
        "LrTg1MvABj3T",
        "N_m0YG841Bfd"
      ],
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/noahgift/fundamentals_ai_ml/blob/master/Lesson3_5_recommendations.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NhT7rabY0fp4",
        "colab_type": "text"
      },
      "source": [
        "# Recommender Systems"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5s7H0qT3iEj4",
        "colab_type": "text"
      },
      "source": [
        "## Nearest Neighbor CF:  Basics"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "JcaN-oIXiIQO",
        "colab_type": "text"
      },
      "source": [
        "* One of most popular and common methods for CF (very intuitive)\n",
        "* User-based and Item Based\n",
        "* Naive Version (Very simple metric is Pearson correlation coefficient)\n",
        "    * ***Measures covariance of two variables divided by product of standard deviations.***\n",
        "    * Problem with basic version is it doesn't account for peoples' **baseline preferences.**\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LOrWDYMolR7b",
        "colab_type": "text"
      },
      "source": [
        "## What is in a Rating?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "yg4YFHoalVC9",
        "colab_type": "text"
      },
      "source": [
        "* Implicit vs. explicit ratings\n",
        "    * Strongest signal is in explicit ratings made by people.\n",
        "    * Implicit:  Did you follow someone, buy the movie or watch the trailer"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4huGqSbPtyo1",
        "colab_type": "text"
      },
      "source": [
        "# Surprise SKLearn Recommendation Framework"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "spaIVqXYt7vJ",
        "colab_type": "text"
      },
      "source": [
        "[Surprise](http://surpriselib.com/) is a Python scikit building and analyzing recommender systems."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "EvTT7BrWxAPP",
        "colab_type": "text"
      },
      "source": [
        "### Training a recommender with surprise"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "t5PrwVKrt7Id",
        "colab_type": "code",
        "outputId": "b8ea1581-71b9-4303-c45c-bf29d419ad08",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 50
        }
      },
      "source": [
        "!pip install -q scikit-surprise"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "\u001b[K     |████████████████████████████████| 3.3MB 1.4MB/s \n",
            "\u001b[?25h  Building wheel for scikit-surprise (setup.py) ... \u001b[?25l\u001b[?25hdone\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "vxTpiqXruynG",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from surprise import SVD\n",
        "from surprise import Dataset\n",
        "from surprise import accuracy\n",
        "from surprise.model_selection import train_test_split"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "DIpKS6tqwUYh",
        "colab_type": "code",
        "outputId": "8fdb0cce-2def-4fea-fd68-10c6c970e809",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 67
        }
      },
      "source": [
        "# Load the movielens-100k dataset (download it if needed),\n",
        "data = Dataset.load_builtin('ml-100k')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Dataset ml-100k could not be found. Do you want to download it? [Y/n] Y\n",
            "Trying to download dataset from http://files.grouplens.org/datasets/movielens/ml-100k.zip...\n",
            "Done! Dataset ml-100k has been saved to /root/.surprise_data/ml-100k\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PcSBQ89QwRAc",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# sample random trainset and testset\n",
        "# test set is made of 25% of the ratings.\n",
        "trainset, testset = train_test_split(data, test_size=.25)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "XAbOLkNLu85F",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# We'll use the famous SVD algorithm.\n",
        "algo = SVD()"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "hyHOszFew3Kd",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# Train the algorithm on the trainset, and predict ratings for the testset\n",
        "algo.fit(trainset)\n",
        "predictions = algo.test(testset)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "WtrrM7XKw5-H",
        "colab_type": "code",
        "outputId": "cf6ced8d-d5e1-46cc-fa53-635e8a0481e6",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 50
        }
      },
      "source": [
        "# Then compute RMSE\n",
        "accuracy.rmse(predictions)"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "RMSE: 0.9440\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.9440155966414212"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kJ6xu_58xP-H",
        "colab_type": "text"
      },
      "source": [
        "### Get top-N recommendations for each user"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "PiV9oegYx0Jq",
        "colab_type": "text"
      },
      "source": [
        "https://surprise.readthedocs.io/en/stable/FAQ.html#how-to-get-the-top-n-recommendations-for-each-user"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KjY-_tHaxTtA",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from collections import defaultdict"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "z6aVHMD_xcGT",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def get_top_n(predictions, n=10):\n",
        "    '''Return the top-N recommendation for each user from a set of predictions.\n",
        "\n",
        "    Args:\n",
        "        predictions(list of Prediction objects): The list of predictions, as\n",
        "            returned by the test method of an algorithm.\n",
        "        n(int): The number of recommendation to output for each user. Default\n",
        "            is 10.\n",
        "\n",
        "    Returns:\n",
        "    A dict where keys are user (raw) ids and values are lists of tuples:\n",
        "        [(raw item id, rating estimation), ...] of size n.\n",
        "    '''\n",
        "\n",
        "    # First map the predictions to each user.\n",
        "    top_n = defaultdict(list)\n",
        "    for uid, iid, true_r, est, _ in predictions:\n",
        "        top_n[uid].append((iid, est))\n",
        "\n",
        "    # Then sort the predictions for each user and retrieve the k highest ones.\n",
        "    for uid, user_ratings in top_n.items():\n",
        "        user_ratings.sort(key=lambda x: x[1], reverse=True)\n",
        "        top_n[uid] = user_ratings[:n]\n",
        "\n",
        "    return top_n"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "N4EjAooUxh9Z",
        "colab_type": "code",
        "outputId": "63bfca6f-d3bc-48c9-f9db-909d156ba03e",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        }
      },
      "source": [
        "# First train an SVD algorithm on the movielens dataset.\n",
        "data = Dataset.load_builtin('ml-100k')\n",
        "trainset = data.build_full_trainset()\n",
        "algo = SVD()\n",
        "algo.fit(trainset)\n",
        "\n",
        "# Than predict ratings for all pairs (u, i) that are NOT in the training set.\n",
        "testset = trainset.build_anti_testset()\n",
        "predictions = algo.test(testset)\n",
        "\n",
        "top_n = get_top_n(predictions, n=10)\n",
        "\n",
        "# Print the recommended items for each user\n",
        "for uid, user_ratings in top_n.items():\n",
        "    print(uid, [iid for (iid, _) in user_ratings])"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "196 ['114', '316', '318', '178', '483', '357', '429', '315', '12', '512']\n",
            "186 ['528', '169', '194', '133', '318', '136', '197', '603', '496', '498']\n",
            "22 ['100', '12', '64', '318', '357', '483', '530', '98', '11', '191']\n",
            "244 ['127', '408', '14', '474', '275', '285', '178', '483', '12', '641']\n",
            "166 ['50', '408', '64', '963', '174', '178', '199', '22', '251', '923']\n",
            "298 ['64', '408', '313', '251', '192', '169', '963', '923', '114', '480']\n",
            "115 ['114', '408', '223', '285', '180', '64', '474', '515', '427', '135']\n",
            "253 ['178', '169', '408', '174', '172', '480', '709', '136', '641', '515']\n",
            "305 ['647', '515', '114', '606', '496', '607', '316', '651', '513', '1194']\n",
            "6 ['603', '654', '114', '606', '923', '657', '611', '589', '83', '647']\n",
            "62 ['185', '661', '641', '187', '223', '615', '963', '175', '478', '272']\n",
            "286 ['86', '19', '963', '12', '479', '496', '318', '292', '488', '427']\n",
            "200 ['272', '64', '186', '641', '408', '114', '12', '316', '1039', '487']\n",
            "210 ['318', '515', '12', '64', '480', '603', '169', '427', '178', '199']\n",
            "224 ['174', '64', '173', '210', '172', '50', '265', '216', '95', '496']\n",
            "303 ['527', '135', '169', '114', '272', '515', '14', '89', '315', '192']\n",
            "122 ['603', '408', '100', '607', '483', '963', '657', '114', '169', '192']\n",
            "194 ['484', '272', '603', '251', '156', '611', '316', '408', '302', '480']\n",
            "291 ['127', '318', '357', '192', '408', '515', '209', '169', '178', '187']\n",
            "234 ['114', '189', '19', '83', '169', '302', '408', '958', '514', '529']\n",
            "119 ['114', '170', '178', '318', '357', '483', '183', '515', '136', '604']\n",
            "167 ['114', '272', '357', '56', '427', '178', '316', '12', '143', '98']\n",
            "299 ['357', '178', '1007', '316', '64', '272', '223', '189', '493', '657']\n",
            "308 ['474', '114', '173', '190', '272', '302', '478', '1449', '652', '1142']\n",
            "95 ['318', '12', '732', '923', '489', '603', '408', '124', '945', '427']\n",
            "38 ['496', '408', '178', '945', '170', '1137', '98', '483', '64', '143']\n",
            "102 ['408', '64', '483', '496', '603', '169', '318', '478', '661', '190']\n",
            "63 ['114', '169', '318', '64', '98', '357', '83', '694', '89', '178']\n",
            "160 ['12', '357', '180', '179', '134', '114', '272', '504', '523', '199']\n",
            "50 ['127', '64', '12', '408', '156', '50', '251', '357', '603', '963']\n",
            "301 ['315', '272', '251', '480', '242', '408', '178', '1137', '316', '603']\n",
            "225 ['483', '408', '178', '169', '607', '223', '515', '114', '313', '661']\n",
            "290 ['408', '313', '272', '316', '169', '275', '480', '12', '603', '1137']\n",
            "97 ['64', '12', '318', '285', '114', '178', '59', '641', '480', '45']\n",
            "157 ['318', '483', '657', '169', '498', '189', '408', '603', '178', '114']\n",
            "181 ['313', '22', '174', '12', '318', '181', '96', '50', '172', '143']\n",
            "278 ['12', '963', '169', '223', '318', '408', '127', '657', '251', '64']\n",
            "276 ['114', '134', '694', '190', '484', '1142', '654', '527', '651', '194']\n",
            "7 ['114', '302', '1142', '272', '408', '1039', '251', '313', '963', '316']\n",
            "10 ['318', '169', '313', '408', '528', '661', '83', '923', '173', '136']\n",
            "284 ['408', '134', '169', '170', '511', '513', '483', '114', '923', '211']\n",
            "201 ['474', '493', '168', '178', '1449', '611', '1007', '135', '114', '504']\n",
            "287 ['603', '408', '318', '357', '199', '657', '12', '169', '427', '429']\n",
            "246 ['268', '171', '127', '156', '179', '114', '302', '23', '514', '315']\n",
            "242 ['603', '480', '174', '479', '272', '172', '483', '408', '178', '127']\n",
            "249 ['127', '178', '515', '654', '923', '180', '285', '694', '528', '474']\n",
            "99 ['318', '357', '498', '515', '191', '272', '190', '180', '429', '205']\n",
            "178 ['408', '169', '186', '205', '114', '272', '251', '923', '963', '709']\n",
            "251 ['408', '483', '318', '511', '127', '285', '169', '187', '114', '474']\n",
            "81 ['483', '64', '178', '408', '603', '963', '357', '320', '515', '197']\n",
            "260 ['603', '174', '483', '178', '318', '64', '114', '1194', '169', '357']\n",
            "25 ['178', '318', '196', '251', '89', '64', '190', '210', '272', '216']\n",
            "59 ['641', '750', '694', '268', '493', '144', '114', '178', '475', '320']\n",
            "72 ['59', '496', '178', '251', '200', '316', '656', '269', '641', '132']\n",
            "87 ['69', '316', '251', '191', '603', '169', '265', '28', '480', '520']\n",
            "42 ['22', '313', '651', '191', '144', '435', '199', '482', '300', '604']\n",
            "292 ['134', '474', '302', '185', '513', '178', '89', '179', '318', '114']\n",
            "20 ['408', '169', '86', '963', '275', '923', '178', '19', '223', '603']\n",
            "13 ['192', '114', '528', '408', '923', '521', '611', '1019', '203', '963']\n",
            "138 ['173', '272', '50', '408', '64', '174', '316', '169', '127', '478']\n",
            "60 ['169', '318', '251', '408', '114', '190', '488', '1019', '170', '100']\n",
            "57 ['174', '169', '114', '172', '96', '1137', '429', '22', '178', '511']\n",
            "223 ['187', '265', '204', '64', '429', '12', '186', '661', '89', '174']\n",
            "189 ['190', '64', '515', '427', '242', '114', '302', '169', '189', '1039']\n",
            "243 ['408', '169', '513', '48', '483', '56', '178', '114', '357', '12']\n",
            "92 ['127', '285', '484', '513', '357', '483', '114', '530', '272', '603']\n",
            "241 ['657', '408', '483', '169', '98', '318', '178', '48', '127', '515']\n",
            "254 ['408', '651', '114', '483', '144', '316', '95', '963', '169', '96']\n",
            "293 ['276', '9', '191', '178', '408', '169', '114', '661', '525', '318']\n",
            "127 ['408', '189', '210', '478', '83', '169', '114', '657', '64', '705']\n",
            "222 ['199', '408', '187', '272', '523', '963', '251', '169', '126', '480']\n",
            "267 ['357', '173', '272', '318', '285', '178', '530', '513', '1449', '519']\n",
            "11 ['251', '64', '169', '408', '134', '1169', '272', '114', '483', '48']\n",
            "8 ['408', '313', '64', '197', '169', '483', '98', '963', '48', '603']\n",
            "162 ['408', '64', '313', '923', '22', '12', '318', '651', '272', '114']\n",
            "279 ['512', '8', '93', '223', '178', '171', '315', '478', '327', '604']\n",
            "145 ['357', '114', '208', '153', '187', '318', '191', '205', '519', '180']\n",
            "28 ['169', '408', '318', '172', '114', '513', '657', '285', '515', '963']\n",
            "135 ['408', '64', '169', '318', '483', '174', '480', '513', '285', '172']\n",
            "32 ['272', '483', '64', '641', '134', '178', '12', '127', '479', '603']\n",
            "90 ['169', '114', '48', '1142', '524', '320', '1449', '408', '1007', '902']\n",
            "216 ['515', '178', '89', '127', '185', '483', '474', '114', '657', '641']\n",
            "250 ['408', '483', '114', '134', '654', '511', '182', '923', '302', '427']\n",
            "271 ['483', '114', '408', '513', '23', '316', '144', '632', '251', '736']\n",
            "265 ['272', '313', '480', '64', '657', '98', '603', '12', '316', '251']\n",
            "198 ['408', '114', '169', '12', '483', '513', '479', '170', '178', '272']\n",
            "168 ['82', '79', '357', '923', '318', '98', '22', '527', '194', '64']\n",
            "110 ['318', '136', '170', '515', '316', '174', '408', '1019', '641', '265']\n",
            "58 ['114', '428', '179', '479', '1449', '52', '530', '489', '657', '251']\n",
            "237 ['114', '647', '223', '272', '50', '48', '56', '12', '657', '285']\n",
            "94 ['114', '340', '137', '285', '276', '171', '513', '530', '515', '480']\n",
            "128 ['408', '318', '479', '169', '498', '474', '316', '178', '480', '488']\n",
            "44 ['408', '12', '169', '186', '187', '127', '661', '488', '519', '272']\n",
            "264 ['272', '178', '134', '169', '114', '408', '483', '474', '223', '357']\n",
            "41 ['408', '169', '114', '483', '12', '654', '134', '187', '603', '272']\n",
            "82 ['98', '651', '210', '607', '251', '659', '189', '12', '192', '427']\n",
            "262 ['178', '12', '127', '657', '302', '357', '272', '114', '199', '136']\n",
            "174 ['528', '316', '170', '603', '588', '89', '367', '318', '657', '136']\n",
            "43 ['515', '657', '427', '251', '483', '378', '513', '132', '136', '183']\n",
            "84 ['357', '316', '603', '272', '483', '480', '174', '178', '169', '515']\n",
            "269 ['652', '114', '589', '223', '1449', '242', '178', '203', '190', '408']\n",
            "259 ['64', '483', '169', '515', '318', '251', '272', '127', '174', '191']\n",
            "85 ['178', '114', '285', '165', '484', '185', '408', '694', '48', '651']\n",
            "213 ['313', '168', '114', '615', '302', '272', '178', '408', '427', '285']\n",
            "121 ['408', '178', '132', '480', '483', '603', '657', '496', '513', '432']\n",
            "49 ['276', '134', '127', '23', '474', '9', '654', '180', '269', '156']\n",
            "155 ['134', '178', '169', '318', '357', '603', '657', '64', '483', '515']\n",
            "68 ['318', '408', '474', '114', '14', '515', '483', '238', '657', '169']\n",
            "172 ['100', '408', '12', '192', '150', '480', '474', '169', '127', '511']\n",
            "19 ['357', '483', '318', '474', '408', '64', '178', '480', '169', '50']\n",
            "268 ['603', '64', '530', '23', '318', '657', '272', '511', '199', '513']\n",
            "5 ['175', '285', '483', '474', '479', '316', '603', '522', '124', '896']\n",
            "80 ['408', '169', '114', '12', '192', '480', '285', '963', '320', '606']\n",
            "66 ['174', '12', '22', '963', '64', '195', '114', '496', '272', '603']\n",
            "18 ['316', '1194', '511', '272', '657', '656', '124', '632', '315', '606']\n",
            "26 ['318', '178', '173', '134', '483', '114', '64', '187', '923', '474']\n",
            "130 ['194', '603', '480', '483', '408', '318', '133', '657', '83', '169']\n",
            "256 ['318', '429', '178', '300', '923', '316', '114', '520', '313', '515']\n",
            "1 ['318', '483', '408', '647', '528', '515', '478', '1142', '657', '530']\n",
            "56 ['313', '272', '480', '511', '318', '357', '190', '12', '192', '1137']\n",
            "15 ['172', '694', '408', '513', '318', '511', '169', '478', '124', '136']\n",
            "207 ['178', '480', '923', '136', '427', '705', '251', '603', '513', '498']\n",
            "232 ['114', '169', '89', '190', '285', '134', '511', '513', '408', '529']\n",
            "52 ['474', '172', '483', '408', '357', '114', '12', '515', '50', '127']\n",
            "161 ['408', '512', '169', '12', '516', '59', '64', '475', '641', '251']\n",
            "148 ['22', '511', '313', '513', '512', '170', '483', '479', '12', '272']\n",
            "125 ['313', '96', '121', '169', '408', '196', '1137', '132', '694', '265']\n",
            "83 ['519', '136', '170', '496', '318', '735', '282', '936', '392', '194']\n",
            "272 ['603', '114', '64', '318', '408', '315', '169', '285', '316', '180']\n",
            "151 ['272', '515', '316', '479', '285', '242', '8', '1007', '251', '165']\n",
            "54 ['172', '12', '408', '285', '114', '316', '64', '320', '1449', '169']\n",
            "16 ['408', '169', '50', '187', '251', '313', '483', '488', '750', '132']\n",
            "91 ['114', '408', '694', '169', '1137', '302', '315', '513', '199', '96']\n",
            "294 ['318', '64', '98', '174', '172', '408', '173', '487', '169', '272']\n",
            "229 ['318', '480', '483', '659', '178', '481', '657', '493', '320', '197']\n",
            "36 ['483', '408', '318', '641', '285', '1194', '190', '64', '615', '114']\n",
            "70 ['114', '318', '64', '480', '12', '127', '515', '603', '272', '192']\n",
            "14 ['169', '114', '488', '178', '659', '483', '318', '180', '64', '480']\n",
            "295 ['302', '515', '512', '169', '611', '269', '923', '963', '657', '607']\n",
            "233 ['169', '251', '513', '408', '427', '114', '493', '496', '659', '641']\n",
            "214 ['513', '9', '178', '657', '488', '165', '654', '320', '205', '528']\n",
            "192 ['318', '12', '14', '474', '173', '64', '657', '483', '357', '480']\n",
            "100 ['318', '50', '64', '12', '515', '173', '251', '174', '483', '496']\n",
            "307 ['519', '268', '285', '489', '127', '479', '606', '709', '12', '530']\n",
            "297 ['657', '318', '483', '127', '427', '496', '478', '134', '169', '178']\n",
            "193 ['511', '483', '656', '482', '496', '169', '515', '178', '484', '480']\n",
            "113 ['64', '483', '408', '181', '174', '172', '480', '513', '519', '430']\n",
            "275 ['64', '603', '318', '513', '12', '251', '480', '357', '114', '136']\n",
            "219 ['185', '100', '175', '12', '408', '156', '285', '318', '169', '474']\n",
            "218 ['127', '408', '483', '515', '480', '114', '530', '963', '178', '474']\n",
            "123 ['408', '190', '357', '603', '484', '661', '1449', '191', '178', '923']\n",
            "158 ['427', '963', '192', '191', '318', '134', '603', '1137', '114', '180']\n",
            "302 ['64', '318', '603', '515', '483', '408', '114', '963', '12', '657']\n",
            "23 ['169', '272', '45', '474', '654', '478', '285', '963', '709', '923']\n",
            "296 ['132', '178', '511', '513', '318', '197', '657', '603', '64', '709']\n",
            "33 ['172', '50', '408', '318', '174', '496', '178', '483', '511', '169']\n",
            "154 ['178', '12', '127', '318', '64', '408', '483', '114', '511', '192']\n",
            "77 ['12', '11', '318', '64', '169', '180', '178', '408', '272', '603']\n",
            "270 ['1137', '515', '427', '512', '209', '479', '272', '14', '483', '408']\n",
            "187 ['318', '408', '313', '169', '12', '923', '480', '963', '185', '50']\n",
            "170 ['603', '127', '64', '87', '313', '12', '408', '483', '923', '22']\n",
            "101 ['313', '657', '98', '483', '199', '169', '515', '408', '272', '496']\n",
            "184 ['178', '114', '242', '661', '427', '169', '302', '408', '633', '921']\n",
            "112 ['357', '127', '64', '318', '603', '661', '12', '408', '169', '56']\n",
            "133 ['169', '56', '114', '408', '178', '603', '127', '9', '513', '174']\n",
            "215 ['169', '190', '408', '511', '285', '603', '199', '114', '178', '515']\n",
            "69 ['178', '483', '515', '173', '114', '127', '89', '318', '357', '170']\n",
            "104 ['56', '98', '515', '357', '174', '178', '61', '318', '641', '83']\n",
            "240 ['318', '64', '408', '316', '114', '357', '45', '641', '427', '178']\n",
            "144 ['483', '427', '481', '199', '513', '923', '511', '169', '114', '210']\n",
            "191 ['318', '357', '12', '169', '64', '174', '114', '50', '98', '615']\n",
            "61 ['408', '483', '169', '64', '966', '479', '484', '661', '197', '199']\n",
            "142 ['50', '480', '114', '318', '483', '191', '427', '187', '313', '12']\n",
            "177 ['169', '408', '474', '513', '180', '134', '191', '427', '48', '480']\n",
            "203 ['408', '172', '114', '483', '174', '606', '12', '963', '169', '98']\n",
            "21 ['268', '168', '192', '493', '114', '173', '156', '302', '175', '318']\n",
            "197 ['28', '64', '732', '1', '480', '204', '144', '192', '178', '69']\n",
            "134 ['174', '22', '172', '318', '483', '657', '408', '705', '169', '484']\n",
            "180 ['408', '190', '169', '189', '64', '286', '114', '134', '482', '132']\n",
            "236 ['197', '923', '589', '480', '357', '515', '251', '178', '902', '513']\n",
            "263 ['313', '170', '408', '216', '427', '705', '603', '1142', '114', '173']\n",
            "109 ['300', '692', '313', '169', '963', '659', '519', '1193', '194', '408']\n",
            "64 ['178', '114', '272', '357', '169', '192', '611', '408', '661', '513']\n",
            "114 ['408', '169', '114', '657', '285', '603', '50', '515', '12', '178']\n",
            "239 ['657', '357', '408', '182', '480', '656', '199', '963', '515', '127']\n",
            "117 ['603', '408', '169', '114', '199', '89', '203', '83', '1449', '318']\n",
            "65 ['169', '408', '483', '479', '251', '114', '172', '603', '488', '923']\n",
            "137 ['95', '603', '1137', '427', '498', '132', '272', '258', '483', '408']\n",
            "257 ['483', '114', '12', '357', '318', '515', '923', '511', '178', '606']\n",
            "111 ['318', '173', '64', '114', '170', '408', '515', '169', '98', '483']\n",
            "285 ['192', '127', '22', '12', '513', '180', '603', '174', '98', '165']\n",
            "96 ['12', '169', '408', '357', '178', '493', '647', '475', '285', '272']\n",
            "116 ['96', '114', '172', '12', '174', '178', '194', '318', '496', '357']\n",
            "73 ['114', '408', '50', '191', '168', '302', '169', '223', '190', '511']\n",
            "221 ['474', '168', '169', '408', '480', '513', '182', '179', '89', '1449']\n",
            "235 ['114', '169', '56', '408', '513', '60', '357', '484', '59', '479']\n",
            "164 ['427', '480', '195', '483', '408', '318', '64', '357', '197', '169']\n",
            "281 ['12', '474', '480', '483', '169', '357', '178', '318', '479', '50']\n",
            "182 ['318', '64', '357', '174', '408', '12', '169', '513', '173', '251']\n",
            "129 ['318', '408', '169', '64', '427', '474', '251', '178', '923', '316']\n",
            "45 ['169', '483', '408', '511', '114', '316', '12', '285', '199', '64']\n",
            "131 ['64', '318', '50', '114', '174', '603', '169', '12', '45', '316']\n",
            "230 ['318', '316', '57', '251', '178', '651', '114', '483', '657', '208']\n",
            "126 ['127', '923', '498', '114', '408', '483', '132', '191', '603', '64']\n",
            "231 ['408', '169', '64', '251', '59', '513', '114', '183', '519', '479']\n",
            "280 ['515', '189', '185', '179', '657', '493', '611', '357', '513', '275']\n",
            "288 ['513', '923', '484', '493', '133', '483', '480', '172', '661', '251']\n",
            "152 ['95', '603', '427', '174', '408', '178', '318', '705', '64', '169']\n",
            "217 ['318', '357', '64', '480', '302', '272', '603', '663', '313', '487']\n",
            "79 ['64', '169', '174', '408', '318', '198', '603', '512', '178', '480']\n",
            "75 ['173', '357', '64', '12', '50', '169', '1007', '127', '483', '178']\n",
            "245 ['64', '173', '408', '178', '12', '519', '127', '98', '251', '272']\n",
            "282 ['408', '114', '318', '169', '64', '190', '515', '478', '134', '657']\n",
            "78 ['408', '98', '923', '316', '8', '174', '483', '318', '169', '272']\n",
            "118 ['242', '246', '1137', '515', '512', '480', '498', '96', '648', '195']\n",
            "283 ['474', '408', '169', '114', '178', '641', '318', '515', '480', '357']\n",
            "171 ['408', '169', '357', '513', '178', '483', '191', '285', '12', '963']\n",
            "107 ['127', '100', '318', '211', '169', '474', '9', '408', '923', '647']\n",
            "226 ['318', '64', '515', '173', '100', '50', '114', '483', '79', '190']\n",
            "306 ['480', '408', '318', '479', '515', '963', '483', '169', '603', '474']\n",
            "173 ['474', '144', '98', '193', '603', '100', '181', '515', '427', '512']\n",
            "185 ['408', '22', '169', '603', '483', '12', '64', '923', '657', '187']\n",
            "150 ['12', '64', '56', '318', '178', '357', '114', '190', '483', '603']\n",
            "274 ['474', '603', '480', '479', '483', '408', '178', '357', '199', '169']\n",
            "188 ['114', '588', '136', '515', '272', '286', '170', '275', '735', '408']\n",
            "48 ['318', '169', '313', '408', '178', '963', '651', '180', '513', '89']\n",
            "311 ['313', '169', '408', '641', '272', '114', '316', '189', '694', '190']\n",
            "165 ['408', '114', '50', '98', '100', '172', '57', '178', '515', '64']\n",
            "208 ['483', '318', '50', '64', '12', '603', '408', '172', '170', '174']\n",
            "2 ['114', '64', '408', '483', '474', '132', '59', '480', '427', '641']\n",
            "205 ['318', '64', '114', '483', '513', '169', '515', '603', '187', '484']\n",
            "248 ['318', '12', '408', '169', '272', '357', '313', '513', '316', '654']\n",
            "93 ['408', '318', '64', '173', '178', '50', '483', '515', '114', '659']\n",
            "159 ['515', '136', '150', '408', '190', '313', '12', '656', '493', '57']\n",
            "146 ['480', '357', '661', '318', '603', '197', '479', '114', '178', '511']\n",
            "29 ['318', '114', '169', '603', '483', '427', '64', '357', '408', '659']\n",
            "156 ['408', '285', '513', '483', '50', '169', '427', '114', '127', '963']\n",
            "37 ['408', '318', '169', '272', '64', '8', '316', '251', '178', '98']\n",
            "141 ['64', '318', '161', '82', '136', '265', '98', '385', '87', '357']\n",
            "195 ['318', '511', '50', '64', '174', '48', '493', '187', '408', '172']\n",
            "108 ['318', '408', '64', '98', '169', '483', '480', '56', '114', '272']\n",
            "47 ['408', '114', '127', '169', '483', '183', '174', '50', '513', '963']\n",
            "255 ['318', '172', '127', '83', '174', '357', '132', '135', '306', '269']\n",
            "89 ['169', '963', '657', '114', '175', '484', '480', '192', '134', '60']\n",
            "140 ['318', '169', '178', '483', '603', '197', '100', '170', '64', '513']\n",
            "190 ['50', '174', '172', '408', '181', '483', '178', '657', '89', '12']\n",
            "24 ['408', '169', '114', '187', '313', '302', '199', '168', '483', '134']\n",
            "17 ['408', '98', '169', '474', '641', '50', '515', '89', '170', '56']\n",
            "313 ['528', '513', '251', '963', '408', '169', '316', '12', '48', '302']\n",
            "53 ['603', '483', '12', '408', '134', '272', '318', '197', '923', '479']\n",
            "124 ['56', '318', '480', '114', '357', '64', '430', '302', '513', '316']\n",
            "149 ['515', '318', '169', '474', '408', '480', '483', '657', '114', '98']\n",
            "176 ['56', '12', '357', '661', '114', '64', '427', '479', '302', '89']\n",
            "106 ['408', '114', '178', '603', '136', '357', '170', '515', '169', '50']\n",
            "312 ['64', '1137', '251', '344', '709', '285', '963', '694', '1149', '318']\n",
            "175 ['963', '178', '318', '480', '427', '114', '603', '408', '657', '251']\n",
            "153 ['475', '318', '156', '654', '98', '513', '1449', '178', '474', '114']\n",
            "220 ['318', '12', '173', '313', '64', '480', '174', '50', '272', '483']\n",
            "143 ['192', '127', '12', '603', '479', '408', '114', '174', '316', '156']\n",
            "199 ['56', '357', '64', '318', '474', '114', '127', '98', '169', '185']\n",
            "202 ['114', '408', '134', '963', '169', '272', '302', '511', '12', '478']\n",
            "277 ['318', '483', '64', '272', '251', '178', '480', '515', '199', '513']\n",
            "206 ['56', '12', '135', '156', '641', '474', '192', '276', '114', '176']\n",
            "76 ['127', '408', '483', '187', '357', '694', '606', '180', '511', '285']\n",
            "314 ['82', '79', '603', '133', '498', '480', '604', '483', '1194', '315']\n",
            "136 ['483', '474', '114', '357', '169', '134', '408', '657', '603', '272']\n",
            "179 ['408', '50', '143', '64', '12', '95', '174', '172', '318', '427']\n",
            "4 ['98', '603', '515', '427', '512', '480', '275', '272', '483', '408']\n",
            "304 ['12', '178', '603', '174', '64', '357', '285', '199', '172', '318']\n",
            "3 ['185', '408', '12', '50', '357', '191', '963', '483', '98', '480']\n",
            "227 ['178', '357', '515', '318', '483', '474', '302', '114', '169', '657']\n",
            "252 ['515', '272', '408', '178', '12', '657', '483', '318', '169', '98']\n",
            "212 ['408', '483', '170', '316', '923', '64', '114', '524', '189', '178']\n",
            "310 ['192', '127', '12', '408', '513', '169', '357', '272', '923', '603']\n",
            "35 ['22', '172', '12', '603', '483', '313', '519', '318', '28', '661']\n",
            "147 ['483', '178', '169', '251', '408', '64', '318', '513', '174', '98']\n",
            "105 ['64', '408', '12', '318', '169', '657', '173', '483', '190', '114']\n",
            "34 ['474', '100', '480', '408', '127', '318', '64', '357', '169', '185']\n",
            "71 ['318', '654', '12', '493', '408', '661', '427', '603', '320', '251']\n",
            "51 ['318', '12', '169', '313', '114', '408', '357', '174', '98', '89']\n",
            "204 ['357', '408', '272', '98', '603', '474', '127', '143', '483', '192']\n",
            "315 ['169', '114', '427', '134', '357', '191', '408', '474', '272', '170']\n",
            "31 ['169', '483', '657', '318', '479', '661', '474', '223', '528', '114']\n",
            "316 ['56', '475', '269', '408', '251', '242', '603', '902', '663', '512']\n",
            "103 ['357', '114', '318', '64', '169', '12', '251', '474', '408', '484']\n",
            "318 ['496', '22', '98', '199', '603', '515', '97', '427', '526', '483']\n",
            "30 ['318', '178', '64', '408', '56', '8', '513', '251', '114', '357']\n",
            "120 ['318', '178', '114', '98', '169', '190', '427', '657', '408', '132']\n",
            "46 ['483', '190', '408', '169', '64', '511', '59', '199', '357', '285']\n",
            "289 ['114', '474', '408', '513', '357', '315', '60', '169', '483', '427']\n",
            "209 ['64', '174', '178', '172', '187', '651', '114', '483', '318', '705']\n",
            "261 ['242', '474', '603', '1137', '100', '480', '498', '174', '195', '479']\n",
            "88 ['174', '408', '318', '427', '169', '50', '64', '170', '316', '513']\n",
            "9 ['12', '22', '408', '251', '318', '174', '199', '313', '64', '272']\n",
            "247 ['408', '98', '178', '83', '483', '114', '318', '657', '169', '427']\n",
            "321 ['408', '169', '318', '178', '98', '313', '606', '136', '189', '285']\n",
            "266 ['318', '98', '515', '483', '178', '654', '603', '64', '408', '480']\n",
            "74 ['169', '64', '318', '114', '408', '223', '483', '187', '178', '474']\n",
            "238 ['408', '169', '318', '603', '483', '496', '272', '191', '64', '515']\n",
            "319 ['318', '12', '64', '357', '483', '127', '272', '480', '174', '178']\n",
            "323 ['408', '174', '12', '187', '474', '169', '114', '285', '480', '603']\n",
            "67 ['480', '318', '357', '12', '483', '272', '169', '192', '22', '127']\n",
            "211 ['427', '923', '963', '134', '603', '408', '8', '313', '496', '511']\n",
            "98 ['174', '318', '408', '69', '50', '22', '170', '483', '172', '313']\n",
            "12 ['515', '178', '657', '8', '408', '483', '173', '496', '603', '83']\n",
            "40 ['178', '483', '64', '318', '136', '187', '408', '170', '114', '169']\n",
            "258 ['169', '408', '483', '64', '923', '480', '199', '114', '178', '430']\n",
            "228 ['169', '318', '174', '64', '408', '50', '189', '170', '483', '515']\n",
            "325 ['169', '963', '178', '515', '923', '606', '64', '488', '603', '171']\n",
            "320 ['408', '169', '114', '205', '357', '318', '963', '98', '189', '178']\n",
            "326 ['169', '1449', '408', '12', '489', '57', '604', '59', '114', '647']\n",
            "327 ['114', '483', '185', '513', '124', '661', '654', '134', '488', '511']\n",
            "183 ['603', '178', '657', '169', '515', '64', '480', '318', '408', '512']\n",
            "328 ['170', '603', '479', '95', '251', '197', '408', '124', '963', '169']\n",
            "322 ['408', '114', '474', '169', '661', '427', '56', '190', '135', '134']\n",
            "330 ['265', '515', '480', '498', '96', '272', '483', '408', '178', '89']\n",
            "27 ['408', '64', '169', '178', '318', '199', '114', '603', '22', '496']\n",
            "331 ['408', '114', '169', '12', '272', '127', '963', '474', '187', '98']\n",
            "332 ['427', '408', '318', '169', '488', '114', '641', '519', '190', '272']\n",
            "329 ['64', '408', '357', '511', '318', '192', '513', '480', '170', '1142']\n",
            "86 ['169', '603', '483', '114', '187', '64', '408', '318', '178', '180']\n",
            "139 ['174', '172', '50', '64', '318', '12', '48', '408', '169', '272']\n",
            "300 ['480', '483', '178', '357', '513', '657', '174', '12', '318', '515']\n",
            "163 ['408', '169', '194', '603', '114', '483', '515', '496', '694', '315']\n",
            "333 ['64', '408', '272', '12', '318', '251', '479', '603', '50', '515']\n",
            "334 ['178', '114', '923', '357', '1449', '64', '480', '647', '589', '493']\n",
            "39 ['187', '318', '178', '480', '357', '64', '513', '427', '496', '432']\n",
            "324 ['474', '98', '603', '515', '526', '427', '480', '496', '174', '479']\n",
            "132 ['1194', '511', '64', '408', '192', '169', '318', '1137', '603', '134']\n",
            "336 ['174', '22', '98', '64', '357', '272', '166', '12', '480', '169']\n",
            "335 ['12', '483', '480', '603', '923', '199', '302', '98', '197', '357']\n",
            "169 ['408', '272', '64', '169', '114', '170', '318', '513', '12', '657']\n",
            "338 ['98', '114', '124', '251', '64', '647', '315', '357', '1449', '127']\n",
            "339 ['114', '513', '14', '169', '318', '285', '408', '611', '137', '432']\n",
            "309 ['50', '173', '172', '483', '181', '272', '408', '64', '318', '174']\n",
            "342 ['127', '180', '474', '185', '205', '603', '178', '498', '187', '589']\n",
            "340 ['318', '22', '483', '657', '519', '479', '169', '170', '603', '408']\n",
            "317 ['64', '127', '56', '251', '318', '191', '187', '12', '483', '178']\n",
            "341 ['474', '603', '174', '272', '483', '408', '318', '89', '64', '191']\n",
            "343 ['151', '114', '285', '185', '514', '513', '647', '641', '172', '479']\n",
            "344 ['114', '474', '134', '135', '654', '318', '56', '659', '427', '480']\n",
            "345 ['187', '408', '178', '127', '515', '114', '134', '427', '169', '493']\n",
            "346 ['69', '316', '357', '28', '71', '194', '513', '923', '531', '963']\n",
            "347 ['408', '316', '64', '663', '194', '135', '114', '603', '213', '205']\n",
            "273 ['173', '169', '114', '657', '483', '168', '515', '134', '318', '12']\n",
            "55 ['12', '64', '408', '603', '272', '479', '318', '313', '178', '187']\n",
            "349 ['127', '12', '64', '357', '318', '408', '511', '483', '132', '661']\n",
            "348 ['603', '174', '172', '483', '408', '178', '64', '169', '963', '12']\n",
            "354 ['408', '114', '357', '56', '302', '633', '654', '474', '641', '427']\n",
            "351 ['98', '603', '181', '480', '174', '96', '79', '483', '408', '178']\n",
            "358 ['178', '285', '408', '657', '64', '641', '513', '528', '136', '189']\n",
            "352 ['513', '313', '189', '408', '483', '64', '272', '480', '963', '285']\n",
            "360 ['169', '114', '493', '408', '488', '1449', '487', '316', '603', '512']\n",
            "363 ['190', '478', '318', '661', '272', '83', '528', '445', '811', '305']\n",
            "355 ['474', '98', '603', '515', '480', '174', '483', '408', '127', '318']\n",
            "362 ['318', '169', '22', '64', '603', '483', '408', '124', '79', '14']\n",
            "357 ['302', '95', '603', '427', '480', '174', '514', '272', '172', '483']\n",
            "356 ['127', '56', '408', '169', '657', '963', '318', '64', '12', '100']\n",
            "361 ['134', '483', '127', '251', '318', '199', '169', '174', '480', '357']\n",
            "365 ['483', '192', '189', '513', '12', '428', '174', '173', '179', '50']\n",
            "350 ['318', '191', '178', '169', '488', '134', '513', '197', '963', '902']\n",
            "367 ['474', '603', '480', '174', '483', '408', '318', '89', '189', '64']\n",
            "368 ['64', '318', '168', '12', '963', '408', '603', '22', '169', '114']\n",
            "371 ['318', '169', '313', '408', '272', '178', '96', '205', '302', '427']\n",
            "373 ['408', '483', '272', '316', '478', '479', '429', '513', '646', '498']\n",
            "370 ['496', '169', '483', '251', '408', '963', '178', '479', '515', '313']\n",
            "374 ['313', '511', '136', '661', '528', '604', '523', '189', '215', '496']\n",
            "372 ['603', '515', '427', '480', '275', '498', '132', '479', '172', '483']\n",
            "337 ['272', '408', '512', '313', '316', '483', '523', '657', '170', '285']\n",
            "378 ['483', '515', '170', '114', '603', '427', '478', '657', '189', '408']\n",
            "366 ['302', '474', '603', '515', '480', '275', '174', '272', '298', '172']\n",
            "377 ['318', '64', '22', '12', '483', '174', '169', '657', '515', '603']\n",
            "375 ['408', '114', '318', '169', '64', '483', '98', '200', '178', '50']\n",
            "359 ['318', '169', '64', '173', '174', '178', '12', '114', '603', '210']\n",
            "379 ['318', '515', '114', '132', '493', '963', '657', '484', '483', '165']\n",
            "380 ['169', '408', '657', '484', '603', '641', '525', '275', '316', '178']\n",
            "381 ['114', '23', '169', '64', '603', '427', '242', '513', '185', '474']\n",
            "385 ['647', '60', '302', '856', '607', '519', '469', '223', '513', '248']\n",
            "382 ['178', '657', '60', '513', '189', '705', '603', '654', '83', '480']\n",
            "387 ['302', '276', '137', '497', '150', '493', '134', '275', '269', '272']\n",
            "364 ['318', '357', '483', '408', '480', '64', '657', '169', '251', '515']\n",
            "369 ['408', '12', '169', '483', '178', '474', '64', '89', '174', '480']\n",
            "388 ['603', '480', '483', '408', '318', '64', '169', '513', '963', '657']\n",
            "386 ['408', '654', '603', '318', '169', '64', '513', '12', '114', '89']\n",
            "389 ['114', '180', '12', '177', '528', '515', '272', '511', '137', '169']\n",
            "383 ['408', '318', '64', '169', '50', '98', '12', '251', '659', '172']\n",
            "390 ['408', '173', '513', '174', '64', '12', '483', '114', '178', '169']\n",
            "393 ['408', '300', '326', '251', '963', '1149', '603', '1019', '481', '429']\n",
            "392 ['603', '357', '483', '427', '124', '318', '100', '408', '153', '315']\n",
            "376 ['64', '483', '408', '169', '174', '318', '480', '12', '127', '22']\n",
            "394 ['64', '357', '318', '272', '408', '127', '114', '474', '316', '205']\n",
            "391 ['178', '654', '607', '408', '513', '192', '493', '251', '488', '114']\n",
            "398 ['318', '143', '22', '408', '657', '515', '963', '187', '313', '251']\n",
            "397 ['173', '187', '64', '89', '98', '48', '169', '114', '515', '234']\n",
            "399 ['408', '657', '515', '83', '478', '169', '512', '659', '479', '251']\n",
            "396 ['483', '64', '657', '480', '603', '285', '318', '12', '607', '512']\n",
            "401 ['30', '496', '178', '498', '607', '169', '170', '513', '694', '114']\n",
            "402 ['187', '318', '134', '170', '98', '114', '178', '484', '963', '656']\n",
            "384 ['174', '483', '408', '64', '199', '657', '480', '12', '114', '357']\n",
            "395 ['114', '408', '169', '963', '496', '357', '132', '427', '178', '511']\n",
            "353 ['169', '408', '603', '64', '483', '174', '657', '114', '56', '89']\n",
            "403 ['963', '603', '483', '657', '178', '89', '169', '479', '408', '661']\n",
            "405 ['144', '485', '487', '490', '1142', '936', '1189', '611', '459', '1137']\n",
            "400 ['114', '408', '169', '483', '50', '173', '172', '657', '174', '178']\n",
            "406 ['169', '408', '45', '653', '659', '530', '484', '189', '60', '114']\n",
            "407 ['318', '114', '513', '48', '124', '963', '654', '320', '511', '515']\n",
            "409 ['169', '408', '963', '488', '694', '1039', '114', '251', '124', '302']\n",
            "404 ['496', '178', '12', '64', '169', '318', '408', '8', '136', '251']\n",
            "413 ['318', '483', '64', '169', '408', '172', '178', '174', '316', '603']\n",
            "416 ['186', '170', '408', '487', '483', '193', '169', '478', '512', '59']\n",
            "408 ['178', '318', '641', '169', '480', '59', '136', '197', '483', '64']\n",
            "410 ['408', '98', '318', '357', '64', '496', '603', '169', '480', '483']\n",
            "411 ['511', '169', '357', '64', '480', '12', '114', '313', '483', '127']\n",
            "417 ['318', '22', '313', '205', '194', '87', '192', '641', '657', '520']\n",
            "412 ['12', '313', '272', '127', '176', '192', '657', '190', '98', '48']\n",
            "420 ['178', '318', '64', '483', '114', '511', '489', '480', '357', '169']\n",
            "422 ['408', '56', '169', '474', '493', '114', '318', '45', '64', '12']\n",
            "425 ['285', '408', '14', '512', '135', '513', '199', '137', '175', '663']\n",
            "419 ['169', '318', '272', '408', '114', '657', '64', '513', '512', '170']\n",
            "415 ['12', '64', '318', '50', '357', '96', '169', '285', '603', '408']\n",
            "423 ['169', '56', '318', '64', '89', '12', '178', '483', '603', '408']\n",
            "429 ['515', '187', '474', '657', '313', '302', '923', '963', '408', '641']\n",
            "428 ['127', '318', '64', '357', '12', '496', '98', '483', '178', '603']\n",
            "427 ['242', '474', '265', '95', '246', '98', '193', '194', '603', '1137']\n",
            "418 ['408', '64', '318', '515', '657', '9', '603', '483', '22', '173']\n",
            "424 ['64', '174', '98', '408', '603', '169', '481', '607', '199', '318']\n",
            "432 ['172', '318', '174', '427', '513', '657', '133', '199', '143', '64']\n",
            "421 ['408', '480', '169', '513', '272', '483', '313', '48', '515', '963']\n",
            "435 ['408', '272', '475', '114', '530', '251', '198', '150', '1449', '641']\n",
            "433 ['98', '199', '408', '483', '513', '169', '427', '480', '511', '64']\n",
            "426 ['169', '408', '963', '64', '89', '923', '12', '114', '48', '615']\n",
            "436 ['408', '641', '474', '523', '1019', '169', '69', '64', '12', '272']\n",
            "430 ['513', '169', '408', '251', '316', '272', '197', '178', '187', '483']\n",
            "434 ['174', '313', '114', '187', '64', '285', '357', '82', '172', '178']\n",
            "437 ['127', '427', '187', '178', '57', '510', '498', '136', '661', '114']\n",
            "438 ['174', '96', '272', '313', '136', '12', '408', '657', '114', '178']\n",
            "431 ['64', '318', '174', '169', '251', '272', '408', '114', '483', '50']\n",
            "442 ['408', '114', '178', '127', '285', '183', '357', '200', '475', '50']\n",
            "440 ['474', '98', '427', '480', '23', '483', '408', '127', '318', '56']\n",
            "445 ['318', '185', '178', '641', '187', '134', '427', '180', '483', '496']\n",
            "447 ['114', '169', '64', '408', '172', '173', '127', '187', '194', '196']\n",
            "449 ['474', '408', '134', '169', '50', '185', '180', '511', '178', '654']\n",
            "450 ['513', '198', '189', '1007', '156', '963', '320', '408', '515', '8']\n",
            "446 ['408', '64', '357', '318', '313', '114', '127', '603', '12', '511']\n",
            "439 ['480', '12', '318', '178', '169', '174', '483', '496', '64', '657']\n",
            "451 ['12', '174', '22', '82', '313', '210', '173', '64', '117', '480']\n",
            "452 ['169', '657', '1131', '408', '28', '524', '699', '604', '511', '313']\n",
            "454 ['251', '1137', '187', '170', '408', '963', '863', '186', '744', '19']\n",
            "453 ['474', '64', '169', '484', '480', '483', '176', '127', '89', '434']\n",
            "414 ['127', '56', '89', '12', '156', '318', '357', '169', '134', '513']\n",
            "455 ['408', '169', '603', '194', '302', '480', '427', '190', '272', '114']\n",
            "444 ['127', '12', '318', '191', '195', '474', '173', '408', '64', '185']\n",
            "448 ['127', '408', '169', '100', '50', '187', '192', '480', '114', '474']\n",
            "457 ['408', '187', '313', '603', '963', '657', '480', '513', '496', '750']\n",
            "456 ['285', '408', '661', '169', '178', '513', '276', '428', '512', '275']\n",
            "458 ['480', '511', '479', '185', '528', '657', '89', '963', '923', '856']\n",
            "462 ['408', '318', '64', '96', '172', '174', '132', '316', '191', '169']\n",
            "459 ['96', '408', '313', '272', '12', '513', '176', '315', '483', '316']\n",
            "460 ['357', '474', '483', '318', '408', '197', '427', '178', '64', '98']\n",
            "461 ['134', '318', '483', '56', '178', '603', '169', '513', '64', '1194']\n",
            "467 ['318', '357', '56', '178', '513', '408', '479', '603', '515', '64']\n",
            "468 ['513', '527', '302', '923', '313', '114', '1142', '134', '483', '408']\n",
            "466 ['318', '603', '64', '191', '511', '524', '408', '251', '114', '12']\n",
            "472 ['302', '474', '512', '480', '317', '750', '479', '272', '61', '48']\n",
            "465 ['251', '9', '302', '657', '519', '479', '1449', '515', '165', '124']\n",
            "463 ['318', '357', '191', '174', '603', '178', '515', '513', '496', '427']\n",
            "471 ['313', '318', '28', '64', '520', '515', '251', '174', '408', '127']\n",
            "474 ['156', '114', '408', '1142', '169', '272', '694', '144', '129', '251']\n",
            "469 ['318', '169', '89', '316', '963', '408', '488', '251', '22', '187']\n",
            "464 ['272', '318', '64', '199', '178', '56', '169', '611', '513', '480']\n",
            "476 ['64', '114', '98', '318', '50', '313', '169', '408', '136', '199']\n",
            "478 ['127', '174', '316', '251', '603', '272', '313', '408', '483', '515']\n",
            "473 ['408', '100', '89', '169', '272', '12', '114', '318', '178', '98']\n",
            "470 ['127', '408', '963', '427', '474', '64', '302', '480', '269', '320']\n",
            "480 ['513', '408', '357', '318', '1142', '427', '694', '173', '134', '657']\n",
            "441 ['169', '480', '318', '408', '513', '511', '50', '357', '479', '483']\n",
            "479 ['114', '519', '178', '64', '12', '484', '223', '654', '132', '494']\n",
            "484 ['511', '169', '64', '513', '12', '483', '520', '604', '178', '114']\n",
            "486 ['318', '511', '134', '357', '116', '480', '64', '483', '427', '513']\n",
            "487 ['408', '177', '251', '923', '198', '316', '523', '1039', '603', '228']\n",
            "482 ['199', '483', '408', '12', '923', '603', '169', '272', '251', '64']\n",
            "481 ['511', '408', '169', '483', '496', '174', '603', '480', '694', '515']\n",
            "492 ['357', '180', '8', '12', '79', '484', '427', '114', '50', '313']\n",
            "493 ['408', '169', '313', '709', '520', '8', '83', '478', '604', '661']\n",
            "490 ['408', '114', '357', '169', '185', '223', '190', '178', '496', '474']\n",
            "489 ['603', '480', '408', '12', '22', '127', '50', '483', '223', '484']\n",
            "483 ['408', '169', '114', '483', '478', '64', '519', '172', '178', '196']\n",
            "496 ['408', '12', '529', '474', '272', '169', '963', '511', '357', '488']\n",
            "494 ['313', '318', '302', '187', '22', '173', '114', '12', '493', '272']\n",
            "495 ['408', '169', '223', '124', '923', '180', '177', '316', '604', '285']\n",
            "477 ['302', '474', '265', '144', '1', '95', '98', '193', '603', '1137']\n",
            "497 ['357', '318', '64', '313', '480', '199', '513', '478', '272', '166']\n",
            "488 ['313', '408', '615', '169', '194', '603', '165', '251', '121', '166']\n",
            "498 ['357', '114', '408', '178', '513', '428', '318', '654', '199', '511']\n",
            "499 ['923', '316', '178', '1194', '515', '496', '203', '134', '498', '242']\n",
            "491 ['64', '174', '272', '318', '427', '50', '313', '963', '251', '178']\n",
            "500 ['647', '512', '114', '474', '1449', '357', '654', '530', '603', '187']\n",
            "502 ['318', '12', '64', '50', '11', '114', '173', '408', '1019', '603']\n",
            "503 ['178', '169', '483', '258', '114', '251', '242', '208', '480', '408']\n",
            "504 ['302', '923', '408', '22', '657', '659', '524', '589', '963', '190']\n",
            "505 ['318', '143', '923', '603', '1194', '408', '483', '15', '963', '216']\n",
            "506 ['313', '144', '22', '318', '64', '127', '480', '526', '192', '483']\n",
            "443 ['318', '408', '169', '64', '50', '316', '190', '272', '427', '498']\n",
            "507 ['242', '346', '474', '265', '86', '392', '486', '144', '1', '246']\n",
            "514 ['1007', '657', '251', '513', '963', '478', '498', '223', '1142', '316']\n",
            "508 ['483', '606', '657', '178', '127', '313', '607', '499', '12', '302']\n",
            "511 ['302', '480', '318', '483', '427', '963', '357', '134', '127', '178']\n",
            "515 ['12', '178', '64', '408', '318', '114', '320', '272', '923', '963']\n",
            "512 ['474', '408', '657', '480', '98', '64', '357', '513', '169', '12']\n",
            "513 ['302', '474', '98', '603', '515', '427', '165', '480', '132', '174']\n",
            "475 ['603', '169', '483', '474', '178', '12', '408', '923', '479', '515']\n",
            "523 ['98', '603', '1137', '480', '498', '174', '172', '483', '178', '318']\n",
            "518 ['313', '172', '64', '483', '12', '194', '515', '318', '98', '178']\n",
            "509 ['408', '12', '173', '183', '114', '64', '474', '316', '483', '89']\n",
            "516 ['483', '114', '134', '408', '603', '498', '513', '64', '480', '487']\n",
            "510 ['12', '50', '181', '64', '172', '408', '318', '272', '174', '173']\n",
            "524 ['923', '169', '11', '853', '694', '114', '963', '512', '659', '524']\n",
            "501 ['408', '114', '169', '357', '64', '190', '318', '511', '12', '515']\n",
            "525 ['178', '318', '963', '64', '657', '98', '483', '12', '316', '480']\n",
            "521 ['318', '408', '64', '169', '513', '603', '478', '190', '357', '923']\n",
            "520 ['50', '318', '174', '496', '64', '191', '408', '22', '12', '194']\n",
            "519 ['242', '302', '474', '98', '194', '603', '1137', '515', '427', '512']\n",
            "528 ['169', '318', '408', '511', '114', '98', '515', '257', '603', '205']\n",
            "532 ['144', '174', '408', '69', '705', '64', '611', '192', '170', '89']\n",
            "530 ['12', '408', '169', '318', '603', '30', '480', '114', '515', '200']\n",
            "531 ['187', '174', '169', '173', '511', '127', '483', '50', '318', '22']\n",
            "529 ['187', '178', '408', '127', '205', '64', '313', '511', '50', '114']\n",
            "517 ['408', '173', '169', '132', '511', '318', '190', '488', '191', '114']\n",
            "527 ['656', '484', '654', '480', '178', '408', '199', '488', '510', '98']\n",
            "485 ['480', '511', '134', '603', '483', '169', '114', '127', '408', '427']\n",
            "533 ['173', '79', '251', '923', '170', '166', '604', '178', '963', '316']\n",
            "535 ['408', '659', '169', '251', '12', '124', '114', '191', '320', '490']\n",
            "536 ['187', '313', '64', '114', '316', '272', '315', '127', '429', '1137']\n",
            "526 ['318', '483', '515', '921', '114', '169', '427', '657', '603', '654']\n",
            "537 ['169', '114', '611', '154', '165', '1449', '223', '9', '8', '408']\n",
            "534 ['603', '143', '515', '480', '479', '272', '483', '408', '178', '318']\n",
            "541 ['169', '178', '114', '408', '64', '318', '480', '357', '191', '98']\n",
            "538 ['408', '169', '603', '64', '178', '480', '657', '251', '513', '357']\n",
            "542 ['114', '169', '134', '178', '483', '98', '480', '285', '529', '408']\n",
            "545 ['408', '12', '316', '529', '483', '272', '313', '169', '320', '963']\n",
            "539 ['114', '479', '178', '657', '318', '134', '427', '302', '169', '513']\n",
            "547 ['64', '318', '127', '50', '178', '427', '483', '114', '182', '170']\n",
            "543 ['178', '483', '285', '657', '484', '488', '511', '641', '127', '512']\n",
            "548 ['963', '524', '511', '174', '223', '22', '661', '1019', '169', '408']\n",
            "546 ['432', '165', '480', '174', '96', '479', '483', '408', '318', '169']\n",
            "522 ['127', '285', '603', '64', '408', '963', '169', '483', '174', '657']\n",
            "551 ['175', '60', '654', '750', '481', '736', '641', '694', '589', '513']\n",
            "544 ['127', '174', '50', '408', '64', '12', '22', '318', '173', '511']\n",
            "553 ['408', '529', '114', '285', '12', '357', '512', '1449', '302', '64']\n",
            "552 ['169', '408', '318', '64', '480', '483', '22', '174', '272', '251']\n",
            "540 ['127', '318', '408', '64', '357', '169', '251', '12', '480', '285']\n",
            "554 ['64', '603', '483', '408', '513', '480', '694', '520', '251', '357']\n",
            "550 ['64', '187', '318', '408', '12', '480', '963', '127', '657', '427']\n",
            "556 ['185', '483', '320', '28', '480', '316', '963', '651', '197', '169']\n",
            "559 ['357', '114', '496', '483', '189', '657', '83', '169', '59', '251']\n",
            "560 ['64', '172', '408', '285', '174', '272', '313', '513', '56', '114']\n",
            "561 ['169', '127', '114', '134', '408', '192', '275', '1007', '647', '528']\n",
            "563 ['12', '318', '408', '64', '127', '187', '357', '114', '603', '272']\n",
            "566 ['190', '187', '663', '357', '200', '180', '9', '185', '654', '641']\n",
            "557 ['178', '318', '483', '64', '87', '251', '19', '169', '408', '488']\n",
            "558 ['318', '64', '114', '127', '483', '169', '408', '603', '302', '480']\n",
            "564 ['64', '318', '191', '408', '483', '603', '963', '1137', '178', '498']\n",
            "565 ['603', '480', '479', '483', '408', '178', '318', '357', '169', '12']\n",
            "573 ['169', '318', '64', '408', '603', '56', '12', '483', '272', '316']\n",
            "549 ['408', '64', '169', '318', '603', '134', '190', '657', '114', '963']\n",
            "567 ['169', '408', '512', '275', '656', '114', '200', '320', '707', '180']\n",
            "569 ['318', '98', '515', '513', '657', '174', '408', '191', '132', '178']\n",
            "562 ['515', '22', '64', '496', '423', '657', '269', '12', '481', '963']\n",
            "576 ['174', '22', '64', '480', '483', '408', '183', '194', '87', '178']\n",
            "577 ['169', '408', '1019', '189', '923', '170', '483', '223', '647', '178']\n",
            "579 ['318', '483', '191', '64', '174', '515', '22', '657', '114', '132']\n",
            "574 ['408', '169', '657', '515', '86', '513', '12', '603', '190', '519']\n",
            "555 ['496', '174', '64', '170', '12', '603', '408', '127', '272', '515']\n",
            "572 ['515', '408', '98', '169', '483', '64', '83', '318', '657', '357']\n",
            "575 ['515', '169', '178', '136', '190', '408', '272', '170', '114', '22']\n",
            "584 ['64', '483', '408', '178', '318', '169', '98', '127', '498', '963']\n",
            "588 ['479', '197', '963', '661', '1103', '603', '487', '190', '300', '486']\n",
            "587 ['169', '98', '483', '114', '12', '408', '192', '474', '199', '482']\n",
            "568 ['318', '316', '64', '408', '169', '190', '251', '272', '12', '969']\n",
            "586 ['316', '64', '272', '12', '408', '480', '251', '315', '313', '300']\n",
            "585 ['64', '318', '603', '408', '12', '9', '272', '487', '251', '657']\n",
            "582 ['408', '127', '169', '511', '114', '180', '654', '318', '474', '135']\n",
            "591 ['318', '114', '408', '98', '515', '178', '169', '657', '512', '315']\n",
            "581 ['318', '169', '178', '408', '251', '89', '488', '190', '923', '12']\n",
            "592 ['156', '474', '515', '493', '506', '530', '1449', '152', '316', '114']\n",
            "580 ['408', '114', '169', '474', '480', '178', '318', '64', '98', '196']\n",
            "590 ['408', '318', '169', '483', '357', '64', '513', '694', '98', '197']\n",
            "593 ['205', '169', '114', '64', '22', '512', '12', '408', '484', '208']\n",
            "583 ['603', '98', '302', '56', '474', '64', '408', '318', '484', '197']\n",
            "596 ['318', '408', '172', '174', '22', '64', '513', '169', '357', '178']\n",
            "570 ['169', '483', '318', '511', '603', '178', '528', '114', '496', '408']\n",
            "599 ['196', '174', '172', '408', '178', '318', '64', '173', '50', '189']\n",
            "589 ['408', '169', '64', '86', '480', '83', '114', '22', '657', '318']\n",
            "594 ['318', '169', '59', '657', '64', '408', '190', '114', '923', '12']\n",
            "597 ['318', '178', '1194', '12', '132', '483', '89', '357', '480', '657']\n",
            "578 ['480', '22', '357', '199', '408', '64', '12', '178', '483', '603']\n",
            "601 ['169', '114', '89', '408', '474', '647', '190', '175', '641', '134']\n",
            "602 ['178', '318', '357', '64', '427', '483', '408', '513', '114', '480']\n",
            "600 ['114', '408', '474', '134', '603', '100', '64', '169', '480', '12']\n",
            "605 ['474', '515', '169', '134', '199', '56', '178', '114', '179', '480']\n",
            "603 ['169', '178', '114', '483', '316', '318', '408', '709', '603', '64']\n",
            "595 ['56', '357', '318', '64', '12', '408', '98', '515', '178', '135']\n",
            "606 ['318', '515', '169', '408', '603', '606', '199', '487', '657', '251']\n",
            "608 ['242', '200', '169', '515', '482', '189', '251', '170', '178', '408']\n",
            "607 ['515', '169', '318', '127', '12', '98', '187', '223', '168', '603']\n",
            "610 ['302', '657', '513', '134', '208', '285', '357', '178', '23', '654']\n",
            "611 ['318', '170', '178', '513', '483', '12', '251', '603', '64', '357']\n",
            "617 ['511', '479', '483', '180', '32', '169', '23', '484', '966', '285']\n",
            "618 ['357', '603', '134', '194', '251', '520', '480', '527', '482', '963']\n",
            "614 ['408', '169', '1019', '12', '654', '114', '474', '603', '189', '513']\n",
            "609 ['318', '178', '50', '64', '169', '427', '89', '174', '483', '114']\n",
            "615 ['483', '511', '318', '172', '169', '285', '98', '134', '484', '50']\n",
            "616 ['357', '483', '12', '480', '318', '56', '64', '169', '127', '474']\n",
            "620 ['483', '408', '64', '169', '114', '657', '178', '318', '515', '641']\n",
            "571 ['318', '515', '408', '178', '189', '483', '170', '169', '22', '132']\n",
            "619 ['1137', '64', '480', '169', '511', '87', '408', '483', '204', '963']\n",
            "613 ['408', '178', '169', '474', '357', '251', '183', '496', '98', '1449']\n",
            "622 ['357', '318', '1449', '114', '186', '313', '513', '272', '205', '192']\n",
            "621 ['169', '408', '98', '114', '56', '199', '357', '474', '511', '923']\n",
            "604 ['50', '318', '172', '511', '181', '483', '285', '132', '489', '187']\n",
            "624 ['12', '515', '64', '174', '98', '173', '172', '114', '408', '657']\n",
            "612 ['483', '318', '169', '98', '114', '513', '136', '189', '408', '515']\n",
            "627 ['173', '169', '209', '408', '483', '963', '272', '512', '114', '127']\n",
            "623 ['408', '169', '318', '64', '174', '172', '199', '480', '12', '479']\n",
            "628 ['474', '95', '98', '194', '603', '1137', '143', '515', '526', '427']\n",
            "625 ['64', '272', '318', '205', '316', '474', '124', '223', '98', '313']\n",
            "629 ['313', '169', '408', '134', '48', '318', '483', '1142', '192', '272']\n",
            "633 ['178', '64', '480', '174', '12', '659', '251', '481', '210', '735']\n",
            "632 ['178', '169', '496', '251', '187', '427', '190', '408', '659', '114']\n",
            "631 ['408', '515', '170', '285', '427', '64', '114', '12', '513', '169']\n",
            "634 ['187', '114', '318', '64', '205', '357', '168', '166', '56', '12']\n",
            "639 ['318', '64', '479', '480', '133', '169', '408', '485', '603', '606']\n",
            "630 ['408', '316', '1194', '313', '136', '189', '318', '169', '921', '114']\n",
            "642 ['194', '408', '270', '169', '481', '275', '199', '57', '1149', '851']\n",
            "637 ['22', '313', '318', '69', '174', '483', '265', '8', '64', '173']\n",
            "640 ['603', '427', '480', '483', '408', '178', '127', '89', '654', '511']\n",
            "626 ['318', '169', '64', '603', '483', '493', '657', '320', '427', '408']\n",
            "643 ['513', '135', '285', '178', '134', '191', '272', '124', '318', '480']\n",
            "598 ['318', '251', '174', '50', '513', '172', '357', '96', '64', '178']\n",
            "638 ['318', '64', '178', '69', '12', '408', '15', '316', '427', '251']\n",
            "635 ['169', '318', '114', '134', '98', '694', '513', '519', '182', '483']\n",
            "644 ['169', '12', '923', '313', '64', '272', '223', '408', '22', '318']\n",
            "636 ['603', '515', '480', '172', '483', '408', '318', '64', '357', '199']\n",
            "645 ['114', '178', '603', '169', '657', '480', '285', '127', '515', '190']\n",
            "648 ['313', '963', '258', '114', '480', '659', '257', '607', '494', '282']\n",
            "647 ['114', '483', '318', '169', '64', '313', '12', '487', '178', '480']\n",
            "650 ['114', '12', '408', '169', '318', '165', '45', '302', '83', '513']\n",
            "651 ['98', '114', '408', '657', '50', '64', '135', '357', '318', '483']\n",
            "654 ['96', '64', '427', '604', '378', '705', '429', '190', '316', '99']\n",
            "653 ['408', '963', '12', '169', '285', '1137', '430', '529', '190', '483']\n",
            "655 ['169', '114', '199', '641', '408', '482', '136', '648', '510', '189']\n",
            "649 ['318', '114', '357', '515', '512', '98', '657', '474', '519', '484']\n",
            "658 ['316', '513', '641', '272', '483', '64', '170', '357', '12', '174']\n",
            "656 ['318', '178', '357', '498', '114', '185', '132', '169', '480', '511']\n",
            "660 ['12', '127', '511', '199', '187', '963', '169', '223', '185', '171']\n",
            "659 ['318', '480', '427', '12', '223', '515', '190', '615', '165', '169']\n",
            "646 ['483', '114', '169', '408', '479', '603', '136', '172', '178', '657']\n",
            "663 ['408', '114', '641', '168', '513', '166', '504', '527', '633', '285']\n",
            "664 ['185', '474', '178', '511', '114', '48', '320', '641', '205', '515']\n",
            "657 ['169', '408', '318', '174', '178', '603', '179', '165', '515', '479']\n",
            "665 ['272', '318', '408', '178', '64', '169', '606', '316', '479', '478']\n",
            "666 ['408', '9', '242', '1449', '316', '589', '178', '488', '524', '285']\n",
            "661 ['483', '513', '12', '127', '251', '1449', '511', '651', '98', '114']\n",
            "662 ['603', '180', '199', '483', '484', '169', '114', '251', '654', '318']\n",
            "667 ['408', '169', '603', '64', '12', '251', '170', '89', '114', '178']\n",
            "641 ['170', '318', '114', '12', '357', '529', '661', '127', '480', '316']\n",
            "668 ['114', '89', '12', '487', '474', '199', '357', '178', '169', '135']\n",
            "673 ['408', '483', '603', '511', '64', '169', '357', '174', '480', '8']\n",
            "671 ['95', '143', '64', '272', '434', '651', '408', '483', '169', '170']\n",
            "669 ['170', '318', '487', '178', '242', '651', '419', '116', '661', '489']\n",
            "676 ['199', '210', '357', '511', '484', '408', '513', '180', '203', '498']\n",
            "674 ['64', '169', '98', '487', '408', '136', '318', '603', '357', '483']\n",
            "652 ['56', '313', '318', '603', '178', '169', '408', '187', '127', '136']\n",
            "677 ['12', '89', '199', '313', '114', '524', '223', '168', '64', '11']\n",
            "682 ['483', '199', '408', '169', '316', '921', '313', '198', '189', '923']\n",
            "679 ['127', '515', '474', '657', '178', '114', '187', '191', '408', '511']\n",
            "684 ['318', '603', '313', '169', '174', '511', '498', '22', '478', '272']\n",
            "685 ['100', '178', '483', '64', '963', '408', '187', '12', '603', '169']\n",
            "683 ['519', '178', '357', '479', '603', '484', '483', '114', '488', '408']\n",
            "691 ['515', '487', '357', '190', '408', '114', '191', '173', '488', '169']\n",
            "672 ['178', '483', '408', '169', '98', '513', '89', '114', '189', '357']\n",
            "692 ['50', '169', '483', '172', '114', '408', '178', '181', '357', '511']\n",
            "690 ['97', '318', '50', '480', '408', '483', '603', '114', '251', '176']\n",
            "689 ['228', '169', '511', '483', '12', '89', '64', '408', '318', '603']\n",
            "686 ['100', '515', '483', '408', '169', '190', '511', '114', '223', '489']\n",
            "693 ['515', '165', '493', '408', '513', '657', '923', '1143', '251', '474']\n",
            "688 ['242', '51', '474', '265', '86', '257', '486', '144', '1', '246']\n",
            "697 ['603', '483', '178', '89', '169', '168', '511', '114', '694', '172']\n",
            "698 ['408', '313', '64', '318', '114', '12', '519', '1007', '136', '251']\n",
            "670 ['513', '963', '408', '172', '178', '169', '64', '313', '318', '22']\n",
            "694 ['64', '408', '114', '251', '513', '169', '272', '79', '651', '96']\n",
            "680 ['12', '483', '603', '89', '963', '56', '223', '178', '272', '127']\n",
            "705 ['524', '408', '607', '487', '603', '480', '136', '430', '835', '315']\n",
            "701 ['480', '408', '657', '169', '513', '483', '114', '479', '474', '178']\n",
            "699 ['408', '169', '178', '661', '513', '483', '251', '1194', '313', '114']\n",
            "704 ['64', '169', '251', '483', '515', '79', '114', '357', '531', '694']\n",
            "707 ['512', '408', '657', '513', '652', '223', '1137', '114', '357', '178']\n",
            "700 ['178', '483', '170', '172', '408', '114', '498', '313', '1137', '272']\n",
            "687 ['408', '169', '483', '603', '172', '50', '114', '511', '178', '498']\n",
            "695 ['169', '474', '183', '408', '179', '178', '114', '483', '654', '98']\n",
            "675 ['408', '178', '603', '22', '180', '197', '132', '511', '430', '83']\n",
            "708 ['174', '64', '169', '172', '318', '12', '357', '603', '144', '79']\n",
            "709 ['408', '480', '963', '251', '736', '496', '169', '521', '357', '923']\n",
            "711 ['9', '474', '515', '657', '178', '14', '479', '357', '57', '709']\n",
            "710 ['480', '178', '98', '474', '408', '511', '169', '170', '513', '114']\n",
            "712 ['22', '318', '300', '272', '429', '12', '133', '408', '64', '169']\n",
            "715 ['357', '169', '178', '515', '316', '483', '705', '527', '166', '408']\n",
            "713 ['408', '127', '169', '474', '50', '114', '178', '480', '187', '357']\n",
            "716 ['302', '12', '313', '165', '170', '114', '57', '657', '923', '607']\n",
            "681 ['408', '169', '50', '180', '603', '114', '483', '923', '474', '480']\n",
            "678 ['114', '64', '357', '318', '302', '480', '408', '169', '223', '483']\n",
            "719 ['173', '169', '408', '963', '515', '12', '197', '657', '178', '496']\n",
            "702 ['169', '408', '511', '50', '114', '59', '127', '963', '187', '223']\n",
            "721 ['210', '496', '169', '79', '963', '251', '96', '190', '408', '313']\n",
            "714 ['408', '483', '963', '169', '496', '190', '172', '83', '12', '96']\n",
            "717 ['923', '178', '318', '603', '199', '136', '966', '657', '483', '519']\n",
            "718 ['50', '511', '408', '191', '170', '603', '318', '169', '661', '483']\n",
            "696 ['318', '64', '98', '127', '408', '56', '12', '272', '100', '659']\n",
            "722 ['408', '647', '50', '357', '511', '483', '661', '192', '199', '963']\n",
            "724 ['173', '127', '12', '187', '174', '50', '64', '176', '89', '408']\n",
            "727 ['318', '190', '272', '64', '313', '479', '519', '1007', '193', '493']\n",
            "725 ['318', '169', '480', '190', '64', '603', '79', '408', '641', '513']\n",
            "706 ['172', '174', '318', '496', '169', '64', '170', '963', '513', '408']\n",
            "720 ['318', '64', '169', '408', '114', '190', '483', '50', '98', '181']\n",
            "729 ['408', '64', '59', '114', '963', '169', '194', '98', '923', '50']\n",
            "726 ['318', '515', '50', '98', '64', '408', '174', '178', '169', '480']\n",
            "728 ['408', '114', '12', '64', '318', '169', '172', '190', '173', '272']\n",
            "703 ['174', '64', '172', '483', '408', '22', '313', '1137', '12', '511']\n",
            "738 ['272', '513', '114', '694', '1137', '483', '187', '657', '641', '165']\n",
            "736 ['56', '64', '169', '357', '408', '114', '98', '318', '285', '427']\n",
            "734 ['923', '657', '408', '963', '127', '302', '114', '189', '512', '196']\n",
            "730 ['169', '318', '657', '64', '603', '12', '127', '170', '136', '251']\n",
            "743 ['127', '178', '513', '357', '187', '285', '493', '318', '169', '174']\n",
            "742 ['169', '603', '513', '408', '192', '511', '134', '483', '318', '9']\n",
            "737 ['408', '114', '515', '98', '134', '135', '168', '480', '647', '269']\n",
            "733 ['318', '483', '357', '178', '187', '479', '197', '427', '511', '923']\n",
            "745 ['318', '357', '56', '408', '83', '528', '661', '136', '173', '251']\n",
            "740 ['318', '169', '408', '483', '474', '427', '316', '513', '498', '64']\n",
            "735 ['318', '114', '408', '169', '357', '172', '64', '12', '483', '480']\n",
            "747 ['114', '191', '42', '647', '484', '589', '528', '515', '513', '641']\n",
            "723 ['408', '64', '479', '480', '963', '12', '483', '318', '427', '511']\n",
            "739 ['174', '408', '64', '89', '512', '513', '169', '199', '285', '228']\n",
            "749 ['12', '923', '408', '318', '963', '588', '269', '97', '515', '611']\n",
            "748 ['272', '12', '285', '127', '513', '313', '178', '963', '190', '251']\n",
            "746 ['318', '12', '169', '69', '496', '195', '313', '173', '251', '480']\n",
            "731 ['174', '98', '318', '178', '408', '657', '651', '530', '515', '193']\n",
            "750 ['178', '98', '172', '318', '515', '357', '50', '483', '136', '657']\n",
            "741 ['12', '474', '127', '483', '318', '302', '114', '408', '89', '484']\n",
            "751 ['132', '318', '496', '357', '963', '285', '513', '427', '408', '22']\n",
            "756 ['313', '189', '114', '483', '357', '12', '169', '318', '511', '498']\n",
            "757 ['318', '408', '12', '963', '114', '178', '603', '127', '285', '483']\n",
            "752 ['496', '83', '657', '98', '180', '654', '318', '603', '478', '498']\n",
            "758 ['515', '178', '318', '357', '114', '9', '408', '493', '187', '1020']\n",
            "732 ['127', '318', '64', '169', '302', '408', '654', '59', '114', '480']\n",
            "762 ['50', '318', '269', '185', '603', '100', '172', '127', '408', '641']\n",
            "744 ['12', '170', '169', '272', '408', '187', '318', '496', '511', '134']\n",
            "754 ['408', '169', '114', '59', '483', '64', '515', '178', '50', '496']\n",
            "753 ['318', '178', '603', '100', '197', '479', '480', '169', '136', '659']\n",
            "763 ['474', '169', '272', '114', '134', '657', '709', '269', '408', '512']\n",
            "764 ['316', '513', '520', '408', '519', '192', '427', '603', '315', '170']\n",
            "767 ['64', '50', '114', '169', '134', '178', '318', '480', '408', '511']\n",
            "769 ['114', '169', '100', '357', '318', '134', '603', '408', '12', '89']\n",
            "755 ['318', '178', '357', '190', '56', '313', '187', '127', '169', '408']\n",
            "771 ['12', '479', '178', '483', '183', '64', '272', '921', '89', '316']\n",
            "768 ['172', '190', '408', '12', '64', '511', '174', '191', '169', '318']\n",
            "773 ['114', '483', '474', '511', '48', '285', '135', '134', '484', '480']\n",
            "765 ['318', '178', '169', '483', '132', '511', '64', '114', '197', '357']\n",
            "772 ['603', '174', '408', '127', '64', '22', '357', '170', '12', '511']\n",
            "766 ['56', '114', '190', '475', '488', '12', '251', '1449', '223', '1137']\n",
            "774 ['114', '474', '694', '169', '462', '408', '483', '268', '484', '285']\n",
            "760 ['64', '512', '174', '114', '357', '178', '603', '134', '408', '143']\n",
            "761 ['318', '498', '604', '265', '22', '357', '169', '963', '114', '178']\n",
            "777 ['316', '64', '178', '114', '318', '408', '498', '513', '136', '96']\n",
            "759 ['318', '64', '12', '96', '483', '79', '169', '22', '69', '480']\n",
            "776 ['408', '114', '302', '170', '169', '172', '100', '528', '197', '313']\n",
            "780 ['64', '251', '483', '480', '1', '651', '169', '205', '181', '272']\n",
            "779 ['318', '408', '496', '169', '64', '127', '12', '603', '83', '479']\n",
            "778 ['169', '408', '603', '302', '64', '182', '318', '12', '199', '427']\n",
            "782 ['408', '22', '64', '174', '12', '96', '195', '210', '187', '498']\n",
            "786 ['64', '603', '251', '12', '22', '513', '408', '170', '272', '316']\n",
            "784 ['408', '603', '318', '127', '963', '12', '178', '483', '114', '64']\n",
            "770 ['194', '603', '515', '512', '479', '272', '483', '408', '178', '127']\n",
            "788 ['313', '170', '603', '515', '127', '408', '169', '1137', '48', '242']\n",
            "789 ['64', '12', '408', '285', '641', '178', '114', '251', '357', '603']\n",
            "790 ['318', '272', '315', '480', '114', '169', '408', '357', '498', '474']\n",
            "787 ['408', '496', '169', '50', '318', '190', '483', '174', '114', '194']\n",
            "783 ['474', '483', '408', '178', '64', '484', '199', '169', '251', '511']\n",
            "785 ['357', '408', '114', '169', '302', '641', '316', '98', '45', '480']\n",
            "794 ['474', '483', '408', '178', '318', '114', '603', '657', '12', '357']\n",
            "781 ['511', '408', '199', '168', '169', '963', '12', '484', '114', '479']\n",
            "796 ['170', '408', '136', '148', '963', '1193', '11', '519', '523', '1137']\n",
            "795 ['127', '56', '603', '223', '408', '114', '302', '64', '474', '9']\n",
            "793 ['169', '408', '251', '318', '313', '172', '496', '98', '173', '603']\n",
            "798 ['313', '300', '641', '12', '385', '169', '604', '316', '483', '22']\n",
            "791 ['408', '114', '318', '64', '172', '178', '285', '169', '515', '483']\n",
            "802 ['64', '313', '12', '174', '318', '172', '480', '178', '496', '251']\n",
            "800 ['408', '169', '318', '64', '603', '199', '483', '513', '114', '657']\n",
            "804 ['169', '408', '190', '178', '223', '114', '484', '251', '607', '12']\n",
            "803 ['169', '100', '515', '357', '483', '603', '474', '513', '408', '318']\n",
            "775 ['56', '64', '114', '357', '169', '318', '251', '408', '513', '474']\n",
            "792 ['318', '64', '114', '169', '427', '480', '657', '251', '178', '483']\n",
            "799 ['64', '408', '318', '114', '272', '169', '134', '178', '357', '483']\n",
            "805 ['114', '919', '171', '896', '275', '302', '201', '408', '474', '652']\n",
            "806 ['64', '134', '114', '191', '603', '1039', '194', '513', '208', '427']\n",
            "807 ['64', '513', '482', '1019', '480', '479', '169', '519', '481', '190']\n",
            "797 ['114', '64', '603', '408', '12', '192', '483', '169', '178', '480']\n",
            "801 ['178', '318', '198', '64', '357', '12', '114', '316', '272', '1019']\n",
            "809 ['98', '357', '318', '22', '515', '169', '408', '12', '79', '603']\n",
            "815 ['178', '657', '519', '498', '64', '478', '194', '408', '923', '648']\n",
            "817 ['313', '169', '357', '114', '408', '318', '89', '178', '56', '483']\n",
            "821 ['480', '172', '408', '178', '169', '251', '114', '513', '285', '127']\n",
            "818 ['654', '114', '483', '178', '603', '134', '408', '64', '511', '318']\n",
            "814 ['408', '318', '64', '169', '483', '12', '50', '114', '172', '603']\n",
            "812 ['64', '169', '483', '603', '199', '114', '187', '318', '408', '488']\n",
            "823 ['178', '285', '251', '114', '513', '357', '515', '272', '132', '1007']\n",
            "825 ['22', '313', '300', '210', '190', '169', '684', '318', '173', '484']\n",
            "827 ['408', '318', '169', '480', '474', '515', '178', '185', '199', '114']\n",
            "829 ['483', '64', '169', '98', '480', '114', '320', '134', '50', '127']\n",
            "811 ['302', '474', '98', '603', '100', '480', '132', '135', '272', '172']\n",
            "830 ['302', '12', '408', '215', '192', '64', '114', '170', '515', '357']\n",
            "826 ['408', '98', '64', '12', '318', '169', '963', '173', '114', '272']\n",
            "831 ['169', '408', '172', '480', '661', '114', '487', '98', '651', '496']\n",
            "819 ['318', '357', '12', '480', '479', '64', '603', '483', '169', '114']\n",
            "828 ['318', '408', '169', '114', '272', '516', '64', '474', '251', '641']\n",
            "808 ['603', '174', '172', '48', '483', '408', '127', '318', '64', '169']\n",
            "835 ['408', '64', '480', '169', '251', '12', '483', '22', '694', '178']\n",
            "833 ['169', '190', '507', '114', '480', '9', '603', '91', '528', '86']\n",
            "836 ['480', '127', '178', '694', '408', '963', '87', '191', '135', '656']\n",
            "816 ['603', '427', '480', '174', '172', '408', '178', '127', '318', '64']\n",
            "838 ['357', '515', '64', '98', '483', '178', '513', '427', '269', '657']\n",
            "839 ['408', '318', '114', '427', '316', '513', '89', '169', '923', '64']\n",
            "840 ['318', '178', '9', '923', '589', '408', '302', '114', '242', '488']\n",
            "832 ['12', '64', '318', '178', '654', '603', '169', '127', '408', '483']\n",
            "810 ['265', '222', '98', '194', '603', '1137', '181', '196', '515', '427']\n",
            "844 ['357', '408', '64', '483', '272', '641', '474', '178', '191', '320']\n",
            "843 ['169', '408', '694', '1019', '963', '272', '114', '12', '1137', '512']\n",
            "834 ['318', '408', '12', '64', '98', '114', '603', '963', '357', '169']\n",
            "846 ['169', '408', '100', '9', '653', '114', '286', '129', '285', '750']\n",
            "837 ['318', '64', '357', '98', '169', '657', '603', '12', '408', '483']\n",
            "813 ['50', '22', '408', '170', '98', '515', '483', '923', '153', '127']\n",
            "842 ['483', '318', '178', '489', '511', '603', '87', '923', '519', '515']\n",
            "847 ['64', '318', '408', '170', '963', '513', '178', '126', '483', '515']\n",
            "848 ['258', '408', '178', '735', '230', '169', '114', '64', '651', '228']\n",
            "822 ['114', '50', '96', '89', '511', '83', '694', '60', '174', '963']\n",
            "852 ['169', '483', '64', '474', '114', '603', '963', '178', '134', '285']\n",
            "851 ['408', '114', '169', '493', '96', '173', '482', '265', '654', '663']\n",
            "849 ['242', '302', '474', '86', '144', '1', '98', '194', '603', '1137']\n",
            "854 ['209', '276', '179', '474', '178', '408', '114', '654', '169', '641']\n",
            "850 ['12', '313', '64', '408', '143', '963', '195', '603', '483', '251']\n",
            "858 ['180', '318', '513', '187', '657', '654', '169', '114', '357', '199']\n",
            "853 ['657', '313', '483', '169', '318', '963', '64', '408', '22', '178']\n",
            "855 ['127', '318', '169', '408', '50', '64', '480', '12', '178', '511']\n",
            "824 ['603', '169', '114', '191', '408', '12', '483', '318', '496', '136']\n",
            "845 ['64', '515', '496', '408', '318', '483', '169', '98', '657', '114']\n",
            "841 ['408', '64', '12', '657', '318', '603', '427', '480', '169', '479']\n",
            "859 ['408', '272', '178', '8', '318', '64', '169', '479', '483', '22']\n",
            "862 ['242', '275', '272', '408', '318', '169', '923', '511', '963', '114']\n",
            "856 ['169', '408', '98', '603', '12', '318', '64', '223', '1449', '427']\n",
            "820 ['64', '318', '173', '127', '169', '12', '190', '191', '114', '603']\n",
            "863 ['56', '408', '64', '50', '12', '156', '318', '169', '170', '172']\n",
            "860 ['64', '318', '483', '12', '173', '50', '172', '114', '132', '515']\n",
            "857 ['318', '64', '127', '483', '12', '178', '190', '357', '408', '515']\n",
            "864 ['515', '529', '272', '316', '963', '480', '89', '657', '520', '45']\n",
            "865 ['179', '474', '114', '127', '190', '191', '223', '12', '428', '276']\n",
            "868 ['483', '275', '171', '285', '175', '515', '654', '530', '124', '276']\n",
            "867 ['408', '169', '488', '513', '170', '357', '427', '114', '315', '199']\n",
            "861 ['408', '318', '64', '316', '174', '315', '114', '272', '427', '12']\n",
            "870 ['408', '275', '515', '493', '1142', '251', '14', '705', '190', '611']\n",
            "871 ['69', '12', '64', '493', '408', '318', '963', '144', '98', '480']\n",
            "875 ['127', '114', '515', '483', '275', '100', '589', '408', '320', '59']\n",
            "876 ['408', '169', '963', '513', '512', '483', '320', '285', '272', '45']\n",
            "872 ['408', '64', '114', '136', '223', '12', '98', '302', '185', '50']\n",
            "866 ['408', '64', '318', '100', '197', '169', '483', '603', '178', '98']\n",
            "877 ['174', '12', '272', '318', '187', '64', '276', '127', '523', '480']\n",
            "873 ['64', '174', '50', '408', '651', '251', '318', '172', '178', '173']\n",
            "880 ['134', '654', '482', '480', '511', '199', '211', '192', '513', '408']\n",
            "878 ['483', '480', '169', '178', '408', '603', '484', '114', '963', '513']\n",
            "869 ['12', '180', '169', '64', '187', '185', '603', '172', '313', '408']\n",
            "881 ['313', '12', '963', '169', '1194', '223', '496', '603', '604', '1149']\n",
            "879 ['318', '357', '313', '114', '169', '272', '64', '178', '408', '480']\n",
            "883 ['474', '169', '114', '483', '480', '178', '32', '963', '488', '179']\n",
            "882 ['480', '483', '318', '178', '12', '520', '923', '513', '963', '657']\n",
            "884 ['45', '276', '483', '493', '134', '512', '187', '408', '272', '320']\n",
            "886 ['169', '603', '515', '114', '480', '210', '272', '408', '498', '193']\n",
            "885 ['64', '357', '408', '251', '313', '657', '98', '480', '496', '515']\n",
            "889 ['114', '313', '272', '136', '478', '963', '166', '641', '316', '611']\n",
            "874 ['64', '98', '483', '515', '318', '316', '408', '114', '427', '272']\n",
            "892 ['408', '169', '963', '285', '199', '272', '513', '223', '48', '251']\n",
            "890 ['178', '318', '124', '191', '511', '242', '169', '83', '197', '923']\n",
            "893 ['313', '318', '408', '64', '316', '174', '272', '169', '483', '520']\n",
            "887 ['272', '483', '133', '286', '52', '316', '205', '529', '48', '498']\n",
            "891 ['603', '272', '483', '408', '178', '318', '89', '709', '169', '173']\n",
            "894 ['357', '127', '197', '483', '8', '474', '56', '169', '178', '513']\n",
            "896 ['114', '169', '194', '192', '408', '205', '1137', '612', '513', '111']\n",
            "897 ['64', '408', '656', '481', '487', '178', '657', '318', '480', '190']\n",
            "901 ['408', '496', '64', '265', '143', '170', '316', '79', '270', '603']\n",
            "899 ['408', '170', '705', '657', '513', '169', '134', '199', '511', '272']\n",
            "903 ['408', '178', '285', '134', '963', '603', '169', '511', '132', '1449']\n",
            "904 ['98', '318', '515', '480', '513', '272', '654', '170', '483', '661']\n",
            "907 ['302', '265', '95', '193', '603', '1137', '515', '512', '480', '174']\n",
            "905 ['318', '483', '173', '408', '114', '515', '199', '169', '50', '479']\n",
            "902 ['408', '64', '357', '114', '98', '474', '178', '169', '242', '174']\n",
            "898 ['98', '318', '603', '114', '408', '169', '178', '199', '515', '1449']\n",
            "895 ['408', '483', '169', '64', '127', '474', '178', '98', '641', '251']\n",
            "906 ['318', '178', '483', '169', '64', '199', '657', '480', '114', '709']\n",
            "900 ['50', '172', '169', '174', '313', '408', '603', '181', '285', '114']\n",
            "908 ['169', '408', '178', '923', '114', '316', '604', '132', '136', '498']\n",
            "916 ['127', '357', '114', '285', '169', '513', '408', '603', '178', '1142']\n",
            "911 ['50', '408', '114', '963', '12', '169', '318', '127', '511', '64']\n",
            "912 ['923', '515', '603', '114', '408', '98', '22', '651', '480', '57']\n",
            "914 ['483', '64', '178', '100', '515', '98', '199', '318', '169', '496']\n",
            "918 ['515', '313', '408', '114', '57', '657', '242', '12', '169', '285']\n",
            "919 ['408', '515', '659', '511', '192', '603', '611', '150', '657', '427']\n",
            "921 ['300', '12', '408', '22', '318', '64', '496', '265', '251', '963']\n",
            "910 ['318', '187', '64', '515', '272', '169', '251', '496', '661', '408']\n",
            "913 ['479', '272', '192', '513', '165', '611', '170', '135', '114', '615']\n",
            "915 ['169', '483', '98', '114', '515', '408', '318', '603', '512', '484']\n",
            "922 ['318', '64', '178', '483', '408', '316', '515', '735', '963', '480']\n",
            "923 ['302', '474', '603', '515', '480', '498', '479', '483', '408', '178']\n",
            "928 ['302', '474', '603', '515', '427', '512', '480', '23', '479', '483']\n",
            "927 ['408', '483', '169', '657', '479', '524', '272', '709', '478', '22']\n",
            "924 ['169', '22', '513', '735', '199', '483', '189', '98', '170', '484']\n",
            "929 ['64', '114', '408', '169', '178', '603', '357', '313', '190', '657']\n",
            "931 ['98', '408', '318', '64', '169', '187', '114', '170', '357', '513']\n",
            "917 ['12', '272', '114', '357', '169', '56', '515', '408', '603', '657']\n",
            "932 ['48', '408', '127', '223', '190', '50', '318', '272', '23', '12']\n",
            "909 ['474', '98', '515', '483', '408', '178', '127', '318', '89', '357']\n",
            "934 ['64', '493', '408', '166', '430', '178', '79', '169', '251', '22']\n",
            "933 ['408', '484', '316', '169', '694', '528', '199', '513', '963', '641']\n",
            "935 ['316', '483', '22', '318', '114', '272', '189', '603', '136', '498']\n",
            "938 ['98', '408', '12', '191', '173', '64', '603', '83', '185', '194']\n",
            "940 ['408', '519', '318', '136', '603', '132', '190', '661', '64', '496']\n",
            "888 ['515', '178', '318', '408', '427', '114', '483', '1131', '603', '357']\n",
            "925 ['12', '318', '172', '64', '50', '178', '174', '483', '603', '480']\n",
            "942 ['408', '64', '169', '483', '603', '223', '178', '98', '515', '194']\n",
            "937 ['169', '483', '64', '357', '98', '603', '127', '963', '513', '480']\n",
            "926 ['169', '64', '318', '408', '478', '603', '56', '251', '114', '657']\n",
            "943 ['272', '357', '474', '190', '199', '135', '134', '203', '156', '855']\n",
            "939 ['144', '1', '234', '98', '193', '194', '603', '100', '181', '423']\n",
            "936 ['483', '513', '357', '318', '189', '23', '169', '474', '192', '316']\n",
            "930 ['169', '357', '251', '408', '320', '513', '613', '963', '59', '318']\n",
            "920 ['174', '169', '318', '172', '50', '408', '12', '483', '480', '199']\n",
            "941 ['174', '318', '64', '483', '251', '50', '127', '169', '651', '480']\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "a6SYyKSkx69r",
        "colab_type": "text"
      },
      "source": [
        "### How to get the k nearest neighbors of a user (or item)\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "nkNyq_LXx_Am",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "import io \n",
        "from surprise import KNNBaseline\n",
        "from surprise import Dataset\n",
        "from surprise import get_dataset_dir"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jIEwucMTyFJC",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def read_item_names():\n",
        "    \"\"\"Read the u.item file from MovieLens 100-k dataset and return two\n",
        "    mappings to convert raw ids into movie names and movie names into raw ids.\n",
        "    \"\"\"\n",
        "\n",
        "    file_name = get_dataset_dir() + '/ml-100k/ml-100k/u.item'\n",
        "    rid_to_name = {}\n",
        "    name_to_rid = {}\n",
        "    with io.open(file_name, 'r', encoding='ISO-8859-1') as f:\n",
        "        for line in f:\n",
        "            line = line.split('|')\n",
        "            rid_to_name[line[0]] = line[1]\n",
        "            name_to_rid[line[1]] = line[0]\n",
        "\n",
        "    return rid_to_name, name_to_rid\n"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QC2RGYQkyLKL",
        "colab_type": "text"
      },
      "source": [
        "Run KNN"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "70qzDCj_yIiw",
        "colab_type": "code",
        "outputId": "483d4d4c-4eb0-4352-dcf9-37a8e7a23aa8",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 84
        }
      },
      "source": [
        "# First, train the algorithm to compute the similarities between items\n",
        "data = Dataset.load_builtin('ml-100k')\n",
        "trainset = data.build_full_trainset()\n",
        "sim_options = {'name': 'pearson_baseline', 'user_based': False}\n",
        "algo = KNNBaseline(sim_options=sim_options)\n",
        "algo.fit(trainset)"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Estimating biases using als...\n",
            "Computing the pearson_baseline similarity matrix...\n",
            "Done computing similarity matrix.\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<surprise.prediction_algorithms.knns.KNNBaseline at 0x7f53103b5fd0>"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 14
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nW568P_MyXVV",
        "colab_type": "text"
      },
      "source": [
        "Print out KNN Mappings"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "BwT_WsJPyWzf",
        "colab_type": "code",
        "outputId": "82ef126b-94d2-4ece-fcb4-894667e33460",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 218
        }
      },
      "source": [
        "# Read the mappings raw id <-> movie name\n",
        "rid_to_name, name_to_rid = read_item_names()\n",
        "\n",
        "# Retrieve inner id of the movie Toy Story\n",
        "toy_story_raw_id = name_to_rid['Toy Story (1995)']\n",
        "toy_story_inner_id = algo.trainset.to_inner_iid(toy_story_raw_id)\n",
        "\n",
        "# Retrieve inner ids of the nearest neighbors of Toy Story.\n",
        "toy_story_neighbors = algo.get_neighbors(toy_story_inner_id, k=10)\n",
        "\n",
        "# Convert inner ids of the neighbors into names.\n",
        "toy_story_neighbors = (algo.trainset.to_raw_iid(inner_id)\n",
        "                       for inner_id in toy_story_neighbors)\n",
        "toy_story_neighbors = (rid_to_name[rid]\n",
        "                       for rid in toy_story_neighbors)\n",
        "\n",
        "print()\n",
        "print('The 10 nearest neighbors of Toy Story are:')\n",
        "for movie in toy_story_neighbors:\n",
        "    print(movie)\n"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "\n",
            "The 10 nearest neighbors of Toy Story are:\n",
            "Beauty and the Beast (1991)\n",
            "Raiders of the Lost Ark (1981)\n",
            "That Thing You Do! (1996)\n",
            "Lion King, The (1994)\n",
            "Craft, The (1996)\n",
            "Liar Liar (1997)\n",
            "Aladdin (1992)\n",
            "Cool Hand Luke (1967)\n",
            "Winnie the Pooh and the Blustery Day (1968)\n",
            "Indiana Jones and the Last Crusade (1989)\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "UU_xwRmh9Acw",
        "colab_type": "text"
      },
      "source": [
        "# Real-World Social Network Problems"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "lnDJdOoq-gd9",
        "colab_type": "text"
      },
      "source": [
        "\n",
        "**Real World Problems**\n",
        "\n",
        "*   UX\n",
        "*   Ethics\n",
        "*   Operational Complexity\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "vkMSq18g9EN6",
        "colab_type": "text"
      },
      "source": [
        "![socialNetwork](https://user-images.githubusercontent.com/58792/62396018-f20cc100-b53f-11e9-9b34-ac791c0b732a.png)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LrTg1MvABj3T",
        "colab_type": "text"
      },
      "source": [
        "## Next Improvements?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_9P6Aw3iBoJA",
        "colab_type": "text"
      },
      "source": [
        "* Recommend Popular People for \"Cold Start\"\n",
        "* Convert to Supervized ML problem"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4tKhD56---wP",
        "colab_type": "text"
      },
      "source": [
        "# Cloud APIs?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-CrXDpbf_MKe",
        "colab_type": "text"
      },
      "source": [
        "https://azure.microsoft.com/en-us/blog/building-recommender-systems-with-azure-machine-learning-service/\n",
        "\n",
        "![Cloud APIs](https://azurecomcdn.azureedge.net/mediahandler/acomblog/media/Default/blog/7e796df5-ce15-488c-9c1b-ec110059b5d2.png)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "2ycOcKaV_s-t",
        "colab_type": "text"
      },
      "source": [
        "## Related Areas?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ahH6OP_N_xP6",
        "colab_type": "text"
      },
      "source": [
        "[Topic Modeling with Gensim](https://radimrehurek.com/gensim/)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "JVofRb1tGFvw",
        "colab_type": "text"
      },
      "source": [
        "## ML Maturity Model?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ZftIaHO7GIz8",
        "colab_type": "text"
      },
      "source": [
        "![ml maturity model](https://user-images.githubusercontent.com/58792/62405528-88ef7280-b56c-11e9-90a6-8ede635419a4.png)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "N_m0YG841Bfd",
        "colab_type": "text"
      },
      "source": [
        "# References"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "GDoeA3Y61FlU",
        "colab_type": "text"
      },
      "source": [
        "\n",
        "\n",
        "*   [Netflix Recommender Systems](https://dl.acm.org/citation.cfm?id=2843948)\n",
        "*   [Surprise](http://surpriselib.com/) is a Python scikit building and analyzing recommender systems.\n",
        "* [azure recommender](https://azure.microsoft.com/en-us/blog/building-recommender-systems-with-azure-machine-learning-service/)\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "iPLI3Rse_ldX",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    }
  ]
}