exercise_5.ipynb

{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"exercise_5.ipynb","provenance":[],"collapsed_sections":[]},"kernelspec":{"name":"python3","display_name":"Python 3"}},"cells":[{"cell_type":"markdown","metadata":{"id":"HLZqpCUKNham"},"source":["#Exercise 5\n","\n","We have provided you with the code to upload files to colab. Please upload `experiments.txt`. This file has following structure:\n","```\n","# Experiment: name of experiment\n","1 1 0\n","2 1 1\n","3 1 1\n","...\n","# Experiment: name of experiment\n","1 1 0\n","2 1 1\n","3 1 1\n","...\n","```\n","\n","Each row that doesn't start with # is composed of row_id, true_class, predicted_class\n","\n","Please load the file and then read then calculate MCC for each experiment, store (experiment name, MCC) tuple in a list and then print experiments in order from the one with the highest MCC to the lowest.\n","\n","Tip: reuse finctions from the previous assignment"]},{"cell_type":"markdown","metadata":{"id":"JyzIO7WNJK8r"},"source":["Code to load file:"]},{"cell_type":"code","metadata":{"id":"HmVyrwMTFYzB","colab":{"resources":{"http://localhost:8080/nbextensions/google.colab/files.js":{"data":"Ly8gQ29weXJpZ2h0IDIwMTcgR29vZ2xlIExMQwovLwovLyBMaWNlbnNlZCB1bmRlciB0aGUgQXBhY2hlIExpY2Vuc2UsIFZlcnNpb24gMi4wICh0aGUgIkxpY2Vuc2UiKTsKLy8geW91IG1heSBub3QgdXNlIHRoaXMgZmlsZSBleGNlcHQgaW4gY29tcGxpYW5jZSB3aXRoIHRoZSBMaWNlbnNlLgovLyBZb3UgbWF5IG9idGFpbiBhIGNvcHkgb2YgdGhlIExpY2Vuc2UgYXQKLy8KLy8gICAgICBodHRwOi8vd3d3LmFwYWNoZS5vcmcvbGljZW5zZXMvTElDRU5TRS0yLjAKLy8KLy8gVW5sZXNzIHJlcXVpcmVkIGJ5IGFwcGxpY2FibGUgbGF3IG9yIGFncmVlZCB0byBpbiB3cml0aW5nLCBzb2Z0d2FyZQovLyBkaXN0cmlidXRlZCB1bmRlciB0aGUgTGljZW5zZSBpcyBkaXN0cmlidXRlZCBvbiBhbiAiQVMgSVMiIEJBU0lTLAovLyBXSVRIT1VUIFdBUlJBTlRJRVMgT1IgQ09ORElUSU9OUyBPRiBBTlkgS0lORCwgZWl0aGVyIGV4cHJlc3Mgb3IgaW1wbGllZC4KLy8gU2VlIHRoZSBMaWNlbnNlIGZvciB0aGUgc3BlY2lmaWMgbGFuZ3VhZ2UgZ292ZXJuaW5nIHBlcm1pc3Npb25zIGFuZAovLyBsaW1pdGF0aW9ucyB1bmRlciB0aGUgTGljZW5zZS4KCi8qKgogKiBAZmlsZW92ZXJ2aWV3IEhlbHBlcnMgZm9yIGdvb2dsZS5jb2xhYiBQeXRob24gbW9kdWxlLgogKi8KKGZ1bmN0aW9uKHNjb3BlKSB7CmZ1bmN0aW9uIHNwYW4odGV4dCwgc3R5bGVBdHRyaWJ1dGVzID0ge30pIHsKICBjb25zdCBlbGVtZW50ID0gZG9jdW1lbnQuY3JlYXRlRWxlbWVudCgnc3BhbicpOwogIGVsZW1lbnQudGV4dENvbnRlbnQgPSB0ZXh0OwogIGZvciAoY29uc3Qga2V5IG9mIE9iamVjdC5rZXlzKHN0eWxlQXR0cmlidXRlcykpIHsKICAgIGVsZW1lbnQuc3R5bGVba2V5XSA9IHN0eWxlQXR0cmlidXRlc1trZXldOwogIH0KICByZXR1cm4gZWxlbWVudDsKfQoKLy8gTWF4IG51bWJlciBvZiBieXRlcyB3aGljaCB3aWxsIGJlIHVwbG9hZGVkIGF0IGEgdGltZS4KY29uc3QgTUFYX1BBWUxPQURfU0laRSA9IDEwMCAqIDEwMjQ7CgpmdW5jdGlvbiBfdXBsb2FkRmlsZXMoaW5wdXRJZCwgb3V0cHV0SWQpIHsKICBjb25zdCBzdGVwcyA9IHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCk7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICAvLyBDYWNoZSBzdGVwcyBvbiB0aGUgb3V0cHV0RWxlbWVudCB0byBtYWtlIGl0IGF2YWlsYWJsZSBmb3IgdGhlIG5leHQgY2FsbAogIC8vIHRvIHVwbG9hZEZpbGVzQ29udGludWUgZnJvbSBQeXRob24uCiAgb3V0cHV0RWxlbWVudC5zdGVwcyA9IHN0ZXBzOwoKICByZXR1cm4gX3VwbG9hZEZpbGVzQ29udGludWUob3V0cHV0SWQpOwp9CgovLyBUaGlzIGlzIHJvdWdobHkgYW4gYXN5bmMgZ2VuZXJhdG9yIChub3Qgc3VwcG9ydGVkIGluIHRoZSBicm93c2VyIHlldCksCi8vIHdoZXJlIHRoZXJlIGFyZSBtdWx0aXBsZSBhc3luY2hyb25vdXMgc3RlcHMgYW5kIHRoZSBQeXRob24gc2lkZSBpcyBnb2luZwovLyB0byBwb2xsIGZvciBjb21wbGV0aW9uIG9mIGVhY2ggc3RlcC4KLy8gVGhpcyB1c2VzIGEgUHJvbWlzZSB0byBibG9jayB0aGUgcHl0aG9uIHNpZGUgb24gY29tcGxldGlvbiBvZiBlYWNoIHN0ZXAsCi8vIHRoZW4gcGFzc2VzIHRoZSByZXN1bHQgb2YgdGhlIHByZXZpb3VzIHN0ZXAgYXMgdGhlIGlucHV0IHRvIHRoZSBuZXh0IHN0ZXAuCmZ1bmN0aW9uIF91cGxvYWRGaWxlc0NvbnRpbnVlKG91dHB1dElkKSB7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICBjb25zdCBzdGVwcyA9IG91dHB1dEVsZW1lbnQuc3RlcHM7CgogIGNvbnN0IG5leHQgPSBzdGVwcy5uZXh0KG91dHB1dEVsZW1lbnQubGFzdFByb21pc2VWYWx1ZSk7CiAgcmV0dXJuIFByb21pc2UucmVzb2x2ZShuZXh0LnZhbHVlLnByb21pc2UpLnRoZW4oKHZhbHVlKSA9PiB7CiAgICAvLyBDYWNoZSB0aGUgbGFzdCBwcm9taXNlIHZhbHVlIHRvIG1ha2UgaXQgYXZhaWxhYmxlIHRvIHRoZSBuZXh0CiAgICAvLyBzdGVwIG9mIHRoZSBnZW5lcmF0b3IuCiAgICBvdXRwdXRFbGVtZW50Lmxhc3RQcm9taXNlVmFsdWUgPSB2YWx1ZTsKICAgIHJldHVybiBuZXh0LnZhbHVlLnJlc3BvbnNlOwogIH0pOwp9CgovKioKICogR2VuZXJhdG9yIGZ1bmN0aW9uIHdoaWNoIGlzIGNhbGxlZCBiZXR3ZWVuIGVhY2ggYXN5bmMgc3RlcCBvZiB0aGUgdXBsb2FkCiAqIHByb2Nlc3MuCiAqIEBwYXJhbSB7c3RyaW5nfSBpbnB1dElkIEVsZW1lbnQgSUQgb2YgdGhlIGlucHV0IGZpbGUgcGlja2VyIGVsZW1lbnQuCiAqIEBwYXJhbSB7c3RyaW5nfSBvdXRwdXRJZCBFbGVtZW50IElEIG9mIHRoZSBvdXRwdXQgZGlzcGxheS4KICogQHJldHVybiB7IUl0ZXJhYmxlPCFPYmplY3Q+fSBJdGVyYWJsZSBvZiBuZXh0IHN0ZXBzLgogKi8KZnVuY3Rpb24qIHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCkgewogIGNvbnN0IGlucHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKGlucHV0SWQpOwogIGlucHV0RWxlbWVudC5kaXNhYmxlZCA9IGZhbHNlOwoKICBjb25zdCBvdXRwdXRFbGVtZW50ID0gZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQob3V0cHV0SWQpOwogIG91dHB1dEVsZW1lbnQuaW5uZXJIVE1MID0gJyc7CgogIGNvbnN0IHBpY2tlZFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgaW5wdXRFbGVtZW50LmFkZEV2ZW50TGlzdGVuZXIoJ2NoYW5nZScsIChlKSA9PiB7CiAgICAgIHJlc29sdmUoZS50YXJnZXQuZmlsZXMpOwogICAgfSk7CiAgfSk7CgogIGNvbnN0IGNhbmNlbCA9IGRvY3VtZW50LmNyZWF0ZUVsZW1lbnQoJ2J1dHRvbicpOwogIGlucHV0RWxlbWVudC5wYXJlbnRFbGVtZW50LmFwcGVuZENoaWxkKGNhbmNlbCk7CiAgY2FuY2VsLnRleHRDb250ZW50ID0gJ0NhbmNlbCB1cGxvYWQnOwogIGNvbnN0IGNhbmNlbFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgY2FuY2VsLm9uY2xpY2sgPSAoKSA9PiB7CiAgICAgIHJlc29sdmUobnVsbCk7CiAgICB9OwogIH0pOwoKICAvLyBXYWl0IGZvciB0aGUgdXNlciB0byBwaWNrIHRoZSBmaWxlcy4KICBjb25zdCBmaWxlcyA9IHlpZWxkIHsKICAgIHByb21pc2U6IFByb21pc2UucmFjZShbcGlja2VkUHJvbWlzZSwgY2FuY2VsUHJvbWlzZV0pLAogICAgcmVzcG9uc2U6IHsKICAgICAgYWN0aW9uOiAnc3RhcnRpbmcnLAogICAgfQogIH07CgogIGNhbmNlbC5yZW1vdmUoKTsKCiAgLy8gRGlzYWJsZSB0aGUgaW5wdXQgZWxlbWVudCBzaW5jZSBmdXJ0aGVyIHBpY2tzIGFyZSBub3QgYWxsb3dlZC4KICBpbnB1dEVsZW1lbnQuZGlzYWJsZWQgPSB0cnVlOwoKICBpZiAoIWZpbGVzKSB7CiAgICByZXR1cm4gewogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbXBsZXRlJywKICAgICAgfQogICAgfTsKICB9CgogIGZvciAoY29uc3QgZmlsZSBvZiBmaWxlcykgewogICAgY29uc3QgbGkgPSBkb2N1bWVudC5jcmVhdGVFbGVtZW50KCdsaScpOwogICAgbGkuYXBwZW5kKHNwYW4oZmlsZS5uYW1lLCB7Zm9udFdlaWdodDogJ2JvbGQnfSkpOwogICAgbGkuYXBwZW5kKHNwYW4oCiAgICAgICAgYCgke2ZpbGUudHlwZSB8fCAnbi9hJ30pIC0gJHtmaWxlLnNpemV9IGJ5dGVzLCBgICsKICAgICAgICBgbGFzdCBtb2RpZmllZDogJHsKICAgICAgICAgICAgZmlsZS5sYXN0TW9kaWZpZWREYXRlID8gZmlsZS5sYXN0TW9kaWZpZWREYXRlLnRvTG9jYWxlRGF0ZVN0cmluZygpIDoKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ24vYSd9IC0gYCkpOwogICAgY29uc3QgcGVyY2VudCA9IHNwYW4oJzAlIGRvbmUnKTsKICAgIGxpLmFwcGVuZENoaWxkKHBlcmNlbnQpOwoKICAgIG91dHB1dEVsZW1lbnQuYXBwZW5kQ2hpbGQobGkpOwoKICAgIGNvbnN0IGZpbGVEYXRhUHJvbWlzZSA9IG5ldyBQcm9taXNlKChyZXNvbHZlKSA9PiB7CiAgICAgIGNvbnN0IHJlYWRlciA9IG5ldyBGaWxlUmVhZGVyKCk7CiAgICAgIHJlYWRlci5vbmxvYWQgPSAoZSkgPT4gewogICAgICAgIHJlc29sdmUoZS50YXJnZXQucmVzdWx0KTsKICAgICAgfTsKICAgICAgcmVhZGVyLnJlYWRBc0FycmF5QnVmZmVyKGZpbGUpOwogICAgfSk7CiAgICAvLyBXYWl0IGZvciB0aGUgZGF0YSB0byBiZSByZWFkeS4KICAgIGxldCBmaWxlRGF0YSA9IHlpZWxkIHsKICAgICAgcHJvbWlzZTogZmlsZURhdGFQcm9taXNlLAogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbnRpbnVlJywKICAgICAgfQogICAgfTsKCiAgICAvLyBVc2UgYSBjaHVua2VkIHNlbmRpbmcgdG8gYXZvaWQgbWVzc2FnZSBzaXplIGxpbWl0cy4gU2VlIGIvNjIxMTU2NjAuCiAgICBsZXQgcG9zaXRpb24gPSAwOwogICAgd2hpbGUgKHBvc2l0aW9uIDwgZmlsZURhdGEuYnl0ZUxlbmd0aCkgewogICAgICBjb25zdCBsZW5ndGggPSBNYXRoLm1pbihmaWxlRGF0YS5ieXRlTGVuZ3RoIC0gcG9zaXRpb24sIE1BWF9QQVlMT0FEX1NJWkUpOwogICAgICBjb25zdCBjaHVuayA9IG5ldyBVaW50OEFycmF5KGZpbGVEYXRhLCBwb3NpdGlvbiwgbGVuZ3RoKTsKICAgICAgcG9zaXRpb24gKz0gbGVuZ3RoOwoKICAgICAgY29uc3QgYmFzZTY0ID0gYnRvYShTdHJpbmcuZnJvbUNoYXJDb2RlLmFwcGx5KG51bGwsIGNodW5rKSk7CiAgICAgIHlpZWxkIHsKICAgICAgICByZXNwb25zZTogewogICAgICAgICAgYWN0aW9uOiAnYXBwZW5kJywKICAgICAgICAgIGZpbGU6IGZpbGUubmFtZSwKICAgICAgICAgIGRhdGE6IGJhc2U2NCwKICAgICAgICB9LAogICAgICB9OwogICAgICBwZXJjZW50LnRleHRDb250ZW50ID0KICAgICAgICAgIGAke01hdGgucm91bmQoKHBvc2l0aW9uIC8gZmlsZURhdGEuYnl0ZUxlbmd0aCkgKiAxMDApfSUgZG9uZWA7CiAgICB9CiAgfQoKICAvLyBBbGwgZG9uZS4KICB5aWVsZCB7CiAgICByZXNwb25zZTogewogICAgICBhY3Rpb246ICdjb21wbGV0ZScsCiAgICB9CiAgfTsKfQoKc2NvcGUuZ29vZ2xlID0gc2NvcGUuZ29vZ2xlIHx8IHt9OwpzY29wZS5nb29nbGUuY29sYWIgPSBzY29wZS5nb29nbGUuY29sYWIgfHwge307CnNjb3BlLmdvb2dsZS5jb2xhYi5fZmlsZXMgPSB7CiAgX3VwbG9hZEZpbGVzLAogIF91cGxvYWRGaWxlc0NvbnRpbnVlLAp9Owp9KShzZWxmKTsK","ok":true,"headers":[["content-type","application/javascript"]],"status":200,"status_text":""}},"base_uri":"https://localhost:8080/","height":90},"executionInfo":{"status":"ok","timestamp":1613788107156,"user_tz":420,"elapsed":6099,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}},"outputId":"86eefd6e-89ba-45cc-d60b-a6bd3b3f8cd9"},"source":["# The following is code for uploading a file to the colab.research.google \n","# environment.\n","\n","# library for uploading files\n","from google.colab import files \n","\n","def upload_files():\n","    # initiates the upload - follow the dialogues that appear\n","    uploaded = files.upload()\n","\n","    # verify the upload\n","    for fn in uploaded.keys():\n","        print('User uploaded file \"{name}\" with length {length} bytes'.format(\n","            name=fn, length=len(uploaded[fn])))\n","\n","    # uploaded files need to be written to file to interact with them\n","    # as part of a file system\n","    for filename in uploaded.keys():\n","        with open(filename, 'wb') as f:\n","            f.write(uploaded[filename])\n","upload_files()"],"execution_count":null,"outputs":[{"output_type":"display_data","data":{"text/html":["\n","     <input type=\"file\" id=\"files-41d74e05-d00d-45fa-b43a-be2e4200a24a\" name=\"files[]\" multiple disabled\n","        style=\"border:none\" />\n","     <output id=\"result-41d74e05-d00d-45fa-b43a-be2e4200a24a\">\n","      Upload widget is only available when the cell has been executed in the\n","      current browser session. Please rerun this cell to enable.\n","      </output>\n","      <script src=\"/nbextensions/google.colab/files.js\"></script> "],"text/plain":["<IPython.core.display.HTML object>"]},"metadata":{"tags":[]}},{"output_type":"stream","text":["Saving experiments.txt to experiments.txt\n","User uploaded file \"experiments.txt\" with length 6093 bytes\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"zRaamv9oJOpG"},"source":["Write your code here:"]},{"cell_type":"code","metadata":{"id":"1ZjXyQlcJQyQ","executionInfo":{"status":"ok","timestamp":1613789832087,"user_tz":420,"elapsed":319,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}}},"source":["import math\n","\n","def test_func(prediction, label):\n","  if (prediction and label) == 1:\n","    return \"tp\"\n","  elif (prediction or label) == 0:\n","    return \"tn\"\n","  elif prediction == 0 and label == 1:\n","    return \"fn\"\n","  elif prediction == 1 and label == 0:\n","    return \"fp\"\n","\n","\n","def test_func_list(predictions, labels):\n","  value_matrix = {}\n","  for pred,label in zip(predictions,true_labels):\n","    value = test_func(pred,label)\n","    if value in value_matrix:\n","      value_matrix[value] += 1\n","    else:\n","      value_matrix[value] = 1\n","\n","  return value_matrix\n","\n","def MCC_accuracy(predictions, true_labels):\n","  result = test_func_list(predictions, true_labels)\n","  numerator = result['tp']*result['tn']-result['fp']*result['fn']\n","  denominator = math.sqrt((result['tp']+result['fp'])*(result['tp']+result['fn'])*(result['tn']+result['fp'])*(result['tn']+result['fn']))\n","  return numerator/denominator"],"execution_count":2,"outputs":[]},{"cell_type":"code","metadata":{"id":"gxYmXkocXqGd","executionInfo":{"status":"ok","timestamp":1613794035653,"user_tz":420,"elapsed":338,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}}},"source":["with open(\"experiments.txt\", \"r\") as input_file:\n","  exp = {} \n","  exp_no = 0\n","  predictions = []\n","  true_labels = []\n","  \n","  for line in input_file:\n","    line_splitted = line.split()\n","    if line_splitted[0] == \"#\":\n","      exp_no += 1\n","      predictions = []\n","      true_labels = []\n","    elif line_splitted[0] == \"200\":    \n","      \n","      predictions.append(int(line_splitted[1]))\n","      true_labels.append(int(line_splitted[2]))\n","      \n","      exp[exp_no] = MCC_accuracy(predictions, true_labels)\n","\n","    else:\n","      predictions.append(int(line_splitted[1]))\n","      true_labels.append(int(line_splitted[2]))\n","      \n","\n"],"execution_count":93,"outputs":[]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"e2AJe35rYM02","executionInfo":{"status":"ok","timestamp":1613794037035,"user_tz":420,"elapsed":351,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}},"outputId":"d446d120-e785-48ce-837e-53ba1183a60c"},"source":["exp"],"execution_count":94,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{1: -0.356995286858551,\n"," 2: 0.6340971939652505,\n"," 3: -0.14087676253894124,\n"," 4: 0.39776561141396055}"]},"metadata":{"tags":[]},"execution_count":94}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"Ll3NADv3aDz9","executionInfo":{"status":"ok","timestamp":1613794695208,"user_tz":420,"elapsed":315,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}},"outputId":"e7a818d6-1206-420b-cf4f-dbdf833433e5"},"source":["experimental_results = {}\n","\n","with open(\"experiments.txt\", \"r\") as input_file:\n","  for line in input_file:\n","    if line.startswith(\"#\"):\n","      experiment_name = line[14:].strip()\n","      experimental_results[experiment_name] = ([], [])\n","    else:\n","      _, pred, label = line.split('\\t')\n","      experimental_results[experiment_name][0].append(int(pred))\n","      experimental_results[experiment_name][1].append(int(label))\n","\n","results_list = []\n","for experiment in experimental_results:\n","  preds, labels = experimental_results[experiment]\n","  results_list.append((experiment, MCC_accuracy(preds, labels)))\n","\n","results_list.sort(key=lambda tuple: tuple[1], reverse=True)\n","\n","for experiment, mcc in results_list:\n","  print(f\"Experiemnt: {experiment}, results are: {mcc}\")"],"execution_count":96,"outputs":[{"output_type":"stream","text":["Experiemnt: Great, results are: 0.39776561141396055\n","Experiemnt: Amazing results!, results are: 0.052256156382819365\n","Experiemnt: so-so, results are: 0.035765888523620754\n","Experiemnt: Could be better, results are: 0.03236836656512239\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"s30Z4xswagXx","executionInfo":{"status":"ok","timestamp":1613794803733,"user_tz":420,"elapsed":373,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}},"outputId":"d18cd6ae-36f1-4905-bfcd-e2fce55ac50c"},"source":["type(experimental_results['Amazing results!'][0])"],"execution_count":103,"outputs":[{"output_type":"execute_result","data":{"text/plain":["list"]},"metadata":{"tags":[]},"execution_count":103}]},{"cell_type":"code","metadata":{"id":"jpC4euOSfWnZ","executionInfo":{"status":"ok","timestamp":1613792977784,"user_tz":420,"elapsed":412,"user":{"displayName":"Ojaswi Dhoubhadel","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14Gjk3OnSPDc1uQhfMW3FBpomzJ6GO3jVp0HlKO4XmUg=s64","userId":"06018964124818252092"}}},"source":["predictions"],"execution_count":72,"outputs":[]},{"cell_type":"code","metadata":{"id":"M_XwpMGjfg9l"},"source":[""],"execution_count":null,"outputs":[]}]}