X02. Web Scraping with Python.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## X02. Web Scraping with Python"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Web Scraping (also called Web Harvesting and Web Data Extraction) is the process of extracting data from a website and transforming this into a format that can be analysed, saved and visualised. \n",
    "\n",
    "There are some things you should bear in mind before performing any kind of web scraping activity...\n",
    "\n",
    "* Check the site's terms and conditions to see if there's anything that prohibits you from scraping it\n",
    "* Be careful not to overload the website's server via dodgy while loops etc...\n",
    "* Web pages format change often - be prepared to reconfigure your scraper!\n",
    "* Some basic knowledge of HTML is a big help!\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Beautiful Soup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll be using two libraries to perform web scraping - the first is Requests which we've already met. The second is called <a href = \"https://www.crummy.com/software/BeautifulSoup/bs4/doc/\">Beautiful Soup</a> which is a library specifically for extracting data from HTML and XML files.\n",
    "\n",
    "Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping. Three features make it powerful:\n",
    "\n",
    "* Beautiful Soup provides a few simple methods and Pythonic idioms for navigating, searching, and modifying a parse tree: a toolkit for dissecting a document and extracting what you need. It doesn't take much code to write an application\n",
    "\n",
    "* Beautiful Soup automatically converts incoming documents to Unicode and outgoing documents to UTF-8. You don't have to think about encodings, unless the document doesn't specify an encoding and Beautiful Soup can't detect one. Then you just have to specify the original encoding.\n",
    "\n",
    "* Beautiful Soup sits on top of popular Python parsers like lxml and html5lib, allowing you to try out different parsing strategies or trade speed for flexibility. \n",
    "\n",
    "Beautiful Soup parses anything you give it, and does the tree traversal stuff for you. You can tell it \"Find all the links\", or \"Find all the links of class externalLink\", or \"Find all the links whose urls match \"foo.com\", or \"Find the table heading that's got bold text, then give me that text.\" \n",
    "\n",
    "Note that a simple definition of <i>parsing</i> is the process of analysing a string of symbols (usually code!).\n",
    "\n",
    "Beautiful Soup is not installed as part of Anaconda so we'll need to install it manually as follows:\n",
    "\n",
    "    conda install bs4"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Understanding HTML"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To best utilise web scraping, it's good to have a basic understanding of html pages and how they work.\n",
    "\n",
    "A couple of excellent resources for this are:\n",
    "\n",
    "* <a href = \"http://www.w3schools.com/html/\">W3 Schools HTML</a><br/>\n",
    "* <a href = \"http://www.w3schools.com/xml/\">W3 Schools XML</a><br/>\n",
    "* <a href = \"https://www.codecademy.com/learn/web\">CodeAcademy</a><br/>\n",
    "\n",
    "Html is a 'markup' language which means it's for the processing and display of text. It does this via 'tags' which are contained in chevrons. There is a simple example of some html below:"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    " ipsum dolor sit amet, consectetur<div class  = \"container\">\n",
    "<h1> Heading</h1><br/>\n",
    "<div class = \"header5\"><p>Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed imperdiet sem velit, eget egestas erat imperdiet vitae. Vivamus diam nibh, malesuada non pellentesque vitae, ullamcorper eget quam. Nam sit amet sodales sapien. In iaculis viverra tortor eget semper. Donec accumsan consequat aliquam. Nulla facilisi. Duis non tellus condimentum, varius elit nec, tempor sapien.</p> \n",
    "\n",
    "<p>Sed facilisis aliquam tincidunt. Nulla magna nunc, rutrum id libero in, venenatis fermentum lacus. Suspendisse potenti. Morbi varius pharetra sapien, id fermentum nisl convallis non. Nulla quis sagittis sapien, quis posuere lorem. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus.</p></div>\n",
    "</div>\n",
    "<ul>\n",
    "<li>Lorem</li>\n",
    "<li>ipsum</li>\n",
    "<li>dolor</li>\n",
    "<li>sit</li>\n",
    "<li>amet</li>\n",
    "</ul>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When displayed on a web page this looks like:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div class  = \"container\">\n",
    "<h1> Heading</h1><br/>\n",
    "<div class = \"header5\"><p>Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed imperdiet sem velit, eget egestas erat imperdiet vitae. Vivamus diam nibh, malesuada non pellentesque vitae, ullamcorper eget quam. Nam sit amet sodales sapien. In iaculis viverra tortor eget semper. Donec accumsan consequat aliquam. Nulla facilisi. Duis non tellus condimentum, varius elit nec, tempor sapien.</p> \n",
    "\n",
    "<p>Sed facilisis aliquam tincidunt. Nulla magna nunc, rutrum id libero in, venenatis fermentum lacus. Suspendisse potenti. Morbi varius pharetra sapien, id fermentum nisl convallis non. Nulla quis sagittis sapien, quis posuere lorem. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus.</p></div>\n",
    "</div>\n",
    "<ul>\n",
    "<li>Lorem</li>\n",
    "<li>ipsum</li>\n",
    "<li>dolor</li>\n",
    "<li>sit</li>\n",
    "<li>amet</li>\n",
    "</ul>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You'll see how the tags help give the text structure and formatting. However we can also use them to extract specific data from a webpage using Beautiful Soup."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Understanding Tags"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You only really need to understand maybe <a href = \"http://www.99lime.com/_bak/topics/you-only-need-10-tags/\">10 tags</a> to get started with web scraping.\n",
    "\n",
    "<img src = \"img/tags.png\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For now we'll only be using he div, h1-h6 and ul tags in our example."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Classes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll also be meeting <a href = \"http://www.w3schools.com/tags/att_global_class.asp\">Classes</a> as part of web scraping. Classes are assigned in order to style various elements of the html document a certain way. For example you might want to style a section heading or list a certain way to set it apart from other items.\n",
    "\n",
    "Since classes set these items apart, we can also use them to identify specific elements in the document which we'll see more of below. Assigning a class is simple and looks like this:"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    "<div class = \"section-header\">Section Heading</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# IDs"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "IDs are similar to classes except that whilst classes can be applied to multiple elements in a web page and ID will only be applied to a single element and not be repeated. Assigning an ID is also simple and looks like this:"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    "<div id = \"section-unique\">Section Heading</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Web Scraping"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll start by importing the libraries we'll need:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import requests\n",
    "from bs4 import BeautifulSoup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll see if we can build a scraper that extracts the recipe title and ingredients from the BBC recipes website.\n",
    "\n",
    "We're going to use a recipe page for cookies to get started:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "url = 'http://www.bbc.co.uk/food/recipes/peanut_butter_cookies_02578'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "200"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "r = requests.get(url)                     # Making the request to the page\n",
    "r.status_code                             # Checking that the request has been successful"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we know our request has been successful we can create a beautiful soup object and start to see how we can extract data from the web page."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<!DOCTYPE html>\n",
      "<html class=\"no-touch\" lang=\"en\">\n",
      " <head>\n",
      "  <meta content=\"IE=edge\" http-equiv=\"X-UA-Compatible\"/>\n",
      "  <meta content=\"width=device-width, initial-scale=1.0\" name=\"viewport\"/>\n",
      "  <meta content=\"100004154058350\" property=\"fb:admins\"/>\n",
      "  <!--[if (gt IE 8) | (IEMobile)]><!-->\n",
      "  <link href=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/style/orb.min.css\" rel=\"stylesheet\"/>\n",
      "  <!--<![endif]-->\n",
      "  <!--[if (lt IE 9) & (!IEMobile)]>\n",
      "<link rel=\"stylesheet\" href=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/style/orb-ie.min.css\">\n",
      "<![endif]-->\n",
      "  <!--orb.ws.require.lib-->\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ if (typeof window.define !== 'function' || typeof window.require !== 'function') { document.write('<script class=\"js-require-lib\" src=\"http://static.bbci.co.uk/frameworks/requirejs/lib.js\"><'+'/script>'); } /*]]>*/\n",
      "  </script>\n",
      "  <script type=\"text/javascript\">\n",
      "   bbcRequireMap = {\"jquery-1\":\"http://static.bbci.co.uk/frameworks/jquery/0.4.1/sha\n"
     ]
    }
   ],
   "source": [
    "soup = BeautifulSoup(r.content,'lxml')           # Creating the beautiful soup object                  \n",
    "print(soup.prettify()[0:1000])                   # Using the prettify method to make the output readable + slicing with a specified number of characters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "This is a LOT of text! Fortunately most of it is irrelevent to us and we can take some simple steps to seperate what's relevent from what's not. For example the header section of the document doesn't contain any content. Similary there will be script tags which contain Javascript which is not of interest to us.\n",
    "\n",
    "The most simple way of returning the document content this is to create a new object just for the body of the document. This makes it easier to explore the content of the document."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<body class=\"nojs\">\n",
      " <!--<![endif]-->\n",
      " <!-- BBCDOTCOM bodyFirst -->\n",
      " <div class=\"bbccom_display_none\" id=\"bbccom_interstitial_ad\">\n",
      " </div>\n",
      " <div class=\"bbccom_display_none\" id=\"bbccom_interstitial\">\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ (function() { if (window.bbcdotcom && bbcdotcom.config.isActive('ads')) { googletag.cmd.push(function() { googletag.display('bbccom_interstitial'); }); } }()); /*]]>*/\n",
      "  </script>\n",
      " </div>\n",
      " <div class=\"bbccom_display_none\" id=\"bbccom_wallpaper_ad\">\n",
      " </div>\n",
      " <div class=\"bbccom_display_none\" id=\"bbccom_wallpaper\">\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ (function() { var wallpaper; if (window.bbcdotcom && bbcdotcom.config.isActive('ads')) { if (bbcdotcom.config.isAsync()) { googletag.cmd.push(function() { googletag.display('bbccom_wallpaper'); }); } else { googletag.display(\"wallpaper\"); } wallpaper = bbcdotcom.adverts.adRegister.getAd('wallpaper'); } }()); /*]]>*/\n",
      "  </script>\n",
      " </div>\n",
      " <script type=\"text/javascript\">\n",
      "  /*<![CDATA[*/ (function() { if (window.bbcdotcom && bbcdotcom.config.isActive('ads')) { document.write(unescape('%3Cscript id=\"gnlAdsEnabled\" class=\"bbccom_display_none\"%3E%3C/script%3E')); } if (window.bbcdotcom && bbcdotcom.config.isActive('analytics')) { document.write(unescape('%3Cscript id=\"gnlAnalyticsEnabled\" class=\"bbccom_display_none\"%3E%3C/script%3E')); } }()); /*]]>*/\n",
      " </script>\n",
      " <div id=\"blq-global\">\n",
      "  <div id=\"blq-pre-mast\">\n",
      "  </div>\n",
      " </div>\n",
      " <script id=\"blq-bbccookies-tmpl\" type=\"text/html\">\n",
      "  <![CDATA[ <section> <div id=\"bbccookies\" class=\"bbccookies-banner orb-banner-wrapper bbccookies-d\"> <div id=\"bbccookies-prompt\" class=\"orb-banner b-g-p b-r b-f\"> <h2 class=\"orb-banner-title\"> Cookies on the BBC website </h2> <p class=\"orb-banner-content\" dir=\"ltr\"> The BBC has updated its cookie policy. We use cookies to ensure that we give you the best experience on our website. This includes cookies from third party social media websites if you visit a page which contains embedded content from social media. Such third party cookies may track your use of the BBC website.<span class=\"bbccookies-international-message\"> We and our partners also use cookies to ensure we show you advertising that is relevant to you.</span> If you continue without changing your settings, we'll assume that you are happy to receive all cookies on the BBC website. However, you can change your cookie settings at any time. </p> <ul class=\"orb-banner-options\"> <li id=\"bbccookies-continue\"> <button type=\"button\" id=\"bbccookies-continue-button\">Continue</button> </li> <li id=\"bbccookies-settings\"> <a href=\"/privacy/cookies/managing/cookie-settings.html\">Change settings</a> </li> <li id=\"bbccookies-more\"><a href=\"/privacy/cookies/bbc\">Find out more</a></li></ul> </div> </div> </section> ]]>\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  /*<![CDATA[*/ (function(){if(bbccookies._showPrompt()){var g=document,b=g.getElementById(\"blq-pre-mast\"),e=g.getElementById(\"blq-bbccookies-tmpl\"),a,f;if(b&&g.createElement){a=g.createElement(\"div\");f=e.innerHTML;f=f.replace(\"<\"+\"![CDATA[\",\"\").replace(\"]]\"+\">\",\"\");a.innerHTML=f;b.appendChild(a);blqCookieContinueButton=g.getElementById(\"bbccookies-continue-button\");blqCookieContinueButton.onclick=function(){a.parentNode.removeChild(a);return false};bbccookies._setPolicy(bbccookies.readPolicy())}var c=g.getElementById(\"bbccookies\");if(c&&!window.orb.fig(\"uk\")){c.className=c.className.replace(/\\bbbccookies-d\\b/,\"\");c.className=c.className+(\" bbccookies-w\")}}})(); /*]]>*/\n",
      " </script>\n",
      " <noscript>\n",
      "  <p style=\"position: absolute; top: -999em\">\n",
      "   <img alt=\"\" height=\"1\" src=\"//sa.bbc.co.uk/bbc/bbc/s?name=frameworks.barlesque.orb.webservice.json.page&amp;ml_name=webmodule&amp;ml_version=50&amp;blq_js_enabled=0&amp;blq_s=4d&amp;blq_r=2.7&amp;blq_v=default&amp;blq_e=pal&amp;pal_route=webserviceapi&amp;app_type=responsive&amp;language=en-GB&amp;pal_webapp=barlesque&amp;prod_name=frameworks&amp;app_name=frameworks\" width=\"1\"/>\n",
      "  </p>\n",
      " </noscript>\n",
      " <!-- Begin iStats 20100118 (UX-CMC 1.1009.3) -->\n",
      " <script type=\"text/javascript\">\n",
      "  /*<![CDATA[*/ if (typeof bbccookies !== 'undefined' && bbccookies.isAllowed('s1')) { (function () { require(['istats-1'], function (istats) { istatsTrackingUrl = istats.getDefaultURL(); if (istats.isEnabled() && bbcFlagpoles_istats === 'ON') { sitestat(istatsTrackingUrl); } else { window.ns_pixelUrl = istatsTrackingUrl; /* used by Flash library to track */ } function sitestat(n) { var j = document, f = j.location, b = \"\"; if (j.cookie.indexOf(\"st_ux=\") != -1) { var k = j.cookie.split(\";\"); var e = \"st_ux\", h = document.domain, a = \"/\"; if (typeof ns_ != \"undefined\" && typeof ns_.ux != \"undefined\") { e = ns_.ux.cName || e; h = ns_.ux.cDomain || h; a = ns_.ux.cPath || a } for (var g = 0, f = k.length; g < f; g++) { var m = k[g].indexOf(\"st_ux=\"); if (m != -1) { b = \"&\" + decodeURI(k[g].substring(m + 6)) } } bbccookies.set(e + \"=; expires=\" + new Date(new Date().getTime() - 60).toGMTString() + \"; path=\" + a + \"; domain=\" + h); } window.ns_pixelUrl = n;  } }); })(); } else { window.istats = {enabled: false}; } /*]]>*/\n",
      " </script>\n",
      " <!-- End iStats (UX-CMC) -->\n",
      " <!--[if (gt IE 8) | (IEMobile)]><!-->\n",
      " <header id=\"orb-banner\" role=\"banner\">\n",
      "  <!--<![endif]-->\n",
      "  <!--[if (lt IE 9) & (!IEMobile)]> <![if (IE 8)]> <header id=\"orb-banner\" role=\"banner\" class=\"orb-old-ie orb-ie8\"> <![endif]> <![if (IE 7)]> <header id=\"orb-banner\" role=\"banner\" class=\"orb-old-ie orb-ie7\"> <![endif]> <![if (IE 6)]> <header id=\"orb-banner\" role=\"banner\" class=\"orb-old-ie orb-ie6\"> <![endif]> <![endif]-->\n",
      "  <div class=\"orb-nav-pri orb-nav-pri-white b-header--white--black orb-nav-empty\" id=\"orb-header\">\n",
      "   <div class=\"orb-nav-pri-container b-r b-g-p\">\n",
      "    <div class=\"orb-nav-section orb-nav-blocks\">\n",
      "     <a href=\"/\">\n",
      "      <img alt=\"BBC\" height=\"24\" src=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/img/bbc-blocks-dark.png\" width=\"84\"/>\n",
      "     </a>\n",
      "    </div>\n",
      "    <section>\n",
      "     <div class=\"orb-skip-links\">\n",
      "      <h2>\n",
      "       Accessibility links\n",
      "      </h2>\n",
      "      <ul>\n",
      "       <li>\n",
      "        <a href=\"#orb-modules\">\n",
      "         Skip to content\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/accessibility/\" id=\"orb-accessibility-help\">\n",
      "         Accessibility Help\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "     </div>\n",
      "    </section>\n",
      "    <div class=\"orb-nav-section orb-nav-id orb-nav-focus\" id=\"mybbc-wrapper\">\n",
      "     <div class=\"orb-nav-section orb-nav-focus\" id=\"idcta-statusbar\">\n",
      "      <a href=\"/id/status\" id=\"idcta-link\">\n",
      "       <span id=\"idcta-username\">\n",
      "        BBC iD\n",
      "       </span>\n",
      "      </a>\n",
      "     </div>\n",
      "     <script type=\"text/javascript\">\n",
      "      require(['idcta/statusbar'], function(statusbar) { new statusbar.Statusbar({\"id\":\"idcta-statusbar\",\"publiclyCacheable\":true}); });\n",
      "     </script>\n",
      "     <a class=\"js-notification-link animated three\" href=\"#\" id=\"notification-link\">\n",
      "      <span class=\"hidden-span\">\n",
      "       Notifications\n",
      "      </span>\n",
      "      <div class=\"notification-link--triangle\">\n",
      "      </div>\n",
      "      <div class=\"notification-link--triangle\">\n",
      "      </div>\n",
      "      <span id=\"not-num\">\n",
      "      </span>\n",
      "     </a>\n",
      "    </div>\n",
      "    <nav class=\"orb-nav\" role=\"navigation\">\n",
      "     <div class=\"orb-nav-section orb-nav-links orb-nav-focus\" id=\"orb-nav-links\">\n",
      "      <h2>\n",
      "       BBC navigation\n",
      "      </h2>\n",
      "      <ul>\n",
      "       <li class=\"orb-nav-news orb-d\">\n",
      "        <a href=\"http://www.bbc.co.uk/news/\">\n",
      "         News\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-newsdotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/news/\">\n",
      "         News\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-sport\">\n",
      "        <a href=\"/sport/\">\n",
      "         Sport\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-weather\">\n",
      "        <a href=\"/weather/\">\n",
      "         Weather\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-shop orb-w\">\n",
      "        <a href=\"http://shop.bbc.com/\">\n",
      "         Shop\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-earthdotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/earth/\">\n",
      "         Earth\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-travel-dotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/travel/\">\n",
      "         Travel\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-capital orb-w\">\n",
      "        <a href=\"http://www.bbc.com/capital/\">\n",
      "         Capital\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-iplayer orb-d\">\n",
      "        <a href=\"/iplayer/\">\n",
      "         iPlayer\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-culture orb-w\">\n",
      "        <a href=\"http://www.bbc.com/culture/\">\n",
      "         Culture\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-autos orb-w\">\n",
      "        <a href=\"http://www.bbc.com/autos/\">\n",
      "         Autos\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-future orb-w\">\n",
      "        <a href=\"http://www.bbc.com/future/\">\n",
      "         Future\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-tv\">\n",
      "        <a href=\"/tv/\">\n",
      "         TV\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-radio\">\n",
      "        <a href=\"/radio/\">\n",
      "         Radio\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-cbbc\">\n",
      "        <a href=\"/cbbc\">\n",
      "         CBBC\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-cbeebies\">\n",
      "        <a href=\"/cbeebies\">\n",
      "         CBeebies\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-food\">\n",
      "        <a href=\"/food/\">\n",
      "         Food\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/iwonder\">\n",
      "         iWonder\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/education\">\n",
      "         Bitesize\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-travel orb-d\">\n",
      "        <a href=\"/travel/\">\n",
      "         Travel\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-music\">\n",
      "        <a href=\"/music/\">\n",
      "         Music\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-earth orb-d\">\n",
      "        <a href=\"http://www.bbc.com/earth/\">\n",
      "         Earth\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-arts\">\n",
      "        <a href=\"/arts/\">\n",
      "         Arts\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-makeitdigital\">\n",
      "        <a href=\"/makeitdigital\">\n",
      "         Make It Digital\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/taster\">\n",
      "         Taster\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-nature orb-w\">\n",
      "        <a href=\"/nature/\">\n",
      "         Nature\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-local\">\n",
      "        <a href=\"/local/\">\n",
      "         Local\n",
      "        </a>\n",
      "       </li>\n",
      "       <li id=\"orb-nav-more\">\n",
      "        <a data-alt=\"More\" href=\"#orb-footer\">\n",
      "         Menu\n",
      "         <span class=\"orb-icon orb-icon-arrow\">\n",
      "         </span>\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "     </div>\n",
      "    </nav>\n",
      "    <div class=\"orb-nav-section orb-nav-search orb-nav-oldsearch\">\n",
      "     <a href=\"http://search.bbc.co.uk/search\">\n",
      "      <img alt=\"Search the BBC\" height=\"18\" src=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/img/orb-search-dark.png\" width=\"18\"/>\n",
      "     </a>\n",
      "     <form accept-charset=\"utf-8\" action=\"//search.bbc.co.uk/search\" class=\"b-f\" id=\"orb-search-form\" method=\"get\" role=\"search\">\n",
      "      <div>\n",
      "       <label for=\"orb-search-q\">\n",
      "        Search the BBC\n",
      "       </label>\n",
      "       <input id=\"orb-search-q\" name=\"q\" placeholder=\"Search\" type=\"text\"/>\n",
      "       <input alt=\"Search the BBC\" height=\"17\" id=\"orb-search-button\" src=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/img/orb-search-dark.png\" type=\"image\" width=\"17\"/>\n",
      "       <input id=\"orb-search-suggid\" name=\"suggid\" type=\"hidden\"/>\n",
      "      </div>\n",
      "     </form>\n",
      "    </div>\n",
      "   </div>\n",
      "   <div id=\"orb-panels\">\n",
      "    <script id=\"orb-panel-template\" type=\"text/template\">\n",
      "     <![CDATA[ <div id=\"orb-panel-<%= panelname %>\" class=\"orb-panel\" aria-labelledby=\"orb-nav-<%= panelname %>\"> <div class=\"orb-panel-content b-g-p b-r\"> <%= panelcontent %> </div> </div> ]]>\n",
      "    </script>\n",
      "   </div>\n",
      "  </div>\n",
      " </header>\n",
      " <!-- Styling hook for shared modules only -->\n",
      " <div id=\"orb-modules\">\n",
      "  <div class=\"browser-upgrade-alert-message\">\n",
      "   <span class=\"browser-upgrade-alert\">\n",
      "    This site is optimised for modern web browsers,\n",
      "    and does not fully support your version of Internet Explorer\n",
      "   </span>\n",
      "  </div>\n",
      "  <div class=\"food-body spring spring_banner_2\">\n",
      "   <div class=\"food-wrapper\">\n",
      "    <div class=\"food-header\">\n",
      "     <div class=\"page-title\">\n",
      "      <div class=\"page-title__logo-wrapper\">\n",
      "       <a class=\"page-title__logo\" href=\"/food/\" title=\"Food homepage\">\n",
      "        Food\n",
      "       </a>\n",
      "       <span class=\"page-title__text\">\n",
      "        Recipes\n",
      "       </span>\n",
      "      </div>\n",
      "     </div>\n",
      "    </div>\n",
      "   </div>\n",
      "   <div class=\"main-menu\" role=\"navigation\">\n",
      "    <div class=\"mobile-nav-toggle\">\n",
      "     <div class=\"mobile-nav-toggle__button-wrapper\">\n",
      "      <label class=\"mobile-nav-toggle__descriptive-text\" for=\"mobile-nav-button\">\n",
      "       Open All Food menu\n",
      "      </label>\n",
      "      <button class=\"mobile-nav-toggle__button\" id=\"mobile-nav-button\">\n",
      "       <span class=\"mobile-nav-toggle__icon\">\n",
      "       </span>\n",
      "       All Food\n",
      "      </button>\n",
      "     </div>\n",
      "    </div>\n",
      "    <nav class=\"main-menu__navigation main-menu__navigation--recipes\">\n",
      "     <ul>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--index \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/\">\n",
      "        Home\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--recipes main-menu__item--active\">\n",
      "       <a class=\"main-menu__link\" href=\"/food/recipes\">\n",
      "        Recipes\n",
      "        <span class=\"main-menu__item__icon\">\n",
      "        </span>\n",
      "       </a>\n",
      "       <ul class=\"main-menu__secondary-navigation\">\n",
      "        <li class=\"main-menu__secondary-item\">\n",
      "         <a class=\"main-menu__secondary-link\" href=\"/food/seasons\">\n",
      "          In Season\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"main-menu__secondary-item\">\n",
      "         <a class=\"main-menu__secondary-link\" href=\"/food/occasions\">\n",
      "          Occasions\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"main-menu__secondary-item\">\n",
      "         <a class=\"main-menu__secondary-link\" href=\"/food/cuisines\">\n",
      "          Cuisines\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"main-menu__secondary-item\">\n",
      "         <a class=\"main-menu__secondary-link\" href=\"/food/dishes\">\n",
      "          Dishes\n",
      "         </a>\n",
      "        </li>\n",
      "       </ul>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--chefs \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/chefs\">\n",
      "        Chefs\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--programmes \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/programmes\">\n",
      "        Programmes\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--ingredients \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/ingredients\">\n",
      "        Ingredients\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--techniques \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/techniques\">\n",
      "        Techniques\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--primary main-menu__item--about \">\n",
      "       <a class=\"main-menu__link\" href=\"/food/about\">\n",
      "        FAQs\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\"main-menu__item main-menu__item--favorites\">\n",
      "       <a class=\"main-menu__link\" href=\"/food/my/favourites\">\n",
      "        Your Favourites\n",
      "       </a>\n",
      "      </li>\n",
      "     </ul>\n",
      "    </nav>\n",
      "   </div>\n",
      "   <div class=\"food-grid\">\n",
      "    <div class=\"food-content-wrapper\">\n",
      "     <div class=\"recipe-finder-link__wrap\">\n",
      "      <div class=\"recipe-layout\">\n",
      "       <div class=\"recipe-finder-link\">\n",
      "        <div class=\"recipe-search-quick-link__wrapper\">\n",
      "         <div class=\"recipe-search-quick-link\">\n",
      "          <a class=\"recipe-search-quick-link__link\" href=\"#recipe-finder__box\">\n",
      "           <span class=\"recipe-search-quick-link__text\">\n",
      "            Quick recipe finder\n",
      "           </span>\n",
      "           <span class=\"recipe-search-quick-link__icon\">\n",
      "           </span>\n",
      "          </a>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "     <div class=\"\" itemscope=\"\" itemtype=\"http://schema.org/Recipe\">\n",
      "      <div class=\"recipe-wrap\">\n",
      "       <div class=\"recipe-layout\">\n",
      "        <div class=\"recipe-main-info\">\n",
      "         <div class=\"recipe-title--small-spacing\">\n",
      "          <h1 class=\"content-title__text\" itemprop=\"name\">\n",
      "           Peanut butter cookies with banana ice cream\n",
      "          </h1>\n",
      "         </div>\n",
      "         <div class=\"recipe-leading-info\">\n",
      "          <div class=\"recipe-media\">\n",
      "           <div class=\"recipe-media__video\">\n",
      "            <div class=\"emp\" data-pid=\"p02rwtft\" data-poster-template=\"http://ichef.bbci.co.uk/food/ic/food_16x9_608/recipes/peanut_butter_cookies_02578_16x9.jpg\" data-version-pid=\"p02rwtfz\">\n",
      "             <div class=\"emp-placeholder\">\n",
      "              <img alt=\"\" itemprop=\"image\" src=\"http://ichef.bbci.co.uk/food/ic/food_16x9_608/recipes/peanut_butter_cookies_02578_16x9.jpg\"/>\n",
      "             </div>\n",
      "             <div class=\"emp-fallback\">\n",
      "              <p class=\"emp-fallback__message\">\n",
      "               You need JavaScript to view this clip.\n",
      "              </p>\n",
      "             </div>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "          <div class=\"recipe-metadata\">\n",
      "           <div class=\"recipe-metadata-wrap\">\n",
      "            <p class=\"recipe-metadata__heading\">\n",
      "             Preparation time\n",
      "            </p>\n",
      "            <p class=\"recipe-metadata__prep-time\" content=\"PT2H\" itemprop=\"prepTime\">\n",
      "             over 2 hours\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-metadata-wrap\">\n",
      "            <p class=\"recipe-metadata__heading\">\n",
      "             Cooking time\n",
      "            </p>\n",
      "            <p class=\"recipe-metadata__cook-time\" content=\"PT30M\" itemprop=\"cookTime\">\n",
      "             10 to 30 mins\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-metadata-wrap\">\n",
      "            <p class=\"recipe-metadata__heading\">\n",
      "             Serves\n",
      "            </p>\n",
      "            <p class=\"recipe-metadata__serving\" itemprop=\"recipeYield\">\n",
      "             Serves 5\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-metadata-wrap\">\n",
      "            <p class=\"recipe-metadata__heading\">\n",
      "             Dietary\n",
      "            </p>\n",
      "            <div class=\"recipe-metadata__dietary\">\n",
      "             <a class=\"recipe-metadata__dietary-vegetarian\" href=\"/food/diets/vegetarian\">\n",
      "              <p class=\"recipe-metadata__dietary-vegetarian-text\">\n",
      "               Vegetarian\n",
      "              </p>\n",
      "             </a>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "          <div class=\"recipe-description\">\n",
      "           <p class=\"recipe-description__text\" itemprop=\"description\">\n",
      "            Crunchy peanut butter cookies and creamy banana ice cream combine to make wonderful ice cream sandwiches in this surprisingly easy recipe.\n",
      "           </p>\n",
      "          </div>\n",
      "          <div class=\"recipe-chef\">\n",
      "           <div class=\"chef\">\n",
      "            <a class=\"chef__image-link\" href=\"/food/chefs/lisa_faulkner\" itemprop=\"author\" title=\"Lisa Faulkner\">\n",
      "             <img alt=\"\" class=\"chef__image\" src=\"http://ichef.bbci.co.uk/food/ic/food_1x1_72/chefs/lisa_faulkner_1x1.jpg\"/>\n",
      "            </a>\n",
      "            <div class=\"chef__about\">\n",
      "             <div class=\"chef__name\">\n",
      "              <span class=\"chef__preposition\">\n",
      "               By\n",
      "              </span>\n",
      "              <a class=\"chef__link\" href=\"/food/chefs/lisa_faulkner\" itemprop=\"author\">\n",
      "               Lisa Faulkner\n",
      "              </a>\n",
      "             </div>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "          <div class=\"recipe-actions\">\n",
      "           <div class=\"recipe-actions-wrap--share-tool\">\n",
      "            <div id=\"recipe-share-wrapper\">\n",
      "            </div>\n",
      "           </div>\n",
      "           <div class=\"recipe-actions-wrap recipe-actions-wrap--js-only\" id=\"add-to-favourites-btn-container\">\n",
      "            <p class=\"my-favourites-recipes__start-adding recipe-actions-text--button\">\n",
      "             <button class=\"recipe-actions-link__button\" id=\"add-to-favourites-button\" name=\"favouritesLink\" title=\"Peanut butter cookies with banana ice cream \" type=\"button\">\n",
      "              <span class=\"recipe-actions__adding-favourites-icon\" name=\"favouritesLinkIcon\">\n",
      "              </span>\n",
      "             </button>\n",
      "            </p>\n",
      "            <p class=\"my-favourites-recipes__start-adding--error\">\n",
      "             Unfortunately we are unable to add this recipe to your favourites, please try again later.\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-actions-wrap\">\n",
      "            <p class=\"my-favourites-recipes__start-adding\">\n",
      "             <a class=\"recipe-actions-link\" href=\"/food/recipes/peanut_butter_cookies_02578/share\" id=\"send-to-mobile-link\">\n",
      "              <span class=\"recipe-actions__send-to-mobile-icon\">\n",
      "              </span>\n",
      "              Send to mobile\n",
      "             </a>\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-actions-wrap\">\n",
      "            <p class=\"my-favourites-recipes__start-adding\">\n",
      "             <a class=\"recipe-actions-link\" href=\"/food/recipes/peanut_butter_cookies_02578/shopping-list\" id=\"shopping-list-link\">\n",
      "              <span class=\"recipe-actions__shopping-list-icon\">\n",
      "              </span>\n",
      "              Shopping list\n",
      "             </a>\n",
      "            </p>\n",
      "           </div>\n",
      "           <div class=\"recipe-actions-wrap--js-only\">\n",
      "            <p class=\"my-favourites-recipes__start-adding\">\n",
      "             <a class=\"recipe-actions-link\" href=\"javascript:window.print()\" id=\"print-link\">\n",
      "              <span class=\"recipe-actions__print-link-icon\">\n",
      "              </span>\n",
      "              Print recipe\n",
      "             </a>\n",
      "            </p>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "         <div class=\"recipe-ingredients\">\n",
      "          <div class=\"recipe-ingredients-wrapper\">\n",
      "           <h2 class=\"recipe-ingredients__heading\">\n",
      "            Ingredients\n",
      "           </h2>\n",
      "           <h3 class=\"recipe-ingredients__sub-heading\">\n",
      "            For the banana ice cream\n",
      "           </h3>\n",
      "           <ul class=\"recipe-ingredients__list\">\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             4 ripe\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/banana\">\n",
      "              bananas\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             100ml/3½fl oz natural Greek\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/yoghurt\">\n",
      "              yoghurt\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             splash\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/milk\">\n",
      "              milk\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             2 tbsp\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/honey\">\n",
      "              honey\n",
      "             </a>\n",
      "            </li>\n",
      "           </ul>\n",
      "           <h3 class=\"recipe-ingredients__sub-heading\">\n",
      "            For the peanut butter cookies\n",
      "           </h3>\n",
      "           <ul class=\"recipe-ingredients__list\">\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             75g/2¾oz\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/margarine\">\n",
      "              margarine\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             100g/3½oz golden\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/caster_sugar\">\n",
      "              caster sugar\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             1 large free-range\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/egg\">\n",
      "              egg\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             100g/3½oz\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/plain_flour\">\n",
      "              plain flour\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             1 tbsp\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/golden_syrup\">\n",
      "              golden syrup\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             100g/3½oz crunchy\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/peanut_butter\">\n",
      "              peanut butter\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             1 tsp\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/bicarbonate_of_soda\">\n",
      "              bicarbonate of soda\n",
      "             </a>\n",
      "            </li>\n",
      "            <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\">\n",
      "             50g/1¾oz salted\n",
      "             <a class=\"recipe-ingredients__link\" href=\"/food/peanut\">\n",
      "              peanuts\n",
      "             </a>\n",
      "            </li>\n",
      "           </ul>\n",
      "          </div>\n",
      "         </div>\n",
      "         <div class=\"recipe-method recipe-method--no-links \">\n",
      "          <div class=\"recipe-method-wrapper\">\n",
      "           <h2 class=\"recipe-method__heading\">\n",
      "            Method\n",
      "           </h2>\n",
      "           <ol class=\"recipe-method__list\">\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              To make the ice cream, peel the bananas, break them into small pieces and put into a large mixing bowl. Using a fork, mash the bananas until smooth. Add the remaining ingredients and beat together. Pour the mixture into a plastic container, cover with a lid and put in the freezer.\n",
      "             </p>\n",
      "            </li>\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              After half an hour take the mixture out of the freezer and use a fork to break up the ice crystals forming around the edges. Return to the freezer and repeat this process one or two times until the ice cream is frozen (the more you beat the mixture during freezing, the smoother the finished ice cream will be). This will take roughly 4 hours in total.\n",
      "             </p>\n",
      "            </li>\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              Meanwhile make the cookies, preheat the oven to 175C/155C Fan/Gas 4 and line two flat baking sheets with greaseproof paper.\n",
      "             </p>\n",
      "            </li>\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              Cream together the margarine and the sugar with a wooden spoon until pale. Beat in the egg, a little of the flour, the golden syrup and peanut butter. Stir in the remaining flour and the bicarbonate of soda then and finally stir through the peanuts.\n",
      "             </p>\n",
      "            </li>\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              Drop dessertspoons of the mixture onto the prepared baking trays. Leave plenty of space between them as the cookies will spread out during baking. Flatten each one with the back of a spoon then bake for 10 minutes. Remove from the oven, leave to cool for 10 minutes on the trays then transfer to a wire rack to cool completely.\n",
      "             </p>\n",
      "            </li>\n",
      "            <li class=\"recipe-method__list-item\" itemprop=\"recipeInstructions\">\n",
      "             <p class=\"recipe-method__list-item-text\">\n",
      "              To serve, top a cookie with a spoonful of the ice cream then sandwich together with a second cookie.\n",
      "             </p>\n",
      "            </li>\n",
      "           </ol>\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"grid-list-wrapper\">\n",
      "         <div class=\"grid-list-finder-panel\">\n",
      "          <div class=\"grid-list-panel__item\">\n",
      "           <div class=\"recipe-finder\">\n",
      "            <form action=\"http://www.bbc.co.uk/food/recipes/search\" class=\"recipe-finder__search-form\" method=\"POST\">\n",
      "             <label class=\"recipe-finder__search-box-label\" for=\"searchInput-large\">\n",
      "              Find a recipe on BBC Food\n",
      "             </label>\n",
      "             <input class=\"recipe-finder__search-box\" id=\"searchInput-large\" name=\"keywords\" placeholder=\"Find a recipe on BBC Food\" type=\"text\"/>\n",
      "             <div class=\"recipe-finder__seach-options\">\n",
      "              <input class=\"recipe-finder__q-e-checkbox\" id=\"quickAndEasy-large\" name=\"quickAndEasy\" type=\"checkbox\" value=\"true\"/>\n",
      "              <label class=\"recipe-finder__q-e-label\" for=\"quickAndEasy-large\">\n",
      "               <span class=\"recipe-finder__q-e-span\">\n",
      "               </span>\n",
      "               Quick &amp; Easy\n",
      "              </label>\n",
      "              <input class=\"recipe-finder__veg-checkbox\" id=\"vegetarian-large\" name=\"diets[]\" type=\"checkbox\" value=\"vegetarian\"/>\n",
      "              <label class=\"recipe-finder__veg-label\" for=\"vegetarian-large\">\n",
      "               <span class=\"recipe-finder__veg-span\">\n",
      "               </span>\n",
      "               Vegetarian\n",
      "              </label>\n",
      "              <label class=\"recipe-finder__search-button-label\" for=\"recipe-finder-search-button\">\n",
      "               Search BBC Food's recipes\n",
      "              </label>\n",
      "              <input class=\"recipe-finder__search-button\" id=\"recipe-finder-search-button\" type=\"submit\" value=\"\"/>\n",
      "             </div>\n",
      "            </form>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "         <div class=\"grid-list-panel--dark\">\n",
      "          <div class=\"grid-list-panel__item\">\n",
      "           <div class=\"related-recipes__content\">\n",
      "            <div class=\"related-recipes__item related-recipes__item--primary \">\n",
      "             <h2 class=\"related-recipes__header\">\n",
      "              Related Recipes\n",
      "             </h2>\n",
      "             <div class=\"related-recipes__about related-recipes__about--collection\">\n",
      "              <a class=\"related-recipes__image-link\" href=\"/food/recipes/pauls_mums_jam_tarts_68845\">\n",
      "               <img alt=\"Paul’s mum’s jam tarts\" class=\"related-recipes__image responsive-images\" data-image-recipe=\"http://ichef.bbci.co.uk/food/ic/$recipe/recipes/pauls_mums_jam_tarts_68845_16x9.jpg\" src=\"http://ichef.bbci.co.uk/food/ic/food_16x9_160/recipes/pauls_mums_jam_tarts_68845_16x9.jpg\"/>\n",
      "              </a>\n",
      "              <div class=\"related-recipes__information\">\n",
      "               <a class=\"related-recipes__title-link\" href=\"/food/recipes/pauls_mums_jam_tarts_68845\">\n",
      "                <h3 class=\"related-recipes__title\">\n",
      "                 Paul’s mum’s jam tarts\n",
      "                </h3>\n",
      "               </a>\n",
      "               <p class=\"related-recipes__author\">\n",
      "                <strong>\n",
      "                 By\n",
      "                </strong>\n",
      "                <span class=\"related-recipes__author-name\">\n",
      "                 Paul Hollywood\n",
      "                </span>\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "             <p class=\"related-recipes__more\">\n",
      "              <strong>\n",
      "               See more\n",
      "              </strong>\n",
      "              <a class=\"related-recipes__more-link\" href=\"/food/collections/childrens_tea_party_ideas\">\n",
      "               <span class=\"related-recipes__more-name\">\n",
      "                Children's tea party ideas\n",
      "               </span>\n",
      "               recipes\n",
      "               <span class=\"related-recipes__more-amount\">\n",
      "                (19)\n",
      "               </span>\n",
      "              </a>\n",
      "             </p>\n",
      "            </div>\n",
      "            <div class=\"related-recipes__item related-recipes__item--secondary related-recipes__item--secondary--image \">\n",
      "             <div class=\"related-recipes__about related-recipes__about--ingredient\">\n",
      "              <a class=\"related-recipes__image-link\" href=\"/food/recipes/bananabread_85720\">\n",
      "               <img alt=\"Banana bread\" class=\"related-recipes__image responsive-images\" data-image-recipe=\"http://ichef.bbci.co.uk/food/ic/$recipe/recipes/bananabread_85720_16x9.jpg\" src=\"http://ichef.bbci.co.uk/food/ic/food_16x9_160/recipes/bananabread_85720_16x9.jpg\"/>\n",
      "              </a>\n",
      "              <div class=\"related-recipes__information\">\n",
      "               <a class=\"related-recipes__title-link\" href=\"/food/recipes/bananabread_85720\">\n",
      "                <h3 class=\"related-recipes__title\">\n",
      "                 Banana bread\n",
      "                </h3>\n",
      "               </a>\n",
      "               <p class=\"related-recipes__author\">\n",
      "                <strong>\n",
      "                 By\n",
      "                </strong>\n",
      "                <span class=\"related-recipes__author-name\">\n",
      "                 John Barrowman\n",
      "                </span>\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "             <p class=\"related-recipes__more\">\n",
      "              <strong>\n",
      "               See more\n",
      "              </strong>\n",
      "              <a class=\"related-recipes__more-link\" href=\"/food/banana\">\n",
      "               <span class=\"related-recipes__more-name\">\n",
      "                banana\n",
      "               </span>\n",
      "               recipes\n",
      "               <span class=\"related-recipes__more-amount\">\n",
      "                (131)\n",
      "               </span>\n",
      "              </a>\n",
      "             </p>\n",
      "            </div>\n",
      "            <div class=\"related-recipes__item related-recipes__item--secondary related-recipes__item--secondary--image related-recipes__item--last\">\n",
      "             <div class=\"related-recipes__about related-recipes__about--dish\">\n",
      "              <a class=\"related-recipes__image-link\" href=\"/food/recipes/buckwheat_triple_32460\">\n",
      "               <img alt=\"Triple chocolate buckwheat cookies\" class=\"related-recipes__image responsive-images\" data-image-recipe=\"http://ichef.bbci.co.uk/food/ic/$recipe/recipes/buckwheat_triple_32460_16x9.jpg\" src=\"http://ichef.bbci.co.uk/food/ic/food_16x9_160/recipes/buckwheat_triple_32460_16x9.jpg\"/>\n",
      "              </a>\n",
      "              <div class=\"related-recipes__information\">\n",
      "               <a class=\"related-recipes__title-link\" href=\"/food/recipes/buckwheat_triple_32460\">\n",
      "                <h3 class=\"related-recipes__title\">\n",
      "                 Triple chocolate buckwheat cookies\n",
      "                </h3>\n",
      "               </a>\n",
      "               <p class=\"related-recipes__author\">\n",
      "                <strong>\n",
      "                 By\n",
      "                </strong>\n",
      "                <span class=\"related-recipes__author-name\">\n",
      "                 Nigella Lawson\n",
      "                </span>\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "             <p class=\"related-recipes__more\">\n",
      "              <strong>\n",
      "               See more\n",
      "              </strong>\n",
      "              <a class=\"related-recipes__more-link\" href=\"/food/cookies\">\n",
      "               <span class=\"related-recipes__more-name\">\n",
      "                cookies\n",
      "               </span>\n",
      "               recipes\n",
      "               <span class=\"related-recipes__more-amount\">\n",
      "                (14)\n",
      "               </span>\n",
      "              </a>\n",
      "             </p>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "         <div class=\"social-promo\">\n",
      "          <div class=\"social-promo-wrapper\">\n",
      "           <div class=\"social-promo-twitter__wrapper\">\n",
      "            <a class=\"social-promo-twitter-link\" href=\"http://www.twitter.com/BBCFood\">\n",
      "             <span class=\"social-promo-twitter-icon\">\n",
      "             </span>\n",
      "             <div class=\"social-promo-link-text\">\n",
      "              Follow\n",
      "              <div class=\"social-promo-site-name\">\n",
      "               BBC Food\n",
      "              </div>\n",
      "             </div>\n",
      "            </a>\n",
      "           </div>\n",
      "           <div class=\"social-promo-facebook__wrapper\">\n",
      "            <a class=\"social-promo-facebook-link\" href=\"http://www.facebook.com/bbcfood\">\n",
      "             <span class=\"social-promo-facebook-icon\">\n",
      "             </span>\n",
      "             <div class=\"social-promo-link-text\">\n",
      "              Like\n",
      "              <div class=\"social-promo-site-name\">\n",
      "               BBC Food\n",
      "              </div>\n",
      "             </div>\n",
      "            </a>\n",
      "           </div>\n",
      "           <div class=\"social-promo-pinterest__wrapper\">\n",
      "            <a class=\"social-promo-pinterest-link\" href=\"http://www.pinterest.com/bbcfood\">\n",
      "             <span class=\"social-promo-pinterest-icon\">\n",
      "             </span>\n",
      "             <div class=\"social-promo-link-text\">\n",
      "              Follow\n",
      "              <div class=\"social-promo-site-name\">\n",
      "               BBC Food\n",
      "              </div>\n",
      "             </div>\n",
      "            </a>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"recipe-finder__wrap\" id=\"recipe-finder__box\">\n",
      "       <div class=\"recipe-layout\">\n",
      "        <div class=\"recipe-finder\">\n",
      "         <form action=\"http://www.bbc.co.uk/food/recipes/search\" class=\"recipe-finder__search-form\" method=\"POST\">\n",
      "          <label class=\"recipe-finder__search-box-label\" for=\"searchInput-small\">\n",
      "           Find a recipe on BBC Food\n",
      "          </label>\n",
      "          <input class=\"recipe-finder__search-box\" id=\"searchInput-small\" name=\"keywords\" placeholder=\"Find a recipe on BBC Food\" type=\"text\"/>\n",
      "          <div class=\"recipe-finder__seach-options\">\n",
      "           <input class=\"recipe-finder__q-e-checkbox\" id=\"quickAndEasy-small\" name=\"quickAndEasy\" type=\"checkbox\" value=\"true\"/>\n",
      "           <label class=\"recipe-finder__q-e-label\" for=\"quickAndEasy-small\">\n",
      "            <span class=\"recipe-finder__q-e-span\">\n",
      "            </span>\n",
      "            Quick &amp; Easy\n",
      "           </label>\n",
      "           <input class=\"recipe-finder__veg-checkbox\" id=\"vegetarian-small\" name=\"diets[]\" type=\"checkbox\" value=\"vegetarian\"/>\n",
      "           <label class=\"recipe-finder__veg-label\" for=\"vegetarian-small\">\n",
      "            <span class=\"recipe-finder__veg-span\">\n",
      "            </span>\n",
      "            Vegetarian\n",
      "           </label>\n",
      "           <label class=\"recipe-finder__search-button-label\" for=\"recipe-finder-search-button\">\n",
      "            Search BBC Food's recipes\n",
      "           </label>\n",
      "           <input class=\"recipe-finder__search-button\" id=\"recipe-finder-search-button\" type=\"submit\" value=\"\"/>\n",
      "          </div>\n",
      "         </form>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "     <script type=\"text/javascript\">\n",
      "      require(['bbcshare'], function (bbcshare) {\n",
      "        var target = document.getElementById('recipe-share-wrapper'),\n",
      "            options = {\n",
      "                'shareUrl': 'http://www.bbc.co.uk/food/recipes/peanut_butter_cookies_02578',\n",
      "                'variant': 'light-grey',\n",
      "                'shareNoun': 'recipe',\n",
      "                'twitterName': 'BBCFood',\n",
      "                'networkOrdering': 'true',\n",
      "                'title': 'Peanut butter cookies with banana ice cream '\n",
      "            };\n",
      "\n",
      "        bbcshare.render(target, options);\n",
      "    });\n",
      "     </script>\n",
      "    </div>\n",
      "   </div>\n",
      "  </div>\n",
      " </div>\n",
      " <div class=\"orb-footer orb-footer-grey b-footer--grey--white\" id=\"orb-footer\">\n",
      "  <div class=\"orb-footer-grey\" id=\"navp-orb-footer-promo\">\n",
      "  </div>\n",
      "  <aside role=\"complementary\">\n",
      "   <div class=\"orb-nav-sec b-r b-g-p\" id=\"orb-aside\">\n",
      "    <div class=\"orb-footer-inner\" role=\"navigation\">\n",
      "     <h2 class=\"orb-footer-lead\">\n",
      "      Explore the BBC\n",
      "     </h2>\n",
      "     <div class=\"orb-footer-primary-links\">\n",
      "      <ul>\n",
      "       <li class=\"orb-nav-news orb-d\">\n",
      "        <a href=\"http://www.bbc.co.uk/news/\">\n",
      "         News\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-newsdotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/news/\">\n",
      "         News\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-sport\">\n",
      "        <a href=\"/sport/\">\n",
      "         Sport\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-weather\">\n",
      "        <a href=\"/weather/\">\n",
      "         Weather\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-shop orb-w\">\n",
      "        <a href=\"http://shop.bbc.com/\">\n",
      "         Shop\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-earthdotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/earth/\">\n",
      "         Earth\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-travel-dotcom orb-w\">\n",
      "        <a href=\"http://www.bbc.com/travel/\">\n",
      "         Travel\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-capital orb-w\">\n",
      "        <a href=\"http://www.bbc.com/capital/\">\n",
      "         Capital\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-iplayer orb-d\">\n",
      "        <a href=\"/iplayer/\">\n",
      "         iPlayer\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-culture orb-w\">\n",
      "        <a href=\"http://www.bbc.com/culture/\">\n",
      "         Culture\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-autos orb-w\">\n",
      "        <a href=\"http://www.bbc.com/autos/\">\n",
      "         Autos\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-future orb-w\">\n",
      "        <a href=\"http://www.bbc.com/future/\">\n",
      "         Future\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-tv\">\n",
      "        <a href=\"/tv/\">\n",
      "         TV\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-radio\">\n",
      "        <a href=\"/radio/\">\n",
      "         Radio\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-cbbc\">\n",
      "        <a href=\"/cbbc\">\n",
      "         CBBC\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-cbeebies\">\n",
      "        <a href=\"/cbeebies\">\n",
      "         CBeebies\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-food\">\n",
      "        <a href=\"/food/\">\n",
      "         Food\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/iwonder\">\n",
      "         iWonder\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/education\">\n",
      "         Bitesize\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-travel orb-d\">\n",
      "        <a href=\"/travel/\">\n",
      "         Travel\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-music\">\n",
      "        <a href=\"/music/\">\n",
      "         Music\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-earth orb-d\">\n",
      "        <a href=\"http://www.bbc.com/earth/\">\n",
      "         Earth\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-arts\">\n",
      "        <a href=\"/arts/\">\n",
      "         Arts\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-makeitdigital\">\n",
      "        <a href=\"/makeitdigital\">\n",
      "         Make It Digital\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/taster\">\n",
      "         Taster\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-nature orb-w\">\n",
      "        <a href=\"/nature/\">\n",
      "         Nature\n",
      "        </a>\n",
      "       </li>\n",
      "       <li class=\"orb-nav-local\">\n",
      "        <a href=\"/local/\">\n",
      "         Local\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "     </div>\n",
      "    </div>\n",
      "   </div>\n",
      "  </aside>\n",
      "  <footer role=\"contentinfo\">\n",
      "   <div class=\"orb-nav-sec b-r b-g-p\" id=\"orb-contentinfo\">\n",
      "    <div class=\"orb-footer-inner\">\n",
      "     <ul>\n",
      "      <li>\n",
      "       <a href=\"/terms/\">\n",
      "        Terms of Use\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/aboutthebbc/\">\n",
      "        About the BBC\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/privacy/\">\n",
      "        Privacy Policy\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/privacy/cookies/about\">\n",
      "        Cookies\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/accessibility/\">\n",
      "        Accessibility Help\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/guidance/\">\n",
      "        Parental Guidance\n",
      "       </a>\n",
      "      </li>\n",
      "      <li>\n",
      "       <a href=\"/contact/\">\n",
      "        Contact the BBC\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\" orb-w\">\n",
      "       <a href=\"http://advertising.bbcworldwide.com/\">\n",
      "        Advertise with us\n",
      "       </a>\n",
      "      </li>\n",
      "      <li class=\" orb-w\">\n",
      "       <a href=\"/privacy/cookies/international/\">\n",
      "        Ad choices\n",
      "       </a>\n",
      "      </li>\n",
      "     </ul>\n",
      "     <small>\n",
      "      <span class=\"orb-hilight\">\n",
      "       Copyright © 2016 BBC.\n",
      "      </span>\n",
      "      The BBC is not responsible for the content of external sites.\n",
      "      <a class=\"orb-hilight\" href=\"/help/web/links/\">\n",
      "       Read about our approach to external linking.\n",
      "      </a>\n",
      "     </small>\n",
      "    </div>\n",
      "   </div>\n",
      "  </footer>\n",
      " </div>\n",
      " <!-- BBCDOTCOM bodyLast -->\n",
      " <div class=\"bbccom_display_none\">\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ if (window.bbcdotcom && window.bbcdotcom.analytics) { bbcdotcom.analytics.page(); } /*]]>*/\n",
      "  </script>\n",
      "  <noscript>\n",
      "   <img alt=\"\" height=\"1\" src=\"//ssc.api.bbc.com/?c1=2&amp;c2=19293874&amp;ns_site=bbc&amp;name=\" width=\"1\"/>\n",
      "  </noscript>\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ if (window.bbcdotcom && bbcdotcom.currencyProviders) { bbcdotcom.currencyProviders.write(); } /*]]>*/\n",
      "  </script>\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ if (window.bbcdotcom && bbcdotcom.currencyProviders) { bbcdotcom.currencyProviders.postWrite(); } /*]]>*/\n",
      "  </script>\n",
      "  <script type=\"text/javascript\">\n",
      "   /*<![CDATA[*/ if (window.bbcdotcom && bbcdotcom.data && bbcdotcom.data.stats && bbcdotcom.data.stats === 1 && bbcdotcom.utils && window.location.pathname === '/' && window.bbccookies && bbccookies.readPolicy('performance') ) { var wwhpEdition = bbcdotcom.utils.getMetaPropertyContent('wwhp-edition'); var _sf_async_config={}; /** CONFIGURATION START **/ _sf_async_config.uid = 50924; _sf_async_config.domain = \"bbc.co.uk\"; _sf_async_config.title = \"Homepage\"+(wwhpEdition !== '' ? ' - '+wwhpEdition : ''); _sf_async_config.sections = \"Homepage\"+(wwhpEdition !== '' ? ', Homepage - '+wwhpEdition : ''); _sf_async_config.region = wwhpEdition; _sf_async_config.path = \"/\"+(wwhpEdition !== '' ? '?'+wwhpEdition : ''); /** CONFIGURATION END **/ (function(){ function loadChartbeat() { window._sf_endpt=(new Date()).getTime(); var e = document.createElement(\"script\"); e.setAttribute(\"language\", \"javascript\"); e.setAttribute(\"type\", \"text/javascript\"); e.setAttribute('src', '//static.chartbeat.com/js/chartbeat.js'); document.body.appendChild(e); } var oldonload = window.onload; window.onload = (typeof window.onload != \"function\") ? loadChartbeat : function() { oldonload(); loadChartbeat(); }; })(); } /*]]>*/\n",
      "  </script>\n",
      " </div>\n",
      " <!-- BBCDOTCOM all code in page -->\n",
      " <script type=\"text/javascript\">\n",
      "  document.write('<' + 'script id=\"orb-js-script\" data-assetpath=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/\" src=\"http://static.bbci.co.uk/frameworks/barlesque/3.18.3/orb/4/script/orb.min.js\"><' + '/script>');\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  (function() {\n",
      "    'use strict';\n",
      "\n",
      "    var promoManager = {\n",
      "        url: '',\n",
      "        promoLoaded: false,\n",
      "                makeUrl: function (theme, site, win) {\n",
      "            var loc = win? win.location : window.location,\n",
      "                proto = loc.protocol,\n",
      "                host = loc.host,\n",
      "                url = proto + '//' + ((proto.match(/s:/i) && !host.match(/^www\\.(int|test)\\./i))? 'ssl.' : 'www.'),\n",
      "                themes = ['light', 'dark'];\n",
      "\n",
      "            if ( host.match(/^(?:www|ssl|m)\\.(int|test|stage|live)\\.bbc\\./i) ) {\n",
      "                url += RegExp.$1 + '.';\n",
      "            }\n",
      "            else if ( host.match(/^pal\\.sandbox\\./i) ) {\n",
      "                url += 'test.';\n",
      "            }\n",
      "\n",
      "                        theme = themes[ +(theme === themes[0]) ];\n",
      "           \n",
      "           return url + 'bbc.co.uk/navpromo/card/' + site + '/' + theme;\n",
      "        },\n",
      "                init: function(node) {\n",
      "            var disabledByCookie = (document.cookie.indexOf('ckns_orb_nopromo=1') > -1),\n",
      "                that = this;\n",
      "            \n",
      "            if (window.promomanagerOverride) {\n",
      "                for (var p in promomanagerOverride) {\n",
      "                    that[p] = promomanagerOverride[p];\n",
      "                }\n",
      "            }\n",
      "                \n",
      "            if ( window.orb.fig('uk') && !disabledByCookie ) {\n",
      "                require(['orb/async/_footerpromo', 'istats-1'], function(promo, istats) {\n",
      "\n",
      "                    var virtualSite = istats.getSite() || 'default';\n",
      "                    that.url = (window.promomanagerOverride || that).makeUrl('light', virtualSite);\n",
      "\n",
      "                    if (that.url) { \n",
      "                        promo.load(that.url, node, {\n",
      "                                                          onSuccess: function(e) {\n",
      "                                if(e.status === 'success') {\n",
      "                                    node.parentNode.className = node.parentNode.className + ' orb-footer-promo-loaded';\n",
      "                                    promoManager.promoLoaded = true;\n",
      "                                    promoManager.event('promo-loaded').fire(e);\n",
      "                                }\n",
      "                             },\n",
      "                             onError: function() {\n",
      "                                istats.log('error', 'orb-footer-promo-failed');\n",
      "                                bbccookies.set('ckns_orb_nopromo=1; expires=' + new Date(new Date().getTime() + 1000 * 60 * 10).toGMTString() + ';path=/;');\n",
      "                             }\n",
      "                        });   \n",
      "                    }\n",
      "                });\n",
      "            }\n",
      "        }\n",
      "    };\n",
      "    \n",
      "        \n",
      "    define('orb/promomanager', ['orb/lib/_event'], function (event) {\n",
      "        event.mixin(promoManager);\n",
      "        return promoManager;\n",
      "    });\n",
      "    \n",
      "    require(['orb/promomanager'], function (promoManager) {\n",
      "        promoManager.init(document.getElementById('navp-orb-footer-promo'));\n",
      "    })\n",
      "})();\n",
      " </script>\n",
      " <script src=\"//mybbc.files.bbci.co.uk/s/notification-ui/1.4.4/js/notifications.js\" type=\"text/javascript\">\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  require.config({\n",
      "            paths: {\n",
      "                \"mybbc/templates\": '//mybbc.files.bbci.co.uk/s/notification-ui/1.4.4/templates',\n",
      "                \"mybbc/notifications\": '//mybbc.files.bbci.co.uk/s/notification-ui/1.4.4/js'\n",
      "            }\n",
      "        });\n",
      "\n",
      "        require(['mybbc/notifications/NotificationsMain', 'idcta/idcta-1'], function (NotificationsMain, idcta) {\n",
      "            var loadNotifications = function (fig) {\n",
      "                if (fig.geo.isUK()) {\n",
      "                    NotificationsMain.run(idcta, '//mybbc.files.bbci.co.uk/s/notification-ui/1.4.4/');\n",
      "                }\n",
      "            };\n",
      "            var orbFig = window.orb.fig;\n",
      "            if (typeof orbFig.load === 'function') {\n",
      "                // Use new async API from Orbit\n",
      "                orbFig.load(loadNotifications, loadNotifications);\n",
      "            } else {\n",
      "                // Use old sync-only API from PAL orbfig project\n",
      "                loadNotifications(orbFig);\n",
      "            }\n",
      "        });\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  if (typeof require !== 'undefined') { require(['istats-1'], function(istats){ istats.track('external', { region: document.getElementsByTagName('body')[0] }); istats.track('download', { region: document.getElementsByTagName('body')[0] }); }); }\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  define(\"orb/async/_suggestions\",[\"orb/lib/_$\",\"orb/api\"],function(e,t){\"use strict\";function n(t,n){var s=document.createElement(\"div\");return e.addClass(s,[\"orb-menu\",\"orb-menu-suggest\"]),e.setAttr(s,\"role\",\"listbox\"),e.addEvent(s,\"mousedown\",function(e){for(var n=e.target;n&&\"LI\"!==(\"\"+n.nodeName).toUpperCase();)n=n.parentNode;n&&t(n)}),e.addEvent(s,\"mousemove\",function(e){for(var t=e.target;t&&\"LI\"!==(\"\"+t.nodeName).toUpperCase();)t=t.parentNode;t&&n(t)}),s}function s(){var t=document.createElement(\"span\");return e.addClass(t,[\"orb-menu\",\"orb-menu-suggest-status\"]),e.setAttr(t,\"role\",\"status\"),e.setAttr(t,\"aria-live\",\"polite\"),e.setAttr(t,\"lang\",\"en-GB\"),e.setAttr(t,\"dir\",\"ltr\"),t}function o(e){var n;if(\"maxSuggestions\"!==e)throw\"ORB Suggestions: Unknown option name.\";return n=\"undefined\"!=typeof t.config(\"maxSuggestions\")?+t.config(\"maxSuggestions\"):g,n=Math.max(Math.min(n,10),0)}function r(e){for(var t=\"_SUGGEST\",n=0,s=e.length;s>n;n++)t+=\"\"+e.charCodeAt(n).toString(16);return t}var i={ESC:27,UP:38,DOWN:40},u=\"//search-suggest.api.bbci.co.uk/search-suggest/suggest?{{scope}}&format=blq-1&apikey=GqoNAMBBmPCZ0t8kXArU5jgojoZdEr10&q={{term}}\",a=1,c=24,g=6,m=500,l=\"orb-menu-active\",h=\"orb-menu-selected\",d=function(o){var r=o.form.parentNode,u=this;this.searchInput=o,this.currentSuggestion=-1,this.changeThrottle=null,this.menuDom=n.call(this,function(e){u.setSuggestion(e),u.searchInput.form.submit()},function(t){var n=+e.getAttr(t,\"data-item\");u.setSelection(n)}),this.statusDom=s(),r.appendChild(this.menuDom),r.appendChild(this.statusDom),e.addEvent([o],\"keyup\",function(t){var n=+(\"number\"==typeof t.which)?t.which:t.keyCode;n===i.UP?(e.removeClass(e(\"ul\",u.menuDom),\"orb-menu-mouse\"),e.addClass(e(\"ul\",u.menuDom),\"orb-menu-keyboard\"),u.moveSelection(-1)):n===i.DOWN?(e.removeClass(e(\"ul\",u.menuDom),\"orb-menu-mouse\"),e.addClass(e(\"ul\",u.menuDom),\"orb-menu-keyboard\"),u.moveSelection(1)):n===i.ESC?(u.setSelection(-1),u.hideSuggestions()):(e(\"#orb-search-suggid\")[0].value=\"\",u.fetchSuggestions())}),e.addEvent([o],\"blur\",function(e){clearTimeout(u.changeThrottle),u.hideSuggestions()}),t.layout(function(e){u.hideSuggestions()}),e.addEvent(this.menuDom,\"mousemove\",function(t){e.removeClass(e(\"ul\",u.menuDom),\"orb-menu-keyboard\"),e.addClass(e(\"ul\",u.menuDom),\"orb-menu-mouse\")})};return d.prototype.showSuggestions=function(t,n){var s,r,i=\"\",u=n.length;if(u&&(r=o(\"maxSuggestions\"),0!==r)){u=r?Math.min(r,u):u;for(var a=0;u>a;a++)s=e.str.htmlEntities(n[a].title),s=s.replace(new RegExp(e.str.htmlEntities(t),\"i\"),\"<b>$&</b>\"),s=e.str.trimHtml(s,c),i+='<li data-item=\"'+a+'\" data-term=\"'+e.str.htmlEntities(n[a].title)+'\" data-suggestion-id=\"'+e.str.htmlEntities(n[a].id)+'\">'+s+\"</li>\";this.menuDom.innerHTML=\"<ul>\"+i+\"</ul>\",u>0&&(this.statusDom.innerHTML=u+\" result\"+(1===u?\" is \":\"s are \")+\"available, use up and down arrow keys to navigate.\"),e.addClass(this.menuDom,l)}},d.prototype.hideSuggestions=function(){e.removeClass(this.menuDom,l),this.menuDom.innerHTML=\"\",this.setSelection(-1),this.statusDom.innerHTML=\"\"},d.prototype.moveSelection=function(t){var n=e(\"li\",this.menuDom),s=n[this.currentSuggestion];s&&(s.removeAttribute(\"aria-selected\"),e.removeClass(s,h)),this.currentSuggestion+=t,this.currentSuggestion>=n.length?(this.currentSuggestion=-1,this.restoreSuggestion()):-1===this.currentSuggestion?this.restoreSuggestion():this.currentSuggestion<-1&&(this.currentSuggestion=n.length-1),s=n[this.currentSuggestion],s&&(s.setAttribute(\"aria-selected\",\"true\",0),e.addClass(s,h),this.setSuggestion(s))},d.prototype.setSelection=function(t){var n=e(\"li\",this.menuDom),s=n[this.currentSuggestion];s&&(s.removeAttribute(\"aria-selected\"),e.removeClass(s,h)),\"number\"==typeof t?this.currentSuggestion=t:this.currentSuggestion=-1},d.prototype.setSuggestion=function(t){if(arguments[0].nodeType){var n=e.getAttr(t,\"data-suggestion-id\");t=e.getAttr(t,\"data-term\"),e(\"#orb-search-suggid\")[0].value=n}this.searchInput.value=t||\"\"},d.prototype.restoreSuggestion=function(){this.searchInput.lastTerm&&(this.searchInput.value=this.searchInput.lastTerm),e(\"#orb-search-suggid\")[0].value=\"\"},d.prototype.fetchSuggestions=function(t){var n,s,o=this;t=t||this.searchInput.value||\"\",t&&t===this.searchInput.lastTerm||(this.searchInput.lastTerm=t,s=u.replace(\"{{term}}\",encodeURIComponent(t)),n=(e(\"#orb-search-scope\")[0]||{}).value||\"all\",s=s.replace(\"{{scope}}\",\"scope=\"+encodeURIComponent(n)),clearTimeout(this.changeThrottle),t.length>=a?this.changeThrottle=setTimeout(function(){e.script.jsonp(s,function(e){o.showSuggestions(t,e[1])},{callbackName:r(t.toLowerCase())})},m):this.hideSuggestions())},d}),define(\"orb/features/_configuresearch\",[\"orb/lib/_$\",\"orb/features/masthead/_widgetmanager\"],function(e,t){\"use strict\";var n=function(){var n=null;e.ready(function(){var s=e(\"#orb-search-q\")[0],o=e(\".orb-nav-search input, .orb-nav-search button\");e.addEvent(o,\"focus\",function(e){clearTimeout(n),t.notify(\"widgetactivated\",s)}),document.documentElement&&0===(\"\"+document.documentElement.lang).indexOf(\"en\")&&(e(\"#orb-search-suggid\")[0].value=\"\",e.addEvent([s],\"keydown\",function(t){\"undefined\"==typeof s.suggestions&&(s.suggestions=\"initialising\",e.setAttr(s,\"autocomplete\",\"off\"),require([\"orb/async/_suggestions\"],function(e){s.suggestions=new e(s)}))})),e.addEvent(o,\"blur\",function(e){n=setTimeout(function(){t.notify(\"widgetdeactivated\",s)},220)})})};return n}),define(\"orb/features/_searchhint\",[\"orb/lib/_$\"],function(e){\"use strict\";return function(){var t=\"placeholder\"in document.createElement(\"input\");if(!t){var n=e(\"#orb-search-q\")[0],s=e(\"#orb-search-form\")[0],o=e.getAttr(n,\"placeholder\");e.ready(function(){e.addEvent(n,\"focusout\",function(e){\"\"===n.value&&(n.value=o)}),e.addEvent(n,\"focusin\",function(e){n.value===o&&(n.value=\"\")}),e.addEvent(s,\"submit\",function(e){n.value===o&&(n.value=\"\")}),n.value||document.activeElement===n||(n.value=o)})}}}),require([\"orb/features/_configuresearch\",\"orb/features/_searchhint\"],function(e,t){e(),t()});\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  require([\"istats-1\",\"orb/cookies\"],function(i,o){o.isAllowed(\"s1\")&&i.invoke()});\n",
      " </script>\n",
      " <script src=\"http://food.files.bbci.co.uk/kandl-food/1137/javascript/foodPage.js\">\n",
      " </script>\n",
      " <script>\n",
      "  require(['foodPage'], function (F) {\n",
      "                var foodPage = new F({cssAnimationsOff: false});\n",
      "                foodPage.init();\n",
      "                \n",
      "    foodPage.addToFavouritesButton.initialise({\n",
      "        \"recipeId\": \"peanut_butter_cookies_02578\",\n",
      "        \"signInUrl\": \"https://ssl.bbc.co.uk/id/signin?ptrt=http%3A%2F%2Fwww.bbc.co.uk%2Ffood%2Frecipes%2Fpeanut_butter_cookies_02578\",\n",
      "        \"foodFavouritesBaseUrl\": \"https://ssl.bbc.co.uk/food/favourites/\"\n",
      "    });\n",
      "\n",
      "            });\n",
      " </script>\n",
      " <script type=\"text/javascript\">\n",
      "  var cookie = \"; \" + document.cookie;\n",
      "    var cSplit = cookie.split(\"; ckns_policy=\");\n",
      "    var ckns_policy = cSplit.pop().split(\";\").shift();\n",
      "\n",
      "    if (ckns_policy != \"101\" && ckns_policy != \"000\" && ckns_policy != \"010\") {\n",
      "        var _sf_async_config={};\n",
      "\n",
      "        /** CONFIGURATION START **/\n",
      "        _sf_async_config.uid = 50924;\n",
      "        _sf_async_config.domain = 'bbc.co.uk';\n",
      "        _sf_async_config.useCanonical = true;\n",
      "        _sf_async_config.sections = 'kandlfood';\n",
      "        _sf_async_config.authors = '';\n",
      "\n",
      "        /** CONFIGURATION END **/\n",
      "        (function(){\n",
      "            function loadChartbeat() {\n",
      "                window._sf_endpt=(new Date()).getTime();\n",
      "                var e = document.createElement('script');\n",
      "                e.setAttribute('language', 'javascript');\n",
      "                e.setAttribute('type', 'text/javascript');\n",
      "                e.setAttribute('src', '//static.chartbeat.com/js/chartbeat.js');\n",
      "                document.body.appendChild(e);\n",
      "            }\n",
      "            var oldonload = window.onload;\n",
      "            window.onload = (typeof window.onload != 'function') ?\n",
      "                    loadChartbeat : function() { oldonload(); loadChartbeat(); };\n",
      "        })();\n",
      "    }\n",
      " </script>\n",
      "</body>\n",
      "\n"
     ]
    }
   ],
   "source": [
    "body = soup.find('body')                       # Creating a body object\n",
    "print(body.prettify())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we're ready to From there we can now search the body using Ctrl+F for specific text as follows: \n",
    "\n",
    "#### Peanut butter cookies with banana ice cream"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that it appears 3 times. One is inside a script tag, one is related to a button and one is as the heading of the recipe. It's this one we'll extract as the title as follows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Peanut butter cookies with banana ice cream \n"
     ]
    }
   ],
   "source": [
    "title = soup.find(\"h1\",class_=\"content-title__text\").text     # Finds the H1 tag with the desinated class and extracts the text from it\n",
    "print(title)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This has successfully given us the title of the recipe! Now we'll need to exctract the ingredients list. If we Ctrl+F and search for ingredient we can see that there's a div and class as follows:"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    "<div class=\"recipe-ingredients\">"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<div class=\"recipe-ingredients\">\n",
       "<div class=\"recipe-ingredients-wrapper\">\n",
       "<h2 class=\"recipe-ingredients__heading\">Ingredients</h2>\n",
       "<h3 class=\"recipe-ingredients__sub-heading\">For the banana ice cream</h3>\n",
       "<ul class=\"recipe-ingredients__list\">\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 4 ripe <a class=\"recipe-ingredients__link\" href=\"/food/banana\">bananas</a> </li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100ml/3½fl oz natural Greek <a class=\"recipe-ingredients__link\" href=\"/food/yoghurt\">yoghurt</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> splash <a class=\"recipe-ingredients__link\" href=\"/food/milk\">milk</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 2 tbsp <a class=\"recipe-ingredients__link\" href=\"/food/honey\">honey</a></li>\n",
       "</ul>\n",
       "<h3 class=\"recipe-ingredients__sub-heading\">For the peanut butter cookies</h3>\n",
       "<ul class=\"recipe-ingredients__list\">\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 75g/2¾oz <a class=\"recipe-ingredients__link\" href=\"/food/margarine\">margarine</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz golden <a class=\"recipe-ingredients__link\" href=\"/food/caster_sugar\">caster sugar</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 large free-range <a class=\"recipe-ingredients__link\" href=\"/food/egg\">egg</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz <a class=\"recipe-ingredients__link\" href=\"/food/plain_flour\">plain flour</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 tbsp <a class=\"recipe-ingredients__link\" href=\"/food/golden_syrup\">golden syrup</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz crunchy <a class=\"recipe-ingredients__link\" href=\"/food/peanut_butter\">peanut butter</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 tsp <a class=\"recipe-ingredients__link\" href=\"/food/bicarbonate_of_soda\">bicarbonate of soda</a></li>\n",
       "<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 50g/1¾oz salted <a class=\"recipe-ingredients__link\" href=\"/food/peanut\">peanuts</a></li>\n",
       "</ul>\n",
       "</div>\n",
       "</div>"
      ]
     },
     "execution_count": 56,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ingredients = soup.find('div',class_=\"recipe-ingredients\")\n",
    "ingredients"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that the ingredients are all in a list due to the li tags and have the class as follows:"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    "<li class=\"recipe-ingredients__list-item\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll use this as the source of our ingredients list but as there's more than one ingredient we'll need to use the find_all method:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 4 ripe <a class=\"recipe-ingredients__link\" href=\"/food/banana\">bananas</a> </li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100ml/3½fl oz natural Greek <a class=\"recipe-ingredients__link\" href=\"/food/yoghurt\">yoghurt</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> splash <a class=\"recipe-ingredients__link\" href=\"/food/milk\">milk</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 2 tbsp <a class=\"recipe-ingredients__link\" href=\"/food/honey\">honey</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 75g/2¾oz <a class=\"recipe-ingredients__link\" href=\"/food/margarine\">margarine</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz golden <a class=\"recipe-ingredients__link\" href=\"/food/caster_sugar\">caster sugar</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 large free-range <a class=\"recipe-ingredients__link\" href=\"/food/egg\">egg</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz <a class=\"recipe-ingredients__link\" href=\"/food/plain_flour\">plain flour</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 tbsp <a class=\"recipe-ingredients__link\" href=\"/food/golden_syrup\">golden syrup</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 100g/3½oz crunchy <a class=\"recipe-ingredients__link\" href=\"/food/peanut_butter\">peanut butter</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 1 tsp <a class=\"recipe-ingredients__link\" href=\"/food/bicarbonate_of_soda\">bicarbonate of soda</a></li>,\n",
       " <li class=\"recipe-ingredients__list-item\" itemprop=\"ingredients\"> 50g/1¾oz salted <a class=\"recipe-ingredients__link\" href=\"/food/peanut\">peanuts</a></li>]"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ingredients_soup = soup.find_all('li',class_=\"recipe-ingredients__list-item\")\n",
    "ingredients_soup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This returns us a list which we can interate through to extract the text from:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "ingredients_list = []\n",
    "\n",
    "for item in ingredients_soup:\n",
    "    out = item.text[1:]\n",
    "    ingredients_list.append(out)\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['4 ripe bananas ',\n",
       " '100ml/3½fl oz natural Greek yoghurt',\n",
       " 'splash milk',\n",
       " '2 tbsp honey',\n",
       " '75g/2¾oz margarine',\n",
       " '100g/3½oz golden caster sugar',\n",
       " '1 large free-range egg',\n",
       " '100g/3½oz plain flour',\n",
       " '1 tbsp golden syrup',\n",
       " '100g/3½oz crunchy peanut butter',\n",
       " '1 tsp bicarbonate of soda',\n",
       " '50g/1¾oz salted peanuts']"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ingredients_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets store our data as a dictionary..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'Peanut butter cookies with banana ice cream ': ['4 ripe bananas ',\n",
       "  '100ml/3½fl oz natural Greek yoghurt',\n",
       "  'splash milk',\n",
       "  '2 tbsp honey',\n",
       "  '75g/2¾oz margarine',\n",
       "  '100g/3½oz golden caster sugar',\n",
       "  '1 large free-range egg',\n",
       "  '100g/3½oz plain flour',\n",
       "  '1 tbsp golden syrup',\n",
       "  '100g/3½oz crunchy peanut butter',\n",
       "  '1 tsp bicarbonate of soda',\n",
       "  '50g/1¾oz salted peanuts']}"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "recipe = {title:ingredients_list}\n",
    "recipe"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And finally wrap everything up into a function:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'Cake pops': ['100g/3½oz dark chocolate',\n",
       "  '125g/4½oz fruit cake ',\n",
       "  '125g/4½oz Madeira cake ',\n",
       "  '2 tbsp desiccated coconut',\n",
       "  '2 tbsp chopped hazelnuts',\n",
       "  '300g/10½oz white chocolate',\n",
       "  'few drops food colouring',\n",
       "  'multi-coloured sugar ball sprinkles'],\n",
       " 'Peanut butter cookies with banana ice cream ': ['4 ripe bananas ',\n",
       "  '100ml/3½fl oz natural Greek yoghurt',\n",
       "  'splash milk',\n",
       "  '2 tbsp honey',\n",
       "  '75g/2¾oz margarine',\n",
       "  '100g/3½oz golden caster sugar',\n",
       "  '1 large free-range egg',\n",
       "  '100g/3½oz plain flour',\n",
       "  '1 tbsp golden syrup',\n",
       "  '100g/3½oz crunchy peanut butter',\n",
       "  '1 tsp bicarbonate of soda',\n",
       "  '50g/1¾oz salted peanuts'],\n",
       " 'Triple chocolate buckwheat cookies': ['150g/5½oz dark chocolate chips',\n",
       "  '125g/4½oz dark chocolate (minimum 70% cocoa solids)',\n",
       "  '125g/4½oz buckwheat flour',\n",
       "  '25g/1oz cocoa powder, sieved',\n",
       "  '½ tsp bicarbonate of soda',\n",
       "  '½ tsp fine sea salt',\n",
       "  '60g/2¼oz soft unsalted butter',\n",
       "  '125g/4½oz soft dark brown sugar',\n",
       "  '1 tsp vanilla paste or extract',\n",
       "  '2 large free-range eggs, fridge-cold']}"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "recipes = {}                                                                          # Blank recipes dictionary to which to append our data\n",
    "\n",
    "def bbc_rec(url):\n",
    "    # Title and ingredients scraper from the bbc website!\n",
    "    r = requests.get(url)                                                             # Making the request to the page\n",
    "    r.status_code                                                                     # Checking that the request has been successful\n",
    "    if r.status_code == 200:                                                          # Only execute if the request is successful\n",
    "        soup = BeautifulSoup(r.content,'lxml')                                        # Creating the beautiful soup object\n",
    "        title = soup.find(\"h1\",class_=\"content-title__text\").text                     # Extracting the title of the recipe\n",
    "        ingredients_soup = soup.find_all('li',class_=\"recipe-ingredients__list-item\") # Extracting the ingredients of the recipe\n",
    "        ingredients_list = []                                                         # Creating a blank ingredients list to which to append text\n",
    "        for item in ingredients_soup:                                                 # Loop to extract the relevant text\n",
    "            out = item.text[1:]                                                       # Extracing the text and removing the preceding space\n",
    "            ingredients_list.append(out)                                              # Appending the blank item to a recipe list  \n",
    "        recipes[title] = ingredients_list                                             # Appending the title and ingredients to the recipes dictionary\n",
    "    else:\n",
    "        print('Error code %s' % r.status_code)                                        # In case of error print the error message + code\n",
    "        \n",
    "bbc_rec(url='http://www.bbc.co.uk/food/recipes/peanut_butter_cookies_02578')          \n",
    "bbc_rec(url='http://www.bbc.co.uk/food/recipes/buckwheat_triple_32460')\n",
    "bbc_rec(url='http://www.bbc.co.uk/food/recipes/cake_lollipops_06507')\n",
    "recipes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Further Reading"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href = \"https://www.crummy.com/software/BeautifulSoup/bs4/doc/\">Beautiful Soup Documentation</a><br/>\n",
    "<a href = \"http://www.pythonforbeginners.com/python-on-the-web/web-scraping-with-beautifulsoup/\">Beautiful Soup Tutorial</a><br/>\n",
    "<a href = \"https://www.youtube.com/watch?v=3xQTJi2tqgk\">Youtube Tutorial on Beautiful Soup + Requests</a>\n",
    "<a href = \"http://www.w3schools.com/html/\">W3 Schools HTML Introduction</a><br/>\n",
    "<a href = \"http://www.w3schools.com/xml/\">W3 Schools XML Introduction</a><br/>\n",
    "<a href = \"https://www.codecademy.com/learn/web\">CodeAcademy HTML Course</a><br/>\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}