Skip to content

Python driven scraper that scrapes list of notices

Notifications You must be signed in to change notification settings

R15hav/KIIT_TnP_Scraper

Repository files navigation

KIIT_TnP_Scraper v1.0

Requirements

  1. Python 3.6
  2. Modules - If and only if you are running this code on a local machine

Setup

  1. Scrape_tnp is the main python file.
  2. Before running the code put your id and password in the mentioned area in the kiit_code.py file.
  3. Get the geko driver on your pc and Enter your Driver location at the specified position on the kiit_code.py file.
  4. Now go to twilio and get an account and activate sandbox (follow this Link)
  5. Put the sand box phone number in the tnp_whatsapp.py file at the mentioned line.

Where to run the code?

  • On windows:-

  1. Download the zipped code files extract it on your local machine.
  2. pip install all the required modules from above.
  3. Follow the setup procedure and you are good to go.
  4. Open terminal and run python Scrape_tnp.py.
  5. Leave the rest to the bot.
  • Better Way:-

  1. In order to run the code you need to host the code on some cloud platforms like Pythonanywhere
  2. Create an account, upload all the files.
  3. Since this code runs a selenium web driver to scrape the site we need to run a virtual display while hosting the code on Pythonanywhere using the command xvfb-run -a python3.6 /home/myusername/myfolder/myscript.py (more on)
  4. To run the code at intervals link

future updates

I am working on how to get the pdf file sent to ones whatsapp.

Kiit TnP

About

Python driven scraper that scrapes list of notices

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published