This project involves developing a Job Analyser
tool designed to help users learn about various job roles and make informed career decisions. It uses web scraping to collect job listing data, processes this data for reliability, and presents it through a web-based dashboard for interactive analysis.
The methodology of this project includes:
- Scraping job listings from GOV.UK website, using API requests and BeautifulSoup.
- Cleaning and transforming the collected data for accuracy and consistency.
- Developing a web-based dashboard using Flask and SQLite to present interactive visualizations.
This project employs the following skills, languages, and libraries:
-
Programming Languages: Python, SQL, HTML, CSS
-
Libraries:
requests
: For HTTP requestsBeautifulSoup
: For web scrapingPandas
andNumPy
: For data processingFlask
: For web developmentSQLite
: For database managementBootstrap
: For front-end designChartJS
: For interactive charts
-
Skills: Web scraping, data cleaning, data transformation, exploratory data analysis (EDA), web development, data visualization