Skip to content

AWS Lambda Async Python Web scraper that updates 27+ discord channels hourly.

Notifications You must be signed in to change notification settings

JayceDugan/OzBargainScraper

Repository files navigation

OzBargain Web Scraper

Webscraper that kept 27+ discord channels updated hourly with categorized deals from Oz Bargain via discord webhooks.

Front Page Channel Starting Soon Channel
Freebies Channel Home & Garden Channel

Stack / Infrastructure

  • Python AWS Lambda
  • AWS DynamoDB for persistence
  • Containerised and deployed to AWS ECS/ECR

Short History

  • Previously used twilio SMS notification service
  • Updated to use discord & update a set of channels instead via webhooks & a JSON file.
  • Refactored to AWS Lamda, AWS ECS and AWS ECR for implementation & DynamoDB for storage.