Spin up a REST API for any Major Database

My personal project for data engineering zoomcamp

This utilizes a static IP address in GCP to pull data from the Clash of Clans API, store it and serve it via data studio. There is also a API client with a sleep of functions you can use to pull, store, and view CoC facts and dimensions.

Automatically load data from Google Cloud Storage files into Big Query tables

In this project, I am trying to predict traffic congestion, based on an aggregate measure of stopping distance and waiting times, at intersections in 4 major US cities: Atlanta, Boston, Chicago & Philadelphia.

Easy-to-use Python library for managing files and data in different environments

Scripts used for analyzing GitHub commit locations to create a map visualization

A platform for users to upload and share the responses from law enforcement agencies to their traffic violation reports in Taiwan. This system aims to increase transparency and public oversight of traffic law enforcement.

Explore efficient big data matching techniques

🍉 Repo for analytics engineering with dbt, transforming raw data into actionable insights.

Master of Applied Data Science - Milestone I Project (San Francisco Bike Sharing)

Data ingestion from Google BigQuery to PostgreSQL

Segmentação de clientes baseada na avaliação de risco de inadimplência.

Market Data Ingestion and BigQuery Integration project

Media sentiment analysis following the Israel-Hamas escalation in 2023

A repo containing auto-triggered Airflow ETL activities for datasets located on GCP storage that flattens and creates analytical views on Big Query

ETL pipeline with pyspark in Google Cloud Platform (GCP) using infrastructure-as-code principles with Terraform

Google_Data_Analytics_Capstone_Cyclistic_2023

Copy table from one dataset to another in google big query using bash script

Analysed SEVIR and Storm Datasets and visualized the data using Big Query on Data Studio. Datasets: Sevir Data: The Storm EVent ImagRy (SEVIR) dataset is a collection of temporally and spatially aligned images containing weather events captured by satellite and radar. Visualized using Big Query and Data Studio.