Popular repositories Loading

1. data-warehouse-aws data-warehouse-aws Public

   Built a data warehouse on AWS and an ETL pipeline for a database hosted on Redshift. The data is loaded from S3 to staging tables on Redshift and modeled into fact and dimensions tables to perform …

   Jupyter Notebook 1

2. data-modeling-postgres data-modeling-postgres Public

   Created a Postgres database and built an ETL pipeline to optimize queries on song play analysis. The fact and dimension tables for a star database schema for a particular analytic focus are defined…

   Jupyter Notebook

3. data-modeling-cassandra data-modeling-cassandra Public

   Modeled the data with Apache Cassandra and completed an ETL pipeline using Python. Tables in Apache Cassandra to run queries are created and the ETL pipeline that transfers data from a set of CSV f…

   Jupyter Notebook

4. data-lake-aws data-lake-aws Public

   Built a data lake on AWS and an ETL pipeline for a database hosted on Spark. The data is loaded from S3 to staging tables on Spark and modeled into fact and dimensions tables to perform analytics a…

   Python

5. data-pipelines-airflow data-pipelines-airflow Public

   Built data pipelines using Apache Airflow with custom defined operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data as the final step

   Python

6. data-engineering-capstone data-engineering-capstone Public

   The scope of the project is to provide an analytical schema for users using provided immigration dataset and temperature dataset. Immigration data and city temperature data provided by Udacity were…

   Jupyter Notebook