Pinned Loading

1. Apache-Hadoop-Spark-Hive-CyberAnalytics Apache-Hadoop-Spark-Hive-CyberAnalytics Public

   This project utilizes Apache Hadoop, Hive, and PySpark to process and analyze the UNSW-NB15 dataset, enabling advanced query analysis, machine learning modeling, and visualization. The project demo…

   Jupyter Notebook

2. Deep-Learning-Grid-World-Q-Learning Deep-Learning-Grid-World-Q-Learning Public

   Deep Learning Grid World Q-Learning . Implement Q-learning in a 5x5 grid where an agent navigates obstacles and rewards. Train the agent with varying learning rates, visualize its progress, and see…

   Python

3. FMA-A-Dataset-For-Music-Analysis FMA-A-Dataset-For-Music-Analysis Public

   Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interfac…

   Python 2 1

4. Apache-Flink-Spark-Data-Streaming Apache-Flink-Spark-Data-Streaming Public

   This project showcases a real-time data streaming pipeline using Apache Flink, Apache Spark, and Grafana. It streams data, stores it in Parquet format, and performs aggregations for insights, with …

   Python

5. Apache-Kafka-and-Frequent-Item-sets Apache-Kafka-and-Frequent-Item-sets Public

   This Bash script automates the setup and execution of a data processing pipeline using Apache Kafka and Python scripts, ensuring fault tolerance and streamlined management of Kafka-based data pipel…

   Python 3

6. MeshJoin-Streaming-ETL-Data-Warehouse MeshJoin-Streaming-ETL-Data-Warehouse Public

   MeshJoin-Streaming-ETL-Data-Warehouse integrates real-time transactional data with master data using the Mesh Join algorithm. It processes and enriches data, then loads it into a data warehouse for…

   Java