My Projects

A showcase of the data pipelines, cloud architectures, and AI integrations I've built.

Optimise-Ops

full-stack web application designed to streamline the workflow of technicians and supervisors in industrial environments. Instead of writing manual reports, employees simply record a voice note at the end of their shift.

Source Demo

Event-Driven IMDb ELT Pipeline

AWS serverless architecture integrating S3, Lambda, EventBridge, SQS/SNS with Snowflake for large-scale dataset orchestration.

Source Demo

Serverless YouTube Big Data Pipeline

AWS Glue + PySpark distributed cleansing pipeline transforming raw CSV datasets into analytics-ready structured data.

Source Demo

Global Weather Analytics Pipeline

Near real-time data ingestion system fetching live weather data for 15 cities with an interactive dashboard.

Source

IBM Data Engineering Professional Certificate Capstone

End-to-end Data Engineering Capstone Project building a complete data pipeline. Features operational databases (MySQL), analytical data warehousing (PostgreSQL), Python-based ETL scripts, Apache Airflow orchestration, and BI dashboarding (Looker Studio).

Source Demo

Abdullah Mahmoud — Portfolio

Data Engineer Portfolio Website

Source Demo

NewsFlow: Intelligent Article Routing System

data pipeline for sourcing, preprocessing, and managing NLP datasets for machine learning workflows.

Source Demo

PyEvolve-Studio

Genetic Algorithms App - A visual, interactive desktop application demonstrating 10 classic optimization problems solved using Genetic Algorithms and Particle Swarm Optimization.

Source

Serverless Real-Time Crypto Data Pipeline & AI Dashboard

A fully serverless, real-time data streaming pipeline built on AWS Free Tier. Ingests live WebSocket trades, micro-batches via SQS and Lambda, stores in DynamoDB, and visualizes market metrics using Streamlit.

Source Demo

Automated Data Pipelines with Spark, dbt, and Airflow

data pipeline system built as part of the Coursera open-source Data Engineering program. It unifies diverse data sources, implements SCD2 historical tracking, and orchestrates workflows using industry-standard tools.

Source Demo

###

###

Source Demo