Data Engineering on Luis Núñez — Data Engineer (M.Sc.) https://luis-fer-333.github.io/categories/data-engineering/ Recent content in Data Engineering on Luis Núñez — Data Engineer (M.Sc.) Hugo -- gohugo.io en-us Sun, 01 Jun 2025 00:00:00 +0000 Nobel Prize Data Lake — Medallion Architecture on AWS https://luis-fer-333.github.io/projects/nobel-prize-data-lake/ Tue, 01 Apr 2025 00:00:00 +0000 https://luis-fer-333.github.io/projects/nobel-prize-data-lake/ A medallion-architecture data lake on AWS S3 with Prefect-orchestrated ETL Lambdas — raw API responses → bronze joins → silver analytics table. Movie Database ETL Pipeline — Multi-Source Ingestion to SQLite https://luis-fer-333.github.io/projects/movie-database-etl/ Sun, 01 Dec 2024 00:00:00 +0000 https://luis-fer-333.github.io/projects/movie-database-etl/ An end-to-end ETL pipeline that ingests movie metadata from IMDb bulk files and a REST API, stages it in MongoDB, and lands it in a normalized relational schema with foreign keys. Airbnb Valencia — Cloud BI with Supabase + Preset https://luis-fer-333.github.io/projects/airbnb-valencia-bi/ Sun, 01 Jun 2025 00:00:00 +0000 https://luis-fer-333.github.io/projects/airbnb-valencia-bi/ A full BI stack analyzing 8,847 Airbnb listings — from raw CSV load through SQL modeling on Supabase to stakeholder dashboards in Preset. Movie Analytics — Deep EDA for Investment Decisions https://luis-fer-333.github.io/projects/movie-analytics-eda/ Fri, 01 Nov 2024 00:00:00 +0000 https://luis-fer-333.github.io/projects/movie-analytics-eda/ A deep exploratory analysis across 4,000 movies to identify the factors driving box-office success — framed around a low-budget-production investment scenario. Sentiment Analysis at Scale — PySpark on AWS https://luis-fer-333.github.io/projects/spark-sentiment-pipeline/ Sat, 01 Mar 2025 00:00:00 +0000 https://luis-fer-333.github.io/projects/spark-sentiment-pipeline/ A distributed ML pipeline processing 17M Amazon reviews with PySpark MLlib on AWS Glue — including S3 medallion storage, feature engineering, and model serialization for batch inference. Spanish Electricity Demand — Time-Series Pipeline with InfluxDB + Forecasting https://luis-fer-333.github.io/projects/electricity-demand-pipeline/ Thu, 01 May 2025 00:00:00 +0000 https://luis-fer-333.github.io/projects/electricity-demand-pipeline/ A continuous ingestion pipeline for Spanish grid demand with InfluxDB storage and Prophet-based day-ahead forecasting. Includes a dashboard for real vs forecast visualization. Formula 1 Data Analysis — Multi-Table Pandas Pipeline https://luis-fer-333.github.io/projects/formula1-data-analysis/ Tue, 01 Oct 2024 00:00:00 +0000 https://luis-fer-333.github.io/projects/formula1-data-analysis/ A pandas-driven analysis across 13 relational CSVs (75 years of F1 history) with multi-way joins, filtering, and map-based visualization.