RETAIL PRICE DASHBOARD

Monitor and analyze product prices across retailers in New Zealand


Google Shopping | 8 Products | Daily Updates | New Zealand

About This Dashboard

This dashboard tracks and analyzes real-time product prices from Google Shopping across 8 popular consumer electronics in New Zealand, covering laptops, smartphones, and action cameras from leading brands like Apple, Samsung, Dell, HP, GoPro, and DJI.

Built as an end-to-end data engineering portfolio project, the pipeline is designed to demonstrate modern data engineering practices including data ingestion, transformation, storage, orchestration, and visualization, all running on a fully automated daily schedule.

Data is collected daily via SerpAPI and loaded into AWS S3 as a data lake using dlt (data load tool) daily at 8pm NZT. From there, data is loaded into a PostgreSQL warehouse, transformed using dbt and orchestrated end-to-end with Prefect Cloud.

The goal of this project is to provide actionable price intelligence — helping consumers identify the cheapest sellers, track price trends over time, monitor discount patterns, and understand seller competition across the New Zealand electronics market.

This dashboard was created as part of the Data Engineering Zoomcamp 2026 cohort, demonstrating skills across the full data engineering stack from raw API ingestion through to an interactive analytics dashboard.


NAVIGATION GUIDE

How It Works

Simply navigate to the section of your choice using the sidebar.

Overview Overview

Get a high-level summary of all products and sellers.

WHAT YOU'LL FIND

  • Total listings, products and sellers
  • Listings by category
  • Top sellers by listings
  • Category summary table
Price Analysis Price Analysis

Dive deep into price trends and ranges across products.

WHAT YOU'LL FIND

  • Average price over time per product
  • Price range box plots
  • Price statistics per product
  • Discounted products
Seller Intelligence Seller Intelligence

Analyze seller competition, ratings and more.

WHAT YOU'LL FIND

  • Seller count per product
  • Cheapest seller per product
  • Average rating by seller
  • Rating status distribution

Pipeline

DATA PIPELINE

SerpAPI

SerpAPIGoogle Shopping

dlt

dltData Loading

AWS S3

AWS S3Data Lake

AWS RDS

AWS RDSData Warehouse

dbt

dbtTransformations