Back to Data Engineer Home Open Trackers live app

Game 3D Heatmap Platform

Data engineering platform for game telemetry: ingestion APIs, OVH datalake storage, Airflow orchestration, and SQL-ready analytics.

Trackers heatmap animation

Heatmap playback

Trackers heatmap screenshot

Heatmap static view

System Scope

End-to-end telemetry pipeline running on OVH to collect, store, and transform gameplay events.

Flow includes ingestion APIs, event buffering, raw export, Airflow ETL, parquet modeling, and analytics-ready delivery.

Source repository is private.

Stack Used

Airflow OVH ETL Pipelines SQL

Architecture Flow

01. Ingestion API

Ingest MessagePack events with token validation and rate limits.

->
02. Event Buffer

Normalize payloads and buffer batches safely before export.

->
03. Raw Export

Rotate NDJSON files and upload raw data to S3-compatible buckets.

->
04. ETL Orchestration

Schedule and track Airflow DAG runs from the Elixir service.

->
05. Parquet Layers

Transform events into partitioned parquet and heatmap-ready outputs.

->
06. Dashboard Analytics

Serve SQL-style analytics, heatmaps, and exports for product teams.

Open Trackers live app Back to Portfolio

Before you continue

You will need an API key to test that, use: 'USBii2ir9xPNWuAwAbCmMF7XAxU44E45OHXrh49KeHM'

USBii2ir9xPNWuAwAbCmMF7XAxU44E45OHXrh49KeHM