Ruben van Gemeren

Projects

A selection of projects focusing on distributed systems, data platforms, and infrastructure.

Stream Processing with Windowed CRDTs

Create decentralized stream processing system that scales globally with Windowed CRDTs

Distributed SystemsStreamingCRDTs
  • Challenge: Traditional stream processing systems require statically defined coordination, which becomes a bottleneck as data scales. This limits scalability and limits the ability to process data in real-time.
  • Impact: Reduced latency by 3.8x and increased throughput by 11x and 5x failure recovery compared to state of the art systems.

ML Pipeline for weather forecasting

Automated weather forecasting pipeline for PM2.5 levels in Rotterdam

Machine LearningFeature EngineeringPipeline
  • Challenge: Automating the creation and updating of a ML predictor model based on sensor data for predicting PM2.5 levels in Rotterdam.
  • Impact: Create a webpage that displays the predicted PM2.5 levels in Rotterdam, with a live update every day.

Real-time Boat Tracking

Display real-time public transport on boats driving in Rotterdam

Real-timePublic TransportEmbedded Systems
  • Challenge: Processing and displaying real-time public transport data on boats based on live location data.
  • Impact: Giving passengers up to date information about their journey, on multiple screens, with arrival time estimates and live updates.

FPL Player Performance Model

Predict the performance of FPL players based on their historical data

Machine LearningFeature EngineeringPipeline
  • Challenge: Automating the creation and updating of a ML predictor model based on historical data for predicting the performance of FPL players.
  • Impact: Create a webpage that displays the predicted performance of FPL players, with a live update every week. Based on real game data, the model can be updated to predict the performance of FPL players more accurately.