Senior Data Engineer

8/2024 – 12/2024

Part of agile team (8 members) providing cloud data analytics platform for business depart- ments of world-leading automotive OEM. Migrating cloud infrastructure within AWS with Terraform. Challenging architecture of existing data pipelines and models.
Skills: AWS: Redshift, lambda, Glue, Athena, Terraform, Python, CI/CD, PySpark, Collibra

Amazon Web Services (AWS)

11/2022 – 8/2024

Part of two agile teams (18 members) providing data analytics platform for customs and border security business departments. Redesigned ETL architecture for ~60 data products processing customs and personal data. Improved performance by factor of ~100. Technical lead in decision making with architects and review of Pull-Requests and tickets of 12 developers.

Apache Kafka, Apache Spark, Python, SQL

1/2022 – 9/2022

Part of agile team (~30 members) providing cloud data platform for industry-leading business departments. Designed and implemented architecture for ~30 ETL applications and APIs processing global IoT data on a terabyte scale. Deployment of various managed services in hybrid cloud setup. Enablement of client developers. Optimized storage to save ~4000€ per month.

Python, Azure, Databricks (Delta Lake), PySpark, SQL, NiFi, Shell, CI/CD, Terraform}}

Apache Spark, Databricks, Bash Shell, Continuous Integration, Microsoft Azure, Python, SQL