Data Engineer & Data Infrastructure Engineer (Azure)

5/2023 – 12/2023

Conception and Realisation of Data Lakehouse with Azure Databricks and Power BI:
- Business requirements engineering to validate the scope and define the KPIs
- Data exploration to design and validate the data model
- Support for offsite development team

Databricks, Python, SQL

2/2023 – 9/2023

Realisation of Data Lakehouse with Azure Synapse and Power BI:
- Setup an Azure Synapse landscape as Data Lakehouse
- Setup CI/CD pipelines for Azure Synapse (development and production)
- Realisation of Data Ingestion processes with SCD2
- Conception and realisation of SQL views
- Realisation of Power BI datasets and reports

Azure Synapse Analytics, SQL

1/2020 – 12/2022

Conception and Realisation of Data Integration and Lakehouse Solutions with Azure Data Factory and Synapse:
- Data wrangling with Data Flow & Python notebooks
- Self-hosted integration runtime on Windows VMs
- Serverless SQL pool as source for Power BI datasets

Azure Synapse Analytics, ETL, SQL

3/2019 – 5/2023

Set-up and operation of a multi-client and multi-stage advanced analytics platform on Azure
- Azure Databricks & Azure ML
- Azure App Services
- Azure Data Factory & Azure Synapse
- Azure Application Gateway
- Azure SQL Database & Azure Storage Account
Set-up and operation of CI/CD pipelines for DevOps and ML Ops on Azure DevOps
- Code security with bandit, safety and SonarCube within build pipeline
- CI/CD flow for Azure Data Factory & Azure Synapse
Infrastructure as Code with Terraform

DevOps, Microsoft Azure