freiberufler Senior Data Engineer auf freelance.de

Senior Data Engineer

offline
  • 85€/Stunde
  • nicht angegeben
  • auf Anfrage
  • pl  |  en
  • 03.05.2023

Kurzvorstellung

Senior Data Engineer possessing an extensive analytical skills, strong attention to detail and a significant ability to work in team environments. Fast paced learner with fluent English and ease of creative thinking in demanding situations.

Qualifikationen

  • Apache Spark
  • Azure Databricks
  • Azure Synapse Analytics
  • Big Data
  • DevOps
  • Git
  • Java (allg.)
  • Microsoft Azure
  • Microsoft Power BI
  • Python
  • Scala
  • Spring
  • Tableau
  • Transact-SQL (T-SQL)

Projekt‐ & Berufserfahrung

Senior Data Engineer
Kundenname anonymisiert, Amsterdam
10/2022 – offen (1 Jahr, 9 Monate)
Banken
Tätigkeitszeitraum

10/2022 – offen

Tätigkeitsbeschreibung

• Leading project development team consisting of 4 Data Engineers with different seniority, Involvement in the
discussions on project roadmap with Project Management, On-boarding and knowledge sharing across new
joiners, providing support on self-development of team members, conducting technical job interviews in data
related positions
• Providing the Design of Cloud Data Architecture supporting the goal of the project, reviewing the progress and
discussing ideas with designated Cloud Architects and other team members
• Developed a Web Application (Java Spring Boot) enabling the migration of data between internal data platforms
• Delivering ETL pipelines providing orchestration and transformation of data using an internally developed Rule
Engine Framework (Python + PySpark)
• Developed Testing Framework (Python) enabling easy validation of Rule Engine Framework output for Business
Developers
• Maintaining and developing CI/CD for the provided solutions using Azure DevOps, keeping clean and consistent
project documentation

Eingesetzte Qualifikationen

Microsoft Azure, Apache Spark, Azure Databricks, DevOps, Git, Java (allg.), Python, Spring

Data Engineer
Kundenname anonymisiert, Berlin
1/2022 – offen (2 Jahre, 6 Monate)
Automobilindustrie
Tätigkeitszeitraum

1/2022 – offen

Tätigkeitsbeschreibung

• Delivering ETL pipelines supporting cloud analytics platforms consisting of raw data transformations using
Spark, data historization and data warehouse loading
• Building cloud data architecture, designing and implementing Data Warehouse - Data Lake (ADLS), Delta Lake,
Azure Synapse Analytics, Azure SQL Database, Azure Data Factory, Databricks
• Data processing using Python, Spark, Scala and SQL on Databricks
• Designing and developing own Python packages supporting data processing, creating PowerBI Dashboards
• Maintaining and developing CI/CD for the data solutions using Azure DevOps, retaining nearly 100% code
test coverage consisting of unit test cases and integration/E2E testing, keeping clean and consistent project
documentation and data dictionaries
• Leading client-oriented meetings, consulting and presenting suggested solutions
• On-boarding and knowledge sharing across team members, providing support on self-development, working with
close cooperation with other project development streams

Eingesetzte Qualifikationen

Apache Spark, Azure Databricks, Microsoft Power BI, Git, Python, Scala, Microsoft Azure

Data Visualization Developer
Kundenname anonymisiert, Wolfsburg
3/2021 – 1/2022 (11 Monate)
Automobilindustrie
Tätigkeitszeitraum

3/2021 – 1/2022

Tätigkeitsbeschreibung

• Gathered business requirements, created user stories to have clear scope of work
• Implemented reporting dashboards to support decision making process
• Translated business requirements into data models using SQL
• Performed multiple actions in area of Business Intelligence and Data Analysis
• Conducted a lot of sessions with clients where developed visualizations were presented
• Presented a solution to a wide know problem in Tableau CRM in front of Deloitte EMEA group
• Performed data processing using Python (PySpark/Pandas) and SQL

Eingesetzte Qualifikationen

Amazon Web Services (AWS), Apache Spark, Git, Microsoft Power BI, Pandas DataFrame, Python, Tableau

Ruby on Rails Developer
Kundenname anonymisiert, Hong Kong
7/2018 – 10/2018 (4 Monate)
Dienstleistungsbranche
Tätigkeitszeitraum

7/2018 – 10/2018

Tätigkeitsbeschreibung

• Implemented an API for existing data warehouse with Swagger UI
• Refactored data integration from web-hooks to API usage in main app,
• Maintained good code quality with 100% code test coverage
• Assisted team leader in weekly project development report

Eingesetzte Qualifikationen

PostgreSQL, Docker, Git, Ruby on rails

Zertifikate

Databricks Certified Data Engineer Associate
Databricks
2023
DP-203 Azure Data Engineer Associate
Microsoft
2022
AWS Certified Cloud Practitioner
AWS
2022
DP-900 Azure Data Fundamentals
Microsoft
2022
AZ-900 Azure Fundamentals
Microsoft
2022
Tableau Desktop Certified Associate
Tableau
2021
Tableau Desktop Specialist
Tableau
2021

Ausbildung

BE in Automatic Control and Robotics
Industrial robot solving Rubiks cube
Gdansk University of Technologi
2021
Gdansk, Poland

Persönliche Daten

Sprache
  • Polnisch (Muttersprache)
  • Englisch (Fließend)
Reisebereitschaft
auf Anfrage
Arbeitserlaubnis
  • Europäische Union
Home-Office
unbedingt
Profilaufrufe
198
Alter
26
Berufserfahrung
3 Jahre und 3 Monate (seit 03/2021)

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden