Senior Data Engineer
- Verfügbarkeit einsehen
- 0 Referenzen
- 85€/Stunde
- nicht angegeben
- auf Anfrage
- pl | en
- 03.05.2023
Kurzvorstellung
Qualifikationen
Projekt‐ & Berufserfahrung
10/2022 – offen
Tätigkeitsbeschreibung
• Leading project development team consisting of 4 Data Engineers with different seniority, Involvement in the
discussions on project roadmap with Project Management, On-boarding and knowledge sharing across new
joiners, providing support on self-development of team members, conducting technical job interviews in data
related positions
• Providing the Design of Cloud Data Architecture supporting the goal of the project, reviewing the progress and
discussing ideas with designated Cloud Architects and other team members
• Developed a Web Application (Java Spring Boot) enabling the migration of data between internal data platforms
• Delivering ETL pipelines providing orchestration and transformation of data using an internally developed Rule
Engine Framework (Python + PySpark)
• Developed Testing Framework (Python) enabling easy validation of Rule Engine Framework output for Business
Developers
• Maintaining and developing CI/CD for the provided solutions using Azure DevOps, keeping clean and consistent
project documentation
Microsoft Azure, Apache Spark, Databricks, DevOps, Git, Java (allg.), Python, Spring Framework
1/2022 – offen
Tätigkeitsbeschreibung
• Delivering ETL pipelines supporting cloud analytics platforms consisting of raw data transformations using
Spark, data historization and data warehouse loading
• Building cloud data architecture, designing and implementing Data Warehouse - Data Lake (ADLS), Delta Lake,
Azure Synapse Analytics, Azure SQL Database, Azure Data Factory, Databricks
• Data processing using Python, Spark, Scala and SQL on Databricks
• Designing and developing own Python packages supporting data processing, creating PowerBI Dashboards
• Maintaining and developing CI/CD for the data solutions using Azure DevOps, retaining nearly 100% code
test coverage consisting of unit test cases and integration/E2E testing, keeping clean and consistent project
documentation and data dictionaries
• Leading client-oriented meetings, consulting and presenting suggested solutions
• On-boarding and knowledge sharing across team members, providing support on self-development, working with
close cooperation with other project development streams
Apache Spark, Databricks, Power Bi, Git, Python, Scala, Microsoft Azure
3/2021 – 1/2022
Tätigkeitsbeschreibung
• Gathered business requirements, created user stories to have clear scope of work
• Implemented reporting dashboards to support decision making process
• Translated business requirements into data models using SQL
• Performed multiple actions in area of Business Intelligence and Data Analysis
• Conducted a lot of sessions with clients where developed visualizations were presented
• Presented a solution to a wide know problem in Tableau CRM in front of Deloitte EMEA group
• Performed data processing using Python (PySpark/Pandas) and SQL
Amazon Web Services (AWS), Apache Spark, Git, Power Bi, Pandas, Python, Tableau
7/2018 – 10/2018
Tätigkeitsbeschreibung
• Implemented an API for existing data warehouse with Swagger UI
• Refactored data integration from web-hooks to API usage in main app,
• Maintained good code quality with 100% code test coverage
• Assisted team leader in weekly project development report
Postgresql, Docker, Git, Ruby on Rails
Zertifikate
Databricks
Microsoft
AWS
Microsoft
Microsoft
Tableau
Tableau
Ausbildung
Gdansk University of Technologi
Gdansk, Poland
Persönliche Daten
- Polnisch (Muttersprache)
- Englisch (Fließend)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden