freiberufler Data Engineer auf freelance.de

Data Engineer

zuletzt online vor 4 Tagen
  • 65€/Stunde
  • 10961 Friedrichshain-Kreuzberg
  • Europa
  • hr  |  en  |  de
  • 03.09.2024

Kurzvorstellung

Data engineer and data architect with over 9 years of experience in various industries such as e-commerce, construction and law. Experienced with Python, SQL, AWS, Azure, Kubernetes, Apache Spark and Kafka.

Auszug Referenzen (4)

"M. served as the Head of Data at VAAAM AG from April 2022 to February 2023 and had a very positive impact on the company"
Data Engineer
Benedikt von Dohnanyi
Tätigkeitszeitraum

7/2024 – 7/2024

Tätigkeitsbeschreibung

- Backup relevant data from MariaDB database, shut down database afterwards
- Backup all data from images database (MongoDB), shut down database afterwards
- Move image files (~10M, multiple TBs) to new AWS account
- Move backups to new AWS account
- Shut down databases
- Shut down unused services

Eingesetzte Qualifikationen

ETL, MariaDB, MongoDB, Python, Amazon Web Services (AWS)

"He was responsible for designing and implementing our data architecture, making sure it integrated successfully with the overall IT architecture."
Staff Data Engineer (Festanstellung)
Marko Lehn
Tätigkeitszeitraum

3/2023 – 3/2024

Tätigkeitsbeschreibung

- Overarching role in data department, participating in daily business of both data teams
- Designing and implementing data architecture, ensuring successful integration with overall IT architecture
- As interim Head of Data, collaborating with product management on product roadmap, aligning with other IT departments and providing higher-level management to data department
- Participated in broad IT infrastructure efforts with planning and implementation, such as service mesh migration

Eingesetzte Qualifikationen

Python, IaaS (Infrastructure as a Service), Kubernetes, Microsoft Azure, RDF (Resource Description Framework), Software Architektur / Modellierung

"M. is an excellent data and software engineer. His many years of experience are reflected in his immense seniority."
Senior Data Engineer (Festanstellung)
Georg Hildebrand
Tätigkeitszeitraum

11/2020 – 3/2022

Tätigkeitsbeschreibung

- Developed event-based streaming pipelines based on serverless solutions
- Implemented infrastructure for digital twin and related products
- Participated in interviewing, onboarding and mentoring of new and existing colleagues

Eingesetzte Qualifikationen

Python, Big Data, IaaS (Infrastructure as a Service), Kubernetes, Microsoft Azure, RDF (Resource Description Framework), SPARQL (SPARQL Protocol And RDF Query Language)

"M. ist ein sehr erfahrener und vielseitiger Data Engineer"
Senior Data Engineering Consultant (Festanstellung)
Dirk Hofmann
Tätigkeitszeitraum

3/2019 – 10/2020

Tätigkeitsbeschreibung

- Developed and maintained existing data ingestion, cleaning and processing pipeline for large remote learning provider
- Designed and implemented data platform for large telecom provider
- Collaborated on various data architecture project proposals

Eingesetzte Qualifikationen

Apache Spark, Kafka, Software Architektur / Modellierung, Python, Scala, Microsoft Azure, Amazon Web Services (AWS)

Qualifikationen

  • Amazon Web Services (AWS)6 J.
  • Big Data4 J.
  • Datawarehouse / DWH
  • Datenmodellierung
  • ETL
  • IaaS (Infrastructure as a Service)3 J.
  • Maschinelles Lernen
  • Microsoft Azure4 J.
  • Python9 J.
  • Software Architektur / Modellierung4 J.

Projekt‐ & Berufserfahrung

Data Engineer
VAAAM, Berlin
7/2024 – 7/2024 (1 Monat)
IT & Entwicklung
Tätigkeitszeitraum

7/2024 – 7/2024

Tätigkeitsbeschreibung

- Backup relevant data from MariaDB database, shut down database afterwards
- Backup all data from images database (MongoDB), shut down database afterwards
- Move image files (~10M, multiple TBs) to new AWS account
- Move backups to new AWS account
- Shut down databases
- Shut down unused services

Eingesetzte Qualifikationen

ETL, MariaDB, MongoDB, Python, Amazon Web Services (AWS)

Staff Data Engineer (Festanstellung)
GROPYUS, Berlin
3/2023 – 3/2024 (1 Jahr, 1 Monat)
IT & Entwicklung
Tätigkeitszeitraum

3/2023 – 3/2024

Tätigkeitsbeschreibung

- Overarching role in data department, participating in daily business of both data teams
- Designing and implementing data architecture, ensuring successful integration with overall IT architecture
- As interim Head of Data, collaborating with product management on product roadmap, aligning with other IT departments and providing higher-level management to data department
- Participated in broad IT infrastructure efforts with planning and implementation, such as service mesh migration

Eingesetzte Qualifikationen

Python, IaaS (Infrastructure as a Service), Kubernetes, Microsoft Azure, RDF (Resource Description Framework), Software Architektur / Modellierung

Head of Data (Festanstellung)
VAAAM, Berlin
2/2022 – 4/2023 (1 Jahr, 3 Monate)
IT & Entwicklung
Tätigkeitszeitraum

2/2022 – 4/2023

Tätigkeitsbeschreibung

- Designing and implementing data architecture, ensuring successful integration with the overall IT architecture
- Managing data science, analytics and engineering efforts operationally and professionally
- Working with CTO on data and product strategy, investor and vendor relationships
- Working with CTO to establish VAAAM AG externally as a leader in engineering topics

Eingesetzte Qualifikationen

Big Data, Software Architektur / Modellierung, Python, IaaS (Infrastructure as a Service), Amazon Web Services (AWS), Django (Framework), Kubernetes

Senior Data Engineer (Festanstellung)
GROPYUS, Berlin
11/2020 – 3/2022 (1 Jahr, 5 Monate)
IT & Entwicklung
Tätigkeitszeitraum

11/2020 – 3/2022

Tätigkeitsbeschreibung

- Developed event-based streaming pipelines based on serverless solutions
- Implemented infrastructure for digital twin and related products
- Participated in interviewing, onboarding and mentoring of new and existing colleagues

Eingesetzte Qualifikationen

Python, Big Data, IaaS (Infrastructure as a Service), Kubernetes, Microsoft Azure, RDF (Resource Description Framework), SPARQL (SPARQL Protocol And RDF Query Language)

Senior Data Engineering Consultant (Festanstellung)
DAIN Studios, Berlin
3/2019 – 10/2020 (1 Jahr, 8 Monate)
IT & Entwicklung
Tätigkeitszeitraum

3/2019 – 10/2020

Tätigkeitsbeschreibung

- Developed and maintained existing data ingestion, cleaning and processing pipeline for large remote learning provider
- Designed and implemented data platform for large telecom provider
- Collaborated on various data architecture project proposals

Eingesetzte Qualifikationen

Apache Spark, Kafka, Software Architektur / Modellierung, Python, Scala, Microsoft Azure, Amazon Web Services (AWS)

Data Engineer (Festanstellung)
Flixbus, Berlin
2/2018 – 9/2018 (8 Monate)
IT & Entwicklung
Tätigkeitszeitraum

2/2018 – 9/2018

Tätigkeitsbeschreibung

- Implemented and maintained data ingestion, cleaning and processing pipelines
- Productionized prototype of machine learning API and deployed it to production

Eingesetzte Qualifikationen

Apache Spark, Python, Amazon Web Services (AWS), Kubernetes

Research Engineer (Festanstellung)
Zalando, Berlin
7/2016 – 1/2018 (1 Jahr, 7 Monate)
IT & Entwicklung
Tätigkeitszeitraum

7/2016 – 1/2018

Tätigkeitsbeschreibung

- Performed A/B test analyses for diverse business and technical features
- Researched advanced statistical analysis methods for automating hypothesis tests
- Implemented and maintained various data ingestion, cleaning and processing pipelines for A/B test analysis automation
- Published and contributed to open-source statistical analysis library ExpAn

Eingesetzte Qualifikationen

Apache Spark, Big Data, Exasol, Back-End Entwicklung, Python, Scala, Amazon Web Services (AWS)

Backend Engineer (Festanstellung)
Zalando, Berlin
9/2015 – 6/2016 (10 Monate)
IT & Entwicklung
Tätigkeitszeitraum

9/2015 – 6/2016

Tätigkeitsbeschreibung

- Implemented system, application and business level monitoring of the A/B testing platform
- Implemented various data ingestion and processing pipelines for A/B test analysis automation

Eingesetzte Qualifikationen

Exasol, Back-End Entwicklung, Python, Scala, Amazon Web Services (AWS)

Research Associate (Festanstellung)
Visage Technologies, Zagreb
7/2014 – 6/2015 (1 Jahr)
IT & Entwicklung
Tätigkeitszeitraum

7/2014 – 6/2015

Tätigkeitsbeschreibung

- Researched and prototyped various machine-learning based approaches to eye gaze detection
- Implemented eye gaze detection feature of the Visage SDK

Eingesetzte Qualifikationen

OpenCV, C++, Python, Maschinelles Sehen

Ausbildung

Information Processing
MSc
University of Zagreb
2014
Zagreb, Kroatien
Information Processing
BSc
University of Zagreb
2012
Zagreb, Kroatien

Über mich

I am M. K., a dedicated data engineer with over 9 years of experience in designing, building, and optimizing data architectures. My career has spanned across diverse industries, including e-commerce, travel, construction & real-estate, and legal where I have successfully implemented scalable data solutions and contributed to data-driven decision-making.

With a strong background in ETL processes, data warehousing, and big data technologies, I excel in transforming complex data into actionable insights. I am proficient in SQL, Python, Scala and various data pipeline tools such as Apache Spark and Kafka. My expertise also includes cloud platforms like AWS and Azure, enabling efficient and secure data storage and processing.

I am recognized for my analytical mindset, meticulous attention to detail, and ability to collaborate effectively with cross-functional teams. My passion lies in solving challenging data problems and continuously improving data infrastructure to support business growth and innovation.

I am eager to bring my skills to a forward-thinking organization where I can drive the development of robust data systems and contribute to impactful projects. My goal is to work in an environment that values continuous learning and the application of cutting-edge data technologies.

Outside of work, I am a tech enthusiast and proud owner of three cats. I also love running, hiking and exploring the great outdoors, which helps me stay energized and inspired.

Persönliche Daten

Sprache
  • Kroatisch (Muttersprache)
  • Englisch (Fließend)
  • Deutsch (Grundkenntnisse)
Reisebereitschaft
Europa
Arbeitserlaubnis
  • Europäische Union
Home-Office
bevorzugt
Profilaufrufe
77
Alter
34
Berufserfahrung
10 Jahre und 2 Monate (seit 07/2014)
Projektleitung
2 Jahre

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden