Freelancer » IT, Entwicklung » Datenbanken
freiberufler Cloud Data Engineer auf freelance.de

Cloud Data Engineer

zuletzt online vor wenigen Tagen
  • auf Anfrage
  • 81737 München
  • Nähe des Wohnortes
  • de  |  bs  |  en
  • 26.08.2024
Jetzt registrieren & Kontakt aufnehmen

Kurzvorstellung

As a Cloud Data Engineer, I focus on development in cloud environments, designing and implement infrastructures to process data. From normal ETL/ELT to realtime use cases.

Qualifikationen

  • Amazon Web Services (AWS)3 J.
  • Apache Airflow
  • Apache Iceberg
  • Apache Spark
  • Dbt
  • Docker1 J.
  • Go (GoLang)1 J.
  • Python5 J.
  • SQL4 J.
  • Terraform

Projekt‐ & Berufserfahrung

Cloud Data Engineer (Festanstellung)
BurdaForward GmbH, München
7/2022 – 11/2023 (1 Jahr, 5 Monate)
Medienbranche
Tätigkeitszeitraum

7/2022 – 11/2023

Tätigkeitsbeschreibung

Pipelines/DAGs for Airflow
Created/improved Airflow operators
Pipeline as a Service
Modeling in Snowflake/DBT
Realtime Ingestions with FastAPI and Golang
Creation of Spark jobs / EMR
Creation of Docker images for ECR/ECS/EKS
Infrastructure as Code / Terraform
Access Management in Snowflake / Terraform
Automations / CI/CD (GitLab)

Eingesetzte Qualifikationen

Amazon Web Services (AWS), Apache Spark, Bash (Shell), Datawarehouse / DWH, Docker, Go (GoLang), Kontinuierliche Integration (CI), Kubernetes, Python, snowflake

Data Engineer (Festanstellung)
AlphaPet Ventures GmbH, München
1/2022 – 6/2022 (6 Monate)
Großhandel
Tätigkeitszeitraum

1/2022 – 6/2022

Tätigkeitsbeschreibung

Data modeling / DataVault
Complex SQL scripts
Looker dashboards creation
BigQuery optimizations
Pipelines created

Eingesetzte Qualifikationen

Data Vault, ETL, PostgreSQL, SQL, Bash (Shell), Python, Google Cloud, Amazon Web Services (AWS)

Data Engineer (Festanstellung)
Smile BI GmbH, München
5/2019 – 1/2022 (2 Jahre, 9 Monate)
IT & Entwicklung
Tätigkeitszeitraum

5/2019 – 1/2022

Tätigkeitsbeschreibung

Development, optimization, and administration of the MySQL DB
Monitoring of processes
Implementation of tests and error detection
Liaison between developers and e-commerce colleagues
Data modeling
Automation & Web-Scraping

Eingesetzte Qualifikationen

ETL, Amazon Web Services (AWS), mySQL, Pandas DataFrame, Python, Qlik Sense, Shell (CSH), SQL

IT-Assisent (Festanstellung)
Dr. Kaske GmbH, München
11/2018 – 5/2019 (7 Monate)
Dienstleistungsbranchen (Service)
Tätigkeitszeitraum

11/2018 – 5/2019

Tätigkeitsbeschreibung

developing and maintaining the MySQL models and procedures,
ingesting/altering data within the Database.
Creating automated exports

Eingesetzte Qualifikationen

Qlik Sense, mySQL, SQL, Bash (Shell), Python

Weitere Projekt‐ & Berufserfahrung anzeigen

Über mich

Cloud Data engineer| Solution oriented| Continuous learning

As a Cloud Engineer with a specialization in data engineering, I frequently liaise with stakeholders to understand their needs. My responsibilities encompass both the acquisition and receipt of data. Depending on the requirements, I set up services to run on EKS or ECS, or I orchestrate daily schedules using tools like Airflow among other orchestration methods, ensuring seamless ETL and ELT pipeline execution. My expertise lies in working with technologies like Spark, Snowflake, and standard RDS databases. I take pride in single-handedly constructing the entire infrastructure using Terraform, always aiming for the most cost-effective solutions possible. If the need arises, especially when dealing with large datasets, I devise alternative approaches such as querying via Apache Iceberg tables. Python and Golang are my languages of choice, and I greatly enjoy utilizing them in my projects.
Always interested in exploring the latest tools and ideas to solve complex tasks and to elevate your data-maturity level. I am also flexible to take on new IT challenges and expand my horizons. Solution-oriented, Team- player but also ready to work by myself.

Weitere Kenntnisse

Deutsch (Muttersprache), Englisch, Python, Golang, Linux, AWS, Terragrunt/Terraform, Apache Airflow, Apache Spark/EMR, Apache Iceberg, Snowflake, SQL/NOSQL, CI/CD

Persönliche Daten

Sprache
  • Deutsch (Muttersprache)
  • Bosnisch (Muttersprache)
  • Englisch (Fließend)
Reisebereitschaft
Nähe des Wohnortes
Arbeitserlaubnis
  • Europäische Union
Home-Office
bevorzugt
Profilaufrufe
114
Alter
26
Berufserfahrung
5 Jahre und 10 Monate (seit 11/2018)

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden