Cloud Data Engineer
- Verfügbarkeit einsehen
- 0 Referenzen
- auf Anfrage
- 81737 München
- Nähe des Wohnortes
- de | bs | en
- 26.08.2024
Kurzvorstellung
Qualifikationen
Projekt‐ & Berufserfahrung
7/2022 – 11/2023
Tätigkeitsbeschreibung
Pipelines/DAGs for Airflow
Created/improved Airflow operators
Pipeline as a Service
Modeling in Snowflake/DBT
Realtime Ingestions with FastAPI and Golang
Creation of Spark jobs / EMR
Creation of Docker images for ECR/ECS/EKS
Infrastructure as Code / Terraform
Access Management in Snowflake / Terraform
Automations / CI/CD (GitLab)
Amazon Web Services (AWS), Apache Spark, Bash Shell, Data Warehousing, Docker, Golang, Continuous Integration, Kubernetes, Python, Snowflake
1/2022 – 6/2022
Tätigkeitsbeschreibung
Data modeling / DataVault
Complex SQL scripts
Looker dashboards creation
BigQuery optimizations
Pipelines created
Data Vault, ETL, Postgresql, SQL, Bash Shell, Python, Google Cloud, Amazon Web Services (AWS)
5/2019 – 1/2022
Tätigkeitsbeschreibung
Development, optimization, and administration of the MySQL DB
Monitoring of processes
Implementation of tests and error detection
Liaison between developers and e-commerce colleagues
Data modeling
Automation & Web-Scraping
ETL, Amazon Web Services (AWS), Mysql, Pandas, Python, Qliksense, Shell (CSH), SQL
11/2018 – 5/2019
Tätigkeitsbeschreibung
developing and maintaining the MySQL models and procedures,
ingesting/altering data within the Database.
Creating automated exports
Qliksense, Mysql, SQL, Bash Shell, Python
Über mich
As a Cloud Engineer with a specialization in data engineering, I frequently liaise with stakeholders to understand their needs. My responsibilities encompass both the acquisition and receipt of data. Depending on the requirements, I set up services to run on EKS or ECS, or I orchestrate daily schedules using tools like Airflow among other orchestration methods, ensuring seamless ETL and ELT pipeline execution. My expertise lies in working with technologies like Spark, Snowflake, and standard RDS databases. I take pride in single-handedly constructing the entire infrastructure using Terraform, always aiming for the most cost-effective solutions possible. If the need arises, especially when dealing with large datasets, I devise alternative approaches such as querying via Apache Iceberg tables. Python and Golang are my languages of choice, and I greatly enjoy utilizing them in my projects.
Always interested in exploring the latest tools and ideas to solve complex tasks and to elevate your data-maturity level. I am also flexible to take on new IT challenges and expand my horizons. Solution-oriented, Team- player but also ready to work by myself.
Weitere Kenntnisse
Persönliche Daten
- Deutsch (Muttersprache)
- Bosnisch (Muttersprache)
- Englisch (Fließend)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden