Data & Cloud Software Engineer/Architect
- Verfügbarkeit einsehen
- 0 Referenzen
- 100‐150€/Stunde
- 13355 Berlin
- Europa
- pt | de | en
- 01.11.2024
Kurzvorstellung
Tech blog -Hyperlink entfernt-
Qualifikationen
Projekt‐ & Berufserfahrung
5/2019 – 5/2021
Tätigkeitsbeschreibung
Enhancing AdTech Data Management Platform (DMP) along with its integration with Demand Side Platform (DSP) and Supply Side Platform (SSP)
Projects:
- Improve DMP Batch & Streaming pipelines (Spark, Flink, HBase & ElasticSearch, scala, java, python) to augment targeted segments and Machine Learning predictions;
- Upgrade to TCF v2 consent framework (GDPR) in DSP (c++), and in DMP (scala/java);
- Improve DMP API with contextual cache service (java, scala);
- Improve DMP segments extension in DSP & SSP (java, scala);
- Improve data engineering & science pipeline setup in hadoop cluster (hadoop, spark, hive, cloudera, linux);
Software engineering / -technik
7/2018 – 1/2020
TätigkeitsbeschreibungSupport technical architecture definition, software development and devOps for building a data lake for german automotive enterprise and FinTech startup;
Eingesetzte QualifikationenSoftware engineering / -technik
12/2017 – 7/2018
Tätigkeitsbeschreibung
- Support architecture definition, software development and devOps implementation for three core Engineering teams: big data, reporting services API, and devOps;
- Big data team: new dashboards product for external customers, business intelligence DWH migration support, migration from AWS data pipeline to distributed dockerized airflow setup;
- Reporting Services API: lambda architecture and DWH design support for event sourcing, data pipelines development;
- DevOps: AWS ECS dockerized prod level deployment, event sourcing setup support
Software engineering / -technik
10/2016 – 6/2017
TätigkeitsbeschreibungContribution to open source project "[...]" for Hadoop Hive Datalake Management and Scheduling based on Scala Akka - -Hyperlink entfernt-, Hive UDFs setup for data lake views, PoCs with Apache Flink and Apache Beam for streaming Kappa architecture
Eingesetzte QualifikationenApache Hadoop, Scala
10/2015 – 1/2018
Tätigkeitsbeschreibung
- Support building data lake and setting up batch pipelines for event processing and storage with Spark, AWS devOps;
- Recommendation System PoC for retention improvement kickstart;
- Real time push notification system based on Scala Akka Streaming; AWS Kinesis with Lambda Streaming solution
Software engineering / -technik
Weitere Kenntnisse
Persönliche Daten
- Portugiesisch (Muttersprache)
- Deutsch (Fließend)
- Englisch (Fließend)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden