Data Architect/Engineer

1/2014 – 8/2016

As part of Manufacturing BI team, covered various roles ranging from team and project management, to solution architecture design, to BI/DWH development. Mentored junior members of the team.

Key achievements:
Appointed lead of geographically dispersed team of DHW/BI developers. Implemented order fulfillment solution which helped plants’ operations and logistics optimization in real-time.

Notable projects:
• Real-time event-based data warehouse – Defined AWS-based solution architecture and developed ETL for retrieval, storage and analysis of real-time manufacturing process status updates, using Kafka/Kafka Streaming, Spark, Java, S3, Hive and Tableu. Solution reduced data latency from 2 hours to 1-2 minutes.
• Legacy data warehouse migration to AWS cloud – Migration of 120TB DWH/BI solution based on Microsoft stack into Amazon cloud, using Big Data technologies like Sqoop, Hive/Hadoop, S3, Pig, Java, Kafka, Presto, Looker, etc. The solution featured lambda architecture to solve a problem of updates in Big Data ecosystem (batch process for immutable/static data, streaming process for updatable data).
• Shipment Tracking Analysis – Using traditional MS DWH/BI stack, implemented a solution to retrieve, store and analyze tracking data across 40+ carriers. Implemented Petri-nets engine for outlier detection. Solution helped optimization of plants operations as well as contract negotiations with carriers.

Business Intelligence and Reporting Tools (BIRT), Data Warehousing, Projektmanagement (IT)