Senior Data Engineer

1/2020 – offen

Contract Type: Freelance
Role: ETL Developer
Project: Procurify Integration with DATEV

Read all bill details including purchase orders, approvals, attachments from Procurify, a cloud-based procurement management system and send it to the Flowwer2, a target system for the Procurify DATEV Connector. Flowwer2 is DATEV approved tool which can be connect to a specific DATEV Client and can send via structured data as well as attachments to DATEV.

Flowwer2 will be used to receive and send invoice data and related attachments (invoice.pdf, po.pdf, shipping slip.pdf AND approval log.pdf) to DATEV.

ETL

8/2019 – 12/2019

Deutsche Boerse, Frankfurt am Main through Marlin Green Ltd
Vertragsart: Freiberuflich
Role: ETL Entwickler
Project: Regulatory Reporting Hub (RRH)
MIFIR/EMIR Transaction Regulatory Reporting to NCAs e.g. BaFin, AMF, etc.
Project Technology Stack
Source System: XML Files, Flat Files, Oracle
Target System: Oracle, XML, CSV
ETL Tool: Informatica Powercenter 10.2
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Control-M

Responsibilities
- Design, Develop and Maintain Informatica ETL/Data pipelines
- Performance tuning of ETL pipelines for faster loading in various environments
- Bug Fixing, Deployment, Production Support, Data Analysis
- Read data from XML & Flat files to load into staging, core layer and further to Delivery Area in Oracle database.
- Perform various cleansing and data completeness checks
- Enrich data from various reference/lookup tables and load into core layer
- Used various transformation like XML Source Qualifier, XML Parser, XML Generator, Transaction Control, Normalizer, lookup, update strategy, etc.
- Performance optimization of informatica mappings and sessions for faster loads
- Developed SCD Type1 and 2 mappings to load history data into data mart.

ETL, Informatica

10/2017 – 7/2019

Commerzbank, Frankfurt am Main through JOB AG Source One GmbH
Vertragsart: Freiberuflich
Role: ETL Entwickler
Project
Compliance (CMC & CAF) - AML Reporting - Frankfurt & Singapore
This was a data Integration project which includes providing data from various banking applications like Murex Cash, Murex Equity, Murex Currency, etc. for compliance reporting.
Project Technology Stack
Source System: Flat Files, MS SQL Server
Target System: Oracle, Flat Files, Hadoop HDFS
ETL Tool: Informatica Powercenter 10.1, Informatica BDM
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting, UC4 Scripting
Scheduling Tool: Automic UC4

Responsibilities:

- Design ETL Pipelines and ETL Architecture.
- Design Informatica ETL jobs as per the quality and software development standards.
- Source to target data mapping analysis and design.
- Analyze, design, develop, test and document Informatica ETL programs from detailed and high-level specifications, and assist in troubleshooting.
- Creation of project-related documents like HLD, LLD, etc.
- Created reusable transformations and mapplets
- Developed data ETL pipelines for Change Data Capture (CDC)
- Creation of data pipelines to load into Hadoop HDFS.
- Complex Informatica Powercenter ETL development and Quality Assurance.
- Design and develop various slowly changing dimension load e.g. Type 1, Type 2.
- Responsible for finding various bottlenecks and performance tuning at various levels like mapping level, session level, and database level.
- Extensive use of various active and passive transformations like Filter, Router, Expression, Source Qualifier, Joiner, and Look up, Update Strategy, Sequence Generator, Rank, and Aggregator.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Conduct Unit tests, Integration tests, performance tests, etc.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Supported deployment team in various environment's deployments
- Developed database objects including tables, Indexes, views, sequences, packages, triggers and procedures to troubleshoot any database problems

ETL, Informatica, Oracle-Anwendungen

6/2015 – 9/2017

Aldi Sued, Muelhiem an der Ruhr through Templeton & Partners Ltd
Vertragsart: Freiberuflich
Role: ETL Tech Lead
Project: Retail Enterprise Data Warehouse
Project Technology Stack
Source System: MS SQL Server, Flat Files, Oracle
Target System: Oracle Exadata
ETL Tool: Informatica Powercenter 10.1
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Informatica Scheduler
Project Methodology: Scrum/Agile

Responsibilities
- Participate in scoping, data quality analysis, source system data analysis, target system requirements, volume analysis and migration window determination.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Perform data cleansing tasks.
- Perform test using sample test data in accordance with the client data migration/integration needs.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Helped Business Analyst in refining mapping specification documents.
- Developed Informatica Powercenter mappings to move data from stage to target tables
- Developed PL/SQL Packages, Procedures and Functions accordance with Business Requirements.
- Documented various input databases and data sources.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Responsible for finding various bottlenecks and performance tuning at various levels like database, ETL, etc.
- Created Materialized Views and partitioning tables for performance reasons.
- Worked on various back end Procedures and Functions using PL/SQL.
- Developed UNIX shell scripts to perform various user requirements.
- Designing Tables, Constraints, Views, and Indexes etc.
- Developed database objects including tables, Indexes, views, sequences, packages, triggers and procedures to troubleshoot any database problems
- Tuned complex Stored Procedures for faster execution
- Responsible for Analyzing and Implementing the Change Requests.
- Involved in handling the changes in compiling jobs and scripts according to the database changes.

ETL, Informatica

1/2015 – 5/2015

HRS, Köln through Informationsfabrik GmbH

Vertragsart: Freiberuflich
Role: Senior ETL Consultant
Project: Hotel Enterprise Data Warehouse
Project Technology Stack
Source System: MS SQL Server, Flat Files, Oracle, XML
Target System: Sybase IQ
ETL Tool: Informatica Powercenter
Other programming languages: Oracle SQL & PLSQL, T-SQL, Unix Shell Scripting
Scheduling Tool: Control-M
Project Methodology: Waterfall
Data Modeling: Dan Linstedt Data Vault Modelling

Responsibilities
- Use of Data Vault as Data Modeling approach for the Hotel Enterprise Data Warehouse.
- Define the ETL Architecture to load the Data Vault model and data mart.
- Analyzed sourced data to identify candidates for Hub, Satellite and link tables
- Developed Informatica Powercenter mappings, sessions and workflows to load Hub, Link & Satellite tables.
- Added Hub, Link & Satellite tables including business keys, Surrogate keys, descriptive satellite information to Data Vault Model.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Perform data cleansing tasks.
- Perform test using sample test data in accordance with the client data migration/integration needs.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Developed Informatica Powercenter mappings to move data from stage to core and data mart layer.
- Documented various input databases and data sources.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Developed UNIX shell scripts to perform various user requirements.

Data Warehousing, ETL, Informatica

1/2014 – 9/2014

Karstadt, Essen through Questax AG

Vertragsart: Freiberuflich
Role: Senior ETL Consultant

Project:
Karstadt information systems for measures and analytics (KARISMA)

The goal of this project was to create centralized Analytical and Reporting system for Karstadt Warehouse GmbH. The major part of the project was to replace existing SAP BW Reporting system and create new enterprise data warehouse with Informatica PowerCenter 9.5.1 for ETL and Cognos 10 for Reporting. Informatica PowerExchange 9.5.1 with BCI (Business Content Integration) & Data Integration using ABAP methods were used to connect to Karstadt SAP Retail system and read data from SAP Standard and Customized Data Sources. IBM Netezza 7 was used as Target system with Informatica PowerExchange for Netezza.
Project Technology Stack
Source System: SAP, IDOC, Flat Files, XML
Target System: IBM Netezza
ETL Tool: Informatica Powercenter 9.5, Informatica Powerexchange 9.5
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Informatica Scheduler
Project Methodology: Waterfall

Data Warehousing, ETL, Informatica

7/2011 – 12/2013

Deutsche Bank, Frankfurt through Datamatics Global Solutions GmbH & Hays AG
Job Type: Employee & Vertragsart: Freiberuflich

Role: Senior ETL Consultant

Informatica Powercenter ETL Tool Development & Support
for Data Migration and Data Integration Projects.

Projects:
#1 Retail Banking - Postbank Savings Deposit Accounts Migration

This project involves migration of savings account
deposits data from Mainframe IBM Z/OS systems to SAP
Deposit Management application using PowerCenter 9.1 HF
1 and Power exchange 9.1. This involves reading data
from flat files, mainframe data sets, oracle and
writing data into flat files which will be then
uploaded into SAP Deposit Management application. Power
exchange 9.1 was used for the connecting to mainframe
and reading of Mainframe data sets. ETL Informatica
PowerCenter 9.1 was used for the extraction,
transformation, and loading of data into the target
systems. The project had only single load i.e. one time
migration. This project involves data extract,
transformation and loads of 250 to 500 million records.

#2 Retail Banking - Postbank Savings Deposit Accounts Integration
This project involves integration of savings deposit
account data from SAP, Mainframe systems in to the
Oracle enterprise data warehouse.
ETL activities includes loading of this data into
Oracle enterprise data warehouse used for Retail
banking reporting in Deutsche Bank, Germany. ETL
Informatica PowerCenter 9.1 HF 1 was used for the
extraction, transformation, and loading of data into
the target systems. The project had several loads like
Daily Loads, Weekly Loads, Monthly Loads, Quarterly
Loads, and YTD Loads. These loads were implemented
using Incremental Loading (Change Data Capture), and
Slowly Changing Dimension Mappings. This project
involves data extract, transformation and loads of 30
to 50 million records.

#3 Retail Banking - Auto Deployment
Deutsche Bank started this project to save huge time
for deployment of all ETL components e.g. informatica
powercenter workflows, informatica powerexchange data
maps, parameter files, shell scripts,etc. This project
helped Deutsche Bank to save time spend by deployers in
deploying multiple environments, error free deployments
and hence reduce cost.

#4 Retail Banking - LDAP Integration

Data Warehousing, ETL, Informatica

11/2010 – 6/2011

American Home Mortgage Servicing Inc, Texas through Hitachi Consulting Pvt Ltd, Pune

Job Type: Employee
Role: Senior ETL Consultant

Project :
Home Mortgage Enterprise Data Warehouse

Data Warehousing, ETL, Informatica

10/2008 – 6/2010

Sigma Systems, Pune
Job Type: Employee
Role: Software Engineer
Oracle, Unix, Java Development & Support

Oracle-Anwendungen, UNIX, Java (allg.)