ETL Developer
- Verfügbarkeit einsehen
- 0 Referenzen
- auf Anfrage
- 82008 Unterhaching
- Nähe des Wohnortes
- ta | en
- 06.11.2018
Kurzvorstellung
Qualifikationen
Projekt‐ & Berufserfahrung
12/2016 – 6/2017
Tätigkeitsbeschreibung
Project Name : Perishable Forecast Management
Customer : Delhaize America - Retail Business Services
Technology: IBM Datastage 11.5,DB2,IBM BlueMix,IBM Infosphere Data Architect
Project Details
• Client is retail major in USA and Europe owning a large number of supermarkets specialising in Food and Consumable products.
• Client is adding a new feature in the existing perishable forecasting tool with integrated retail and supply chain planning solutions ( RELEX)
• This Project offers in-Memory-powered demand forecasting, inventory optimization, replenishment automation, and consumer-focused automated category optimization, space and assortment planning.
• Datastage is being used as the ETL tools for Data tranformation and Middleware between the source and target applications
Tasks and Responsibilities
• Working as the ETL Architect and Designed the process flow end –to –end.
• Understood the Business Requirement for each Interface and was involved in periodic User/Business Meetings
• Analysed the data and created data Models.
• Published the Architecture Diagram and held regular Client meetings to bridge the gap between requirements and the design
• Developed Unix Scripts to trigger and schedule Datastage jobs
• Used various stages in Datastage such as Change Capture, Sort , Transformer , Join,Lookup , Switch , Filter ,Containers ,DB2 Target etc to develop jobs
• Introduced and educated the team of latest feature in Infosphere 11.5 –Workload Management
• Datastage jobs were priortised based on their SLA and appropriate queues were assigned to manage the workload of the Datastage server
• Tuned the performance of Long Running ETL jobs.
• Tuned the performance of Oracle and DB2 Queries, by understanding the execution plans and leveraged the special features of the Databases
Business Need
• Client is implementing a retail and supply chain planning solutions for demand forecasting, automatic replenishment and space optimization
Data Warehousing, Relationale Datenbanken, Open Database Connectivity
7/2016 – 12/2016
Tätigkeitsbeschreibung
Project Name: FoodLion Shopping History and Shopping List
Customer : Delhaize America - Retail Business Services
Technology: IBM Datastage 9.1,11.3,11.5,DB2,IBM Cloudant,IBM BlueMix,
IBM Infosphere Data Architect
Project Details
• Client is retail major in USA and Europe owning a large number of supermarkets specialising in Food and Consumable products.
• The Project Requirement is to display the history of transactions in the foodlion.com webpage and the ability to interact with their previously purchased items and add them to their shopping list
• The source data for the webpage was pulled from the cloudant
• Datastage was used to insert data into the nosql database Cloudant through REST API Service
Tasks and Responsibilities
• Helped and mentored the team to understand the DW layer and the Cloudant database
• Worked with Business Users and Managers to understand the business needs and to design the Data Model to fulfill the requirements
• Worked with Complex Mainframe files and transformed the data to targets in different formats.
• Worked with real-time stages (Rest Services, XML hierarchical Stage, Kafka Connector)
• Provided the optimal ETL Solution to extract and load the data from different source system to EDW
• Designed the ETL Reference Patterns and created ,reviewed the Mapping Documents with Data Architect
• Reviewed all the DDL's with Data Architect to make sure the Indexes, Compression and Partitioning is as expected
• Designed POC Mappings and help the ETL team on data acquisition techniques and loading strategies during the development phase
• Tested and organised peer reviews for each of the modules to minimize the errors during development phase
• Created Control-M drafts and was involved in scheduling of the Jobs in Control-M.
Business Need
• Client wanted to provide customers a convenient way to view their shopping history in their web page
Oracle Business Intelligence Standard Edition (SE), Data Warehousing, IBM DB2
11/2015 – 12/2016
Tätigkeitsbeschreibung
Project Name : Ariba Spend Visibility
Customer : Delhaize America - Retail Business Services
Technology: IBM Datastage 9.1,11.3,11.5,
DB2,IBM Cloudant,IBM BlueMix
IBM Infosphere Data Architect
Project Details
• Client is retail major in USA and Europe owning a large number of supermarkets specialising in Food and Consumable products.
• Client is rolling-out a new IT system to identify Delhaize America's indirect expenditure details by a suitable solution called Ariba SpendVis
• IBM Datastage was the ETL tool used for data transformation
Tasks and Responsibilities
• Gathering of Project Requirements –periodic interaction with Business Analysts and understanding the existing process flow
• Understanding and analysis of the Data Model
• Developed jobs for data extraction, transformation, loading, data cleansing by using several built in transformations and standards.
• Developed multiple jobs and transformations in Datastage
• Tuned the performance of Long Running ETL jobs by implementing Datastage and est practices and recommendations
• Creation of Functional and Technical Specification Documents
• Documentation of detailed technical/user manuals such as -Implementation Plan, Mapping Document, Input File Formats, DDL's for Staging and Final Tables.
• Unit testing and peer reviews at the end of each phase of development
• Deployed the code to Production and implemented change requests to fix data errors
Business Need
• Client is implementing a new IT solution which will provide visibility and intelligence on data expenditure that will allow sourcing to identify unaddressed expenditures as well as providing categorization of all indirect expenditures
• Additionally, it will allow Business to create IT strategies including, but not limited to, sourcing plans, vendor oversight, insight for future negotiations, as well as contract compliance
Oracle Business Intelligence Standard Edition (SE), Data Warehousing, IBM DB2
12/2014 – 1/2017
Tätigkeitsbeschreibung
Project Name : Datastage Migration
Customer : Walmart
Technology: IBM Datastage 9.1,8.7,Teradata,Oracle,Unix,Perl
Project Details
• The Objective of the project is to migrate jobs from Datastage 8.1, 8.5 environment to Datastage 9.1 environment
• Datastage was used as the ETL tools for Data Cleansing , Staging and Integration into Datawarehouse.
Tasks and Responsibilities
• Migrated 5000+ jobs to Datastage 9.1 environment
• Published the Design Document and was involved in Client Meeting with a single aim of bringing out the best design
• Created automated process to change the servers automatically in case of failover
• Minimised coding in Datastage by using advanced features such as schema file, RuntimeColumn Propagation
• Managed and led a team of 3 – assigning and tracking the completion of tasks, provided technical training and also provided constant motivation to get the best out of the people
Business Need
• Client wanted to migrate the jobs to more stable environment and fix warnings, errors in the existing production jobs and to have error free code in Datastage 9.1 environment
• Client also aims to improve the performance of the jobs by increasing the nodes
Data Warehousing, Teradata Sql
11/2011 – 12/2014
Tätigkeitsbeschreibung
Project Name : Nexus - ETL Middleware and DataMart Process
Customer : Retail & Ecommerce
Technology: IBM Datastage 8.7, Oracle 11G, Netezza 7, UC4
Project Details
• Client is retail major in USA specialising in Sports & Outdoor Goods
• Client is reshaping its IT systems by rolling-out Oracle Retail Merchandising System which will process 80% of Enterprise data
• The Project involved in understanding a wide variety of applications- RDF, JDA , SAS ,POSHUB, CLS, etc in its Enterprise Landscape
• Datastage was used as the ETL tools for Data tranformation and Middleware between the source and target applications
Tasks and Responsibilities
• Was involved in the project design from the scratch
• Designed and developed Datastage jobs and sequences with Audit and Error Handling
• Created Unix Shell scripts to call Datastage jobs –the scripts were invoked from the UC4 scheduler
• Developed mapping (sub –transformation ) to group multiple steps into a single mapping for reusability and flexibility
• Developed test cases for Unit Testing and provided support during the SIT, UAT phases.
• Tuned the performance of Oracle and Netezza Queries, by understanding the execution plans and leveraged the special features of the Databases
• Understood and developed Netezza DW Appliance scripts to load data into the DataWarehouse
• Evangelised and Implemented Netezza Best practices – Distribution Key, Groom, Generate Statistics, Clustered Base Table, etc.
Business Need
• Client is implementing a new Retail Merchandising System which will process data related to order management , purchasing, sales, transport management.
• Client required a Middleware System which can interact with the various Retail Systems and applications and transform data between the data streams
Oracle Business Intelligence Standard Edition (SE), Data Warehousing, SESAM/SQL Server, IBM DB2
Zertifikate
Ausbildung
Chennai
Anna university
Über mich
Passion: Technology and Tools are rapidly evolving and I am very passionate about learning and experimenting with new tools. I constantly read to keep myself abreast with the latest happenings in BI and also in the field of Big Data& Analytics
Weitere Kenntnisse
DB2,IBM Cloudant,IBM BlueMix
IBM Infosphere Data Architect,
Teradata,SQL Server,Oracle,Unix,Perl,
Netezza 7, UC4,MS Office- Word,Excel,Powerpoint,
Atlassian Jira,Confluence
Persönliche Daten
- Englisch (Fließend)
- Tamil (Muttersprache)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden