Data Engineer and Data Warehouse Consultant

12/2018 – offen

• Good understanding of data governance practices such as metadata management, data
lineage, and data catalogs.
• Good understanding of DevOps key concepts and Agile methodologies.
• Interacted with End user community to understand the business requirements and in
identifying data sources.
• Involved in all phases of SDLC from requirement gathering, design, development, testing,
production, user training and support for production environment
• Designed and developed ETL processes using DataStage designer to load data from Oracle,
Flat Files (Fixed Width) to staging database and from staging to the target Data Warehouse
database.
• Created DataStage parallel tasks with components such as Funnel, Transformer, Sort, Join,
Lookup, Merge, Filter, Change Capture, Aggregator, Copy, Pivot, Remove Duplicates,
Surrogate Key, and Sequential File for faster data processing.
• Experience in Mapping parallel Jobs in DataStage to populate tables in Data warehouse and
Data marts.
• Ensured XFB-transmitted files were processed exclusively as full loads, optimizing data
integrity.
• Excessively used DS Director for monitoring Job logs to resolve issues.
• Involved in Unit Testing and Resolution of various bottlenecks that came across.
• Excellent with PL/SQL, Stored Procedures, Database Triggers and SQL Loader.
• Optimized ETL workflows using DataStage seamlessly integrating data from databases and
various structured and unstructured sources.
• Designed, optimized, and automated ETL processes with DataStage to improve efficiency,
scalability, and operational effectiveness.
• Expert knowledge of data modelling techniques involving high-volume data eventually
converting into an efficient ETL/ELT design. Experienced in using ETL tools like DataStage.
• Configured job scheduling, established CI/CD deployment pipelines, and automated data
synchronization to ensure continuous availability and efficiency.
• Developed and enforced migration test strategies, conducted extensive unit and integration
testing, and implemented data validation frameworks to uphold accuracy.
• Identified and mitigated performance bottlenecks in Snowflake, troubleshooting connectivity,
query inefficiencies, and security challenges for optimized system reliability.
• Provided strategic mentorship to junior developers, enforced best practices in Snowflake
architecture, and drove initiatives to enhance cloud-based data solutions.
• Drive client meetings and status presentations.
• Support extensively for production deployments.
• Training and ramp ups of resources for new opportunities.
• Responsible for project level dependency, risk management and mitigation actions.

Data Warehousing, Spezialist Technischer Support