Data Engineering Consultant
- Verfügbarkeit einsehen
- 0 Referenzen
- auf Anfrage
- 91074 Herzogenaurach
- Nähe des Wohnortes
- en
- 30.12.2024
Kurzvorstellung
Qualifikationen
Projekt‐ & Berufserfahrung
2/2022 – offen
Tätigkeitsbeschreibung
• Designed and deployed a Lakehouse architecture using Delta Lake, reducing storage costs by 25% and improving analytics performance.
• Developed scalable data pipelines that optimized resource utilization by over 70%, reducing operational costs by 20%.
• Delivered hybrid cloud solutions that improved workflows and reduced infrastructure costs by 15%.
• Automated monitoring systems, cutting downtime by 50% and accelerating issue resolution.
• Collaborated with clients to define data strategies, enabling 20% faster decision-making through advanced analytics.
• Created end-to-end ETL pipelines, improving integration efficiency by 30%.
• Partnered with stakeholders on data migration initiatives, ensuring 100% on-time delivery of key projects.
• Mentored junior engineers, fostering a culture of learning and technical excellence.
Apache Spark, Databricks, ETL, Python, Data Engineer, Microsoft Azure, Amazon Web Services (AWS)
9/2013 – 8/2021
Tätigkeitsbeschreibung
• Led the design and development of scalable data pipelines to support market expansion, contributing to a 15% revenue increase.
• Streamlined ETL processes, reducing load times by 25% and enhancing integration capabilities.
• Managed multiple project lifecycles, ensuring delivery aligned with client requirements and achieving a 100% satisfaction rate.
• Improved code quality by implementing rigorous testing frameworks, achieving a 95% code coverage rate.
• Spearheaded technical documentation efforts, ensuring compliance with business and regulatory standards.
Apache Hadoop, Apache Spark, Big Data, Databricks, Datenanalyse, ETL, Python
Ausbildung
Jawaharlal Nehru Technological University
India
Über mich
• Cloud & Big Data Solutions: Proficient in AWS, Azure, and hybrid cloud strategies.
• ETL Development & Integration: Advanced skills in creating efficient pipelines using tools like StreamSets and PySpark with DataBricks.
• Data Governance: Hands-on experience in data lineage, security, and compliance.
• Analytics & Visualization: Strong proficiency in Power BI and advanced analytics workflows.
• Mentoring & Leadership: Adept at guiding cross-functional teams and fostering high-performance culture
Weitere Kenntnisse
• Cloud Services: Azure (ADF, Blob Storage, ADLS), AWS (EMR, S3)
• ETL Tools: StreamSets, SQL, Sqoop, Azure Data Factory
• Analytics & Visualization: Microsoft Power BI
• Programming: Python, Scala, PySpark
• DevOps: Azure DevOps, Logic Apps, GitHub, Bitbucket, Jenkins
Persönliche Daten
- Englisch (Muttersprache)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden