Cloud Data Engineer

Experienced Data Engineer with a focus on cloud migrations, ETL automation, and data pipeline optimization. Skilled in AWS, Python, and data quality tools, I deliver scalable, high-quality data solutions.

• Amazon Web Services (AWS)
• Apache Kafka
• aws
• Big Data
• Data Warehousing
• Oracle Business Intelligence (BI)
• Postgresql
• pyspark
• Python
• SQL

Experienced Data Engineer with a solid foundation in cloud data migrations, ETL process automation, and data pipeline optimization for high-quality, scalable solutions. Skilled in AWS services (S3, Glue, Lambda, Athena, and Airflow), I specialize in moving data securely from on-premises to cloud environments, freeing teams from infrastructure management. I’m proficient in Python, SQL, Apache Spark, PySpark, and various data formats (structured, semi-structured, and unstructured), creating robust data workflows that meet diverse needs.

Data Quality and Monitoring: I utilize validation tools like Great Expectations to maintain data accuracy, reliability, and trustworthiness. My approach emphasizes the implementation of data lifecycle and monitoring processes, ensuring that data is consistently ready for analytics, machine learning, and reporting.

Infrastructure Management: Experienced in CI/CD (using GitHub Actions, Terraform, and Terragrunt) to automate deployment workflows, manage infrastructure, and enhance development efficiency.

Collaboration: In agile environments, I actively contribute to Scrum teams, participating in sprint planning, reviews, and daily standups. I work closely with data analysts and data scientists to deliver high-quality data tailored to their machine learning and analytics needs. I also support the marketing team, providing them with reliable data for integration with external APIs (e.g., Qualtrics, Google Ads).

Big Data and Advanced Analytics: With experience in Databricks and data lake architectures, I build efficient data flows from data lakes to data warehouses to support high-performance analytics and advanced data applications.

Eager to contribute to data-driven decision-making and innovation, I continually seek new use cases, applications, and opportunities for optimization in data engineering, adding value across diverse business functions.