Job Description
Must Have Technical/Functional Skills
\n
\n
· 12+ years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark
\n
· Very Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.
\n
· Experience in creating data pipelines and orchestrating using DBT & Apache Airflow
\n
· Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts.
\n
· Experiencing in fixing performance issues / parallelism, Data model exposure is a must.
\n
· Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool
\n
· Experience in using Snowflake, DB2, Postgres and other database technologies is plus.
\n
· Excellent communication skills to liaise with Business & IT stakeholders.
\n
· Expertise in planning execution of a project and efforts estimation.
\n
· Exposure to working in Agile ways of working
\n
\n
Roles & Responsibilities
\n
\n
· Lead the design of reliable, secure, and highly available data lakes, data marts and data meshes
\n
· leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality
\n
· Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap
\n
· Translate complex technical constraints into business insights and manage expectations across cross-functional teams
\n
· Develop, modify, configure & debug existing data pipeline as per the business requirement.
\n
· Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance
\n
· Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc.
\n
· Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns
\n
· Document all data flow & mappings, sessions and workflows
\n
· Ticket handling and problem ticket analysis skills in Agile /POD approach