Search

AWS Senior ETL Data Engineer

PublishedPublished: 6/14/2022
Technology
|

Job Description

Job DescriptionAWS Senior ETL Data Engineer\n
\n

\n\n Job ID: JIH5JP00004852\n
\n\n\n Location: Torrance, CA (Onsite 4 Days per Week)\n
\n\n\n Contract Duration: 3 Months\n
\n\n\n Pay Rate: $60/hour (W2 Only)\n
\n\n\n Employment Type: Contract\n
\n\n

Job Overview\n
\n

We are seeking an experienced Senior AWS ETL Data Engineer with strong hands-on expertise in AWS data engineering, ETL/ELT development, data warehousing, and large-scale data processing.

\n

The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring data quality, reliability, performance, security, and cost efficiency. This role requires extensive experience with AWS services, Python, PySpark, Apache Spark, and modern data integration technologies.

Key Responsibilities\n
\n

    \n
  • \n

    Design, develop, and maintain scalable ETL/ELT data pipelines using AWS Glue, EMR, MWAA/Airflow, Lambda, and Redshift.

  • \n

  • \n

    Build and optimize data integration workflows to efficiently extract, transform, and load data into target systems.

  • \n

  • \n

    Utilize Python, PySpark, and Apache Spark to process and transform large datasets.

  • \n

  • \n

    Implement data validation, cleansing, monitoring, and error-handling mechanisms to maintain data quality and integrity.

  • \n

  • \n

    Optimize data pipelines for performance, scalability, reliability, and cost efficiency.

  • \n

  • \n

    Identify and resolve performance bottlenecks, fine-tune SQL queries, and optimize Amazon Redshift workloads.

  • \n

  • \n

    Implement CI/CD pipelines and DevOps practices for automated data pipeline development, deployment, and releases.

  • \n

  • \n

    Manage AWS IAM roles, policies, access controls, and Lake Formation permissions to ensure data security and governance.

  • \n

  • \n

    Integrate data from multiple sources using AWS and Informatica IDMC/Informatica Cloud.

  • \n

  • \n

    Translate business requirements into technical specifications and production-ready data pipelines.

  • \n

  • \n

    Collaborate with data analysts, business stakeholders, and engineering teams to support business intelligence and analytics initiatives.

  • \n

  • \n

    Maintain technical documentation and ensure compliance with data governance, security, and regulatory requirements.

  • \n

  • \n

    Explore and implement Generative AI and Agentic AI use cases within data engineering workflows.

  • \n

\n
\nRequirementsRequired Qualifications\n
\n

    \n
  • \n

    Minimum 7 years of experience in data engineering, database design, ETL processes, and data warehousing.

  • \n

  • \n

    Minimum 5 years of hands-on experience with AWS services and technologies, including:

    \n

      \n
    • \n

      Amazon S3

    • \n

    • \n

      AWS Glue

    • \n

    • \n

      Amazon EMR

    • \n

    • \n

      Amazon Athena

    • \n

    • \n

      Amazon Redshift

    • \n

    • \n

      Amazon RDS

    • \n

    • \n

      Redshift Spectrum

    • \n

    • \n

      Apache Airflow / AWS MWAA

    • \n

  • \n

  • \n

    Minimum 5 years of programming experience with Python, PySpark, and/or Scala.

  • \n

  • \n

    Minimum 2 years of experience with CI/CD tools and DevOps practices for automated builds, deployments, and releases.

  • \n

  • \n

    Minimum 2 years of hands-on experience with AWS IAM and AWS Lake Formation, including roles, policies, access controls, and data lake security.

  • \n

  • \n

    Strong understanding of data storage, data lakes, distributed computing, and processing frameworks such as Hadoop and Apache Spark.

  • \n

  • \n

    Experience with Informatica IDMC / Informatica Cloud.

  • \n

Preferred Qualifications\n
\n

    \n
  • \n

    Experience implementing Agentic AI or Generative AI use cases in data engineering.

  • \n

  • \n

    Strong understanding of cloud-based data architecture and modern data warehousing solutions.

  • \n

  • \n

    Experience optimizing large-scale data processing workloads.

  • \n

  • \n

    Knowledge of data governance, security, and compliance best practices.

  • \n

Core Technical Skills\n
\n

    \n
  • \n

    Cloud Platform: AWS

  • \n

  • \n

    ETL/ELT: AWS Glue, Informatica IDMC

  • \n

  • \n

    Data Warehousing: Amazon Redshift, Redshift Spectrum

  • \n

  • \n

    Programming: Python, PySpark, Scala

  • \n

  • \n

    Big Data: Apache Spark, Hadoop, Amazon EMR

  • \n

  • \n

    Data Storage: Amazon S3, Amazon RDS

  • \n

  • \n

    Query Services: Amazon Athena

  • \n

  • \n

    Workflow Orchestration: Apache Airflow, AWS MWAA

  • \n

  • \n

    Security & Governance: AWS IAM, AWS Lake Formation

  • \n

  • \n

    DevOps: CI/CD, automated deployment and release management

  • \n

  • \n

    Emerging Technologies: Generative AI, Agentic AI

  • \n

Work Arrangement\n
\n

    \n
  • \n

    Onsite 4 days per week in Torrance, California.

  • \n

  • \n

    Initial contract duration of 3 months.

  • \n

  • \n

    W2 employment only.

  • \n

\n\n
\n\n

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...