Job Description
Job Role: AWS Data Engineer
\n
Location: Newark NJ – Onsite 3 days/week
\n
Employment type: Fulltime / Contract
\n
No of position: 4
\n
Exp. Start date: Nov 3rd week
\n
Year of Experience: 10+ years
\n
\n
CLIENT INTERVIEW will happen F2F in Newark, NJ too.
\n
\n
Role Summary –
\n
\n
Design, develop and support AWS-based data pipelines for enterprise data onboarding, transformation, and consumption. The engineer will work hands-on with Python/PySpark and AWS-native data services to create reliable, scalable, and analytics/AI-ready datasets.
\n
\n
Key Responsibilities -
\n
\n
Data Pipeline Development
\n
- \n
- Develop ingestion and transformation pipelines using AWS Glue, EMR, S3, Python and PySpark.
- Ingest data from legacy and enterprise source systems into AWS.
- Develop transformations required to create standardized, consumption-ready datasets.
- Build and maintain ETL/ELT workflows supporting enterprise data domains.
\n
\n
\n
\n
\n
\n
AWS Data Engineering
\n
- \n
- Work with S3 for data storage and processing.
- Develop workloads using Glue and EMR.
- Develop and optimize analytical datasets and workloads involving Redshift and Athena.
- Support Iceberg-based data structures on S3 where required.
- Work with other AWS data services such as DynamoDB when appropriate to the solution.
\n
\n
\n
\n
\n
\n
\n
Data Quality & Reliability
\n
- \n
- Implement data validation, reconciliation, and quality checks within pipelines.
- Identify and resolve data-processing failures and data-quality issues.
- Support performance optimization of PySpark/SQL workloads and data pipelines.
- Participate in troubleshooting and production support.
\n
\n
\n
\n
\n
\n
Development & Delivery
\n
- \n
- Develop clean, maintainable, and reusable Python/PySpark code.
- Perform unit and integration testing.
- Participate in peer code reviews.
- Document data flows, mappings, transformations, and technical designs.
- Work with the Data Engineering Lead and client stakeholders to understand source data and transformation requirements.
\n
\n
\n
\n
\n