Job Description
🚀 Hiring: Data Engineer
\n
📍 Location: Remote (Candidates based in McLean, VA)
\n
💼 Employment Type: Contract – 7 Months
\n
💰 Pay Rate: $50–$60/hour on W2
\n
\n
Job Description
\n
We are looking for an experienced Data Engineer with strong expertise in Python, PySpark, and AWS services to design, develop, and optimize scalable data pipelines. The ideal candidate will have hands-on experience processing large datasets, implementing data quality frameworks, and ensuring data integrity and lineage.
\n
Key Responsibilities
\n
- \n
- Design, develop, and maintain high-performance data pipelines for large-scale data processing.
- Build and optimize ETL workflows using Python, PySpark, AWS Glue, and Amazon EMR.
- Implement data quality checks, validation frameworks, and data lineage tracking.
- Work with Amazon S3 data lakes and relational databases such as PostgreSQL and MySQL.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Troubleshoot pipeline failures and ensure data accuracy and reliability.
\n
\n
\n
\n
\n
\n
\n
\n
Required Skills & Qualifications
\n
- \n
- Strong hands-on experience with Python and PySpark.
- Extensive experience with AWS Glue and Amazon EMR.
- Experience building scalable data pipelines for large volumes of data.
- Knowledge of data quality, data validation, and data lineage frameworks.
- Experience working with Amazon S3 and relational databases (RDS, PostgreSQL, MySQL).
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- Experience in financial services or banking.
- Knowledge of Apache Kafka or Amazon Kinesis for real-time data processing.
- Familiarity with CI/CD pipelines and Infrastructure as Code.
\n
\n
\n
\n
📩 Interested candidates: Please share your updated resume and contact details to learn more about this opportunity.
\n
#Hiring #DataEngineer #CapitalOne #AWS #PySpark #Python #AWSGlue #AmazonEMR #BigData #DataEngineering #ContractJobs