Job Description
Job Title: AWS Databricks Architect
\n
Location: Edison, NJ
\n
Work Mode: 3–5 Days Onsite
\n
Interview Mode: Face-to-Face
\n
Job Type: Contract
\n
\n
Job Summary
\n
We are seeking an experienced AWS Databricks Architect to design, develop, and implement scalable data engineering and analytics solutions on AWS and Databricks platforms. The ideal candidate will have strong expertise in cloud data architecture, Lakehouse architecture, data pipelines, big data technologies, and enterprise data integration.
\n
The candidate will be responsible for defining technical architecture, optimizing data platforms, and leading the implementation of robust, secure, and high-performance data solutions.
\n
Key Responsibilities
\n
- \n
- Design and implement end-to-end data architecture using AWS and Databricks.
- Develop scalable data pipelines using Databricks, Apache Spark, and PySpark.
- Design and implement Lakehouse architecture using Delta Lake.
- Build and optimize ETL/ELT workflows for large-scale data processing.
- Leverage AWS services such as S3, Glue, Lambda, EMR, Redshift, IAM, and CloudWatch.
- Implement data governance, security, access controls, and data quality frameworks.
- Design data ingestion solutions for structured, semi-structured, and unstructured data.
- Optimize Spark jobs, cluster configurations, and Databricks workloads for performance and cost.
- Implement CI/CD pipelines and DevOps practices for data engineering.
- Collaborate with business stakeholders, data engineers, and enterprise architects.
- Provide technical leadership and architectural guidance to development teams.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Skills
\n
- \n
- 8+ years of experience in Data Engineering, Cloud Data Architecture, or related roles.
- Strong hands-on experience with AWS Cloud services.
- Extensive experience with Databricks and Apache Spark.
- Strong programming skills in Python, PySpark, and SQL.
- Experience with Delta Lake, Unity Catalog, and Databricks Lakehouse architecture.
- Expertise in designing scalable ETL/ELT pipelines.
- Strong knowledge of AWS S3, Glue, Lambda, Redshift, IAM, and EMR.
- Experience with data modeling, data warehousing, and distributed computing.
- Knowledge of Terraform or CloudFormation.
- Experience with Git, Jenkins, Azure DevOps, or similar CI/CD tools.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- AWS Certified Solutions Architect or AWS Data Engineer certification.
- Databricks Certified Data Engineer Professional or Associate.
- Experience with Kafka or AWS Kinesis.
- Experience with data governance, metadata management, and enterprise security.
- Strong communication, problem-solving, and leadership skills.
\n
\n
\n
\n
\n
\n
Important Requirements
\n
- \n
- Location: Edison, NJ
- Work Mode: 3–5 Days Onsite
- Interview Mode: Face-to-Face
- Candidates must be comfortable attending an in-person interview and working onsite as required.
\n
\n
\n
\n
\n