AWS Databricks Platform Architect
Job Description
Position: AWS Databricks Platform Architect
\n
Location: Raritan, NJ (Onsite)
\n
Duration: Contract
\n
Job Description:
\n
We are seeking an experienced Solution Architect to lead the migration and modernization of enterprise scale data lakes from Azure Databricks to AWS Databricks while transforming the platform into an AIready Lakehouse architecture The role involves defining targetstate architecture migration strategy governance frameworks modernization roadmaps and AIGenAI enablement across largescale data ecosystems.
\n
The ideal candidate will have deep expertise in Databricks cloud migration modern data architecture and AIdriven data platforms with experience leading complex enterprise transformation programs involving thousands of data assets and multiple downstream applications
\n
\n
Key Responsibilities
\n
Architecture Strategy
\n
Define endtoend migration strategy from Azure Databricks to AWS Databricks
\n
Design scalable Lakehouse architecture using Medallion principles Bronze Silver Gold
\n
Develop Day1 Business Continuity and Day2 Modernization AI Enablement migration roadmaps
\n
Perform application and dependency assessment across upstream and downstream systems
\n
Establish architecture patterns standards and best practices for cloudnative data platforms
\n
Migration Modernization
\n
Lead migration of data pipelines notebooks Delta tables workflows and data products
\n
Modernize legacy ETLELT frameworks using Databricks native capabilities
\n
Optimize performance scalability security and operational efficiency
\n
Define migration approach for CDC batch streaming and realtime workloads
\n
Drive technology rationalization and tool consolidation initiatives
\n
AI Ready Data Platform
\n
Build AIready data foundations leveraging Delta Lake and Unity Catalog
\n
Design data architectures supporting ML GenAI RAG feature stores and advanced analytics
\n
Enable governed data access for data scientists and AI applications
\n
Define semantic models metadata strategies lineage and data discovery frameworks
\n
Establish frameworks for AI governance and responsible AI adoption
\n
Data Governance Security
\n
Architect enterprisewide governance using Unity Catalog
\n
Design data lineage auditing access controls masking and compliance standards
\n
Implement data quality observability and monitoring frameworks
\n
Ensure platform adherence to security and regulatory requirements
\n
Stakeholder Management
\n
Collaborate with business data engineering analytics AI security and cloud teams
\n
Lead architecture review boards and executivelevel discussions
\n
Mentor solution architects technical leads and engineering teams
\n
Drive estimation roadmap planning risk assessment and governance reviews
\n
Required Experience
\n
5 years as a Solution Architect or Lead Architect
\n
Proven experience in largescale cloud migration programs
\n
Handson experience with Azure Databricks and AWS Databricks
\n
Experience migrating enterprise Data LakesLakehouses across cloud platforms
\n
Strong understanding of Medallion Architecture and Delta Lake
\n
Experience with Modern Data Platforms supporting AIML workloads
\n
Expertise in enterprise integration and largescale data ecosystems