Databricks Integration Lead
Job Description
Veeva CRM to Vault CRM Migration
\n
\n
Location: Indianapolis, IN preferred. Open to candidates based in Chicago, IL, Cincinnati, OH, or surrounding areas within reasonable proximity to Indianapolis.
\n
\n
About the Opportunity
\n
We are seeking a senior, hands-on Databricks Integration Lead to lead the integration architecture for a large-scale Veeva CRM to Vault CRM migration within the life sciences industry.
\n
This role involves managing integrations across 5 Veeva CRM organizations and 46 integration points, optimizing existing integrations, and ensuring a seamless transition to Vault CRM.
\n
\n
The ideal candidate has deep, hands-on Databricks expertise, strong integration architecture experience, and a background in pharmaceutical or life sciences environments. This is a technical leadership role requiring active involvement in architecture, pipeline development, and engineering team oversight.
\n
\n
Key Responsibilities
\n
- \n
- Lead end-to-end integration architecture across Databricks, Veeva CRM, Vault CRM, and connected systems.
- Analyze and optimize 46 integration points, identifying opportunities for consolidation and standardization.
- Design scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
- Establish standards for medallion architecture, Unity Catalog, workflow orchestration, and CI/CD.
- Develop data mapping and integration strategies to support the Veeva CRM to Vault CRM migration.
- Provide hands-on technical guidance, review pipelines, and troubleshoot complex integration challenges.
- Lead engineering teams, including offshore resources.
- Ensure data validation, governance, regulatory compliance, and successful migration cutover.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Qualifications
\n
- \n
- 10+ years of experience in data integration, engineering, or architecture.
- 5+ years of deep, hands-on Databricks experience in enterprise environments.
- Expertise in PySpark, Spark SQL, Delta Lake, Delta Live Tables, Auto Loader, Workflows/Jobs, and Unity Catalog.
- Hands-on experience with Veeva CRM integrations and data models.
- Experience in pharmaceutical or life sciences commercial environments, including HCP/HCO data, call activity, samples, and consent.
- Experience delivering complex, multi-system integration projects.
- Strong API integration experience (REST/SOAP), data pipelines, and performance optimization.
- Proven technical leadership experience, including managing distributed or offshore engineering teams.
- Familiarity with GxP validation and regulated environments.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- Experience with Vault CRM or Veeva CRM to Vault CRM migrations.
- Databricks certifications.
- Experience with Veeva Network, OpenData, or multi-org integrations.
- Experience with Terraform, Azure DevOps, GitHub Actions, or cloud platforms (AWS, Azure, GCP).
\n
\n
\n
\n
\n