Data Engineer / Data Architect (Pharma / biotech domain)
Diligente Technologies
Westlake Village, CA, USA
6/14/2022
Technology
Full Time
Job Description
Data Engineer / Data Architect
📍 Location: Westlake, CA (Hybrid/Onsite)
📄 Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
- Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
- Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
- Support AI/ML initiatives, advanced analytics, and data-driven applications.
- Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
- Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
- Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Competencies & Skills
- Experience with Azure Cloud (Databricks, DevOps, DataFactory)
- Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
- Strong hands-on python, pyspark, and SQL skills
- Direct experience with building and leveraging API integrations in ETL pipeline development
- Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
- Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
- Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities
Preferred Competencies & Skills
- Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
- Familiarity with tools and practices in the Martech and Adtech landscape
- Knowledge of Consumer, Patient, or HCP data ecosystems
- Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
- Experience with custom-built or third-party Customer Data Platforms (CDP)
- Experience with marketing automation tools
Working Conditions
- General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.
