Search

Data Engineer / Data Architect (Pharma / biotech domain)

Diligente Technologies
locationWestlake Village, CA, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Data Engineer / Data Architect

📍 Location: Westlake, CA (Hybrid/Onsite)

📄 Type: Contract-to-Hire

We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.

Key Responsibilities

  • Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
  • Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
  • Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
  • Support AI/ML initiatives, advanced analytics, and data-driven applications.
  • Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
  • Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
  • Optimize cloud data infrastructure performance, scalability, and cost efficiency.

Required Competencies & Skills


  • Experience with Azure Cloud (Databricks, DevOps, DataFactory)
  • Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
  • Strong hands-on python, pyspark, and SQL skills
  • Direct experience with building and leveraging API integrations in ETL pipeline development
  • Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
  • Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
  • Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities


Preferred Competencies & Skills

  • Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
  • Familiarity with tools and practices in the Martech and Adtech landscape
  • Knowledge of Consumer, Patient, or HCP data ecosystems
  • Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
  • Experience with custom-built or third-party Customer Data Platforms (CDP)
  • Experience with marketing automation tools


Working Conditions


  • General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...