Search

Data Platform Engineer - AI

PublishedPublished: 6/14/2022
Technology

Job Description

We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.

\n


\n

Key Responsibilities:

\n

Data Platform & Engineering:

\n

    \n
  • Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
  • \n

  • Develop large-scale data processing using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.
  • \n

  • Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers
  • \n

\n


\n

Backend Services & Integration:

\n

    \n
  • Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
  • \n

  • Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
  • \n

  • Implement microservices and event-driven processing patterns with secure authentication and authorization.
  • \n

\n

\n

Modernization & Reliability

\n

    \n
  • Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
  • \n

  • Support platform and data migrations while ensuring functional and data parity.
  • \n

  • Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights
  • \n

\n


\n

Cloud, DevOps & Technical Leadership

\n

    \n
  • Build and maintain CI/CD pipelines using Azure DevOps and Git.
  • \n

  • Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
  • \n

  • Support Docker and Kubernetes/AKS-based workloads where applicable.
  • \n

\n


\n

Mandatory Skills:

\n

Data Engineering

\n

    \n
  • Azure Databricks, Spark/PySpark
  • \n

  • Azure Synapse Analytics, Azure Data Factory
  • \n

  • ADLS Gen2, Delta Lake
  • \n

  • SQL Server / Azure SQL
  • \n

  • Cosmos DB, Kusto / Azure Data Explorer
  • \n

  • ETL/ELT, Data Warehousing & Data Modeling
  • \n

  • Lakehouse / Medallion Architecture
  • \n

  • Data Quality, Reconciliation & Governance
  • \n

\n


\n

Backend & Services

\n

    \n
  • C#, .NET / ASP.NET Core
  • \n

  • REST APIs & Microservices
  • \n

  • Azure Functions
  • \n

  • Event Hubs & Service Bus
  • \n

  • Entity Framework Core
  • \n

  • Authentication & Authorization
  • \n

\n


\n

Cloud & DevOps

\n

    \n
  • Microsoft Azure
  • \n

  • Azure DevOps, Git & CI/CD
  • \n

  • Azure Monitor & Application Insights
  • \n

  • Azure Key Vault
  • \n

  • Docker / Kubernetes
  • \n

\n


\n

Good to Have

\n

    \n
  • React or Angular, TypeScript
  • \n

  • GraphQL
  • \n

  • Power BI
  • \n

  • Infrastructure as Code
  • \n

  • SRE / Production Support experience
  • \n

  • AI/ML or AI-enabled analytics exposure
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...