Azure Databricks Data Engineer

Job Description

Job DescriptionAzure Databricks Data Engineer

• Location: Louisville, KY

• Duration: 6 months

• Role: Databricks / Azure Data Engineer

• Experience Required: 8–10 years

• Primary Skill: Azure Databricks

Must-Have Technical Skills

• Strong experience developing data pipelines using Azure Data Factory (ADF).

• Experience ingesting data from multiple sources using Azure ADF.

• Experience transforming data using:

  • Azure Databricks

  • Delta Lake

• Strong experience with Azure DevOps CI/CD.

• Experience managing:

  • User Stories

  • Bugs

  • Issues

  • Sprint deliverables

Azure Data Engineering

• Design and develop data pipelines using Azure Data Factory.

• Build data ingestion solutions from multiple source systems.

• Develop data transformation processes using Azure Databricks.

• Implement and manage Delta Lake solutions.

• Troubleshoot data pipeline and data-related issues.

• Perform data analysis to identify root causes and resolve data issues.

Roles & Responsibilities

• Implement integration solutions in Microsoft Azure.

• Develop and maintain scalable Azure data pipelines.

• Ingest data from various source systems using Azure ADF.

• Transform and process data using Azure Databricks and Delta Lake.

• Analyze data to troubleshoot data-related issues.

• Assist in resolving data quality and pipeline issues.

• Participate in Agile development projects.

• Contribute to sprint planning and sprint delivery.

• Manage development activities through Azure DevOps.

• Work as an individual contributor and problem solver.

• Collaborate with technical and business teams to deliver data solutions.

DevOps & Agile

• Experience with Azure DevOps CI/CD.

• Manage Stories, Bugs, and Issues in Azure DevOps.

• Work within Agile/Scrum development methodologies.

• Participate in sprint planning, execution, and delivery.

• Support continuous integration and continuous delivery processes.

Generic Managerial Skills

• Experience working in Agile development projects.

• Strong sprint delivery experience.

• Good analytical and problem-solving skills.

• Ability to work independently as an individual contributor.

• Strong collaboration and communication skills.

Key Search Keywords

• Azure Databricks

• Databricks

• Azure Data Factory

• ADF

• Delta Lake

• Azure Data Engineer

• Data Pipelines

• Data Ingestion

• Data Transformation

• Azure DevOps

• CI/CD

• Agile

• Sprint Delivery

• Data Integration

• Data Troubleshooting

Role Details

• Role Description: Databricks

• Essential Skills: Databricks

• Desirable Skills: Azure Data Factory, Delta Lake, Azure DevOps, CI/CD

• Keyword: Databricks, ADF, Delta Lake, Azure DevOps

• Skills: Digital — Databricks

• Experience Required: 8–10 years