Job Description
Job Description 1. Azure Data Factory (ADF)
- Develop and maintain data pipelines in Azure Data Factory
- Ingest data from multiple/different sources using Azure ADF
- Experience with ADF Pipelines, Linked Services, Datasets, Triggers, Copy Activity
- Keywords: Azure Data Factory, ADF, ETL, Data Pipelines, Data Ingestion
2. Azure Databricks
- Transform and process data using Azure Databricks
- Experience with PySpark / Spark / SQL
- Keywords: Azure Databricks, Databricks, PySpark, Apache Spark, Spark SQL
3. Delta Lake
- Experience implementing Delta Lake for data storage and transformation
- Keywords: Delta Lake, Delta Tables, Databricks Delta, Lakehouse