Job Description
Job Title : Databricks Quality Lead Tester
\n
Job Location: New York, United States
\n
Job Duration : 6 Months
\n
\n
Client Interview : Yes
\n
Skill Cluster : DA-Data Testing.
\n
Primary Skill : SQL, PySpark, Agile
\n
Experience : 10 years
\n
\n
Job Description :
\n
Job Requirements Key Responsibilities
\n
Data Testing & Validation
\n
- \n
- Design and implement test plans, test cases, and test automation for data pipelines (ELT/ETL).
- Validate payer data, including claims, membership, provider, and clinical datasets.
- Conduct FHIR-based API testing for CMS Interoperability compliance.
- Validate HEDIS measure calculations and quality reporting data.
\n
\n
\n
\n
\n
\n
CI/CD Integration
\n
- \n
- Develop Azure DevOps test planswith QA gates for Databricks Jobs/DLT and ADF deployments.
- Technical DeliveryCollaborate with product owners, Azure Data Factory (ADF), Databricks engineering teams to ensure end-to-end data quality.
- Build and maintain data quality automation frameworks leveraging PySpark, SQL, and Python.Work with data governance and business teams to resolve data quality issues.
\n
\n
\n
\n
\n
Performance & Scalability
\n
Design automated load and stress tests for large-scale data pipelines.
\n
\n
Compliance & Best Practices
\n
- \n
- Ensure data QA practices adhere to HIPAA, CMS, and payer industry standards.
- Document QA processes, test results, and provide
\n
\n
\n
\n
Skills:
\n
- \n
- Hands-on experience with Azure Data Factory (pipelines, monitoring, CI/CD).
- Proficiency in Python, PySpark, SQL for test automation.
- Knowledge of data governance, PII compliance, and data quality frameworks.
- Strong communication and leadership abilities for cross-functional teamwork.
\n
\n
\n
\n
\n