Job Description
Job Description
Job Title: Python Databricks Developer
Location: Bentonville, AR - (On-Site)
Exp: 8-10
Client: UST Global/Walmart
Job Summary
We are looking for a skilled Python Databricks Developer with strong hands-on experience in Python, Databricks, data processing, and data analytics. The ideal candidate will have experience building and working with Databricks pipelines and notebooks, along with hands-on exposure to data synthesis/generation for testing purposes.
The candidate should be comfortable working independently in a fast-paced environment and should have strong problem-solving and analytical skills.
Key Responsibilities
- Develop and maintain Python-based data processing and analytics solutions.
- Build, enhance, and troubleshoot Databricks notebooks and data pipelines.
- Perform data processing, transformation, validation, and analysis using Python and Databricks.
- Develop synthetic/generated datasets for application and data testing purposes.
- Work with large datasets and ensure data quality, accuracy, and consistency.
- Analyze data requirements and translate them into scalable data-processing solutions.
- Collaborate with development, QA, data engineering, and business teams to understand data needs.
- Debug and optimize Python scripts, Databricks jobs, and data pipelines.
- Support testing activities by creating and managing test data.
- Document technical solutions, data processes, and pipeline workflows.
- Work independently while managing multiple priorities in a fast-paced environment.
Required Skills
- Strong hands-on experience with Python.
- Mandatory experience with Databricks.
- Hands-on experience with Databricks notebooks and pipelines.
- Experience with data synthesis / synthetic data generation for testing.
- Strong understanding of data analytics and data processing.
- Experience working with data transformation and manipulation.
- Strong analytical and problem-solving skills.
- Ability to work independently with minimal supervision.
Preferred Skills
- Experience with PySpark.
- Knowledge of SQL and relational databases.
- Experience with Databricks workflows/jobs.
- Familiarity with data engineering concepts and ETL/ELT processes.
- Experience working with large-scale datasets.
- Knowledge of cloud data platforms such as AWS, Azure, or GCP is a plus.
- Experience working in Agile/Scrum environments.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of overall IT/software development experience preferred.
- Strong communication skills and the ability to collaborate across technical teams.