Job Description
Role: Data Engineer (Databricks) with AI
Location: Austin TX (Hybrid) - Need locals Only
Visa Independent profiles only
- 10+ years of data engineering or software engineering experience, with hands-on work in cloud data platforms (Databricks, Snowflake, Azure)
- Proven experience developing automation solutions, agents, or AI-powered tools (e.g., using LLMs, prompt engineering, or orchestration frameworks like Databricks Agent Framework (or LangChain, AutoGen)
- Strong proficiency in Python and SQL with focus on production-grade code quality
- Demonstrated experience with Azure Databricks (notebooks, jobs, workflows, DLT) or equivalent modern data platforms
- Expert-level Python programming with strong software engineering practices (testing, documentation, version control)
- Strong SQL and PySpark optimization skills
- Hands-on experience with LLM APIs, prompt engineering, and AI agent frameworks (e.g., Databricks Agent Bricks, LangChain, OpenAI, Azure OpenAI)
- Proficiency in Azure Databricks, including Delta Lake, workflows, and Databricks Asset Bundles
- Experience designing and implementing automation workflows using orchestration tools or serverless platforms