Job Description
Title: Senior Data Engineer (Databricks)
\n
Location: Parsippany, NJ (Hybrid)
\n
In-person interview is required!
\n
\n
Requirement:
\n
· Bachelor's degree in engineering, Computer Science or related field; Master's degree is a plus.
\n
· 8+ years relevant industry and functional experience in Database and Cloud-based technologies
\n
· Experience in building data ingestion pipelines for Structured and Unstructured data both for storage and optimal retrieval
\n
· Experience working with Cloud data stores (specifically AWS), noSQL, Graph and Vector databases.
\n
· Proficiency with languages such as Python, SQL, and PySpark
\n
· Experience working with Databricks and Snowflake technologies
\n
· Exposure to Machine learning and AI concepts related to RAG architecture, LLMs and Vector Datastores is a plus
\n
· Experience with relevant code repository and project tools such as GitHub, JIRA and Confluence
\n
· Working experience with Continuous Integration & Continuous Deployment with hands-on expertise on Jenkins, Terraform, Splunk and Dynatrace.
\n
· Highly innovative with aptitude for foresight, systems thinking and design thinking, with a bias towards simplifying processes.
\n
· Detail oriented individual with strong analytical, problem-solving, and organizational skills
\n
· Ability to clearly communicate to both technical and business teams
