Search

Senior Data Engineer

Shaavir
locationGlendale, CA, USA
PublishedPublished: 6/14/2022
Technology
Full Time

Job Description

Job Description

Job Title: Sr. Data Engineer

Location: Glendale, CA – Onsite (4 days a week)

Platform / Tech Stack

You will work with technologies including:

  • Python
  • AWS
  • Spark
  • Snowflake
  • Databricks
  • Airflow

Key Responsibilities

  • Contribute to maintaining, updating, and expanding existing core data platform pipelines.
  • Build and maintain APIs to expose data to downstream applications.
  • Develop real-time streaming data pipelines.
  • Work with technologies such as Airflow, Spark, Databricks, Delta Lake, and Snowflake.
  • Collaborate with product managers, architects, and engineering teams to enhance the core data platform.
  • Develop and document internal and external standards, including pipeline configurations, naming conventions, and best practices.
  • Ensure the reliability, efficiency, and quality of core data platform datasets while meeting SLAs and supporting Engineering, Data Science, Operations, and Analytics teams.

Required Qualifications

  • 5+ years of experience in data engineering, building and maintaining large-scale data pipelines.
  • Proficiency in at least one programming language such as Python, Java, or Scala.
  • Hands-on production experience with distributed processing frameworks like Spark.
  • Experience with workflow orchestration tools such as Airflow.
  • Experience with at least one major MPP or cloud data platform, such as Snowflake, Databricks, or BigQuery.
  • Experience developing APIs using GraphQL.
  • Strong understanding of OLTP and OLAP environments.
  • Solid background in distributed data processing, software engineering for data services, or data modeling.

Additional Information

  • A background check is required as part of the hiring process.

Benefits

  • Three medical insurance plan options for employees and eligible dependents.
  • Dental insurance.
  • 401(k) retirement plan.
  • Overtime eligibility.
  • Sick leave accrued in accordance with applicable state laws (California employees accrue 1 hour for every 30 hours worked, up to 48 hours).
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...