Search

Data Engineer

PublishedPublished: 6/14/2022
Technology

Job Description

Must-Have Skills & Experience:

\n

    \n
  • Strong hands-on experience as a Data Engineer.
  • \n

  • Strong proficiency in Python.
  • \n

  • Experience building and maintaining large-scale Apache Spark pipelines on AWS.
  • \n

  • Strong knowledge of the modern AWS Data Lake ecosystem, including:
  • \n

  • Amazon S3
  • \n

  • AWS Glue Data Catalog
  • \n

  • Amazon Athena
  • \n

  • Amazon EMR
  • \n

  • Amazon Redshift
  • \n

  • Experience designing and implementing reliable data ingestion, transformation, and validation pipelines at scale.
  • \n

  • Strong understanding of Data Lake architecture and best practices.
  • \n

\n


\n

Differentiator / Preferred Experience:

\n

    \n
  • Hands-on experience with AWS Lake Formation permission models.
  • \n

  • Experience designing and testing:
  • \n

  • Row-level security
  • \n

  • Column-level filtering
  • \n

  • LF-TBAC (Tag-Based Access Control)
  • \n

  • Experience designing and validating end-to-end Data Lake permission models.
  • \n

  • Strong experience in test design, validation, and troubleshooting for large-scale data platforms and access-control models.
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...