Big Data Platform Administrator

Job Description

\n

Title: Spark, HDFS, and Kafka Administrator/Engineer

\n

Location: Hybrid (4 days on site - Jersey City, NJ)

\n

Duration: 6-12 Month + contract

\n

Pay: 70-80 H/R W2

\n

\n

\n
• Minimum of 3 years of hands-on experience maintaining and supporting enterprise big data environments utilizing Apache Spark, HDFS, and Kafka in production.

\n

• Proven ability to manage Spark environments, including system setup, workload optimization, performance monitoring, and resolving technical issues.

\n

• Strong background supporting HDFS, with experience managing distributed storage, access controls, system availability, and performance.

\n

• Practical experience administering Kafka, including cluster operations, topic configuration, message processing, security, and troubleshooting.

\n

• Proficiency working in Linux environments, including executing commands, investigating system issues, and performing administrative tasks.

\n

• Familiarity with monitoring and troubleshooting platforms such as Grafana, Splunk, or comparable enterprise tools.

\n

• Working knowledge of Cloudera CDP, Hadoop, and Cloudera Manager is a plus, although direct expertise with Spark, HDFS, and Kafka takes priority.

\n

• Relevant certifications in Cloudera or other big data technologies are beneficial but not mandatory.

\n

• Understanding of distributed platform security, including Kerberos, SSL/TLS, IAM, and LDAP authentication and access management.

\n

\n