Hadoop Developer

Job Description

Role : Kafka, Redis and Hadoop Developer

\n

Location: Pennington, NJ (4 Days office)

\n

\n

\n

Primary Skill: Kafka, Redis, Hadoop, PySpark

\n

Secondary: Python

\n

Experience: Minimum 9 years

\n

\n

Roles & Responsibilities

\n

\n

\n
• Bachelor’s or master’s degree in science or engineering, or a related field.

\n

• Minimum of 5 years of industry experience, with at least 3 years focused on hands-on work in Big Data and real-time data processing technologies.

\n

• Proficiency in real-time streaming technologies like Kafka (KStreams, KTable)

\n

• Proficiency in Hadoop and PySpark

\n

• Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase.

\n

• Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting.

\n

• Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications.

\n

• Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures.

\n

• Experience with additional real-time streaming technologies like Flink or Storm.

\n

• Familiarity with Cloud Technologies such as Azure, AWS, or GCP.

\n

• Working knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models.

\n

• Proficiency in Data Integration and Data Security within real-time and Big Data ecosystems, including knowledge of Kerberos.

\n

• Strong command of Visual Analytics Tools, with a focus on Tableau.

\n