Search

Spark Kafka/Kafka with Hadoop

PublishedPublished: 6/14/2022
Technology

Job Description

Role: Spark Kafka/Kafka with Hadoop

\n

Location: Pennington, NJ- Onsite

\n

Duration: Full Time

\n


\n

Job Description:

\n

Skill: Spark Kafka

\n


\n

Must Have Technical/Functional Skills:

\n

Primary Skil: Kafka

\n

Secondary: Redis, Python

\n

Experience: Minimum 9 years

\n


\n

Roles & Responsibilities:

\n

• Bachelor's or Master's degree in Science or Engineering, or a related field.

\n

• Minimum of 5 years of industry experience, with at least 3 years focused on hands-on work in Big Data and real-time data processing technologies.

\n

• Proficiency in real-time streaming technologies like Kafka (KStreams, KTable)

\n

• Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase.

\n

• Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting.

\n

• Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications.

\n

• Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures.

\n

• Experience with additional real-time streaming technologies like Flink or Storm.

\n

• Familiarity with Cloud Technologies such as Azure, AWS, or GCP.

\n

• Working knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models.

\n

• Proficiency in Data Integration and Data Security within real-time and Big Data ecosystems, including knowledge of Kerberos.

\n

• Strong command of Visual Analytics Tools, with a focus on Tableau.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...