Job Description
Hiring: Lead Data Engineer – GCP
\n
Location: Charlotte, NC
\n
Employment Type: W-2 only
\n
Work Authorization: Must be authorized to work in the United States.
\n
We are seeking an experienced Lead Data Engineer with strong GCP and Big Data expertise to design and deliver scalable data solutions supporting banking, financial crimes, and Anti-Money Laundering (AML) platforms.
\n
\n
Key Responsibilities
\n
- \n
- Design, develop, and optimize large-scale data pipelines for ingestion, transformation, and analytics.
- Build event processing pipelines using Kafka or GCP Pub/Sub.
- Develop and optimize SQL queries and data models for performance and scalability.
- Orchestrate data workflows using Airflow and implement reliable processing solutions using Spark and Dataproc.
- Improve engineering practices through automation, testing, CI/CD, and resilient system design.
- Collaborate with product and cross-functional teams to deliver financial crimes compliance solutions.
- Identify opportunities to improve pipeline reliability, efficiency, and maintainability.
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Qualifications
\n
- \n
- 5+ years of hands-on software development experience with Big Data and Analytics solutions.
- Strong experience with GCP services, including BigQuery, Dataproc, and Pub/Sub.
- Hands-on experience with Airflow, Hadoop, Hive, Spark, Python, and shell scripting.
- Strong SQL skills and experience designing scalable data models.
- Experience with Kafka or Pub/Sub for event-driven data processing.
- Understanding of distributed systems, relational databases, object-oriented programming, and design patterns.
- Experience with Git/GitHub, Jenkins, CI/CD pipelines, and automated testing frameworks.
- Familiarity with Agile/Scrum and software development lifecycle practices.
- Strong problem-solving, communication, and collaboration skills.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- GCP Professional Data Engineer certification.
- Experience supporting banking, financial crimes, or AML platforms.
- Familiarity with enterprise Big Data frameworks and release automation tools such as XLR.
\n
\n
\n
\n
Interested candidates: Please share your resume for consideration.