Job Description
Job Description: Google Cloud Platform (GCP) Data Engineer
\n
Location: Charlotte, NC – 300 S Brevard St
\n
Schedule: Hybrid
\n
Interview Process: In person Interview
\n
\n
Job Overview
\n
We are seeking a hands-on Google Cloud Platform (GCP) Data Engineer with strong experience developing real-time streaming data pipelines and cloud-based data processing solutions. The ideal candidate will have expertise in GCP services, Python, Apache Beam, Java, Spring Boot, and SQL, with a focus on building scalable, secure, and high-performance data pipelines.
\n
This is a specific use case requiring practical experience in real-time data streaming and Google Cloud data platforms. Candidates must demonstrate relevant hands-on experience rather than general cloud or data engineering knowledge.
\n
Key Responsibilities
\n
- \n
- Design, develop, and maintain scalable, secure data pipelines from on-premises systems to Google Cloud Platform.
- Build real-time streaming and batch data pipelines using GCP Dataflow, Pub/Sub, BigQuery, and Apache Beam.
- Develop reusable Python/Apache Beam transformation libraries for Slowly Changing Dimensions (SCD), data quality checks, and masking/tokenization.
- Design and develop high-performance Java applications using Java 8+, Spring Framework, and RESTful APIs.
- Implement real-time data ingestion and processing using Kafka and Google Cloud Pub/Sub.
- Develop and optimize SQL queries and data transformations in BigQuery.
- Build and maintain scalable microservices and integrate applications with cloud-based data platforms.
- Implement CI/CD pipelines using Jenkins, GitHub Actions, Gradle, and other DevOps tools.
- Perform coding, testing, debugging, deployment, and performance optimization.
- Document technical designs, data pipelines, and implementation solutions.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Qualifications
\n
- \n
- Hands-on experience with Google Cloud Platform, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
- Strong experience developing real-time streaming data pipelines.
- Proficiency in Python and Apache Beam for data processing and transformation.
- Strong Java development experience, including Java 8+, multithreading, Spring Framework, and RESTful APIs.
- Experience with SQL and data transformation.
- Knowledge of microservices architecture and cloud-native applications.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, and Gradle.
- Experience integrating on-premises data sources with GCP services.
\n
\n
\n
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- Experience with Cloud Composer and Cloud Functions.
- Exposure to Kafka-based streaming architectures.
- Experience implementing SCD patterns, data quality validations, and data masking/tokenization.
- Experience building reusable data processing frameworks and libraries.
\n
\n
\n
\n
\n