Job Description
Job Description
ComResource is looking for a Senior Data Engineer.
Responsibilities:
Software Development
- Implement high-quality software features and components for complex software solutions, including the responsible use of agentic coding tools to enhance productivity, maintainability, and software quality.
- Lead sizing and complexity evaluation discussions for initiatives.
- Troubleshoot complex software, application, and performance issues through analysis, testing, benchmarking, and root-cause investigation.
- Guide and mentor peers in engineering best practices, including automated testing, code reviews, documentation, and secure coding standards.
Testing & Quality Assurance
- Follow and implement test practices covering all layers of the application, including unit, system, end-to-end, security, performance, regression, and automation testing.
- Implement QA processes such as code review and static analysis.
- Coach junior team members on testing techniques including TDD, BDD, and testing for positive and negative scenarios.
Data Management
- Design and implement scalable data ingestion and processing solutions supporting analytical and operational workloads.
- Apply data modeling, schema design, query optimization, and database performance tuning techniques for relational database systems.
- Design solutions that address data quality, idempotency, late-arriving data, scalability, and maintainability requirements.
Infrastructure & Integrations
- Design and support cloud-native solutions leveraging AWS technologies including MWAA (Apache Airflow), Glue, Lambda, SQS, S3, EKS (Kubernetes), Aurora PostgreSQL, and Redshift.
- Manage infrastructure using IaC, including Terraform.
- Build and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
- Establish advanced monitoring, alerting, and logging solutions for infrastructure.
- Design systems for high availability, load balancing, and disaster recovery.
Operations
- Support production systems through deployment activities, monitoring, incident response, troubleshooting, and operational improvements.
- Collaborate with partner teams to improve platform stability, performance, and scalability.
- Utilize techniques like blue/green deployments to minimize user impact.
- Participate in on-call support processes as needed.
Security & Compliance
- Develop software with a security-first mindset using knowledge of standard security protocols, common security risks, secure coding techniques, and appropriate usage and protection of sensitive information including PHI.
- Proactively design secure code employing best practices and threat modeling.
- Implement secure integration methods and data-transfer protocols including TLS, SFTP, PGP, and equivalent technologies.
Requirements & Design
- Collaborate with technical and business stakeholders to design appropriate systems based on business needs and technical constraints.
- Write detailed technical stories and technical epics.
- Define and manage tech debt and coordinate non-functional requirements.
- Translate business needs into practical technical solutions that balance functionality, maintainability, scalability, and delivery timelines.
Essentials:
- Bachelor's degree or equivalent work experience in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, or IT.
- 7+ years of software engineering experience.
- High level of experience with Python and strong experience with at least one other programming language; TypeScript and/or Java preferred.
- Experience with cloud computing platforms and infrastructure as code with heavy use of MWAA (Apache Airflow), Glue, Lambda, SQS, S3, and EKS (Kubernetes).
- High level of experience with SQL relational database management systems, including database design, data modeling, and query optimization; PostgreSQL preferred.
- Experience with non-relational databases and messaging systems.
- Experience with standard service and software deployment patterns and CI/CD systems such as GitHub Actions or Concourse.
- High level of experience developing, deploying, and supporting REST services and microservices.
- Excellent written and verbal communication skills.
Req ID: CG388269910