Job Description
Job Description
Job Description
Onsite IT Advisors LLC is seeking a skilled and motivated Data Engineer to join our growing technology team.
The ideal candidate will have hands-on experience designing, developing, and maintaining scalable cloud-based data solutions. This position focuses on building efficient data pipelines, optimizing data storage systems, and transforming complex datasets into reliable, analysis-ready information.
You will work closely with technical teams, data analysts, and business stakeholders to develop solutions that support reporting, business intelligence, advanced analytics, and data-driven decision-making.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines to collect, process, and integrate data from multiple sources.
- Develop and optimize cloud-based data warehouses, data lakes, and other storage solutions to support large-scale analytics.
- Build automated workflows for extracting, transforming, validating, and loading structured and unstructured data.
- Perform SQL and NoSQL database testing, data quality checks, troubleshooting, and post-deployment validation.
- Collaborate with developers, analysts, and stakeholders to understand business requirements and translate them into technical solutions.
- Develop Python scripts and SQL queries for data extraction, transformation, processing, and automation.
- Monitor and improve data pipeline performance, reliability, scalability, and efficiency.
- Work with distributed data processing technologies to manage and transform large datasets.
- Identify and resolve data integration issues, schema inconsistencies, and processing errors.
- Support the development and maintenance of cloud-based data platforms and analytics infrastructure.
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Minimum 3 years of experience in data warehouse development.
- Minimum 3 years of experience analyzing and integrating data from multiple sources within cloud-based environments.
- Minimum 2 years of experience developing and maintaining scalable data storage solutions for large-scale analytics.
- Strong proficiency in SQL and Python for data retrieval, processing, and transformation.
- Hands-on experience developing ETL/ELT pipelines using cloud-based technologies.
- Experience with Cloudera, Hadoop, or related big data processing technologies.
- Experience using generative AI-assisted coding tools to support software development.
- Knowledge of backend SQL and NoSQL database testing, data validation, and post-deployment testing.
- Strong analytical, problem-solving, and communication skills.
- Ability to work effectively with cross-functional technical teams.
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination, as required for the position.
- Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder).
Preferred Qualifications
- Experience with AWS services, including AWS Glue, AWS Athena, and Amazon Redshift.
- Familiarity with PostgreSQL, MySQL, or Snowflake.
- Experience with distributed processing technologies such as Apache Spark, Databricks, Apache Hive, AWS EMR, or Apache Kafka.
- Knowledge of real-time data processing and streaming architectures.
- Experience with NoSQL databases such as MongoDB or Cassandra.
- Familiarity with UNIX/Linux environments and shell scripting.
- Understanding of Agile software development methodologies.
- Experience working in collaborative, cross-functional engineering environments.
What We're Looking For
We are looking for a detail-oriented Data Engineer who enjoys solving complex data challenges, developing reliable cloud-based solutions, and improving data processing efficiency.
The successful candidate will demonstrate strong technical expertise, adaptability, and the ability to work independently and collaboratively in a fast-paced environment.
How to Apply
Interested candidates are encouraged to apply with an updated resume highlighting their experience in data engineering, SQL, Python, cloud technologies, and ETL/ELT development.
Onsite IT Advisors LLC is an Equal Opportunity Employer. We consider qualified applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, or other legally protected characteristics.