ETL Engineer

As an ETL Engineer, you will be responsible for designing, developing, and maintaining the ETL processes that support our data infrastructure. You will work with various teams to gather data from multiple sources, transform it into usable formats, and load it into data warehouses and databases. The ideal candidate will have experience in ETL development, data integration, and a deep understanding of data systems and workflows.

Key Responsibilities:

• Design and develop ETL workflows to extract data from various data sources (databases, APIs, flat files, etc.), transform it as needed, and load it into data warehouses or other storage solutions.
• Optimize ETL processes for efficiency, scalability, and error-free execution.
• Develop data validation routines to ensure data accuracy and integrity during extraction, transformation, and loading.
• Work closely with data analysts, data scientists, and business stakeholders to understand data needs and integrate data from various internal and external sources.
• Create seamless and automated data pipelines for real-time or batch data processing.
• Develop and implement transformation logic to convert raw data into usable formats for analysis.
• Ensure data quality by implementing cleansing and validation processes to guarantee consistency and reliability.
• Collaborate with data engineers and database administrators to manage and optimize databases and data warehouses.
• Ensure the ETL process is tightly integrated with data warehouse architecture to maintain consistency and improve performance.
• Monitor ETL processes to ensure timely data loads and troubleshoot any issues or failures in the ETL pipeline.
• Proactively identify bottlenecks and recommend performance improvements to ETL processes.
• Maintain clear documentation on ETL processes, data flows, and transformation logic for future reference.
• Prepare regular reports and communicate the status of ETL workflows, including identifying potential risks and suggesting mitigation strategies.

*Position contingent upon Spring 2025 contract award*

Required Skills & Qualifications:

• TS/SCI with Polygraph level clearance is required.
• BA/BS and 8+ years of experience; Masters and 6+ years of experience; an additional four years of experience may be considered in lieu of degree.
• Proven experience as an ETL Engineer, Data Engineer, or in a similar data engineering role.
• Strong knowledge of ETL tools and frameworks (e.g., Apache NiFi, Talend, Informatica, Microsoft SSIS, Apache Airflow, etc.).
• Proficiency in SQL and experience working with relational databases (e.g., MySQL, PostgreSQL, Oracle).
• Experience with cloud-based data platforms (AWS, GCP, Azure) and data warehouse solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake).
• Experience in scripting languages such as Python, Shell, or Bash.
• Strong understanding of data integration, data transformation, and data quality practices.
• Familiarity with version control systems (e.g., Git).

Preferred Skills & Qualifications:

• Experience with real-time data processing and streaming technologies (e.g., Apache Kafka, AWS Kinesis, etc.).
• Familiarity with data governance and compliance requirements (e.g., GDPR, HIPAA).
• Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data systems.
• Experience with automation tools and CI/CD pipelines for ETL processes.
• Strong analytical and problem-solving skills with attention to detail.
• Ability to work collaboratively in a team environment and communicate effectively with non-technical stakeholders.