Senior Data Engineer (18 Months Contract)

About This Role

We are seeking a Senior Data Engineer with 6+ years of experience to build and maintain Illumina's unified data framework, pipelines, and tooling.

Responsibilities

• Design a common unified data framework for seamless integration of diverse sources.
• Create and optimize data pipelines for ingesting, processing, transforming, and storing large volumes of structured and unstructured data.
• Work closely with data scientists to translate their requirements into robust data models.
• Develop and maintain engineering tooling for data ingestion, quality monitoring, and governance processes.
• Troubleshoot and resolve data pipeline issues to ensure uninterrupted flow.
• Monitor performance, identify bottlenecks, and optimize data processing for efficiency.

Requirements

• Proficiency in Python, Scala, or Java for data processing.
• Solid understanding of data quality, governance, security, and lineage concepts.
• Strong ability to troubleshoot data-related issues effectively.
• Excellent communication and collaboration skills with cross-functional teams.
• Demonstrated passion for data engineering, automation, and continuous learning.