About the role
This Senior Data Engineer role focuses on designing and maintaining the APJ regional data analytics platform for AWS Sales Insights. The position involves building robust data pipelines, data lakes, and ETL processes to support strategic business decisions across the Asia Pacific and Japan region.
TechnologyOnsiteCorporate Operations
Key Responsibilities
- Own the design, development, and maintenance of the APJ SIADS' data analytics platform, including data pipelines, data lakes, and analytical and visualisation platforms
- Build and maintain APJ-specific data models and pipelines, ensuring alignment between worldwide definitions and APJ business logic
- Design and maintain the backend data infrastructure for end-user last-mile analytics tools, implementing ETL processes that ensure data is clean, fresh, and optimised
- Develop monitoring capabilities for data quality and query performance to keep platforms reliable and responsive
- Collaborate on the design and delivery of metrics, reports, analyses, and dashboards that drive key business decisions across APJ
- Ensure pipelines and data products meet the requirements of field teams across key verticals and business units
- Maintain compliance with information security policies and data governance standards for all infrastructure and software used by the team
Requirements
- 8+ years of data engineering experience
- Strong written and verbal communication skills
- Competent in performing data transformation using SQL
- Experienced in managing and maintaining data pipelines
- Proficient in cloud computing platforms (e.g., AWS)
- Experienced in Infrastructure-as-Code (e.g., Terraform, CloudFormation, CDK)
- Skilled in designing system solutions at scale
- Knowledgeable in Apache Spark for large-scale data workloads
- Proficient in serverless ETL using AWS Glue for data ingestion, transformation, and cataloguing
- Skilled in automating data quality validation to detect anomalies and enforce data integrity