About the role
Lead and deliver large‑scale big data initiatives for financial services clients, designing and implementing Hadoop‑based solutions, data ingestion pipelines, and data quality improvements while collaborating with multidisciplinary consulting teams across APAC.
ConsultingOnsite
Key Responsibilities
- Participate in large‑scale client engagements and potentially lead delivery of innovative big data solutions
- Gather and translate business and technical requirements into big data engineering designs
- Conduct data discovery, root‑cause analysis, and recommend remediation for data quality issues
- Design, build, install, configure, and support Hadoop‑based applications and components
- Develop and maintain data ingestion pipelines using tools such as Kafka, Flume, Sqoop, and ETL platforms (Talend, Informatica, AWS Glue, Azure Data Factory)
- Create and optimize HiveQL queries and workflows using Oozie
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- Minimum 6 years of relevant experience in big data engineering (9+ years considered for Senior Manager)
- Hands‑on experience with Hadoop ecosystem and Hadoop‑based components
- Proficiency in at least one programming language: Java, Python, C# or C++
- Experience with ETL tools (Talend preferred, Informatica, AWS Glue, Azure Data Factory)
- Strong knowledge of data ingestion tools (Kafka, Flume, Sqoop) and workflow schedulers (Oozie)