About the role
The Databricks Data Engineer (Senior Associate) focuses on designing and implementing scalable, high-performance data pipelines and platforms within EY's Technology Consulting practice. The role involves translating complex business requirements into technical designs across Azure, AWS, and GCP cloud environments, leveraging deep expertise in Databricks and modern data engineering practices.
ConsultingOnsite
Key Responsibilities
- Design data pipelines with scalability, high performance and resilience in-built
- Code complex requirements as part of large complex data platforms - develop, refine, and implement high quality delivery executions
- Deliver project deployments on public clouds and highly secure environments
- Integrate with data governance tools, ecosystem products across the cloud landscape
- Understand the business requirements and translate into high-level and low-level designs to successfully meets the business objectives
- Collaborate with stakeholders, presenting findings to a non-technical audience
- Bring in best practices for coding and building modular data engineering code that can be reused
- Stay current with technical and industry developments and standards to ensure effective and advanced applications of data analysis techniques and methodologies, including AI integrations
Requirements
- Min Bachelor's degree in Computer science, Mathematics, Engineering, Statistics, or a related field
- Databricks certifications, Azure certifications on data engineering
- At least 4 years of experience on various data platform solutions across data and analytics across the entire SDLC
- Atleast 2 years' experience on designing and mapping requirements to technical capabilities of data pipelines on databricks across Azure, AWS or GCP cloud
- Proficiency in programming leveraging Python, Spark, Scala and other programming languages
- Understanding of end-to-end data analytics domain and insights delivery
- Excellent understanding of data modelling techniques and leading trends on data platforms including AI
- Possess strong problem-solving, analytical and strategic thinking abilities
- Proficiency with agile boards like JIRA, Atlassian products
- Must have hands-on experience with ELT, data pipeline and orchestration tools
- Experience in end-to-end technical project delivery following agile delivery methodologies
- Experience in estimation, infrastructure sizing for data platform solutions