Software Engineer, AI i18n and Evaluations

About This Role

Google is seeking a Software Engineer to lead the i18n expansion for AI features, quality evaluations, and rater quality on Pixel and Android platforms.

Responsibilities

• Leading a research and development team for AI i18n expansion, quality evaluations, and rater quality.
• Creating auto-raters, ensuring metrics consistency, establishing benchmarks across features and products.
• Working with teams to design and align on appropriate quality and performance bar for AI launches.
• Crafting evaluation datasets, metrics, and pipelines to understand, evaluate, and optimize model behavior.
• Collaborating with AI feature teams and researchers to integrate new models into evaluation and benchmarks.
• Identifying opportunities, developing strategies, and leading roadmaps to scale capabilities across languages and locales.

Requirements

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products.
• 3 years of experience with software design and architecture.
• 5 years of experience in speech/audio, reinforcement learning, ML infrastructure, or another ML field.
• 5 years of experience in ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning).
• Experience working across US and Asia.
• Experience in on-device machine learning, mobile algorithms, large Language Model evaluations, data collection for ML, and Android development.