Senior AI engineer

About the job

At KPMG Israel, our Generative AI delivery team leads the market in advanced AI solution delivery. We work across the full spectrum of Generative AI technologies—from large language models and multimodal architectures to autonomous agent systems and production-scale machine learning platforms.

Our work combines advanced engineering with strategic advisory capabilities, delivering AI-driven solutions that create measurable business value for leading organizations.

About the Role

We're looking for a hands-on Senior AI Engineer to provide technical leadership within our Generative AI team.

This role is designed for engineers who enjoy combining deep hands-on development with technical leadership. You'll drive technical decisions, shape solution architecture, mentor engineers, and help define engineering best practices while remaining actively involved in designing and building production-grade AI solutions.

Working closely with customers and multidisciplinary teams, you'll help transform complex business challenges into scalable AI systems that deliver measurable business value.

What You'll Do

• Lead the technical design and delivery of end-to-end GenAI solutions, from architecture through production deployment.
• Design, build and maintain production-grade AI applications and backend services using Python.
• Develop LLM-powered solutions, including retrieval-based architectures, AI agents and orchestration workflows.
• Drive architecture decisions for prompt engineering, retrieval pipelines and model evaluation.
• Translate business requirements into scalable AI architectures and technical solutions.
• Provide technical leadership through design reviews, code reviews and engineering mentorship.
• Contribute to engineering standards, best practices and technical excellence across projects.
• Evaluate emerging AI models, frameworks and technologies, incorporating them into production solutions where appropriate.

Requirements

What We're Looking For

• 3+ years of experience in Software Engineering, Machine Learning, Data Science or related AI roles.
• Hands-on experience building and deploying production AI applications using LLMs and Generative AI technologies.
• Strong Python development skills.
• Experience with GenAI techniques such as RAG, AI agents, prompt engineering, model evaluation or similar approaches.
• Experience working with leading LLM providers (OpenAI, Anthropic, Cohere or open-source models).
• Experience working with cloud platforms (AWS, Azure or GCP) and familiarity with MLOps practices.
• Demonstrated technical leadership through architecture ownership, technical decision-making, or mentoring other engineers.

Important Note

This is a hands-on technical leadership role. We're looking for engineers who enjoy taking ownership, influencing technical direction and helping other engineers succeed while continuing to build production AI systems. A formal Tech Lead title isn't required. We're interested in engineers who have demonstrated technical leadership through the systems they've built, the technical decisions they've driven and the engineers they've mentored.