AI Engineer - Microsoft specialized clouds - Edge AI group
Herzliya | Software Engineering | Dec 01, 2025 | Job number 200011669


Overview

The Microsoft specialized clouds - Edge AI group is responsible for bringing AI to customers that want to manage their AI workload on premises using Azure Arc technologies. Working on the on Prem appliances requires the team to work across various hardware configurations, optimize AI for different hardware categories, connect AI to data sources in order to provide the right context for the AI to the customers’ business needs and more.   

Individual contributors in the team get a chance to impact the industry working across various areas, our data science team leads research and implementation of AI components and SOTA models, ideation, design to production and delivery to the customer. Being at the center of innovation provides great opportunities for engineering excellence in an amazing work environment in a team that will allow you to develop, grow, and contribute.  



Responsibilities

We are looking for AI Engineer to join the Data Science team. 

As an AI Engineer in the Data Science team, you will be working closely with applied researchers on model optimizations, GPU and hardware, language-model optimizations in the Video and Language domains and more. Your code will reach Azure resources and extensions, and you will use various technology stacks with the latest tools and methodologies. You will be expected to break down problems, learn and develop, have an open mind, and have ownership all the way to production. Working in a multi-disciplinary team will require excellent communication skills and at the heart of it all, alignment with Microsoft values and endless curiousness. 



Qualifications

Required: 

  • B.Sc. in Computer Science or equivalent  

  • 4+ years of experience with SW development using Python, C# or Java. 

  • Experience with AI models and Kubernetes 

  • Experience with developing and operating code in the cloud on Azure / AWS / GCP  

Preferred:  

  • Master's degree in computer science or equivalent 

  • Experience in GPU programming and GPU-accelerated ML workflows, including model optimization and debugging on GPU hardware 

Other 

  • Ability to build tools and infrastructure to improve shipping and ensure software quality 

  • Strong ability in code and solution design, creating modular and reusable solutions in both code and AI infrastructures 

  • Able to lead complex tasks in unknown territories independently and bring them to production 

  • Skills to leverage AI in coding, testing, and building automations using tools like GitHub Copilot Agent, Cursor, Claude Code, Cline etc.  

  • Demonstrated ability to think creatively and out of the box 

#MSCIL

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.




Make
your
mark