Tech Jobs for Talents without Borders
English-1st. Relocation-friendly. Curated daily by Imagine.
5,280 Jobs at 194 Companies

Senior Product Manager



This job is no longer accepting applications

See open jobs at Microsoft.
Redmond, WA, USA
Posted on Monday, February 12, 2024
Are you passionate about driving exponential growth for Azure Artificial Intelligence (AI) by building a vibrant ecosystem of Large Language Models (LLMs) and Generative AI tools? Do you like solving difficult multi-faceted problems involving stakeholders across business development, planning, finance, marketing, marketplace and engineering? Come join our team as a Senior Product Manager!

Our team builds the AI inferencing platform that powers the CoPilot stack of GitHub and Bing Chat and enables thousands of Azure customers to harness the power of Generative AI with frontier LLMs like OpenAI and Llama. Our ambition is to make Azure AI the best platform for Generative AI developers. One of our goals is to offer all the frontier LLMs from major model providers in the Generative AI space. We are defining the architecture so that LLM providers can host and monetize their models on Azure AI. This involves defining hosting capabilities for model providers, integrating with Azure Marketplace for monetization and most importantly, building intuitive experience for discovering, deploying, and inferencing models to build Generative AI apps for Azure users.

We are looking for a Senior Product Manager who can conceptualize, spec and launch the LLM Model Provider offering in Azure AI. You will need a sound understanding the Generative AI tools and LLMs, both from the lens of a data scientist training or finetuning models and from the lens of a developer who uses LLM application programming interfaces (APIs) to build Generative AI apps. We are looking for someone who understands what it takes to host and run LLMs, including the inference containers and finetuning, so that you can work with model providers to define the publishing experience. You must be well versed with latest Generative AI tools like LangChain and concepts such as Retrieval Augmented Generation (RAG) so that you can define a compelling experience for using models. Understanding monetization through marketplace is a bonus. Not only are publishing and consumption experiences essential, but the ability to allow partners to monetize models is equally important. You will draw upon your experience of handing ambiguous situations and conflicting requirements and make well-reasoned tradeoffs to drive clarity across different stakeholders. Relentless persuasion and influencing with leadership will be essential to your success.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.


  • Take your deep technical and product expertise and combine it with your understanding of our customers' needs to solve their complex business challenges by advancing the capabilities of Azure AI.
  • Join a high-performing team to deliver and improve world-class product experiences.
  • Champion and advocate for our customers in evolving their experience with Azure AI and ability to use the product to solve business challenges.
  • As a member of the product engineering team, you will use your skills to improve our services, based on customer feedback and insights gained while supporting them.
  • Create an inclusive work environment where every employee can effectively engage and wants to be part of the team.
  • Other: Embody our Culture and Values


Required/Minimum Qualifications:

  • Bachelor’s Degree AND 5+ years experience in product management
    • OR equivalent experience.
  • 5+ years of experience designing and shipping complex products for developers, Machine Learning (ML) professionals, or similar
  • 2+ years of experience with distributed platform ecosystem (multi-tenant / real-time processing, batch computing etc.)
Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications

  • Experience creating solutions using Azure, AWS, or Google Cloud
  • Experience writing Python, particularly for machine learning
  • Experience with ML platforms
  • Effective at driving complex multi-stakeholder processes and cross-team programs
  • Ability to build effective relationships, influence and collaborate at all organizational levels
  • Verbal and written communications skills for a global audience
  • Proven business acumen, analytical and detail-oriented

Product Management IC4 - The typical base pay range for this role across the U.S. is USD $112,000 - $218,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $145,800 - $238,600 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:



Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

This job is no longer accepting applications

See open jobs at Microsoft.