Director, Product Manager - Agentic AI Platform
Kyndryl
Who We Are
At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.
The Role
Kyndryl is at the forefront of AI innovation, building cutting-edge platforms that empower enterprises to leverage the full potential of artificial intelligence. We believe in creating intelligent, autonomous systems that redefine productivity and problem-solving. Join a dynamic team where your contributions directly shape the future of AI. We are looking for a skilled AI/ML Prompt Engineer to design, develop, and deploy advanced generative AI models that power a platform for creating business applications. You’ll work at the intersection of AI innovation and practical application, building intelligent systems that automate app generation, enhance user customization, and solve real-world business challenges. Collaborating with architects, developers, and product teams, you’ll bring cutting-edge AI capabilities to life in a scalable, production-ready environment.
Key Responsibilities:
Build, train, and fine-tune generative AI models (e.g., LLMs, GANs, VAEs) to support features like automated code generation, UI design, workflow creation, or data synthesis.
- Collaborate with the software architect to integrate AI models into the platform via APIs, ensuring seamless interaction with backend and frontend systems.
- Design and optimize data preprocessing pipelines to prepare high-quality datasets for training and inference, tailored to business application needs.
- Enhance model efficiency (e.g., latency, memory usage) for real-time or near-real-time application generation, using techniques like quantization or pruning.
- Research and experiment with state-of-the-art GenAI techniques to improve platform capabilities, such as natural language understanding, image generation, or predictive analytics.
- Rigorously evaluate model outputs for accuracy, relevance, and robustness, ensuring generated applications meet user expectations and industry standards.
- Work with DevOps to deploy AI models into production, leveraging cloud infrastructure (e.g., AWS, Azure, Google) and containerized environments (e.g., Kubernetes, EKS, AKS, GKE).
- Implement monitoring tools to track model performance and drift in production, iterating based on real-world feedback.
Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.
Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.
Required Skills and Experience
- 4+ years in AI/ML engineering, with at least 1-2 years focused on generative AI models or similar technologies.
- Strong proficiency in Python and AI/ML frameworks (e.g., TensorFlow, PyTorch, Hugging Face).
- Experience with model training, fine-tuning, and deployment in production environments.
- Familiarity with cloud AI platforms (e.g., AWS AgenticAI, Google AI Platform, Azure AI Foundry) and distributed computing.
- Knowledge of data engineering tools (e.g., Pandas, Spark) and version control (e.g., Git).
- Hands-on experience with generative models (e.g., GPT, Stable Diffusion, BERT) and their application in automation, content creation, or predictive tasks.
- Ability to tackle complex challenges, from dataset biases to model scalability, with creative and practical solutions.
- Capable of explaining AI concepts and trade-offs to technical and non-technical team members.
- Design, develop, and iterate on prompts to elicit optimal responses from AI models for various use cases.
- Analyze AI outputs to identify patterns, biases, or inconsistencies and adjust prompts accordingly.
- Master’s degree or PHD in Computer Science, Data Science, Mathematics, or a related field (or equivalent experience).
Preferred Skills and Experience
- Experience with low-code/no-code platforms or business application development.
- Background in natural language processing (NLP) or computer vision, depending on platform focus.
- Familiarity with reinforcement learning or prompt engineering for LLMs.
- Contributions to AI research, open-source projects, or a portfolio of GenAI work.
Why Join Us
Work on the next frontier: build data infrastructure for Agentic AI, a transformative technology.
Startup energy and enterprise scale: agile innovation backed by global resources.
Direct impact: your work enables AI-native transformation at enterprise scale.
Career Growth: Opportunity to lead and innovate in data engineering for AI systems.
Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement.
There is a different applicable compensation range for the following work locations:
California: $190,560 to $395,040
Colorado: $173,280 to $329,280
New York City: $207,840 to $395,040
Washington: $190,560 to $362,160
Washington DC: $190,560 to $362,160
This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off. Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.
Applications will be accepted on a rolling basis.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Being You
Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.
What You Can Expect
With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.