Sr. AI Engineer

Job Description:

Zylo is the enterprise leader in SaaS Management, enabling companies to discover, manage, and optimize their SaaS applications. Zylo helps companies reduce costs and minimize risk by centralizing SaaS inventory, license, and renewal management. Trusted by industry leaders, Zylo’s AI-powered platform provides unmatched visibility into SaaS usage and spend. Powered by the industry’s most intelligent discovery engine, Zylo continuously uncovers hidden SaaS applications, giving companies greater control over their SaaS portfolio. With more than 30 million SaaS licenses and $34 billion in SaaS spend under management, Zylo delivers the deepest insights, backed by more data than any other provider.

Overview

We are seeking an experienced Senior AI Engineer to lead the evolution of our enterprise SaaS platform's agentic AI capabilities. You'll drive strategic AI initiatives that solve complex client problems while working with large-scale datasets for global enterprise customers. This role combines deep technical expertise in AI agents, RAG systems, and enterprise integration with strategic thinking about how AI can transform our platform and deliver exceptional business value..

What you will do

• Drive strategic AI initiatives that directly impact client success and business growth, defining technical roadmaps and influencing product strategy to solve complex enterprise problems
• Architect and enhance our agentic processes for enterprise-scale deployments, building sophisticated multi-agent orchestration patterns for complex workflows
• Design advanced agent memory systems and context management solutions that maintain coherence across long-running conversations and extended enterprise tasks
• Build and implement RAG (Retrieval-Augmented Generation) systems to dramatically improve AI accuracy, including knowledge retrieval pipelines and semantic search optimization for large-scale datasets
• Develop enterprise-grade MCP (Model Context Protocol) services enabling seamless client agent integration with standardized APIs, security protocols, and comprehensive documentation
• Leverage AWS technologies (Bedrock, Lambda, etc) to architect AI solutions with optimal performance, cost efficiency, and enterprise-scale LLM integration
• Design and optimize schemas for storing LLM interactions, agent state, and conversation history while building monitoring systems for AI operations
• Lead cross-functional initiatives to integrate AI throughout our platform ecosystem, partnering with product and engineering teams to deliver measurable business value
• Translate complex technical AI concepts into business value, working directly with enterprise clients to understand their needs and influence strategic platform decisions
• Mentor engineering teams on AI best practices, emerging technologies, and enterprise AI governance while maintaining high engineering standards for production AI systems.

What you need

• Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, Mathematics, or a related field.
• 5+ years of experience in AI/ML engineering with at least 2 years in a senior role
• Proven experience building and deploying AI agents or conversational AI systems in production
• Experience working with large-scale enterprise datasets and SaaS platforms.
• Expertise in design patterns for memory systems and context management solutions and optimization for AI workloads
• Experience with Amazon Bedrock and AWS Lambda for serverless AI deployments
• Experience with RAG systems, vector databases, and semantic search
• Understanding of Model Context Protocol (MCP) and AI agent integration patterns
• Proficiency in programming languages such as Python, PySpark, SQL and ML frameworks such as TensorFlow, PyTorch.
• Knowledge of enterprise security patterns and compliance requirements
• Ability to articulate technical concepts to technical and non-technical stakeholders.
• Ability to thrive in a fast-paced, dynamic environment.
• Flexibility to adapt to changing priorities and requirements.

Nice to have

• Experience in SaaS Management or Software Asset Management.
• Ph.D. in Data Science, Computer Science, Statistics, Mathematics, or a related field.
• Knowledge of ethical AI, bias mitigation, and AI safety best practices
• Experience with LangChain and LangGraph frameworks

At Zylo, we’re committed to Growing Stronger Together by fostering a diverse and inclusive workplace. We believe that a variety of perspectives not only fuels innovation, but also allows us to better serve our diverse customer base. If you meet the essential qualifications, we encourage you to apply and join us on this journey. Still growing in your career? Connect with our talent community—we’re always looking for future Zylos who share our passion for continuous learning.