Senior Software Engineer - Machine Learning

Job Description:

Your opportunity

At New Relic, we empower our customers with real-time insights to accelerate innovation. Our observability tools provide deep visibility into various technologies and distributed systems, enabling software engineering teams to proactively address issues, optimize performance, and enhance their infrastructure.

Join our Cloud Platform team to develop state-of-the-art cloud platforms and services that securely process over 2 billion telemetry events per minute across multi-cloud environments. We are seeking a Senior Software Engineer specializing in AI/ML to contribute to our expansion into AI and ML technologies, with a focus on Generative AI. This role involves implementing innovative Generative AI solutions that generate dynamic content, support automated decision-making, enhance anomaly detection, and deliver predictive analytics, transforming how businesses interact with data. You will collaborate with team leads to address complex technical challenges and participate in cross-team initiatives.

This position offers an excellent opportunity to advance your career, enhance your technical skills, and deepen your expertise in Generative AI and cloud technologies. The ideal candidate will have experience in AI infrastructure, particularly in Generative AI applications, and a demonstrated ability to solve challenging technical problems in today's digital landscape.

What you'll do

• Implement Generative AI Solutions: Develop and implement generative AI capabilities within the Cloud Platform team, focusing on content creation, decision-making processes, and predictive analytics
• Execute on Team Objectives: Work toward clear team objectives with a focus on project outcomes, system architecture optimization, and developer productivity
• Analyze Data and Improve Systems: Conduct rigorous data analysis to deliver substantial improvements and refine strategic approaches
• Develop AI Integration Components: Build components of a comprehensive generative AI SDK, integrating Large Language Models like OpenAI and Google AI with programming languages such as Python, Java, and Go
• Build Scalable AI Systems: Design and implement highly scalable, resilient AI solutions capable of handling significant volume and maintaining performance at scale
• Collaborate Across Teams: Work effectively across multiple teams to ensure technical initiatives meet high standards and integration requirements
• Build AI Prototypes: Develop AI Proof of Concepts and contribute to Minimum Viable Products (MVPs) supporting multiple business domains
• Support Technical Excellence: Participate in code reviews, technical discussions, and knowledge sharing to maintain high engineering standards

This role requires

• 4+ years of professional work experience in software development and/or operations
• Proficient coding skills in Python, Java, or Go with experience using AI-focused libraries such as TensorFlow, PyTorch, Hugging Face Transformers, or similar frameworks
• Experience with cloud platforms that support deploying and scaling AI models and RAG knowledge bases
• Strong background in designing and implementing scalable, distributed systems that can handle high throughput and maintain reliability
• Experience with containerization (Docker), orchestration (Kubernetes), and microservices architecture
• Knowledge of database optimization, caching strategies, and data storage solutions for large-scale applications
• Skills in working with large datasets and implementing data processing pipelines for AI model training and fine-tuning
• Practical experience applying generative techniques in applications such as content creation, data augmentation, or anomaly detection
• Experience with enterprise AI services including OpenAI, AWS Bedrock, or equivalent platforms, with knowledge of NLP, Search, and AI Infrastructure
• Solid understanding of generative models, including Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Large Language Models (LLMs)
• Ability to understand how AI initiatives align with business goals and outcomes

Bonus points if you have

• Experience with recommender systems or ranking models that enhance user experiences
• Familiarity with AI accelerator architectures
• Background in platforms and tools such as Azure Semantic Kernel, Google's Vertex AI, or other machine learning technologies
• Experience with stream processing frameworks (Kafka, Kinesis) for real-time data processing
• Experience with auto-scaling systems and infrastructure-as-code practices
• Knowledge of observability tools and performance monitoring for large-scale AI systems
• Experience with LLM customization or fine-tuning techniques
• Previous work with MLOps practices and tools
• Contributed to open-source AI frameworks or projects

Please note that visa sponsorship is not available for this position.

The pay range below represents a reasonable estimate of the salary for the listed position. This role is eligible for a corporate bonus plan. Pay within this range varies by work location and may also depend on job-related factors such as an applicant’s skills, qualifications, and experience.

New Relic provides a variety of benefits for this role, including healthcare, dental, vision, parental leave and planning, and mental health benefits, a 401(k) plan and match, flex time-off, 11 paid holidays, volunteer time-off, a discounted employee stock purchase plan, and other competitive benefits designed to improve the lives of our employees.

Estimated Base Pay Range: $157,000 - $212,000 USD