Staff Software Engineer, Gen AI

Company: DataRobot

About the Company: DataRobot delivers AI that maximizes impact and minimizes business risk. Their platform integrates into core business processes so teams can develop, deliver, and govern AI at scale — enabling both predictive and generative AI across global enterprises.

Job Category: Software Engineering / GenAI / MLOps / Infrastructure

Contract Type: Full-Time, Permanent

Location: Remote — Worldwide

Salary: Competitive (estimated $200,000–$280,000 for US-based candidates)

Application Link: https://www.remoteitjobs.app/job/datarobot-staff-software-engineer-gen-ai

Posted: May 11, 2026

Skills Required: Python, Kubernetes, Infrastructure as Code, Microservices, LLMs, Generative AI, Docker, AWS, Azure, GCP, GPU Clusters, CI/CD, REST APIs

Job Description: You'll join the GenAI team responsible for developing the core services and infrastructure that power DataRobot's Generative AI offerings, enabling customers to build, deploy, and manage cutting-edge AI solutions at enterprise scale.

Key Responsibilities:

• Build and scale core services and infrastructure powering DataRobot's GenAI product suite
• Develop LLM integration, RAG pipelines, and vector search infrastructure
• Work with GPU clusters and high-performance compute environments
• Implement CI/CD pipelines and cloud-native microservices across AWS, Azure, and GCP
• Collaborate with research and ML teams to take cutting-edge academic advances into production
• Design for reliability, observability, and scalability at global enterprise scale

Requirements:

• Strong Python and distributed systems engineering background
• Hands-on experience with Kubernetes, Docker, and cloud infrastructure across at least one major cloud provider
• Practical production experience with LLMs, generative AI, or ML infrastructure
• Experience with GPU cluster management or high-performance compute environments
• Strong communication skills and a collaborative approach across remote teams