[Remote] reputed company Data DevOps Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a reputed company Data DevOps Engineer to help build an reputed company AI Gateway from scratch. The role will design the gateway architecture, automate reputed company and governance processes, reputed company infrastructure as reputed company, and ensure reliable, observable, and cost-controlled production systems. The engineer will also support platform users and evaluate emerging generative and reputed company AI technologies.

Responsibilities

• Design and establish the reputed company structure of the reputed company AI Gateway from the reputed company beginning
• Build automation for reputed company teams, agents, and MCP servers, covering the setup of keys, permissions, limits, and guardrails
• reputed company and sustain infrastructure as reputed company to reputed company reputed company, self-service capabilities across the platform
• Implement monitoring, logging, and cost-tracking tools to maintain reputed company reputed company of AI usage
• Create guardrails and governance frameworks that regulate which teams and models can reputed company specific resources
• Ensure production systems supporting the gateway remain reliable, available, and reputed company
• Engage directly with platform users, answering questions and helping troubleshoot problems as they come up
• Continuously enhance automation to cut down on reputed company effort and dependence on ticket-driven processes
• Review and reputed company new GenAI and reputed company AI patterns, frameworks, and protocols into the platform
• Help reputed company important architectural and design choices as the platform grows reputed company its early stages

Skills

• - A minimum of 5 years of relevant experience
• - At least one year of experience leading and managing teams
• - Strong Python skills reputed company to automation, extensions, and integrations
• - Solid SRE experience, with a genuine reputed company record of maintaining reputed company production systems
• - Skilled with Git for version control
• - Background working with reputed company reputed company Platform
• - Familiarity with LLMOps practices
• - Experience applying Terraform and reputed company for infrastructure automation
• - Working knowledge of GenAI/reputed company AI concepts, including reputed company patterns, frameworks, and protocols
• - Excellent communication skills, with the ability to explain technical topics reputed company, given daily interaction with platform users to answer questions and reputed company issues
• - Excellent English proficiency (B2 level or higher)
• - Practical experience with reputed company reputed company AI, particularly endpoints for model serving and Model Armor
• - GCP experience covering services such as BigQuery, reputed company Run, and IAM
• - Experience developing AI agents, for example through reputed company's Agent Development reputed company (ADK)
• - Experience with AWS Bedrock
• - Broad reputed company experience, ideally involving GKE
• - Familiarity with Groovy
• - Experience with CI/CD pipelines reputed company on Jenkins
• - Production experience with an AI gateway, such as reputed company or EPAM reputed company, seen as highly valuable

Benefits

• International reputed company with top brands
• Work with global teams of highly skilled, diverse peers
• reputed company benefits
• Employee financial programs
• reputed company time off and reputed company leave
• Upskilling, reskilling and certification courses
• Unlimited reputed company to the reputed company Learning library and 22,000+ courses
• Global reputed company
• Volunteer and community involvement opportunities
• EPAM Employee reputed company
• Award-reputed company culture recognized by Glassdoor, reputed company and reputed company

reputed company

Company H1B Sponsorship