Note: The job is a remote job and is open to candidates in USA. Indeed is the world’s number 1 job site, and they are seeking a Senior Software Engineer to join their AI Gateway & Guardrails team. The role focuses on developing platform services that connect AI-powered products to language models while ensuring compliance and quality standards for production AI deployment.
Responsibilities
- Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments
- Contribute to multi-provider access, failover, and rate-limiting capabilities across cloud platforms (Azure, AWS, and GCP)
- Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction
- Facilitate technical discussions and contribute architectural decisions at the service and system level
- Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development
- Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production-ready AI systems
- Share knowledge and provide technical guidance with teammates
Skills
- Requires a Bachelor's degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master's degree with a minimum of 3 years of experience; or a PhD without experience
- Experience building or operating large-scale distributed systems, ideally within platform or infrastructure environments
- Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations
- Experience with or interest in AI/ML systems, including LLM-based services, prompt engineering, or AI safety approaches
- Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on-call readiness
- Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems
- Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn
Benefits
- Quarterly bonuses
- Restricted Stock Units (RSUs)
- Paid Time Off policy
- Many region-specific benefits
- Reasonable accommodations to qualified individuals with disabilities in the employment application process
Company Overview
Indeed is an employment-related metasearch engine for job listings. It was founded in 2004, and is headquartered in Austin, Texas, USA, with a workforce of 10001+ employees. Its website is http://www.indeed.com.Company H1B Sponsorship
Indeed has a track record of offering H1B sponsorships, with 65 in 2026, 197 in 2025, 158 in 2024, 218 in 2023, 302 in 2022, 160 in 2021, 210 in 2020. Please note that this does not guarantee sponsorship for this specific role.