Software Engineer (Python, Go)

On-site
Posted Oct 19, 2026
1 position

Opens LinkedIn

Employment type: Full-time
Experience level: Mid-level · 2+ years
Minimum education: Bachelor’s degree
Posting language: English
Working hours: 40 hours per week
Seniority: Associate

Job summary

Develop and maintain infrastructure for Baseten’s machine learning inference platform, including Kubernetes deployments, inference orchestration, monitoring, and resource management across cloud and on-premises environments. Automate and optimize deployment workflows and system performance, troubleshoot issues with cross-functional teams, and contribute to infrastructure improvements.

Job details

About The Company Baseten is at the forefront of powering mission-critical inference for some of the world's most innovative AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By integrating applied AI research with flexible infrastructure and seamless developer tooling, Baseten enables organizations operating at the cutting edge of artificial intelligence to deploy and scale advanced models efficiently and reliably. The company’s recent successful funding round, a $1.5 billion Series F led by Altimeter Capital, Conviction Partners, and Spark Capital, underscores its rapid growth and industry confidence. As a rapidly expanding organization, Baseten is dedicated to building a platform that transforms how engineers and developers turn AI models into production-ready applications, fostering innovation and technological advancement in the AI space. About The Role As an Infrastructure Software Engineer at Baseten, you will play a critical role in developing and maintaining the core components of our machine learning inference platform. Your work will directly impact the efficiency, scalability, and reliability of AI applications used by top-tier clients. You will be responsible for designing and implementing infrastructure solutions that support high-performance deployment, monitoring, and management of machine learning models. This role offers an exciting opportunity to work on complex distributed systems, contribute to innovative initiatives such as multi-cloud capacity management and GPU optimization, and collaborate with a talented team dedicated to advancing AI infrastructure. Your contributions will help ensure that Baseten’s platform remains robust, scalable, and capable of supporting the most demanding AI workloads in production environments. Qualifications Bachelor's degree or higher in Computer Science, Software Engineering, or a related field Proficiency in one or more programming or scripting languages such as Python, Go, or similar Working knowledge of Kubernetes and container orchestration technologies Basic understanding of machine learning concepts and model serving architectures Familiarity with distributed systems and scalable infrastructure design Experience with monitoring and logging tools for system performance and reliability Interest in AI/ML infrastructure and eagerness to learn emerging technologies Strong collaboration, communication, and problem-solving skills Responsibilities Develop and maintain infrastructure components for the ML inference platform using Python, Go, and related technologies Implement and manage Kubernetes deployments to support scalable model serving Contribute to the development of inference orchestration layers for efficient model deployment workflows Build and improve monitoring systems to track model performance and system health Design and implement resource management solutions to optimize ML workloads across cloud and on-prem environments Automate infrastructure processes to streamline ML deployment pipelines and reduce manual interventions Collaborate with cross-functional teams to troubleshoot issues and implement technical solutions Balance system performance and reliability through continuous optimization and best practices Participate in technical discussions and contribute to infrastructure improvements and innovations Stay updated on industry trends and apply best practices in infrastructure engineering Benefits Competitive salary with meaningful equity participation 100% coverage of medical, dental, and vision insurance for employees and dependents Flexible paid time off policy, including a company-wide Winter Break (closed from Christmas Eve to New Year’s Day) Paid parental leave to support work-life balance Fertility and family-building stipend through Carrot Company-sponsored 401(k) retirement plan Exposure to a diverse range of ML startups, providing valuable learning and networking opportunities Equal Opportunity Baseten is committed to fostering a diverse, inclusive, and equitable workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We consider qualified applicants with criminal histories in a manner consistent with applicable laws, including the San Francisco Fair Chance Ordinance where applicable.

What you’ll do

Requirements

A bachelor’s degree or higher in computer science, software engineering, or a related field is required, along with proficiency in Python, Go, or a similar language. Candidates should have working knowledge of Kubernetes, basic machine learning and model-serving concepts, familiarity with distributed systems and monitoring tools, and strong collaboration and problem-solving skills.