Home › Jobs › Baseten › EPD

Software Engineer - Dedicated Inference

Baseten San Francisco FullTime EPD Posted Date not supplied
Apply Now →

Culture signals in this specific role

Inferred from the employer’s wording in this job description. These role-level signals are separate from the company-wide employee-review scores below.

Cross-functionalThe role explicitly involves collaboration across teams or functions.
Deep technical workThe role highlights substantial technical, research, or systems work.
Role contextThis is a epd role; confirm team-specific working norms during the interview.

What it’s like to work at Baseten

ML Inference Infrastructure · San Francisco

4.3
Employee Rating
3.5
Work-Life Balance
106
Open Roles
eng-drivenship-fastmany-hatsproduct-impactflat

What employees love

  • Cutting-edge ML inference infrastructure — deploying models at scale for real production customers
  • Small team means high ownership and direct impact on product direction and company strategy

What could be better

  • Limited resources compared to larger competitors — can feel stretched thin on multiple fronts
  • Fast-moving product roadmap means priorities shift frequently as the market evolves
View full Baseten culture profile →

About the Role

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage mission-critical inference deployments.

Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers.

EXAMPLE INITIATIVES

You'll get to work on these types of projects as part of our Dedicated Inference team:

RESPONSIBILITIES

REQUIREMENTS

BENEFITS

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar Roles

More at Baseten
Site Reliability Engineer
San Francisco
›
Cloud Platform Engineer
San Francisco
›
Software Engineer - Infrastructure
San Francisco
›
Frontend Engineer - Dedicated Inference
San Francisco
›
Software Engineer - GPU Kernels
San Francisco
›
Similar roles at other companies
AI Infrastructure Operations, Demand Planning
Anthropic · San Francisco, CA | New York City, NY
›
Senior Full-Stack Engineer, Internal Applications
Cohere · Toronto
›
Member of Technical Staff (Software Engineer, Monetization)
Perplexity AI · San Francisco
›
Head of, Financial Systems Engineering
Mistral AI · Paris
›
Director of Engineering (Data Infrastructure)
Databricks · Bengaluru, India
›

Frequently Asked Questions

What is the work-life balance like at Baseten?
Baseten has a work-life balance score of 3.5/5 based on employee reviews. This is about average for the AI/tech industry.
What is Baseten’s culture like?
Baseten is characterized by these culture values: eng-driven, ship-fast, many-hats, product-impact, flat. Based on employee reviews, the company has an overall rating of 4.3/5. Cutting-edge ML inference infrastructure — deploying models at scale for real production customers
How many open roles does Baseten have?
Baseten currently has 106 open roles across departments including engineering, product, sales, and more. Roles are refreshed daily from their careers page.
Is this role remote-friendly?
This role is located in San Francisco. Check the job description above for specific location and remote work details.
Apply for this role at Baseten →