HomeJobsBaseten › EPD

Technical Program Manager, Infrastructure

Baseten San Francisco FullTime EPD Posted 3w+ ago
Apply Now →

What it’s like to work at Baseten

ML Inference Infrastructure · San Francisco

4.3
Employee Rating
3.5
Work-Life Balance
68
Open Roles
eng-drivenship-fastmany-hatsproduct-impactflat

What employees love

  • Cutting-edge ML inference infrastructure — deploying models at scale for real production customers
  • Small team means high ownership and direct impact on product direction and company strategy

What could be better

  • Limited resources compared to larger competitors — can feel stretched thin on multiple fronts
  • Fast-moving product roadmap means priorities shift frequently as the market evolves
View full Baseten culture profile →

About the Role

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

At Baseten, we’re looking for a Technical Program Manager to drive our most complex, cross-cutting infrastructure programs. This role will operate across all domains of AI infrastructure, from the GPUs up to the multi-cluster orchestration layer.

This is an execution-first role. The work is less about owning a single system and more about imposing order on ambiguity: standing up the right structures, driving decisions to closure, and making sure nothing falls through the cracks across dozens of stakeholders. If you take satisfaction in turning a chaotic, half-defined initiative into a predictable, well-governed program, this role is for you.

RESPONSIBILITIES

REQUIREMENTS

NICE-TO-HAVES

WHAT SUCCESS LOOKS LIKE

In your first few months, you'll have taken ownership of one or more in-flight programs, established the operating rhythm they were missing, and built the trust that makes teams want you in the room.

Within a year, the programs you run are the ones leadership doesn't worry about, the because the structure is clear, the risks are visible early, and the follow-ups always close.

BENEFITS

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar Roles

More at Baseten
Software Engineer - Model Performance
San Francisco
SRE
San Francisco
Cloud Platform Engineer
San Francisco Office
Software Engineer - Infrastructure
San Francisco
Software Engineer - Internal Platform
San Francisco
Similar roles at other companies
Technical Program Manager, Compute Infrastructure
OpenAI · San Francisco
Developer Marketing Manager
Weaviate · Europe
Product Manager, API & Platform
Descript · San Francisco, CA or Remote, US
Engineering Manager, Developer Productivity
Webflow · CA Remote (BC & ON only); U.S. Remote
Manager, Site Reliability Engineering
Navan · Tel-Aviv, Israel

Frequently Asked Questions

What is the work-life balance like at Baseten?
Baseten has a work-life balance score of 3.5/5 based on employee reviews. This is about average for the AI/tech industry.
What is Baseten’s culture like?
Baseten is characterized by these culture values: eng-driven, ship-fast, many-hats, product-impact, flat. Based on employee reviews, the company has an overall rating of 4.3/5. Cutting-edge ML inference infrastructure — deploying models at scale for real production customers
How many open roles does Baseten have?
Baseten currently has 68 open roles across departments including engineering, product, sales, and more. Roles are refreshed daily from their careers page.
Is this role remote-friendly?
This role is located in San Francisco. Check the job description above for specific location and remote work details.
Apply for this role at Baseten →