HomeJobsTwelve Labs › Research Science

ML Research Engineer, Video Cognition System

Twelve Labs Seoul, South Korea FullTime Research Science Posted 3w+ ago
Apply Now →

What it’s like to work at Twelve Labs

Video Understanding AI · San Francisco / Seoul

3.6
Employee Rating
3.4
Work-Life Balance
32
Open Roles
eng-drivenship-fastflatproduct-impact

What employees love

  • Unique video AI niche with strong product-market fit and cutting-edge research
  • Flat, collaborative org structure with real impact opportunities

What could be better

  • Compensation reported below market average with expensive benefits
  • High attrition rate and some concerns about leadership experience
View full Twelve Labs culture profile →

About the Role

Who we are

At TwelveLabs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.

With a $110+ million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA’s NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.

Our partnership with NVIDIA and AWS gives us access to the most advanced chips, including B300s, enabling us to push the boundaries of what's possible in video AI.

We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.

About the Team

The Video Cognition System team is building the world's first video cognition system that transforms raw video archives containing millions of hours of footage into a queryable, structured Video Memory & Cortex accessible to vertical LLM agents.

We're tackling foundational questions about what constitutes machine cognition: perception, memory, reasoning, and attention. We design what and how memory should be structured for machines that go beyond the context window, and build the cortex that can reason across an entire archive of videos.

Our work spans corpus-level reasoning, knowledge extraction, indexing architectures, tool-based operations, multi-video understanding, and agentic workflows. This requires a close partnership between research and engineering, and we care deeply about building systems that are both scientifically rigorous and practically impactful.

Our research team has access to the most advanced chips in the world, including NVIDIA B300s, to push the boundaries of video cognition and understanding systems—accelerating our research-to-production cycle as fast as possible.

About the Role

This position spans two tracks—Research Scientist and Research Engineer—determined by your strengths and interests. These roles exist on a spectrum rather than as discrete categories; both contribute to research and implementation.

As a Research Scientist, you will explore fundamental questions in video reasoning, retrieval-guided QA, and multimodal understanding, driving research from hypothesis formulation to experiment design and analysis. You’ll investigate how video agents can interpret long-form content, connect evidence across modalities, and deliver reliable, structured outputs that reflect real user needs.

As a Research Engineer, you will focus on translating research ideas into robust, scalable systems. You’ll build and optimize pipelines that support indexing, retrieval, and agentic workflows, and develop the infrastructure that accelerates experimentation and ensures our models perform reliably in production. Your work will bridge the gap between exploratory research and the systems that power real-world applications.

Both tracks contribute to advancing our video agent capabilities, and both require a balance of curiosity, technical depth, and collaborative problem solving.

You might be a great fit if you have

We’re looking for candidates with research or engineering experience in areas related to video understanding, multimodal retrieval, temporal reasoning, or agent-driven workflows that combine models, tools, and structured search. You should be able to define meaningful research questions, design experiments, and drive projects from ideation to execution while grounding your work in real user scenarios and practical constraints.

Strong proficiency in Python and PyTorch is essential, along with the ability to clearly communicate technical concepts and collaborate across science, engineering, and product teams. Experience in building AI/ML agents and bringing them into production environments is highly preferred. This includes designing agent architectures, integrating them with retrieval or reasoning systems, and deploying them as reliable, user-facing components.

We evaluate based on relevant technical skills and research experience rather than degrees alone, though this is typically supported by an MS/PhD or equivalent practical experience in a relevant field.

What makes this role unique

The team sits at the intersection of models, retrieval, reasoning, and user workflows. The systems you build will rapidly make their way into real products used by customers worldwide. We operate with a tight research-to-production loop, ensuring that innovations have immediate, meaningful impact.

Others

Even if you don't check every box, we encourage you to apply. If you're a zero-to-one achiever, a ferocious learner, and a kind team player who motivates others, you'll find a home at TwelveLabs.

Hiring Process

Application Review → Recruiter Interview (비대면/30분) → Hiring Manager Interview (비대면/30분) → Technical Interview Round 1 (대면/60분) → Technical Interview Round 2 (비대면/90분) → Final Round Interview (비대면/30분) → Reference Check → Offer

Benefits and Perks

Similar Roles

More at Twelve Labs
Staff ML Research Engineer, Marengo
Seoul, South Korea
Senior ML Research Engineer, Marengo
Seoul, South Korea
Senior ML Research Scientist, Pegasus
Seoul, South Korea
Staff ML Research Scientist, Pegasus
Seoul, South Korea
ML Research Scientist, Pegasus
Seoul, South Korea
Similar roles at other companies
Biological Safety Research Scientist
Anthropic · San Francisco, CA
Member of Technical Staff, Modeling
Cohere · London
Member of Technical Staff (AI Researcher)
Perplexity AI · San Francisco
AI Scientist - Audio
Mistral AI · Paris
PhD GenAI Research Scientist Intern
Databricks · San Francisco, California

Frequently Asked Questions

What is the work-life balance like at Twelve Labs?
Twelve Labs has a work-life balance score of 3.4/5 based on employee reviews. This is below average, which may indicate a fast-paced, demanding work environment.
What is Twelve Labs’s culture like?
Twelve Labs is characterized by these culture values: eng-driven, ship-fast, flat, product-impact. Based on employee reviews, the company has an overall rating of 3.6/5. Unique video AI niche with strong product-market fit and cutting-edge research
How many open roles does Twelve Labs have?
Twelve Labs currently has 32 open roles across departments including engineering, product, sales, and more. Roles are refreshed daily from their careers page.
Is this role remote-friendly?
This role is located in Seoul, South Korea. Check the job description above for specific location and remote work details.
Apply for this role at Twelve Labs →