Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.
The Community You Will Join:
The Guest & Host team based out of India, operates to ensure high quality supply and merchandising differentiates our brand, by providing tools to be used by 1000+ operations agents for supply vetting and quality moderation. As Airbnb expands beyond the core, it is looking to onboard supply outside of the core stays business which requires enhancing our tools. The operational tasks we face are diverse and rapidly evolving. The current manual processes and lack of optimum tooling capabilities hinder the ability of operation agents to work more efficiently, maintain business continuity, and achieve higher scale.
The Difference You Will Make:
As a Data Engineer on the Guest & Host team, you will play a pivotal role in shaping the systems that onboard and manage the highest quality supply across Airbnb. You’ll build robust data pipelines and platforms that power end-to-end visibility for supply operations, from onboarding and regulatory compliance to AI-assisted vetting and listing quality enforcement. Your work will directly enable operations, product, and ML teams to scale trusted supply globally, ensuring every home, service, and experience meets Airbnb’s standards. Whether it’s surfacing insights to optimize onboarding flows, enabling smarter audit triggers, or supporting nuanced licensing workflows, your contributions will be foundational to helping hosts join Airbnb efficiently and ensuring guests have access to safe, high-quality stays.
As you build and maintain key components of the critical data ecosystem, you’ll have the opportunity to contribute to creating standards and best practices for Airbnb’s Data Engineering. Your work on solving complex business challenges at scale will be instrumental in shaping the tools, processes, and standards used by the broader data community.
A Typical Day:
- Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
- Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
- Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
- Collaborate with cross-functional teams, including Data Scientists, Product Managers, andSoftware Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
- Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
- Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues
Your Expertise:
- 6+ years of relevant industry experience
- BE/B.tech in computer science or relevant technical field
- Extensive experience designing, building, and operating robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and handling data at the petabyte scale.
- Strong knowledge of Java, Scala, or Python, and expertise with data processing technologies and query authoring (SQL).
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
- Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
- Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
- Excellent written and verbal communication skills