· ai-devtools

Airbnb Introduces CASTLE for Training Natural Language Search Models with Synthetic Data

The approach uses de-identified booking sessions and large language models (LLMs) to jointly generate synthetic search queries and relevance labels, enabling model training before enough real search traffic is available.


Natural language search allows guests to describe their preferences in everyday language, such as "romantic cabin near skiing" or "pet-friendly beach house that sleeps eight", rather than relying exclusively on predefined filters. Training such systems presents two challenges: generating queries that reflect actual user behavior and determining which property listings are relevant to each query. Previous approaches, including InPars and Promptagator, address query generation and relevance labeling as separate tasks.

They use LLMs to generate queries from documents or examples, followed by extra model-based judgments to assign relevance labels. According to the researchers, this separation can introduce extra sources of error and differences between synthetic and real-user query distributions. CASTLE uses contrastive listing pairs derived from de-identified booking sessions. When a guest books a property after viewing several alternatives, the selected listing becomes a positive example, while another viewed but unbooked property serves as a negative example.

Related coverage

Also worth reading

  1. next.js 16.5.0-canary.53 released
  2. US allies deepen deal to guard AI supply chains against 'hostile actors' (cough, China, cough)
  3. Java News Roundup: Lazy Constants, Spring for Apache Pulsar, GlassFish, Hibernate, TomEE, Seed4J
  4. Nightly enables parallel frontend for developers
  5. Uber’s Legal AI Agent Cuts Contract Review Time by 20% with Rules and RAG